Data Engineer

Job description Design and develop robust and scalable ETL processes to ingest and process large datasets from various sources. Job Overview: We are looking for a skilled Data Engineer with 3-5 years of experience to join our data team. The ideal candidate will have a strong background in ETL processes, data pipeline creation, and database management. As a Data Engineer, you will be responsible for designing, developing, and maintaining scalable data systems and pipelines. Key Responsibilities: Design and develop robust and scalable ETL processes to ingest and process large datasets from various sources. Build and maintain efficient data pipelines to support real-time and batch data processing. Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions. Optimize database performance and ensure data integrity and security. Troubleshoot and resolve data-related issues and provide support for data operations. Implement data quality checks and monitor data pipeline performance. Document technical solutions and processes for future reference. Required Skills and Qualifications: Bachelor's degree in Engineering, or a related field. 5-8 years of experience in data engineering or a related role. Strong proficiency in ETL tools and techniques. Experience with SQL and relational databases (e.g., MySQL, PostgreSQL). Familiarity with big data technologies Proficiency in programming languages such as Python, Java, or Scala. Knowledge of data warehousing concepts and tools Excellent problem-solving skills and attention to detail. Strong communication and collaboration skills. Preferred Qualifications: Experience with data visualization tools (e.g., Tableau, Power BI). Knowledge of machine learning and data science principles. Experience with real-time data processing and streaming platforms (e.g., Kafka). Knowledge of data warehousing concepts and tools Role: Data Engineer Industry Type: NBFC (Micro Finance) Department: Data Science & Analytics Employment Type: Full Time, Permanent Role Category: Data Science & Machine Learning Education UG: B.Tech/B.E. in Production/Industrial PG: Any Postgraduate Doctorate: Doctorate Not Required Key Skills Skills highlighted with ‘‘ are preferred keyskills Python javadata sciencescalaPostgreSQLdata processingMySQLpower bimachine learningdata engineeringsql