Job Description & Scope
Job description Primary Responsibilities: Design, code, test, document, and maintain high-quality and scalable data pipelines/solutions in cloud Work in both dev and ops and should be open to work in ops with flexible timings in ops Ingest and transform data using variety of technologies from variety of sources (APIs, streaming, Files, Databases) Develop reusable patterns and encourage innovation that will increase team’s velocity Design and develop applications in an agile environment, deploy using CI/CD Participate with prototypes as well as design and code reviews, own or assist with incident and problem management Self-starter who can learn things quickly, who is enthusiastic and actively engaged Comply with the terms and conditions of the employment contract, company policies and procedures, and any and all directives (such as, but not limited to, transfer and/or re-assignment to different work locations, change in teams and/or work shifts, policies in regards to flexibility of work benefits and/or work environment, alternative work arrangements, and other decisions that may arise due to the changing business environment). The Company may adopt, vary or rescind these policies and directives in its absolute discretion and without any limitation (implied or otherwise) on its ability to do so Qualifications - External Required Qualifications: Bachelor's degree in technical domain. Required experience with the following: Databricks, Python, Spark, pyspark, SQL, Azure Data factory Design and Implementation of Datawarehouse/Datalake (Databricks/snowflake) Data architecture, Data modelling Operations Processes, reporting from operations, Incident resolutions Github actions/Jenkins or similar CICD tool, Cloud CICD, GitHub NoSQL and relational databases Preferred Qualifications: Experience or knowledge in Apache Kafka Experience or knowledge in Data ingestions from variety of API’s Working in Agile/Scrum environment Role: Data Engineer Industry Type: IT Services & Consulting Department: Data Science & Analytics Employment Type: Full Time, Permanent Role Category: Data Science & Machine Learning Education UG: B.Tech/B.E. in Any Specialization Key Skills Skills highlighted with ‘‘ are preferred keyskills Azure Data FactoryETLData BricksPythonSQL
