Job Description & Scope
Job description locationsGurugram - DLF Buildingposted onPosted 10 Days Ago time left to applyEnd DateMay 31, 2025 (10 hours left to apply) job requisition idR_295096 Company: Oliver Wyman Description: Oliver Wyman is a global leader in management consulting. With offices in 60 cities across 29 countries, Oliver Wyman combines deep industry knowledge with specialized expertise in strategy, operations, risk management, and organization transformation. Our 5000 professionals help clients optimize their business, improve their operations, and risk profile, and accelerate their organizational performance to seize the most attractive opportunities. Oliver Wymans thought leadership is evident in our agenda-setting books, white papers, research reports, and articles in the business press. Our clients are the CEOs and executive teams of the top Global 1000 companies. Visit our website for more details about Oliver Wyman Job specification Job title:Senior Data Engineer Department: OWG Tech Office/region: India Reports to: Director of Data Engineering Job Overview: The OWG Technology department is seeking a highly skilled and motivated Senior Data Engineer to play a critical role in our data transformation program. In this position, you will lead major projects and workstreams, collaborating closely with stakeholders to ensure the successful implementation of data solutions. You will also mentor and coach junior team members, providing guidance during sprints as a technical lead. Your expertise in cloud data platforms, particularly the Databricks Lakehouse, will be essential in driving innovation and best practices within the team. Key Responsibilities: Lead the design and implementation of processes to ingest data from various sources into the Databricks Lakehouse platform, ensuring alignment with architectural and engineering standards. Oversee the development, maintenance, and optimization of data models and ETL pipelines that support the Medallion Architecture (Bronze, Silver, Gold layers) to enhance data processing efficiency and facilitate data transformation. Utilize Databricks to integrate, consolidate, and cleanse data, ensuring accuracy and readiness for analysis, while leveraging Delta Lake for versioned data management. Implement and manage Unity Catalog for centralized data governance, ensuring proper data access, security, and compliance with organizational policies and regulations. Collaborate with business analysts, data scientists, and stakeholders to understand their data requirements and deliver tailored solutions that leverage the capabilities of the Databricks Lakehouse platform. Promote available data and analytics capabilities to business stakeholders, educating them on how to effectively leverage these tools and the Medallion Architecture for their analytical needs. Experience: Bachelors or Masters degree in Computer Science, Data Science, Engineering, or a related field. Minimum of 7+ years of experience in data engineering or a related data role, with a proven track record of leading projects and initiatives. Expertisein designing and implementing production-grade Spark-based solutions. Expertisein query tuning, performance tuning, troubleshooting, and debugging Spark or other big data solutions. Proficientin big data technologies such as Spark/Delta, Hadoop, NoSQL, MPP, and OLAP. Proficientin cloud architecture, systems, and principles, particularly in AWS. Proficientin programming languages such as Python, R, Scala, or Java. Expertisein scaling ETL pipelines for performance and cost-effectiveness. Experiencein building and scaling streaming data pipelines. Strong understandingof DevOps tools and best practices for data engineering, including CI/CD, unit and integration testing, automation, and orchestration. Cloud or Databricks certification is highly desirable. Skills and Attributes: Full professional proficiency in both written and spoken English. Strong problem-solving and troubleshooting skills. Excellent communication skills, both verbal and written, with the ability to articulate c
