Senior Big Data Engineer - II

Role Overview: As a Data Engineer at MetLife's Global capability center in India, you will play a crucial role in the data and analytics life cycle. Your primary responsibility will be to design, build, and maintain robust ETL/ELT pipelines on cloud (Azure) or on-premises to collect, ingest, and store large volumes of structured and unstructured data for batch and real-time processing. Additionally, you will collaborate with various stakeholders to ensure data processing, quality, security, and compliance guidelines are adhered to. Your role will also involve leading and developing talent within the Data and Analytics team. Key Responsibilities: - Design, build, and maintain ETL/ELT pipelines on cloud (Azure) or on-premises - Monitor, optimize, and troubleshoot data pipelines for reliability, scalability, and performance - Ensure adherence to data processing, quality, security, and compliance guidelines - Collaborate with partners from different departments and capabilities - Lead design, solutioning, and estimations independently - Provide people leadership by coaching, developing, and engaging talent Qualification Required: - Education: Bachelor's degree in computer science, information technology, or equivalent - Experience: 10-12+ years of relevant experience - Technical Skills: - SQL, Python/Scala - NoSQL and distributed databases (Hbase, Cosmos DB) - ETL pipeline design and development - Big Data Frameworks: Apache Spark, Hadoop, Hive - Cloud platforms: Azure data factory, Eventhub, Azure functions, Synapse, Databricks - Data warehouses, data marts, data lakes - Medallion architecture - Performance tuning, optimization, and data quality validation - Real-time and batch data processing - Communication skills, analytical skills, structured problem-solving skills - Storytelling skills, Partner & Stakeholder engagement experience - People leadership: talent development & engagement experience Additional Company Details: MetLife, a Fortune "World's Most Admired Companies" and Fortune Worlds 25 Best Workplaces awardee, is a leading financial services company with operations in over 40 markets. The company provides insurance, annuities, employee benefits, and asset management services to individual and institutional customers. MetLife's purpose is to help create a more confident future for its colleagues, customers, communities, and the world at large. Guided by core values such as Win Together, Do the Right Thing, Deliver Impact Over Activity, and Think Ahead, MetLife is committed to transforming the financial services industry. Join MetLife to be a part of this impactful journey. Role Overview: As a Data Engineer at MetLife's Global capability center in India, you will play a crucial role in the data and analytics life cycle. Your primary responsibility will be to design, build, and maintain robust ETL/ELT pipelines on cloud (Azure) or on-premises to collect, ingest, and store large volumes of structured and unstructured data for batch and real-time processing. Additionally, you will collaborate with various stakeholders to ensure data processing, quality, security, and compliance guidelines are adhered to. Your role will also involve leading and developing talent within the Data and Analytics team. Key Responsibilities: - Design, build, and maintain ETL/ELT pipelines on cloud (Azure) or on-premises - Monitor, optimize, and troubleshoot data pipelines for reliability, scalability, and performance - Ensure adherence to data processing, quality, security, and compliance guidelines - Collaborate with partners from different departments and capabilities - Lead design, solutioning, and estimations independently - Provide people leadership by coaching, developing, and engaging talent Qualification Required: - Education: Bachelor's degree in computer science, information technology, or equivalent - Experience: 10-12+ years of relevant experience - Technical Skills: - SQL, Python/Scala - NoSQL and distributed databases (Hbase, Cosmos DB) - ETL pipeline design and development - Big Data Frameworks: Apache Spark, Hadoop, Hive - Cloud platforms: Azure data factory, Eventhub, Azure functions, Synapse, Databricks - Data warehouses, data marts, data lakes - Medallion architecture - Performance tuning, optimization, and data quality validation - Real-time and batch data processing - Communication skills, analytical skills, structured problem-solving skills - Storytelling skills, Partner & Stakeholder engagement experience - People leadership: talent development & engagement experience Additional Company Details: MetLife, a Fortune "World's Most Admired Companies" and Fortune Worlds 25 Best Workplaces awardee, is a leading financial services company with operations in over 40 markets. The company provides insurance, annuities, employee benefits, and asset management services to individual and institutional customers. MetLife's purpose is to help create a more confi