Lead Data Engineer - Big Data

As a Lead Engineer in the FOE POD, your role involves architecting, building, and scaling next generation marketing technology solutions. You will be responsible for blending deep MarTech orchestration expertise with modern big data engineering, cloud-native design, and emerging AI-driven development patterns. Your key responsibilities include: - Architecting scalable, event-driven systems for real-time marketing experiences and automated customer journeys. - Developing high-performance big data applications using Scala, Databricks, Spark SQL, Spark Streaming, and Python. - Building and optimizing cloud-native data pipelines on Azure, including ADF-based ingestion, transformation, and orchestration. - Driving AI-assisted engineering practices such as Vibe Coding and other generative AI development accelerators. - Collaborating with product, marketing, and data teams to translate business needs into robust technical solutions. - Mentoring engineers to elevate engineering standards, code quality, and operational excellence within the POD. Required Skills & Experience: - Deep expertise in MarTech platforms with hands-on experience in Adobe Campaign or similar orchestration tools. - Strong proficiency in big data technologies such as Scala, Databricks, Spark SQL, Spark Streaming, and Python. - Cloud engineering experience with Azure services, particularly Azure Data Factory. - Experience with AI augmented development like Vibe Coding or comparable frameworks. Preferred Qualifications: - Experience in large-scale marketing ecosystems, including ESP, CDP, personalization engines, and real-time decisioning. - Background in high-volume data processing supporting customer engagement or growth marketing. - Familiarity with DevOps practices like CI/CD, observability, and automated testing. - Exposure to modern AI/ML pipelines for personalization, segmentation, or content automation. As a Lead Engineer in the FOE POD, your role involves architecting, building, and scaling next generation marketing technology solutions. You will be responsible for blending deep MarTech orchestration expertise with modern big data engineering, cloud-native design, and emerging AI-driven development patterns. Your key responsibilities include: - Architecting scalable, event-driven systems for real-time marketing experiences and automated customer journeys. - Developing high-performance big data applications using Scala, Databricks, Spark SQL, Spark Streaming, and Python. - Building and optimizing cloud-native data pipelines on Azure, including ADF-based ingestion, transformation, and orchestration. - Driving AI-assisted engineering practices such as Vibe Coding and other generative AI development accelerators. - Collaborating with product, marketing, and data teams to translate business needs into robust technical solutions. - Mentoring engineers to elevate engineering standards, code quality, and operational excellence within the POD. Required Skills & Experience: - Deep expertise in MarTech platforms with hands-on experience in Adobe Campaign or similar orchestration tools. - Strong proficiency in big data technologies such as Scala, Databricks, Spark SQL, Spark Streaming, and Python. - Cloud engineering experience with Azure services, particularly Azure Data Factory. - Experience with AI augmented development like Vibe Coding or comparable frameworks. Preferred Qualifications: - Experience in large-scale marketing ecosystems, including ESP, CDP, personalization engines, and real-time decisioning. - Background in high-volume data processing supporting customer engagement or growth marketing. - Familiarity with DevOps practices like CI/CD, observability, and automated testing. - Exposure to modern AI/ML pipelines for personalization, segmentation, or content automation.