Product Development Engineer - Data Engineering

You will be joining PHENOM, a global HR tech company dedicated to transforming the talent experience. Our AI-powered platform enables companies to recruit faster, enhance development, and improve retention rates. As a Data Engineer at Phenom People, you will be instrumental in constructing the next generation Enterprise Data Lake, focusing on scalability and innovation. **Responsibilities:** - Translate business and functional requirements into scalable solutions that align with the data architecture. - Develop and maintain data pipelines, create new API integrations, and operate large-scale, low-latency applications. - Design data integrations and establish data quality frameworks. - Engage in the full development life cycle, from design to testing, documentation, delivery, and support. - Independently work on end-to-end projects with a focus on innovation through data-driven solutions. **Work Experience:** Must have: - Proficient in Python programming. - Over 5 years of experience in big data development using Spark. - Familiarity with Dimension Modeling, Data Warehousing, and ETL pipelines. - Strong SQL expertise with the ability to write complex queries. - Experience in building stream processing platforms utilizing tools like Kafka and Spark Streaming. Nice to have: - Knowledge of job orchestration frameworks such as Airflow, Oozie, Luigi. - Experience with AWS services like S3, EMR, RDS. - Understanding of cloud data warehouses like Snowflake and SQL distribution engines like Presto, Druid. - Familiarity with streaming processing frameworks like Flink and NoSQL databases like HBase, Cassandra. **Benefits:** - Competitive salary within a startup environment. - Rapid experiential growth opportunities. - Direct collaboration with the executive team. - Thrive in a fast-paced work setting where innovation is encouraged. You will be joining PHENOM, a global HR tech company dedicated to transforming the talent experience. Our AI-powered platform enables companies to recruit faster, enhance development, and improve retention rates. As a Data Engineer at Phenom People, you will be instrumental in constructing the next generation Enterprise Data Lake, focusing on scalability and innovation. **Responsibilities:** - Translate business and functional requirements into scalable solutions that align with the data architecture. - Develop and maintain data pipelines, create new API integrations, and operate large-scale, low-latency applications. - Design data integrations and establish data quality frameworks. - Engage in the full development life cycle, from design to testing, documentation, delivery, and support. - Independently work on end-to-end projects with a focus on innovation through data-driven solutions. **Work Experience:** Must have: - Proficient in Python programming. - Over 5 years of experience in big data development using Spark. - Familiarity with Dimension Modeling, Data Warehousing, and ETL pipelines. - Strong SQL expertise with the ability to write complex queries. - Experience in building stream processing platforms utilizing tools like Kafka and Spark Streaming. Nice to have: - Knowledge of job orchestration frameworks such as Airflow, Oozie, Luigi. - Experience with AWS services like S3, EMR, RDS. - Understanding of cloud data warehouses like Snowflake and SQL distribution engines like Presto, Druid. - Familiarity with streaming processing frameworks like Flink and NoSQL databases like HBase, Cassandra. **Benefits:** - Competitive salary within a startup environment. - Rapid experiential growth opportunities. - Direct collaboration with the executive team. - Thrive in a fast-paced work setting where innovation is encouraged.