AI/ML Developer Azure Databricks

As an experienced AI/ML Developer with expertise in Azure Databricks, Python, PySpark, and SQL, your role will involve designing, developing, and deploying scalable machine learning and data engineering solutions on the Azure cloud platform. Key Responsibilities: - Develop end-to-end AI/ML solutions using Azure Databricks. - Build and optimize data pipelines using PySpark and Spark SQL. - Train, evaluate, and deploy ML models in production. - Perform data preprocessing, feature engineering, and model tuning. - Implement batch and streaming data solutions. - Optimize Spark jobs for performance and cost. - Collaborate with data scientists and stakeholders. - Ensure best practices in coding, testing, CI/CD, and documentation. - Monitor model performance and data drift. Qualifications Required: - 5+ years of AI/ML or Data Engineering experience. - Strong Python programming for ML and data processing. - Hands-on experience with Azure Databricks, PySpark, and Spark SQL. - Strong SQL skills for data transformation and analysis. - Experience deploying ML models (regression, classification, clustering, etc.). - Familiarity with ML libraries (Scikit-learn, MLflow, TensorFlow, PyTorch). - Experience with Azure services (ADLS, Synapse, Azure ML preferred). - Understanding of ETL/ELT, data warehousing, and big data architecture. - Git and collaborative development experience. - Strong analytical and communication skills. Preferred Skills: - Real-time/streaming data (Kafka, Event Hubs, Structured Streaming). - MLOps, CI/CD pipelines, model lifecycle management. - Delta Lake and data versioning. - Docker or containerization tools. - Azure security, governance, and compliance knowledge. - Domain experience (Finance, Healthcare, Retail, Telecom). As an experienced AI/ML Developer with expertise in Azure Databricks, Python, PySpark, and SQL, your role will involve designing, developing, and deploying scalable machine learning and data engineering solutions on the Azure cloud platform. Key Responsibilities: - Develop end-to-end AI/ML solutions using Azure Databricks. - Build and optimize data pipelines using PySpark and Spark SQL. - Train, evaluate, and deploy ML models in production. - Perform data preprocessing, feature engineering, and model tuning. - Implement batch and streaming data solutions. - Optimize Spark jobs for performance and cost. - Collaborate with data scientists and stakeholders. - Ensure best practices in coding, testing, CI/CD, and documentation. - Monitor model performance and data drift. Qualifications Required: - 5+ years of AI/ML or Data Engineering experience. - Strong Python programming for ML and data processing. - Hands-on experience with Azure Databricks, PySpark, and Spark SQL. - Strong SQL skills for data transformation and analysis. - Experience deploying ML models (regression, classification, clustering, etc.). - Familiarity with ML libraries (Scikit-learn, MLflow, TensorFlow, PyTorch). - Experience with Azure services (ADLS, Synapse, Azure ML preferred). - Understanding of ETL/ELT, data warehousing, and big data architecture. - Git and collaborative development experience. - Strong analytical and communication skills. Preferred Skills: - Real-time/streaming data (Kafka, Event Hubs, Structured Streaming). - MLOps, CI/CD pipelines, model lifecycle management. - Delta Lake and data versioning. - Docker or containerization tools. - Azure security, governance, and compliance knowledge. - Domain experience (Finance, Healthcare, Retail, Telecom).