Azure Synapse Data Engineer

As an Azure Synapse Developer with 4+ years of experience in data engineering and data warehousing, your role will involve designing, developing, and managing large-scale data pipelines using Azure Synapse Analytics (formerly SQL DW). You will be responsible for integrating data from various sources such as Azure Data Lake, SQL Server, Blob Storage, and APIs into Synapse using Azure Data Factory (ADF). Your expertise in writing and optimizing complex T-SQL queries, stored procedures, and scripts for data transformations will be crucial in supporting advanced analytics and BI solutions. Key Responsibilities: - Design, develop, and manage large-scale data pipelines using Azure Synapse Analytics (formerly SQL DW). - Integrate data from various sources (Azure Data Lake, SQL Server, Blob Storage, APIs) into Synapse using Azure Data Factory (ADF). - Write and optimize complex T-SQL queries, stored procedures, and scripts for data transformations. - Collaborate with data scientists, BI developers, and business stakeholders to support reporting and analytics needs. - Implement data partitioning, indexing, and performance tuning strategies for Synapse. - Monitor and troubleshoot Synapse pipeline and query performance issues. - Work with CI/CD pipelines and implement best practices for code deployment and versioning. - Ensure data quality, compliance, and security in accordance with company and regulatory standards. Qualifications Required: - 4+ years of hands-on experience in Azure Data Platform, especially Azure Synapse Analytics. - Strong experience in T-SQL, SQL Server, and data warehousing concepts. - Experience in Azure Data Factory, Azure Data Lake Gen2, Blob Storage, and Power BI. - Knowledge of ETL/ELT processes, data modeling (star/snowflake), and dimensional modeling. - Experience in performance tuning, query optimization, and data validation. - Familiarity with DevOps, Git, and CI/CD tools for data pipelines. - Understanding of security and compliance in cloud data environments. In addition to the above, you may also be interested to know that the company prefers candidates with the following qualifications: - Microsoft Certification in Azure (e.g., DP-203: Data Engineering on Microsoft Azure). - Experience with Spark pools and serverless SQL pools in Synapse. - Knowledge of Python/Scala for data manipulation (optional but preferred). - Exposure to Databricks, Azure Purview, or Azure Machine Learning is a plus. As an Azure Synapse Developer with 4+ years of experience in data engineering and data warehousing, your role will involve designing, developing, and managing large-scale data pipelines using Azure Synapse Analytics (formerly SQL DW). You will be responsible for integrating data from various sources such as Azure Data Lake, SQL Server, Blob Storage, and APIs into Synapse using Azure Data Factory (ADF). Your expertise in writing and optimizing complex T-SQL queries, stored procedures, and scripts for data transformations will be crucial in supporting advanced analytics and BI solutions. Key Responsibilities: - Design, develop, and manage large-scale data pipelines using Azure Synapse Analytics (formerly SQL DW). - Integrate data from various sources (Azure Data Lake, SQL Server, Blob Storage, APIs) into Synapse using Azure Data Factory (ADF). - Write and optimize complex T-SQL queries, stored procedures, and scripts for data transformations. - Collaborate with data scientists, BI developers, and business stakeholders to support reporting and analytics needs. - Implement data partitioning, indexing, and performance tuning strategies for Synapse. - Monitor and troubleshoot Synapse pipeline and query performance issues. - Work with CI/CD pipelines and implement best practices for code deployment and versioning. - Ensure data quality, compliance, and security in accordance with company and regulatory standards. Qualifications Required: - 4+ years of hands-on experience in Azure Data Platform, especially Azure Synapse Analytics. - Strong experience in T-SQL, SQL Server, and data warehousing concepts. - Experience in Azure Data Factory, Azure Data Lake Gen2, Blob Storage, and Power BI. - Knowledge of ETL/ELT processes, data modeling (star/snowflake), and dimensional modeling. - Experience in performance tuning, query optimization, and data validation. - Familiarity with DevOps, Git, and CI/CD tools for data pipelines. - Understanding of security and compliance in cloud data environments. In addition to the above, you may also be interested to know that the company prefers candidates with the following qualifications: - Microsoft Certification in Azure (e.g., DP-203: Data Engineering on Microsoft Azure). - Experience with Spark pools and serverless SQL pools in Synapse. - Knowledge of Python/Scala for data manipulation (optional but preferred). - Exposure to Databricks, Azure Purview, or Azure Machine Learning is a plus.