Azure Data Engineer

Job Description:

As an Azure Data Engineer, you will be expected to design, implement, and manage data solutions on the Microsoft Azure cloud platform. The ideal candidate will have a proven track record of writing complex SQL stored procedures with implementing OTLP database solutions (using Microsoft SQL Server). As well as experience with Azure Synapse / PySpark / Azure Databricks for big data processing.

JOB DESCRIPTION:

Key Responsibilities:

Collaborate with cross-functional teams to gather, analyze, and document business requirements for data integration projects.

Expertise in T-SQL, Dynamic SQL, Spark SQL, and ability to write complex stored procedures.

Write complex stored procedures to support data transformation and to implement business validation logic.

Experience in writing notebooks in Azure Synapse/Databricks using Spark SQL or PySpark to process and analyse large volumes of data

Develop and maintain robust data pipelines using Azure Data Factory ensuring seamless data flow between systems.

Strong algorithmic programming skills

Work closely with the team to ensure data quality, integrity, and accuracy across all systems.

Experience on OLTP (Online Transaction Processing) systems using SQL Server and contribute to their enhancement and optimization.