Azure Services

Python

PySpark

Databricks

SQL

Azure Synapse

Job Description

We are looking for an experienced Azure Data Tech Lead / Sr. Azure Data Engineer with strong expertise in cloud-based data engineering and analytics. The ideal candidate will be responsible for designing, building, and optimizing scalable data pipelines and solutions leveraging Azure ecosystem and modern data technologies.

Key Responsibilities

Design and build ETL/ELT pipelines to ingest, transform, and load data from various clinical, research, operational, and omics sources.
Optimize performance and scalability of data flows using Apache Spark, Databricks, and PySpark.
Collaborate with domain experts in genomics, clinical trials, and lab sciences to implement robust and scalable data solutions.
Develop and maintain data models, schemas, and governance practices for structured and unstructured biomedical datasets.
Implement data quality checks, lineage tracking, logging, and monitoring for reliable and reproducible data workflows.
Work with cloud infrastructure teams to deploy, manage, and monitor pipelines on Azure services.
Contribute to data lake/warehouse solutions using Azure Synapse, Snowflake, or Redshift.
Mentor junior engineers and provide technical leadership in project execution.

Senior Azure Data Engineer (6+yr experience)