Senior Analyst

Role Overview:
We are looking for a hands-on Data Engineer with strong development skills in Python, PySpark, and SQL, experienced in building modern data pipelines using Azure Databricks, Microsoft Fabric, and ADF. This role suits engineers who love to code, automate, and optimize data workflows not just maintain them.

Key Responsibilities:

• Design, build, and deploy scalable ETL/ELT pipelines using Databricks, ADF, and Fabric Data Pipelines.
• Write production-grade PySpark and SQL code for transformation, cleansing, and data validation.
• Develop parameterized, reusable pipeline components and modular notebooks.
• Integrate and orchestrate data workflows using ADF pipelines and triggers.
• Contribute to data modeling (bronze, silver, gold) using Delta Lake and Fabric Lakehouse.
• Implement and monitor CI/CD pipelines with Azure DevOps and Git.
• Debug data quality and performance issues proactively.

Skills & Qualifications:

• 36 years of experience as a data developer or engineer in cloud environments.
• Strong hands-on experience with:
  • PySpark, SQL, and Python (coding and optimization)
  • Databricks, ADF, ADLS Gen2, Fabric Dataflows
• Solid understanding of ETL/ELT design, data modeling, and pipeline orchestration.
• Familiar with DevOps (YAML pipelines, Git branching) and Agile sprints.
• Experience with GCP BigQuery, Dataflow, Composer, or hybrid multi-cloud setups.

Preferred Certifications:

• Databricks Certified Data Engineer Associate
• Microsoft Certified: Fabric Analytics Engineer Associate (DP-600)

Microsoft Certified: Azure Data Engineer Associate (DP-203)