Job Description

Role Overview

We are looking for an experienced Data Engineer to join our Data Platform team. The candidate will work on building and maintaining scalable data pipelines and solutions using Azure Data Services. This role involves close collaboration with business stakeholders, internal teams, and implementation partners to deliver high-quality data solutions that enable analytics and reporting.

Key Responsibilities

• Design, develop, and maintain data pipelines using Azure Data Factory (ADF).
• Manage and optimize data storage in Azure Data Lake Storage (ADLS).
• Implement transformations and data processing using Azure Databricks (PySpark/SQL).
• Ensure data quality, integrity, and security across all Medallion layers (Bronze, Silver, Gold).
• Work closely with business teams to gather requirements and translate them into technical solutions.
• Collaborate with cross-functional teams (BI, Application Owners, Infra) and external implementation partners.
• Enable downstream consumption for Power BI dashboards and reports.
• Optimize ETL workflows for performance and cost efficiency.
• Monitor and troubleshoot data pipelines and jobs.

Required Skills & Qualifications

• Strong experience in Azure Data Factory, Azure ADLS, Azure Databricks (PySpark, SQL).
• Good understanding of data modeling (Star/Snowflake schema) and data warehousing concepts.
• Hands-on experience with Power BI integration and enabling data for reporting.
• Hands-on experience in creating optimized SQL queries and developing efficient scripts using PySpark for large-scale data processing.
• Familiarity with CI/CD for data pipelines and DevOps practices.
• Strong problem-solving skills and ability to work in an agile environment.
• Excellent communication and stakeholder management skills.

Nice to Have

• Knowledge of data governance, security, and compliance in Azure.
• Exposure to big data frameworks and streaming technologies.
• Exposure to any CDC tool like FiveTran, Replicate etc

Soft Skills

• Ability to work independently and as part of a team.
• Strong collaboration and coordination skills.
• Analytical mindset with attention to detail.