A fast-growing firm operating in the Enterprise Cloud Data & Analytics sector, delivering scalable Azure-based data platforms, analytics, and reporting solutions for enterprise customers. We build production-grade ETL/ELT pipelines, data lakes, and analytic workspaces to power BI, ML, and real-time reporting. Location: India On-site role working with cross-functional engineering and analytics teams.
Role & Responsibilities
- Design and implement end-to-end data ingestion and ETL/ELT pipelines on Azure to ingest, transform, and curate large datasets for analytics and ML.
- Develop and optimize PySpark and SQL workloads on Azure Databricks and Synapse to meet performance and cost targets.
- Build, deploy and maintain Azure Data Factory orchestration pipelines, parameterization, and monitoring for scheduled and streaming workflows.
- Implement data storage and partitioning strategies on ADLS Gen2 and Delta Lake to ensure high-throughput querying and data governance.
- Automate deployment and release processes using Azure DevOps and CI/CD pipelines; author infrastructure-as-code templates for repeatable environments.
- Instrument observability: implement logging, metrics, and alerting for data pipelines and troubleshoot production incidents to meet SLAs.
Skills & Qualifications Must-Have
- Azure Data Factory
- Azure Synapse Analytics
- Azure Databricks
- PySpark
- SQL
- ADLS Gen2
- Azure DevOps
- CI/CD pipelines
Preferred
- Terraform
- Delta Lake
- Power BI
Additional Qualifications
- Proven track record deploying production data solutions on Azure with strong emphasis on reliability and performance.
- Relevant Azure certification such as Microsoft Certified: Azure Data Engineer Associate is a plus.
- Willingness and ability to work on-site in India and collaborate closely with engineering and analytics stakeholders.
Benefits & Culture Highlights
- On-site, collaborative engineering environment with opportunities for technical ownership and impact.
- Learning and certification support for Azure and data engineering technologies.
- Competitive compensation with performance-driven growth opportunities.
Skills: pipelines,cd,ci,terraform,azure,sql,power bi
