Key Responsibilities
- Design, develop, and maintain scalable data pipelines using Azure Synapse Analytics, Azure Data Factory (ADF), and Azure Databricks (ADB) for ETL processes.
- Build and optimize data models to support analytics and reporting requirements.
- Write efficient and high-performance SQL queries and ensure query optimization.
- Integrate data from multiple sources (on-premises and cloud) into a unified data platform.
- Implement data security measures including encryption, access control, and governance policies.
- Monitor data pipelines, troubleshoot issues, and ensure data accuracy and availability.
- Collaborate with data analysts, data scientists, and stakeholders to deliver data solutions.
- Maintain proper documentation for data pipelines, workflows, and models.
Required Skills (Must-Have)
- Strong experience with Azure Data Stack: Azure Synapse, ADF, ADB, ADLS Gen2
- Proven experience in data engineering and analytics
- Strong proficiency in SQL and data modeling
- Understanding of data warehousing concepts and best practices
- Hands-on experience with ETL/ELT processes
- Strong problem-solving and debugging skills
- Good communication and collaboration skills
Good to Have
- Experience with CI/CD pipelines
- Knowledge of Python, Bash, or other scripting languages
- Exposure to Agile methodologies
- Domain experience in Insurance/Healthcare
- Relevant Azure certifications
Soft Skills
- Strong analytical thinking
- Team collaboration mindset
- Ability to work in a fast-paced environment
- Proactive and ownership-driven approach
Skills: azure synapse,azure,data bricks
