We are seeking a Senior Data Engineer with 7+ years of hands-on experience in data engineering. The ideal candidate will have proven expertise in Azure and Microsoft technologies, specializing in building and optimizing large-scale data pipelines, ETL workflows, and cloud-based solutions. Strong skills in Azure Data Factory, Data Lake, Synapse, and SQL Server along with advanced problem-solving and performance optimization abilities are essential for this role.
Key Responsibilities: (Must)
- Design, develop, and maintain scalable data pipelines and ETL workflows in Azure.
- Work extensively with Microsoft technologies including SQL Server, Azure Data Factory, Azure Data Lake, and Synapse.
- Write, optimize, and tune complex SQL queries, stored procedures, and database operations for performance.
- Implement best practices in data modeling, indexing, partitioning, and query optimization.
- Build automation scripts for data ingestion, transformation, and processing (Python, PowerShell, or equivalent).
- Troubleshoot production issues and deliver root-cause analysis with timely resolutions.
Required Skills & Experience:
- 7+ years of hands-on experience in data engineering roles.
- Strong expertise in Azure data services (Data Factory, Data Lake, Synapse/SQL DW).
- Deep knowledge of SQL Server including query tuning and stored procedure optimization.
- Strong scripting experience (Python, PowerShell, or equivalent).
- Solid understanding of data architecture, ETL/ELT frameworks, and performance tuning.
- Proven experience in handling large-scale, complex datasets.
- Excellent problem-solving and debugging skills.
Nice-to-Have (Plus):
- Exposure to Machine Learning workflows and integration.
- Experience with C#, AWS, or GCP.
- Familiarity with DevOps, CI/CD pipelines, or containerization (Docker/Kubernetes).
