Azure Data Engineer

• Design, develop, and optimize data pipelines using Azure Synapse Analytics, Spark Pools, and Azure Data Factory.
• Write efficient Python and SQL code with a focus on scalability, performance, and optimization.
• Manage Azure Data Lake for structured and unstructured data ingestion at scale (volume, variety, velocity).
• Implement CI/CD pipelines and follow Data Ops practices for automation and reliability.
• Optimize data partitioning, versioning, and storage/compute costs for large-scale workloads.
• Ensure high-quality solutions through unit testing frameworks and automated validation.
• Collaborate with business teams to support analytics, reporting, and data science initiatives.
• Mentor junior engineers, sharing knowledge and promoting engineering excellence.
• Bachelor s degree in computer science, IT, Data Engineering, or a related field.
• 5+ years of experience in data engineering roles with proven expertise in cloud data platforms.
• Expert in Python and SQL, with strong performance optimization skills.
• Proficiency in Azure Synapse Analytics, Spark Pools, and Azure Data Factory (ADF).
• Hands-on experience with Azure Data Lake and structured ingestion at scale.
• Experience in CI/CD pipelines and applying Data Ops principles.
• Ability to manage large datasets with diverse structures, velocity, and volume.

Good to Have Skills

• Experience with Delta Lake, versioned data, and advanced partitioning strategies.
• Knowledge of data governance and security implementations across platforms.
• Strong understanding of advanced data modelling (e.g., slowly changing dimensions).
• Exposure to cost optimization strategies for cloud storage and compute.
• Experience mentoring or providing technical leadership to junior engineers.