Azure Data engineer

Exp: 4.5+ yrs

Azure DE

Roles & Responsibilities

• Design, build, and maintain scalable data pipelines and modern data platforms on Hadoop or cloud environments.
• Develop and optimize end-to-end ETL/ELT workflows for structured and unstructured data using modern data engineering frameworks.
• Architect robust data flows that improve scalability, reliability, and operational efficiency.
• Drive DataOps best practices by automating data provisioning, testing, monitoring, and deployment processes.
• Establish data governance standards, CI/CD pipelines, automated testing, and monitoring for production-grade data solutions.
• Collaborate with Enterprise Architecture and cross-functional teams to evaluate and implement the right data technologies and platform strategies.
• Build and maintain dimensional data models to support analytics and business intelligence initiatives.
• Develop highly optimized SQL queries to process and analyze large-scale datasets.
• Work with Python/PySpark and distributed computing technologies to process high-volume data efficiently.
• Lead data engineering work streams with a product mindset, ensuring high-quality and scalable data solutions.
• Continuously improve platform performance, deployment frequency, and data reliability through engineering best practices.