ADF (Azure Data Factory) + Databricks+ Snowflake

Job Description:

• Join a high impact data engineering team where you ll lead the design and delivery of modern scalable data platforms powered by Azure Data Factory ADF and Databricks
• This role blends hands on engineering with technical leadership driving robust pipelines reliable transformations and production grade data products that enable analytics and business decision making
• You ll collaborate closely with stakeholders architects and engineers to shape end to end solutions improve performance and cost efficiency and establish best practices across development and operations
• If you enjoy solving complex data challenges mentoring teams and building cloud native solutions with a strong focus on quality observability and delivery excellence this is a great opportunity to grow your leadership footprint while working in a collaborative learning focused culture

Key Responsibilities:

• Key Responsibilities
• Lead end to end implementation of data ingestion and orchestration workflows using ADF including scheduling dependency management parameterization and error handling
• Design and develop scalable data processing pipelines in Databricks using Spark based transformations for batch and incremental loads
• Build and optimize ELT ETL patterns integrating Snowflake as a target source ensuring performance reliability and cost efficiency
• Define data pipeline standards naming modularity reusability and enforce engineering best practices across the team
• Implement monitoring alerting and operational runbooks for production pipelines drive incident triage and root cause analysis
• Collaborate with stakeholders to translate requirements into technical designs estimates and delivery plans manage risks and dependencies
• Conduct code reviews mentor engineers and guide technical decisions to ensure maintainable and secure solutions
• Improve pipeline performance through tuning partitioning strategies and efficient data layout processing approaches
• Minimum Qualifications
• BTECH MTECH MCA or MSC
• 7 9 years of overall experience with strong hands on expertise in ADF and Databricks for building production grade data pipelines
• Proven experience designing and supporting reliable ETL ELT workflows including scheduling retries and failure recovery patterns
• Strong SQL skills and experience working with large datasets and data quality considerations
• Experience collaborating with cross functional teams and leading technical delivery with ownership mindset

Technical Requirements:

• Technology Cloud Integration Azure Data Factory ADF
• Technology Data Engineering Databricks
• Technology Data on Cloud Snowflake

Additional Responsibilities:

• Preferred Qualifications
• Strong experience integrating and optimizing workloads with Snowflake including loading strategies and performance tuning
• Experience implementing medallion lakehouse style architectures and scalable data modeling patterns for analytics consumption
• Familiarity with CI CD practices for data engineering workflows and automated testing approaches for pipelines
• Experience with production observability practices pipeline metrics logging alerting and operational excellence
• Demonstrated ability to mentor team members drive design discussions and influence engineering standards across projects

Preferred Skills:

Technology->Cloud Integration->Azure Data Factory (ADF),Technology->Data Engineering->Databricks,Technology->Data on Cloud-DataStore->Snowflake