Job Description:

Join a high impact data engineering team where you ll lead the design and delivery of modern scalable data platforms powered by Azure Data Factory ADF and Databricks
This role blends hands on engineering with technical leadership driving robust pipelines reliable transformations and production grade data products that enable analytics and business decision making
You ll collaborate closely with stakeholders architects and engineers to shape end to end solutions improve performance and cost efficiency and establish best practices across development and operations
If you enjoy solving complex data challenges mentoring teams and building cloud native solutions with a strong focus on quality observability and delivery excellence this is a great opportunity to grow your leadership footprint while working in a collaborative learning focused culture

Key Responsibilities:

Key Responsibilities
Lead end to end implementation of data ingestion and orchestration workflows using ADF including scheduling dependency management parameterization and error handling
Design and develop scalable data processing pipelines in Databricks using Spark based transformations for batch and incremental loads
Build and optimize ELT ETL patterns integrating Snowflake as a target source ensuring performance reliability and cost efficiency
Define data pipeline standards naming modularity reusability and enforce engineering best practices across the team
Implement monitoring alerting and operational runbooks for production pipelines drive incident triage and root cause analysis
Collaborate with stakeholders to translate requirements into technical designs estimates and delivery plans manage risks and dependencies
Conduct code reviews mentor engineers and guide technical decisions to ensure maintainable and secure solutions
Improve pipeline performance through tuning partitioning strategies and efficient data layout processing approaches
Minimum Qualifications
BTECH MTECH MCA or MSC
7 9 years of overall experience with strong hands on expertise in ADF and Databricks for building production grade data pipelines
Proven experience designing and supporting reliable ETL ELT workflows including scheduling retries and failure recovery patterns
Strong SQL skills and experience working with large datasets and data quality considerations
Experience collaborating with cross functional teams and leading technical delivery with ownership mindset

Technical Requirements:

Technology Cloud Integration Azure Data Factory ADF
Technology Data Engineering Databricks
Technology Data on Cloud Snowflake

Additional Responsibilities:

Preferred Qualifications
Strong experience integrating and optimizing workloads with Snowflake including loading strategies and performance tuning
Experience implementing medallion lakehouse style architectures and scalable data modeling patterns for analytics consumption
Familiarity with CI CD practices for data engineering workflows and automated testing approaches for pipelines
Experience with production observability practices pipeline metrics logging alerting and operational excellence
Demonstrated ability to mentor team members drive design discussions and influence engineering standards across projects

Preferred Skills:

Technology->Cloud Integration->Azure Data Factory (ADF),Technology->Data Engineering->Databricks,Technology->Data on Cloud-DataStore->Snowflake

ADF (Azure Data Factory) + Databricks+ Snowflake