Project Role : Custom Software Engineer
Project Role Description : Develop custom software solutions to design, code, and enhance components across systems or applications. Use modern frameworks and agile practices to deliver scalable, high-performing solutions tailored to specific business needs.
Must have skills : Microsoft Azure Data Services
Good to have skills : NA
Minimum 3 Year(s) Of Experience Is Required
Educational Qualification : 15 years full time education
Summary:
We are looking for an experienced Azure Data Factory (ADF) Developer to support, monitor, and enhance data integration pipelines. The role focuses on designing, developing, monitoring, and recovering ADF pipelines, as well as handling service requests and enhancements to ensure smooth and reliable data movement across systems.
Roles & Responsibilities:
- Design, develop, and maintain Azure Data Factory pipelines for data ingestion and transformation.
- Monitor ADF pipelines and triggers identify, analyze, and recover failed pipelines to ensure data continuity.
- Perform root-cause analysis for pipeline failures and implement corrective and preventive actions.
- Handle service requests and enhancement requests related to ADF pipelines and data flows.
- Implement effective error handling, logging, alerting, and retry mechanisms within ADF.
- Optimize ADF pipeline performance and ensure efficient resource utilization.
Support deployment of ADF artifacts across environments (Dev, Test, Prod).
- Actively participate in team discussions and independently resolve ADF-related issues as an SME.
- Create and maintain technical documentation such as pipeline designs, configurations, and operational runbooks.
Professional & Technical Skills:
Must To Have Skills:
- Strong hands-on experience with Azure Data Factory:
- Pipelines, datasets, linked services, triggers
- Activities (Copy, Lookup, ForEach, If Condition, Execute Pipeline, Web, etc.)
- Experience in monitoring, troubleshooting, and recovering ADF pipelines in production environments.
- Solid understanding of ETL/ELT concepts using ADF.
- Experience implementing error handling, logging, and alerting in ADF.
- Ability to analyze failures and optimize pipeline performance.
- Familiarity with parameterization, variables, and reusable pipeline design in ADF.
- Experience with ADF integration runtime (Azure IR, Self-hosted IR).
Professional Experience:
- 3–5 years of experience in data integration roles with strong focus on Azure Data Factory.
- Hands-on experience in supporting production ADF pipelines and handling enhancements.
- Experience working in agile teams and interacting with business and support teams for ADF-related requirements.
- Proven ability to manage the full ADF lifecycle: development, deployment, monitoring, and support.
Additional Information:
- A 15 years full time education is required.
, 15 years full time education