Data Engineer AI & Analytics

Our Client is a leading management consulting firm is looking to engage with a Data Engineer – AI & Analytics to help with:

• Develop and implement scalable data pipelines using Azure Data Factory (ADF) and SHIR.
• Translate business logic and AI prototypes into production-ready data solutions.
• Integrate data from ERP systems, databases, Excel, flat files, and external sources.
• Build Python-based data validation, reconciliation, and quality checks.
• Review and optimize SQL data models and database designs for performance and scalability.
• Manage pipeline deployment, monitoring, troubleshooting, and go-live support.
• Collaborate with client IT teams on connectivity, security, access, and deployment requirements.

Skills Required

• Azure Data Factory (ADF)
• Azure Self-Hosted Integration Runtime (SHIR)
• Python
• SQL & Data Modelling
• ETL/ELT & Data Pipeline Development
• Data Validation & Reconciliation