Our Client is a leading management consulting firm is looking to engage with a Data Engineer – AI & Analytics to help with:
- Develop and implement scalable data pipelines using Azure Data Factory (ADF) and SHIR.
- Translate business logic and AI prototypes into production-ready data solutions.
- Integrate data from ERP systems, databases, Excel, flat files, and external sources.
- Build Python-based data validation, reconciliation, and quality checks.
- Review and optimize SQL data models and database designs for performance and scalability.
- Manage pipeline deployment, monitoring, troubleshooting, and go-live support.
- Collaborate with client IT teams on connectivity, security, access, and deployment requirements.
Skills Required
- Azure Data Factory (ADF)
- Azure Self-Hosted Integration Runtime (SHIR)
- Python
- SQL & Data Modelling
- ETL/ELT & Data Pipeline Development
- Data Validation & Reconciliation
