Lead the design, development, and maintenance of data pipelines and ETL processes for efficient data integration and transformation.
Manage and optimise data storage and data flows on at least 2 of the following cloud ecosystems - GCP, AWS, Azure, Oracle Cloud.
Work with large-scale datasets, streaming data, ensuring data quality, consistency, and reliability across systems.
Collaborate with cross-functional teams to understand business requirements and deliver data-driven solutions.
Implement and enforce data governance, security, and compliance standards.
Develop and Enhance Cloud Architecture that could be used for New proposals as well as for Data Engineering pipelines, refreshes, automations and integrations.
Monitor data pipelines, troubleshoot issues, and ensure high availability of data platforms.
Optimize database performance and ensure cost-effective cloud resource utilization.
Mentor junior engineers, provide technical guidance, and contribute to best practices in data engineering.
Qualifications
Strong proficiency in data storage and data flows on at least 2 of the following cloud ecosystems - GCP, AWS, Azure, Oracle Cloud.
Hands-on experience with ETL tools (Oracle DI, Informatica, Talend, or similar).
Advanced knowledge of SQL, PL/SQL, and database performance tuning.
Solid understanding of data warehousing concepts and big data technologies.
Strong skills in Python for data processing and automation.
Experience with streaming data pipelines (Kafka, Spark Streaming).
Past experience of developing or enhancing Cloud and data flow Architecture, including Data Engineering pipelines, refreshes, automations and integrations.
Experience of Application/ Data Integrations with Internal and Third Party APIs, MCPs, LLMs & other multimodal language models would be required
Web Data Harvesting, Automations & API integration would be a good-to-have skill
Knowledge of data modelling and data governance best practices.
Exposure to containerization technologies (Docker, Kubernetes) is a plus.
Strong analytical and problem-solving abilities.
Excellent communication and collaboration skills.
Ability to work independently, manage multiple priorities, and thrive in a fast-paced environment.
