About the Role:
We are looking for a Senior Manager – Data Engineering to lead and manage data engineering teams responsible for building robust, scalable, and secure data infrastructure leveraging cloud technologies across Azure, AWS, Google Cloud Platform (GCP), Informatica and Oracle Cloud. The ideal candidate will combine strong technical expertise with leadership skills to drive data platform initiatives, optimize data pipelines, and collaborate cross-functionally to support analytics, BI, and data science needs.
Experience: 12 to 15years
Job Location: Bhubaneswar, Noida & Kolkata
Key Responsibilities:
- Lead and mentor data engineering teams to design, build, and maintain high-performance, scalable data platforms on cloud environments including Azure, AWS, Google Cloud Platform (GCP), Informatica and Oracle Cloud
- Own the end-to-end lifecycle of data engineering solutions: data ingestion, transformation, storage, and delivery.
- Collaborate with enterprise architects, data scientists, business analysts, and IT teams to translate business requirements into scalable data engineering solutions.
- Drive adoption of best practices in cloud-native data architectures such as data lakes, data warehouses, and lakehouses.
- Define technical standards, architecture guidelines, and operational procedures to ensure reliability, performance, and data security.
- Oversee cloud migration projects and upgrade efforts for existing on-premises data platforms to cloud.
- Manage vendor relationships and evaluate emerging cloud services and tools relevant to data engineering.
- Implement and enforce data governance, data quality, and compliance measures.
- Monitor data pipeline performance and implement tuning, troubleshooting, and capacity planning.
- Lead Agile delivery processes with efficient sprint planning, backlog grooming, and stakeholder communication.
- Provide technical leadership in evaluating and incorporating automation and orchestration tools (e.g., Apache Airflow, Jenkins).
- Report progress, risks, and KPIs to senior leadership and stakeholders.
Must-Have Skills & Qualifications:
Cloud Platforms Expertise:
- Demonstrated hands-on experience designing and managing data workloads across one or more cloud platforms:
- Microsoft Azure (Data Factory, Synapse Analytics, Databricks)
- AWS (Glue, Redshift, Athena, EMR)
- Google Cloud Platform (BigQuery, Dataflow, Dataproc)
- Oracle Cloud Infrastructure (Autonomous Database, Data Integration, Object Storage)
- Experience in cloud migration from traditional on-prem data systems to cloud-native data platforms.
Data Engineering Fundamentals:
- Deep understanding of ETL/ELT pipelines, data ingestion, batch and streaming data processing.
- Expertise in data storage solutions: Data Lakes, Data Warehouses, Lakehouses, and relational/non-relational databases.
- Skilled in programming/scripting languages (Python, SQL, Scala, or Java).
- Experience with big data frameworks and tools such as Apache Spark, Kafka, and Apache Airflow.
- Familiar with containerization (Docker) and orchestration (Kubernetes) in data workflows.
- Knowledge of infrastructure automation tools (Terraform, CloudFormation, ARM templates).
- Strong grasp of data governance, security frameworks (IAM, encryption), and regulatory compliance.
Leadership & Management:
- Proven experience leading and scaling technical teams in data engineering or related fields.
- Strong project management and Agile methodology experience.
- Ability to effectively communicate technical concepts to business and technical stakeholders.
- Skilled in resource planning, budgeting, and vendor management.
Preferred Qualifications:
- Bachelor's or Master's degree in Computer Science, Engineering, Data Science, or related disciplines.
- Relevant cloud certifications such as:
- Microsoft Certified: Azure Data Engineer Associate
- AWS Certified Big Data – Specialty or Data Analytics – Specialty
- Google Professional Data Engineer
- Oracle Cloud Infrastructure Data Management Specialist
- Experience working in multi-cloud or hybrid cloud environments.
- Knowledge of orchestration of ML pipelines and basic AI/ML concepts is a plus.
