Search Jobs

Search by job, company or skills

Data Engineering Lead

Data Engineering Lead

staff on air
Early Applicant
  • Posted 18 hours ago
  • Be among the first 10 applicants

Job Description

8+ Years

Mumbai

Full-Time

About the Role:

We are looking for a Data Engineering Lead to join our AMS team supporting a large scale analytics platform for a major Oil & Gas enterprise. You will lead the data engineering track, managing ETL pipelines, data transformations, and ensuring platform reliability.

Key Technologies:

* AWS Glue, AWS Lambda, Amazon Redshift, Aurora PostgreSQL

* MSK Kafka, AWS SQS, AWS Transfer Family

* Apache Airflow (orchestration)

* SQL, Python

What You'll Do:

* Lead a team of 3 data engineers in maintaining & enhancing large-scale data assets

* Own ETL pipeline performance, monitoring & optimization

* Handle production incidents (24x7 rotation for P1 issues)

* Drive enhancements within defined SLA timelines

* Collaborate with client business advisory team

* Create & maintain runbooks and documentation

Requirements:

* 8+ years in Data Engineering with leadership experience

* Expert in AWS data services (Glue, Redshift, Aurora)

* Strong SQL and Python skills

* Experience managing production data pipelines at scale

* Ability to work from Mumbai (client site as required)

* Available for weekend/night on-call rotation

Nice to Have: - Experience in Oil & Gas domain / large enterprise analytics

More Info

Job Type:
Industry:
Employment Type:

Key Skills

Aurora PostgreSQL

AWS Transfer Family

MSK Kafka

About Company

Similar Jobs

10-12 yrs
Mumbai, India
Skills:
Nosql, Devops, Typescript, Javascript, Pyspark, Databricks, Python, Sql, Azure cloud architecture, AIOps
7-9 yrs
Mumbai, India, Navi Mumbai
Skills:
Sql, AWS Glue, Kinesis, Kafka, BigQuery, AWS, Python, Gcp, MongoDB, Redshift, NiFi, Airflow, Amazon QuickSight, Pub Sub, DocumentDB, EMR Serverless