Search by job, company or skills

Senior Big Data Engineer (10 + Years)

10-12 Years

This job is no longer accepting applications

Job Description

Job Title: Senior Data Engineer – Technical Lead (GCP)

Experience: 10+ Years

Location: Remote (Candidate must collect company assets from the client location)

Shift Timing: 2:00 PM – 11:00 PM IST

About the Role

We are looking for an experienced Senior Data Engineer – Technical Lead to lead a Business-As-Usual (BAU) Data Engineering team responsible for maintaining, optimizing, and enhancing production data pipelines on Google Cloud Platform (GCP).

This is a hands-on technical leadership role where you will drive operational excellence, mentor a team of data engineers, troubleshoot production issues, optimize Airflow pipelines, and ensure smooth delivery of reliable data solutions from Data Lake to Enterprise Data Warehouse.

Key ResponsibilitiesTechnical Leadership
  • Lead and mentor an offshore Data Engineering BAU team.
  • Provide technical guidance and ensure alignment with engineering best practices.
  • Collaborate effectively with US stakeholders during overlapping working hours.
Production Support & Incident Management
  • Act as the highest escalation point for production data issues.
  • Troubleshoot and resolve complex pipeline failures.
  • Perform root cause analysis and implement permanent fixes.
Data Pipeline Management
  • Manage end-to-end data movement from Data Lake → Dimensions/Facts → Data Warehouse.
  • Implement SQL fixes, Airflow DAG enhancements, data backfills, and validation processes.
  • Optimize pipeline performance and ensure data reliability.
Change & Release Management
  • Execute production deployments with proper testing and rollback strategies.
  • Maintain documentation and deployment evidence.
  • Follow ITIL and Change Management best practices.
Continuous Improvement
  • Identify recurring production issues and automate solutions using Python and SQL.
  • Reduce manual intervention through process optimization.
  • Improve monitoring, performance, and operational efficiency.
Required SkillsMandatory Skills
  • SQL Server
  • Python
  • Apache Airflow / Cloud Composer
  • Hadoop
  • Google BigQuery
  • Data Lake
  • Google Cloud Platform (GCP
Required Experience
  • 10+ years of Data Engineering experience.
  • Proven experience leading technical teams or acting as a Technical Lead.
  • Extensive hands-on experience with production support in enterprise data environments.
  • Strong expertise in SQL optimization, Airflow orchestration, and Python development.
  • Experience working with global stakeholders and supporting US business hours.

More Info

Job Type:
Industry:
Employment Type:

About Company

Job ID: 151832983

Beware of Scammers

We don’t charge money for job offers