Lead Data Engineer

Position - Senior Data Engineer

Years of experience required - 8–12 Years Experience

About the Role

A Senior Data Engineer with deep expertise in databases and cloud-native data warehousing. The role requires designing and optimizing large-scale data solutions, leading technical initiatives, and ensuring robust pipelines across AWS and GCP.

Key Responsibilities

Database Design: Design normalized, scalable schemas and enforce best practices for relational and analytical workloads.

Data Warehouse Solutions: Implement optimized DWH models and scalable architectures.

ETL/ELT Pipelines: Build and optimize pipelines using SQL and PySpark.

Technical Leadership: Mentor engineers and drive technical initiatives independently.

Client Communication: Translate requirements into actionable strategies and communicate clearly with stakeholders.

Production Support: Oversee scheduling, monitoring, and optimization of pipelines.

Documentation & SOPs: Create and maintain technical documentation, design guidelines, and SOPs to ensure consistency and knowledge sharing across the team.

Required Tech Stack & Skills

Strong database skills with AWS RDS (MS SQL Server, PostgreSQL).

Deep expertise in AWS Redshift and AWS Glue.

Hands-on experience with GCP BigQuery, Google Cloud Storage, Dataflow, and Dataproc.

Advanced proficiency in SQL and PySpark.

Proven track record in senior or lead data engineering roles.