Data Engineer Lead

Role Overview

We are seeking a Delivery Lead to lead the end‑to‑end delivery of data platforms and web‑based data solutions. This role blends hands-on data engineering expertise with strong delivery ownership and people leadership.

The ideal candidate will manage a cross‑functional team of 7–9 engineers (Data Engineers, DevOps Engineers, and Full‑Stack Developers), work closely with onshore Solution Architects, and act as the primary bridge between business stakeholders and technical execution.

Key Responsibilities & Day‑to‑Day Expectations

Delivery & Technical Leadership

• Own end‑to‑end delivery of data engineering and data‑driven web solutions
• Design, build, and maintain scalable, reliable data pipelines and data architectures
• Provide hands‑on technical guidance and architectural oversight when required
• Ensure performance, data quality, reliability, and scalability of data systems
• Drive best practices in coding, testing, documentation, deployment, and monitoring

Team Leadership & People Management

• Lead, mentor, and manage a team of 7–9 engineers including:
• Data Engineers
• DevOps Engineers
• Full‑Stack Developers
• Conduct task planning, sprint execution, reviews, and performance feedback
• Ensure efficient collaboration across engineering roles

Stakeholder & Client Collaboration

• Work closely with business stakeholders to translate requirements into technical solutions
• Coordinate with Onshore Solution Architects for solution design, alignment, and delivery
• Act as the primary point of contact for delivery status, risks, and dependencies
• Support engagement planning, delivery commitments, and execution timelines

DevOps & Platform Excellence

• Collaborate with DevOps to implement CI/CD pipelines and automation strategies
• Optimize workflows for cost, performance, and operational efficiency
• Support containerized and cloud-native deployments

Required Technical Skills

Core Data Engineering Skills

• Strong hands‑on coding experience in Python and SQL
• Solid experience designing and building data pipelines and data platforms
• Proficiency in Teradata SQL with strong query optimization skills
• Hands‑on experience with PySpark for large‑scale data processing
• Strong understanding of ETL / ELT concepts and data warehousing principles

Cloud & Platform Skills

• Experience with AWS, including services such as:
• S3
• EMR
• Glue
• Lambda
• Redshift
• Familiarity with DevOps practices and CI/CD tooling
• Knowledge of Docker and Kubernetes for containerization and orchestration

Functional Skills

• Experience is supporting and delivering data‑driven web applications
• Exposure to modern data architecture patterns (lakehouse, microservices, event‑driven systems)
• Experience working in global delivery models with onshore/offshore coordination

Domain & Project Experience

• Experience delivering enterprise‑scale data platforms or analytics solutions
• Prior exposure to projects involving:
• Large datasets
• Performance optimization
• Multi‑stakeholder delivery environments
• Comfortable managing delivery in fast‑paced, client‑facing engagements

Team Size & Stakeholder Interaction Summary

• Team Size: 7–9 engineers (could expand)
• Direct Interaction With:
• Business stakeholders
• Onshore Solutions Architect
• Product owners and client representatives
• Role Nature: Mix of delivery leadership, technical oversight, and people management