About the Role
The Data Engineering Lead will be responsible for designing and implementing enterprise-level data architecture across AWS data platforms, ensuring scalability, security, and performance while aligning with business strategy.
Job Location: Hyderabad / Bengaluru
Responsibilities
- Design and define enterprise-level data architecture across AWS data platforms.
- Architect, develop, and oversee implementation of data lakes/lakehouse solutions using AWS services such as S3, Glue, Redshift, Athena, EMR, Lambda, and Lake Formation.
- Lead the design and development of robust ETL/ELT pipelines (batch and real-time).
- Define and implement enterprise data models (conceptual, logical, physical).
- Establish BI architecture standards using Tableau.
- Strong understanding of Data Governance, Security & Compliance.
- Translate complex business requirements into scalable technical architecture.
- Provide hands-on technical leadership in SQL, Python/PySpark.
- Define and enforce data governance, security frameworks, and compliance standards.
- Guide teams in implementing CI/CD pipelines and DevOps best practices.
- Review solution designs and code to ensure adherence to architectural standards.
- Collaborate with product teams and leadership to align data strategy.
- Drive modernization initiatives including migration from legacy/on-prem systems to AWS cloud environments.
- Ensure monitoring, logging, observability, backup, and disaster recovery strategies are implemented effectively.
- Mentor and technically guide data engineers and BI developers.
- Continuously evaluate emerging technologies, BI trends, and AWS innovations.
Primary Skills (Must Have Experience):
- 10+ years of overall IT experience, with 8+ years in Data Engineering & Analytics.
- 6+ years of hands-on experience in AWS data architecture.
- 5+ years of hands-on Tableau development & BI reporting experience.
- 3+ years of experience in leading data engineering teams as Technical Architect / Lead.
- 3+ years of experience in real-time and batch data processing architectures.
Required Skills
- Strong understanding of cloud-native data patterns & SQL development.
- Advanced data modeling.
- Experience in CI/CD.
Preferred Skills
- Experience with orchestration tools (Airflow or equivalent).
- Knowledge of encryption, data masking, metadata management, and access control frameworks.
Pay range and compensation package
Competitive salary based on experience and qualifications.
Equal Opportunity Statement
We are an equal opportunity employer and are committed to creating a diverse and inclusive workplace. We encourage applications from all qualified individuals regardless of race, gender, age, sexual orientation, disability, or any other characteristic protected by law.
