Job Title: AWS Data Engineer - Lead
Location: Hyderabad/ Pune/ Coimbatore
Experience: 8-10 years of experience
Primary Skills:
- Terraform for AWS infrastructure provisioning
- PySpark/Spark, Python, Advanced SQL
- Lakehouse/Medallion Architecture (Bronze/Silver/Gold)
- Type 2 Dimensions, CDC/Merge processing
- Incremental & historical processing, deduplication, late-arriving data handling
- Idempotency and resilient pipeline patterns
- AWS data services (S3, Glue, EMR, Lambda, Step Functions, Iceberg etc.), Lake Formation and AWS Services and pipelines.
- Data modelling fundamentals & data quality mindset
Job Summary:
We are looking for a experienced Lead AWS Data Engineer with strong handson expertise in building scalable, reliable data pipelines in a Lakehouse/Medallion architecture. Must have deep knowledge of Spark/PySpark, Terraform, and modern data engineering patterns.
Candidate should have strong analytical skills, design capabilities, problem solving skills. Based on stakeholders requirements, should be able to propose solutions to the customer for review. Discuss pros/cons of different solution designs and optimization strategies.
Responsibilities:
- Build and operate data pipelines using PySpark/Spark, SQL, and AWS services.
- Implement Medallion (Bronze/Silver/Gold) architecture with proper separation of concerns.
- Design incremental processing, SCD Type 2, CDC/merge, and late-arriving/outofsequence data handling.
- Ensure pipelines are idempotent, resilient, and reprocessable.
- Manage AWS data infrastructure using Terraform.
- Apply strong data quality, deduplication, schema validation, and operational best practices.
Requirements:
- Senior Data Engineering leader with extensive experience designing and delivering scalable AWS-based data pipelines for batch and real-time processing.
- Proven expertise in data modernization, cloud-native architectures, and high-volume data environments.
- Strong collaborator across business, engineering, and QA teams to ensure data quality, reliability, and analytics readiness.
- Skilled to drive end-to-end data solutions aligned with business goals.
Desired Skill Set:
Candidates Must have below experience
- Updates/deletes from relational sources
- Deterministic deduplication
- Late-arriving/out-of-sequence data handling
- Idempotent pipeline design
About the Company:
ValueMomentum isamongst the fastestgrowing insurance-focused IT services providersin North America.Leading insurers trust ValueMomentum with their core, digital and data transformation initiatives. Having grown consistently every year by 24%, we have now grown to over 4000 employees. ValueMomentum is committed to integrity and to ensuring that each team and employee is successful. We foster an open work culture where employees opinions are valued. We believe in teamwork and cultivate a sense of fun, fellowship, and pride among our employees.
Benefits:
We at ValueMomentum offer you the opportunity to grow by working alongside the experts. Some of the benefits you can avail are:
- Competitive compensation package comparable to the best in the industry.
- Career Advancement: Individual Career Development, coaching and mentoring programs for professional and leadership skill development.
- Comprehensive training and certification programs.
- Performance Management: Goal Setting, continuous feedback and year-end appraisal. Reward & recognition for the extraordinary performers.
- Benefits: Comprehensive health benefits, wellness and fitness programs. Paid time off and holidays.
- Culture: A highly transparent organization with an open-door policy and a vibrant culture
If you are interested in the above role, kindly fill in the details below and share your updated resume here.
Full Name:
Overall Experience:
Relevant Experience:
Notice Period:
Current CTC (Cost to Company):
Expected CTC:
Are you open to working 5 days a week from the office (Yes/No):
Preferred Location (if applicable):
Are you currently employed (Yes/No):
Reason for Looking for a Chang
