Search by job, company or skills

C

Data Engineering Lead

Save
new job description bg glownew job description bg glow
  • Posted an hour ago
  • Be among the first 10 applicants
Early Applicant

Job Description

Job Description

Role:Data Engineering Lead
Experience:9 to 13 years
Location:Gurguram
Notiece period : Upto 60 days
As a Data Engineering Lead, you will own the end-to-end data engineering strategy that powers enterprise analytics and AI capabilities. You will lead the design and evolution of scalable, secure, and high-performance data platforms while ensuring data is reliable, governed, and ready for advanced use cases such as machine learning and agentic AI systems.

In this role, you will:

  • Architect and implement modern, scalable data pipelines supporting batch, streaming, and real-time ingestion.
  • Define and institutionalize data modeling best practices for analytical, AI, and retrieval-ready datasets.
  • Build and enforce robust data quality frameworks ensuring high trust in data across systems.
  • Drive performance optimization initiatives across ingestion, transformation, and storage layers.
  • Establish strong data governance, access control, classification, and compliance mechanisms.
  • Lead technical decision-making for large-scale data platform architecture.
  • Mentor and grow a high-performing data engineering team, fostering engineering excellence and ownership.
  • Collaborate cross-functionally with ML, RAG, MLOps, Security, and Product teams to deliver impactful data solutions.
  • Continuously evaluate and adopt new technologies to improve data platform capabilities and efficiency.

Your Profile

  • Strong hands-on experience withPython,SQL, and ETL/ELT pipeline development.
  • Experience withAWS data services: S3, Glue, Glue Data Catalog, Athena, Lambda, Step Functions, CloudWatch, IAM, KMS.
  • Working knowledge ofAmazon Bedrock Knowledge Bases, Agents, Guardrails, and model inference APIs. Bedrock Guardrails can be associated with agents to validate inputs and outputs for safer GenAI applications.
  • Experience withRAG data pipelines, including document ingestion, chunking, metadata tagging, embedding generation, vector indexing, and retrieval validation.
  • Experience withalarm/event data processing, network telemetry, logs, ticket data, and topology/inventory datasets.
  • Ability to parse semi-structured data from CSV, JSON, logs, SNMP trap payloads, and alarm text.
  • Understanding ofnetwork topology concepts: device, interface, link, LAG, site, region, upstream/downstream, service dependency.
  • Experience withdata quality frameworks, schema validation, deduplication, and anomaly detection.
  • Familiarity withOpenSearch, DynamoDB, Redshift, PostgreSQL, or vector databases.
  • Good understanding ofsecurity, access control, encryption, and audit loggingin AWS.

What You'll Love About Working Here

  • Opportunity to lead and shape next-generation data platforms powering AI and analytics at scale.
  • Work on cutting-edge technologies including AI-ready data systems, RAG pipelines, and intelligent automation.
  • Collaborative environment with highly skilled teams across data, AI, and product engineering.
  • Strong focus on innovation, engineering excellence, and continuous learning.
  • Flexible work culture that supports work-life balance and professional growth.
  • Visibility and impact - your work directly influences critical business decisions and AI capabilities.

About US

We are a forward-thinking organization focused on building intelligent, data-driven platforms that enable scalable analytics and advanced AI capabilities. Our mission is to unlock the full potential of enterprise data by combining engineering excellence, strong governance practices, and cutting-edge AI technologies. We foster a culture of innovation, collaboration, and continuous improvement, empowering teams to solve complex challenges and deliver meaningful impact.

More Info

Job Type:
Industry:
Employment Type:

About Company

Capgemini was founded by Serge Kampf in 1967 as an enterprise management and data processing company. The company was founded as the Société pour la Gestion de l'Entreprise et le Traitement de l'Information (Sogeti).In 1974 Sogeti acquired Gemini Computers Systems, a US company based in New York.In 1975, having made two major acquisitions of CAP (Centre d'Analyse et de Programmation) and Gemini Computer Systems, and following resolution of a dispute with the similarly named CAP UK over the international use of the name 'CAP', Sogeti renamed itself as CAP Gemini Sogeti.

Job ID: 148803803