Search by job, company or skills

talent worx

Lead Data Engineer

talent worx
Gurugram, India, Gurugram
2-6 Years
Save
  • Posted 2 months ago
  • Be among the first 30 applicants
Early Applicant

Job Description

Talworx is an emerging recruitment consulting and services firm , we are hiring for our Fintech Product based client, In this role, you will be working with a team or teams of enthusiastic members supporting our critical technology systems and guiding our business partners & end users with industry best practices, solution design, and creating long term value to our customers.

engaging work environment. You will work in a (truly) global team and encouraged for thoughtful risk-taking and self-initiative.

Requirements

Job Summary:

As a member of the Cognitive Engineering team, you will build and maintain enterprise-scale data extraction, automation, and ML model deployment pipelines. You will design resilient, production-ready systems within an AWS-based ecosystem, collaborating with a hands-on, technically strong global team to solve high-complexity problems end-to-end.

Key Responsibilities:

  • Develop, deploy, and operate data extraction and automation pipelines in production.
  • Integrate and deploy machine learning models into pipelines (e.g., inference services, batch scoring).
  • Lead the delivery of complex extraction, transformation, and ML deployment projects.
  • Scale pipelines on AWS (EKS, ECS, Lambda) and manage DataOps processes with Celery, Redis, and Airflow.
  • Implement robust CI/CD pipelines on Azure DevOps and maintain comprehensive test coverage.
  • Strengthen data quality and reliability through logging, metrics, and automated alerts.
  • Partner with data scientists, ML engineers, and product teams to align on requirements and delivery timelines.

Technical Requirements:

  • 2-6 years of relevant experience in data engineering, automation, or ML deployment.
  • Expert proficiency in Python, including building extraction libraries and RESTful APIs.
  • Hands-on experience with task queues and orchestration: Celery, Redis, Airflow.
  • Strong AWS expertise: EKS/ECS, Lambda, S3, RDS/DynamoDB.
  • Containerization and orchestration experience: Docker (mandatory), basic Kubernetes (preferred).
  • Proven experience deploying ML models to production.
  • Solid understanding of CI/CD practices and hands-on experience with Azure DevOps.
  • Familiarity with SQL and NoSQL stores (e.g., PostgreSQL, MongoDB)

More Info

Job Type:
Permanent Job
Industry:
Other
Function:
Fintech
Employment Type:
Full time

About Company

talent worx

Job ID: 141169021

Jobs by Skill - IT
Jobs by Skill - Non IT
International Jobs
Last Updated: 30-06-2026 00:07:16 AM
Homejobs in Gurgaon / GurugramLead Data Engineer

Similar Jobs

Lead Data Engineer

UKG
Noida, India

Skills:

snowflake , BigQuery, cloud automation, Data Warehousing, Dimensional Modeling, Sql, Jenkins, Gcp, Terraform, Docker, Databricks, Python, Kubernetes, AWS, Airflow, Infrastructure as Code, DevOps practices, AI-enabled analytics platforms, data orchestration tools, GitHub Actions, Generative AI tools, CI CD pipelines

Lead Data Engineer

Atain
Gurugram, Gurugram, India

Skills:

Azure Data Factory, Power Bi, Etl Development, SQL Server, Data Quality, Databricks, Data Warehousing, SSIS, Microsoft technology stack

Lead - Data Engineer

iris software inc.
Noida, India

Skills:

data engineering , Microservices, Networking, Sql, Data Modeling, Encryption, Pyspark, Rest Apis, Python, Iam, Scala, Spark, Airflow, cloud security best practices, AWS data services, lakehouse, OLAP dimensional modeling, ETL ELT pipelines, GitHub Copilot

Lead - Data Engineer

IRIS software
Noida, India

Skills:

data engineering , containerization , Pyspark, Kafka, Networking, Data Modeling, Microservices, Encryption, Kinesis, Docker, Python, cloud security, Scala, Sql, Iam, Spark, Rest Apis, Kubernetes, lakehouse, Airflow, Hudi, AWS data services, ETL ELT pipelines, data observability solutions, OLAP dimensional modeling, AWS Certifications, Iceberg, streaming technologies, GitHub Copilot, Delta Lake

Lead Data Engineer

Exl
Gurugram, Gurugram, India

Skills:

snowflake , S3, Python, Sql, Etl, AWS, Glue