Search by job, company or skills

Senior Data Engineer

  • Posted 14 hours ago
  • Be among the first 10 applicants

Job Description

Work Experience: 9+ years

Work Mode: Hybrid (2 days WFO)

Work Location: Chennai and Mumbai


Job Description

:
Key Responsibilities & Expectatio

  • nsDesign, develop, and support scalable data engineering solutions with strong focus on automation, data quality, scripting, and production readines
  • s.Apply proper AI knowledge to understand modern AI models and AI-assisted development tools, including prompts, tokens, context windows, reasoning behaviour, model responses, and practical integration points within data engineering workflow
  • s.Develop and maintain Python coding and scripting solutions for automation, data validation, file processing, and reusable engineering utilitie
  • s.Drive automation initiatives to reduce manual effort, improve repeatability, strengthen controls, and accelerate data processing workflow
  • s.Perform Unix-based scripting, scheduling support, file handling, log analysis, and operational troubleshooting across data engineering environment
  • s.Contribute to Spec Kit development by building, enhancing, validating, and maintaining specification-driven data processing component
  • s.Ensure strong data quality through validation rules, reconciliation checks, exception handling, root cause analysis, and continuous monitorin

g.Must-Have Skills & Experien

  • ce7–8 years of experience as a Senior Data Engineer or Data Engineer in technical, data-driven environment
  • s.Strong technical orientation with hands-on understanding of complex systems, data flows, batch processes, pipelines, and integration pattern
  • s.Proper AI model and AI-assisted coding knowledge with ability to understand how large language models, including prompts, tokens, context windows, reasoning modes, code suggestions, model limitations, and practical data engineering use case
  • s.Strong Python coding and scripting experience for automation, data processing, data quality checks, file handling, reusable utilities, and operational suppor
  • t.GitHub Copilot exposure for AI-assisted Python coding, script generation, code review support, debugging help, unit test creation, documentation, and developer productivity improvemen
  • t.Hands-on Unix experience including shell scripting, command-line operations, file transfers, scheduling support, log review, and troubleshootin
  • g.Proven hands-on exposure to data quality concepts, validation frameworks, reconciliation processes, exception handling, and defect prevention practice
  • s.AI model and GitHub Copilot awareness, including how prompts are interpreted, how context windows affect outputs, how responses and code suggestions are generated, and how data quality impacts AI-assisted automatio
  • n.Automation-focused engineering mindset with experience creating scripts, reusable components, monitoring checks, and repeatable operational processe
  • s.Experience in Spec Kit development, including specification interpretation, component build, testing, validation, and maintenance of data processing logi
  • c.DevOps awareness with exposure to version control, CI/CD concepts, deployment readiness, environment configuration, monitoring, and production support practice
  • s.Excellent written and verbal communication skills, with strong documentation capabilitie

s.

More Info

Job Type:
Industry:
Employment Type:

Job ID: 151812767

Similar Jobs

Chennai

Skills:

graph databases snowflake GitPythonSqlAzure DevOpsAWS cloud servicesvector databases

Chennai, India

Skills:

Hl7SqlPythonEtlEHI ExportFHIR

Chennai, India

Skills:

Advanced SqlPythonAnalytics Hub data sharingDataflow batch streaming pipelinesBatch and streaming data processingBigQuery advanced optimization and tuningScripting and automationDataform SQL-based transformationsDataplex Data CatalogData lakehouse architecture conceptsGoogle Cloud Platform GCPIAM Security controlsPub Sub event-driven architecturesCloud Monitoring LoggingCloud Storage GCSData ingestion frameworks config-driven approach preferredETL ELT pipeline design and implementationData modeling and warehousing principlesJava or Scala preferredCDC and incremental processing

Chennai

Skills:

BigQueryCloud StorageGitPythonSqlDataform

Chennai, India

Skills:

Power BiAWS GlueApache SparkTableauSqlAzure Data FactoryDockerAzureKubernetesPythonDevOps methodologiesData governance frameworksMatillionLookerSynapsedbtData quality tools

Beware of Scammers

We don’t charge money for job offers