Search by job, company or skills

This job is no longer accepting applications

Job Description

Designation: Data Engineer (Python)

Location: Pune and Chennai

Work mode: Hybrid

Job type: Contract to Hire

Required:

  • 8+ years of overall experience in large-scale application development with recent mandatory platform for the secure and scalable deployment of AI agents into application contexts
  • Minimum of 5+ years of proven experience in a Python and pyspark Engineering lead role focused on building enterprise-grade, high-volume ELT/ETL processes using the PySpark and Databricks ecosystem.
  • Hands-on experience with agentic AI development using YAML, JSON, FAST API or Spring boot, Google ADK, LLM itegrations, including Devin.AI or Github Copilot, and integrating models via platforms like MCP using advanced prompt engineering.
  • Proven experience developing and automating microservice integrations to support data-intensive applications.
  • Proficiency in at least one programming language commonly used for data analytics, engineering, such as Python or Scala.
  • Strong SQL skills and experience with various relational databases.
  • Deep understanding of data modeling, data warehousing concepts, Data Mesh architecture, and data federation.
  • Excellent communication, collaboration, and problem-solving skills.

Preferred:

  • Experience with cloud-based Big Data platforms (e.g., Cloudera, Databricks, AWS, Azure, GCP).
  • Experience with frontend technologies such as Angular or React JS for building data-driven application interfaces.
  • Practical experience applying AI/ML techniques to solve real-world business problems.
  • Familiarity with containerization technologies (e.g., Docker, Kubernetes).
  • Experience in data engineering within the banking retail products domain (e.g., Cards, Mortgage, Deposits, Wealth Management).
  • Relevant industry certifications (e.g., AWS Certified Big Data - Specialty, Azure Data Engineer Associate).

More Info

Job Type:
Industry:
Employment Type:

Job ID: 151614375

Similar Jobs

Chennai, India

Skills:

PysparkGcpScalaKafkaDataprocBQAirflow

Chennai, India

Skills:

PysparkAzure DatabricksSqlEncryptionAzure Data FactoryTerraformAzure Synapse AnalyticsData GovernanceArmPythonAzure DevOpsAzure PurviewADLS Gen2ComplianceSecurityrbacCI CD pipelinesDelta LakeBicepInfrastructure-as-Code

Chennai, India

Skills:

BigQueryDataFlowAdvanced SqlPythonLoggingDataformBatch and streaming data processingData CatalogCloud MonitoringData lakehouse architecture conceptsPub SubDataplexIAM Security controlsJava or ScalaData ingestion frameworksAnalytics HubData modeling and warehousing principlesCDC and incremental processing

Chennai, India

Skills:

BigQueryData ModelingCiKafkaSqlELTApache AirflowGitGcpDockerPythonKubernetesEtlcdGoogle Cloud Composer

Chennai, India

Skills:

snowflake KafkaAutomated TestingData ModelingELTPythonAWSApisSqlGoogle CloudSparkDatabricksAzureEtlAirflowReconciliationtraceability controlsindustrial historiansOPC-UAIEC protocolsModbusdata-quality validationdbtSCADA systemslineage monitoringerror handling

Beware of Scammers

We don’t charge money for job offers