Search by job, company or skills

Data Engineer

Data Engineer

zorba ai
6-8 Years
Not Disclosed

This job is no longer accepting applications

Job Description

Job Title: Data Engineer – GCP + PySpark + Scala

Experience: 6+ Years

We are looking for a skilled Data Engineer with hands-on experience in GCP, PySpark, and Scala to develop and optimize scalable batch ETL pipelines.

Key Skills

  • Strong experience in Scala, PySpark, GCP, BigQuery, Dataproc, and Apache Airflow
  • Experience in developing, deploying, monitoring, and optimizing batch ETL workflows
  • Good understanding of Medallion Architecture with data quality checks and data summarization
  • Expertise in performance optimization, observability, and runbook creation
  • Strong knowledge of Airflow orchestration, dependency handling, and idempotent execution
  • Exposure to Data Governance is an added advantage

Responsibilities

  • Design, develop, and maintain scalable ETL pipelines on GCP
  • Build and optimize data processing workflows using PySpark and Scala
  • Ensure data quality, performance, and reliability across data pipelines
  • Collaborate with cross-functional teams to deliver efficient data solutions

Skills: pyspark,pipelines,gcp,scala,etl

More Info

Job Type:
Industry:
Employment Type:

Key Skills

About Company

Similar Jobs

5-7 yrs
Chennai, India
Skills:
BigQuery, Gcp, Spark, Apache Beam, Dataproc, DataFlow, Python, Sql, ELT, Etl, Cloud Data Engineering
4-6 yrs
Chennai, India
Skills:
BigQuery, Hadoop, PostgreSQL, Apache Spark, Kafka, DataFlow, Python, Sql, Cloud Composer, Cloud Functions, Cloud SQL
4-6 yrs
Chennai, India
Skills:
Azure Data Lake Storage (ADLS), Pyspark, Apache Spark, Python, Sql, Git, Azure Data Factory, Power Bi, Azure Synapse Analytics, Databricks, Azure DevOps, Fabric Lakehouse, OneLake, Delta Lake, Fabric Data Factory Data Pipelines, Microsoft Fabric, Microsoft Purview, ETL ELT concepts, Real-time streaming data, CI CD
6-8 yrs
Chennai, India
Skills:
Pyspark, Azure Data Factory, Azure Functions, Azure Databricks, Sql, Synapse, ADLS, Databricks notebooks using Python