Search by job, company or skills

GCP Data Engineer

Early Applicant
  • Posted a day ago
  • Be among the first 10 applicants

Job Description

We are seeking a Senior GCP Data Engineer with 4-8 Years experience to design, build, and operate scalable batch and real-time data pipelines on Google Cloud Platform (GCP).

The ideal candidate has strong foundations in cloud-native data engineering, is highly self-driven, accountable, and excels as a collaborative team player in Agile environments.

Key Responsibilities

  • Design, develop, and maintain batch and real-time ETL/ELT pipelines on GCP
  • Build and optimize data pipelines using Python
  • Implement streaming solutions using Pub/Sub and Dataflow
  • Develop and manage batch workflows using Cloud Composer
  • Design and optimize data models and queries in BigQuery
  • Work with large-scale, low-latency data stores such as Bigtable
  • Ensure data quality, reliability, performance, and scalability
  • Manage source code, reviews, and collaboration using GitHub
  • Build and maintain CI/CD pipelines using GitHub Actions
  • Collaborate with product, platform, and analytics teams in an Agile setup

Required Skills & Qualifications

  • Strong hands-on experience with Google Cloud Platform (GCP)
  • Proven expertise in batch and real-time data pipelines
  • Strong programming experience in Python
  • Hands-on experience with BigQuery, Bigtable, Pub/Sub, Dataflow, and Cloud Composer
  • Solid understanding of data modeling, ETL/ELT, and distributed data systems
  • Proficiency with GitHub and GitHub Actions–based CI/CD
  • Experience working in Agile environments
  • Strong knowledge of data security and access management

Nice to Have

  • Experience with data governance, lineage, and observability tools
  • Exposure to large-scale analytics or enterprise data platforms

Primary Skills : GCP. Bigdata, PySpark, GCP, Bigquery, Composer, Python

Seondary Skills : SQL, Spark/Python,

Good to Have : Gen AI

More Info

Job Type:
Industry:
Employment Type:

About Company

Job ID: 153405831

Similar Jobs

Gurugram, Gurugram, India

Skills:

BigQueryHadoopPysparkData WarehousingBashSparksqlDataprocSqlCloud StorageHiveGcpIamDataFlowPythonAirflowDataFramePub Sub

Noida, India

Skills:

BigQueryLoggingTableauSqlGcpApp EnginePythonGCP IAMLookerMonitoringProduction SupportAI LLM applicationsSpannerbatch streaming pipelines

Gurugram, India

Skills:

composer NetworkingVpcCloud StorageShellGcpTerraformCompute EngineDataprocPythonGKECloud DNSGoogle Cloud Monitoring

Gurugram, Gurugram, India

Skills:

BigQueryPandasGcpPower BiPysparkTableauSqlPythonELTEtl

Gurugram, Gurugram, India

Skills:

BigQueryHadoopPysparkData WarehousingBashSparksqlDataprocSqlCloud StorageHiveGcpIamDataFlowPythonAirflowDataFramePub Sub

Beware of Scammers

We don’t charge money for job offers