Search by job, company or skills

GCP Data Engineer

  • Posted 2 hours ago
  • Be among the first 10 applicants

Job Description

We are seeking a Senior GCP Data Engineer with 4-8 Years experience to design, build, and operate scalable batch and real-time data pipelines on Google Cloud Platform (GCP).

The ideal candidate has strong foundations in cloud-native data engineering, is highly self-driven, accountable, and excels as a collaborative team player in Agile environments.

Key Responsibilities

  • Design, develop, and maintain batch and real-time ETL/ELT pipelines on GCP
  • Build and optimize data pipelines using Python
  • Implement streaming solutions using Pub/Sub and Dataflow
  • Develop and manage batch workflows using Cloud Composer
  • Design and optimize data models and queries in BigQuery
  • Work with large-scale, low-latency data stores such as Bigtable
  • Ensure data quality, reliability, performance, and scalability
  • Manage source code, reviews, and collaboration using GitHub
  • Build and maintain CI/CD pipelines using GitHub Actions
  • Collaborate with product, platform, and analytics teams in an Agile setup

Required Skills & Qualifications

  • Strong hands-on experience with Google Cloud Platform (GCP)
  • Proven expertise in batch and real-time data pipelines
  • Strong programming experience in Python
  • Hands-on experience with BigQuery, Bigtable, Pub/Sub, Dataflow, and Cloud Composer
  • Solid understanding of data modeling, ETL/ELT, and distributed data systems
  • Proficiency with GitHub and GitHub Actions–based CI/CD
  • Experience working in Agile environments
  • Strong knowledge of data security and access management

Nice to Have

  • Experience with data governance, lineage, and observability tools
  • Exposure to large-scale analytics or enterprise data platforms

Primary Skills : GCP. Bigdata, PySpark, GCP, Bigquery, Composer, Python

Seondary Skills : SQL, Spark/Python,

Good to Have : Gen AI

More Info

Job Type:
Industry:
Employment Type:

About Company

Job ID: 153660609

Similar Jobs

Bengaluru, India

Skills:

HadoopPysparkKafkaHiveGcpSqoopLinuxSparkApache BeamPythonBig QueryData ProcGoogle Data Engineerdata fusionCI-CD pipelinesData FlowGoogle Cloud Storage

Bengaluru, India

Skills:

BigQueryPysparkDataprocSqlCloud StorageGitGcpApache BeamDataFlowPythonAirflowLookerData CatalogPub SubCloud ComposerBigQuery MLdbtVertex AI

Bengaluru, India

Skills:

JavaBigQueryDataprocSqlELTDevopsCloud StorageCompute EngineSparkApache BeamDataFlowData AnalyticsPythonKubernetesEtlAir FlowColabcloud security best practicesLookerData Lake EngineeringPub SubVertex AI

Bengaluru

Skills:

DataFlowELTCloud StorageBigQueryEtlDataprocData GovernanceGcpData SecurityAirflowData lakesPub SubData quality checksdata marts

Bengaluru, India

Skills:

BigQueryHadoopPower BiTableauDataprocSqlELTGitGcpDockerTerraformSparkAgileDataFlowKubernetesPythonEtlAirflowLookerCloud Composer

Beware of Scammers

We don’t charge money for job offers