Search by job, company or skills

GCP Data Engineer

Early Applicant
  • Posted a day ago
  • Be among the first 10 applicants

Job Description

Role: GCP Data Engineer

Location: Chennai, Tamil Nadu

Experience: 5-9 Years

Required Skills: Python, Spark or Pyspark, SQL, GCP

Job Description :

  • Design, develop, and optimize scalable data pipelines using Python / PySpark.
  • Work extensively with Google Cloud Platform (GCP) services to build robust data solutions.
  • Develop and manage data workflows using Airflow / Cloud Composer / Astronomer.
  • Implement data ingestion and streaming solutions using Pub/Sub and Apache Kafka.
  • Build and maintain ETL/ELT pipelines using Dataflow or Dataproc.
  • Write complex and optimized queries using BigQuery and Advanced SQL.
  • Automate infrastructure provisioning using Terraform scripting.
  • Develop serverless solutions using Cloud Functions.
  • Configure and manage Scheduled Queries, Monitoring Dashboards, and Alerting Systems.
  • Ensure data quality, reliability, and performance across pipelines.
  • Collaborate with cross-functional teams (analytics, product, DevOps).
  • Implement and maintain CI/CD pipelines for data workflows.

More Info

Job Type:
Industry:
Employment Type:

Job ID: 151538113

Similar Jobs

Chennai, India

Skills:

composer BigQueryGitTerraformDataprocPythondata fusion

Chennai, India

Skills:

PysparkTerraformPythonJavaMlBigQueryDataprocSqlGcpCompute EngineApache KafkaApache BeamDataFlowAirflowTektonDataformCloud BuildPub SubCloud ComposerCloud RunVertex AICloud SQLCloud FunctionsDataplexArtifact Registry

Chennai, India

Skills:

JavaBigQueryPysparkScalaApache SparkKafkaDataprocSqlGitDockerApache BeamDataFlowPythonKubernetesCloud Functions

Chennai, India

Skills:

BigQueryHadoopPysparkData WarehousingBashSparksqlDataprocSqlCloud StorageHiveGcpIamDataFlowPythonAirflowDataFramePub Sub

Chennai, India

Skills:

Cloud StoragePysparkDataprocPythonTerraformGoogle Cloud PlatformTektonAirflowCloud SQLDataFusionData FlowDataPlexConfluent Kafka