Search by job, company or skills

GCP Data Engineer

GCP Data Engineer

Tata Consultancy Services
6-10 Years
Not Disclosed
Early Applicant
  • Posted 11 hours ago
  • Be among the first 10 applicants

Job Description

Job description

Role: GCP Data Engineer

Experience: 6-10 Years

Locations: Chennai, Bengaluru, Hyderabad, Pune, Kochi, Kolkata, NCR/Delhi

Interview Mode: Virtual Interview on 17th October

Job Summary

We are looking for an experienced GCP Data Engineer with strong expertise in designing, developing, and maintaining scalable data platforms on Google Cloud Platform (GCP). The ideal candidate should have hands-on experience in data ingestion, transformation, ETL development, cloud-native data services, and large-scale data processing.

Key Responsibilities

  • Design and develop scalable ETL/ELT data pipelines on GCP.
  • Build and maintain data processing solutions using BigQuery, Dataflow, Dataproc, and Cloud Storage.
  • Develop and optimize data ingestion and transformation frameworks.
  • Work with structured and unstructured data from multiple sources.
  • Collaborate with Data Scientists, Analysts, and Business teams to support data requirements.
  • Implement data quality, governance, security, and monitoring processes.
  • Troubleshoot performance issues and optimize data workflows.
  • Follow CI/CD and DevOps best practices for deployment and maintenance.

Required Skills

  • 6-10 years of overall IT experience.
  • Strong experience with Google Cloud Platform (GCP).
  • Hands-on experience with:
  • BigQuery
  • Dataflow
  • Dataproc
  • Cloud Storage
  • Pub/Sub
  • Cloud Composer/Airflow
  • Strong SQL skills.
  • Experience in building ETL/ELT pipelines.
  • Knowledge of Python or Java for data engineering.
  • Understanding of data warehousing and data lake concepts.
  • Experience with Git and CI/CD processes.

Preferred Skills

  • Experience with Apache Spark/PySpark.
  • GCP Certifications.
  • Exposure to Kafka and real-time data processing.
  • Experience with Docker and Kubernetes.

Note: Looking for candidates with a 90-day notice period. Please apply if you meet this requirement.

More Info

Job Type:
Industry:
Employment Type:

Key Skills

ETL/ELT pipelines

Google Cloud Platform (GCP)

CI/CD

Similar Jobs

5-10 yrs
Chennai, India
Skills:
Hadoop, Pyspark, Kafka, Sql, Nosql, Hive, Linux, Sqoop, Spark, Log Monitoring, Apache Beam, Python, GCP data services, data fusion, CI-CD pipelines, Google Cloud Storage
5-7 yrs
Chennai, India
Skills:
BigQuery, Gcp, Spark, Apache Beam, Dataproc, DataFlow, Python, Sql, ELT, Etl, Cloud Data Engineering
5-7 yrs
Chennai, India
Skills:
Pyspark, Google Cloud Platform, Dataproc, Cloud Storage, Terraform, Python, Git, Shell Scripting, Api Development, Tekton, Airflow, DataFusion, DataPlex, Confluent Kafka, Cloud SQL, Data Flow, Agile Framework, Data Transfer Utilities, Redis Memory
6-10 yrs
Chennai, India
Skills:
Sql, Dataproc, Python, Gcp, Pyspark, Kafka, Airflow, Cloud Run, Cloud Function, Big Query, Pubsub, Data Flow
4-6 yrs
Chennai, India
Skills:
Elasticsearch, BigQuery, Pyspark, Dataproc, MongoDB, Sql, Python, Cloud Functions, GCP Data Analytics, Airflow Composer