Search by job, company or skills

5-10 Years
Not Disclosed
  • Posted 12 hours ago
  • Be among the first 10 applicants

Job Description

Exp- 5-10 yrs

Location- Chennai, Bangalore, Kerala, Kolkata, Hyderabad

Desired Competencies (Technical/Behavioral Competency)

•Proficiency in GCP services: BigQuery, Dataflow, Pub/Sub, Cloud Composer, Dataplex, Airflow Composer.

• Strong SQL and Python programming skills

• Experience with Apache Beam for batch and streaming pipelines

• Exp in CI/CD and Infrastructure as Code (GitHub Actions)

Good-to-Have

  • Familiarity with data governance, security, and observability tools
  • Understanding of AI/ML integration with Vertex AI
  • Expertise in performance tuning and cost optimization
  • Develop ETL/ELT workflows for structured and unstructured data

Responsibility of / Expectations from the Role

Design and implement scalable data pipelines using GCP services

• Develop ETL/ELT workflows for structured and unstructured data

• Ensure data quality, security, and compliance with governance standards

• Collaborate with data scientists and analysts for advanced analytics

• Optimize data workflows for cost efficiency and performance

• Implement monitoring and alerting for data pipelines

• Support AI/ML readiness and integration with Vertex AI

• Strong communication and stakeholder management skills

• Agile methodology experience for project delivery

More Info

Job Type:
Industry:
Employment Type:

Key Skills

Infrastructure as Code

CI CD

Cloud Composer

GitHub Actions

Dataplex

GCP services

Similar Jobs

6-10 yrs
Chennai, India
Skills:
Google Cloud Platform (GCP), Java, BigQuery, Dataproc, Sql, Cloud Storage, Git, DataFlow, Python, ETL/ELT pipelines, Pub Sub, CI/CD
6-9 yrs
Chennai, India
Skills:
BigQuery, Hadoop, Flume, SAS, Dataproc, Pig, Mapreduce, Sql, MATLAB, Tensorflow, Hive, Spark, Apache Beam, Genomics, GCP Dataflow, Stata, Torch, Pub Sub, Dataprep, R, Caffe, Datalab
3-7 yrs
Chennai, India
Skills:
BigQuery, Dataproc, Sql, Apache Airflow, Cloud Storage, Git, Gcp, Terraform, DataFlow, Python, Cloud Logging, CI CD, Cloud Monitoring, Pub Sub, Claude AI, Cloud Composer, LLM-based tools
5-7 yrs
Chennai, India
Skills:
BigQuery, Gcp, Spark, Apache Beam, Dataproc, DataFlow, Python, Sql, ELT, Etl, Cloud Data Engineering
5-7 yrs
Chennai, India
Skills:
Pyspark, Google Cloud Platform, Dataproc, Cloud Storage, Terraform, Python, Git, Shell Scripting, Api Development, Tekton, Airflow, DataFusion, DataPlex, Confluent Kafka, Cloud SQL, Data Flow, Agile Framework, Data Transfer Utilities, Redis Memory