GCP Data Engineer

Website-https://intraedge.com/

GCP Data Engineer (6+ Years Experience)

Location: Pune-Hybrid

Experience: 6+ Years

Job Summary

We are seeking a highly skilled GCP Data Engineer with strong expertise in designing, building, and optimizing large-scale cloud-native data platforms on Google Cloud Platform (GCP). The ideal candidate will have hands-on experience with Dataflow, Dataproc, Pub/Sub, BigQuery, and Cloud Spanner, along with a strong understanding of data engineering best practices, real-time data processing, and distributed systems.

Key Responsibilities

• Design, develop, and support scalable batch and real-time data pipelines on GCP.
• Build and maintain data ingestion and transformation solutions using Dataflow, Dataproc, and Pub/Sub.
• Design and optimize analytical data models in BigQuery for reporting, analytics, and AI/ML workloads.
• Implement high-performance, globally scalable solutions using Cloud Spanner.
• Develop data integration frameworks for structured and unstructured data sources.
• Optimize data processing performance, scalability, reliability, and cost efficiency.
• Collaborate with architects, data scientists, business stakeholders, and DevOps teams to deliver enterprise data solutions.
• Implement CI/CD, monitoring, security, and governance best practices for cloud data platforms.
• Troubleshoot production issues and provide ongoing support for critical data pipelines.

Required Skills

• 6+ years of overall IT experience with 5+ years in GCP Data Engineering.
• Strong hands-on experience with:
• Google Cloud Dataflow
• Google Cloud Dataproc
• Google Cloud Pub/Sub
• BigQuery
• Cloud Spanner
• Strong knowledge of Python, Java, or Scala.
• Experience with Apache Spark, ETL/ELT frameworks, and distributed data processing.
• Strong understanding of data warehousing, data modeling, and cloud architecture.
• Experience with DevOps, CI/CD, Infrastructure as Code, and monitoring tools.
• Excellent communication and stakeholder management skills.

Preferred Qualifications

• GCP Professional Data Engineer Certification.
• Experience with Kafka, Airflow/Composer, Terraform, and Kubernetes.
• Exposure to AI/ML data pipelines and modern data lakehouse architectures.

Location: Preferably Pune

Work Model: Preference for candidates who are willing to work 3 days from Intraedge Pune Office

.