GCP Data Engineer

Role Overview

We are looking for an experienced GCP Data Engineer to design, develop, and maintain scalable data engineering solutions on Google Cloud Platform. The candidate should have strong hands-on experience with BigQuery, GCS, GKE, Cloud Functions, Cloud Build, Airflow/Cloud Composer, dbt, Python, and SQL, along with a good understanding of data modelling, monitoring, and logging.

Key Responsibilities

• Design and develop scalable data pipelines and data platforms on GCP.
• Develop and optimize data solutions using BigQuery and Cloud Storage (GCS).
• Build and manage containerized data workloads on GKE.
• Develop event-driven and serverless solutions using Cloud Functions.
• Implement CI/CD pipelines for data engineering workloads using Cloud Build.
• Develop, schedule, and monitor workflows using Apache Airflow / Cloud Composer.
• Develop and maintain transformation pipelines using dbt.
• Write efficient and maintainable Python and SQL code for data processing and automation.
• Design analytical data models including fact/dimension models, star schemas, and data marts.
• Implement data quality, validation, error handling, and pipeline recovery mechanisms.
• Configure and troubleshoot GCP Monitoring and Logging for data pipelines and cloud workloads.
• Optimize BigQuery queries, data processing, storage, and overall pipeline performance.
• Work with development, QA, DevOps, and analytics teams to deliver reliable data solutions.
• Follow security, IAM, governance, and best practices across GCP data platforms.
• Participate in code reviews, technical design discussions, and production support.

Good to Have

• Experience with Pub/Sub, Dataflow, Cloud Run, Secret Manager and IAM.
• Experience building Bronze/Silver/Gold data architecture.
• Experience with data lake/lakehouse architectures.
• Experience with Terraform / Infrastructure as Code.
• Experience with data quality and metadata/cataloguing tools.
• Experience working in Agile/Scrum environments.
• Experience supporting production data pipelines and troubleshooting failures.

Qualifications

• Bachelor's degree in Computer Science, Engineering, Information Technology, or a related field.
• Strong experience in data engineering and cloud-based data platforms.
• Strong problem-solving and communication skills.
• Ability to work independently and collaborate with cross-functional teams.