Senior GCP Data Engineer

About Kagool 

Kagool is a global IT services and consulting company specialising in enterprise digital transformation, with strong expertise across SAP delivery, data management, cloud modernisation, analytics, AI, and managed services. We help organisations unlock more value from their ERP and data platforms through end-to-end consulting, delivery, integration, migration, and support services. 

Our partnerships with leading technology providers such as Microsoft, SAP, Databricks, Google, AWS, Oracle, and other strategic partners enable us to deliver scalable, secure, and innovative solutions for complex enterprise environments. Kagool serves customers across multiple regions, with a presence across three continents and several countries, supporting clients globally with reliable delivery capability and 24/7 coverage. 

About the Role

We are looking for a skilled and motivated GCP Data Engineer to design, build, optimize, and maintain scalable data solutions on Google Cloud Platform (GCP). The ideal candidate will have strong experience in cloud-based data engineering, ETL/ELT pipelines, big data technologies, and modern data warehousing solutions.

You will work closely with data analysts, data scientists, DevOps teams, and business stakeholders to deliver reliable, secure, and high-performance data platforms and pipelines.

Key Responsibilities

·      Design, develop, and maintain scalable data pipelines using GCP services

·      Build and optimize ETL/ELT workflows for structured and unstructured data

·      Develop and manage data lakes and data warehouses on GCP

·      Implement data integration solutions using batch and real-time streaming technologies

·      Work with large datasets using distributed processing frameworks

·      Optimize query performance, storage, and compute costs

·      Ensure data quality, governance, security, and compliance standards

·      Automate deployment and monitoring of data engineering solutions

·      Collaborate with cross-functional teams to gather business and technical requirements

·      Troubleshoot production issues and provide long-term solutions

·      Create technical documentation and best practices

Required Skills & Qualifications

Technical Skills

Strong experience with Google Cloud Platform (GCP) services -

·      BigQuery

·      Cloud Storage

·      Dataflow

·      Pub/Sub

·      Cloud Composer / Apache Airflow

·      Dataproc

·      Cloud Functions

·      Looker / BI tools

·      SQL and advanced query optimization

·      Python or Java/Scala, Apache Spark

·      ETL/ELT development

·      CI/CD pipelines

·      Git version control

Experience with:

·      Real-time data streaming

·      Data modelling and warehousing concepts

·      REST APIs and data integration

·      Infrastructure as Code (Terraform preferred)

·      Monitoring and logging tools

Preferred Qualifications:

·      GCP Associate Data Practitioner(Mandatory)

·      GCP Professional Data Engineer Certification (Mandatory)

·      Experience with Kubernetes or Docker

·      Exposure to machine learning pipelines

·      Knowledge of data governance and security frameworks

·      Experience working in Agile/Scrum teams

 Education & Experience

Bachelor's degree in Computer Science, Information Technology, Engineering, or related field

5+ years of experience in Data Engineering

5 years of hands-on experience with GCP services

Nice to Have

Experience with multi-cloud environments (AWS/Azure)

Experience with Snowflake or other cloud data warehouses

Understanding of DevOps/DataOps practices

What We Offer

Competitive salary and benefits

Flexible working environment

Learning and certification support

Opportunity to work on large-scale cloud data platforms

Collaborative and innovative team culture