Search by job, company or skills

Fresher
Not Disclosed
Early Applicant
  • Posted 19 days ago
  • Be among the first 50 applicants

Job Description

Platform Engineering | Google Cloud | Data & AI Enablement

We are looking for a Senior Developer to help build and evolve the CI/CD frameworks used by our Data and AI Platform teams.

This role is focused on building reusable platform capabilities rather than one-off project-specific implementations. You will work closely with data engineers, AI/ML engineers, and platform teams to design reusable pipelines, automation frameworks, deployment patterns, and self-service engineering capabilities for modern data and AI workloads on Google Cloud Platform.

The right person for this role is hands-on, comfortable writing production-quality code, and has a strong understanding of both cloud services and CI/CD engineering practices. You should be able to take complex platform requirements and turn them into scalable, reusable frameworks that engineering teams can easily adopt.

Key Responsibilities

Build Platform CI/CD Frameworks

  • Design and develop reusable GitLab CI/CD frameworks for Data and AI platform teams.
  • Create reusable pipeline templates, deployment workflows, validation steps, and automation standards that can be adopted across projects and environments.
  • Build self-service deployment capabilities and golden-path engineering workflows for Data & AI teams.

Enable GCP Data Platform Deployments

  • Build deployment patterns and automation for core GCP data services including:
    • Dataproc
    • BigQuery
    • Dataform
    • Cloud Composer
    • Google Cloud Storage
    • Dataflow
    • Bigtable
    • Cloud Spanner
  • Enable teams to deploy, configure, and operate these services through reliable and repeatable CI/CD processes.
  • Design frameworks supporting multi-environment and multi-tenant deployment patterns.
Support Data Pipeline Delivery

  • Design CI/CD workflows for:
    • Batch data pipelines
    • Streaming workloads
    • Transformation logic
    • Orchestration workflows
    • Environment-specific releases
  • Work with engineering teams to improve how data pipelines are built, tested, promoted, and deployed across environments.
Develop Internal Tools and Automation

  • Build platform tools, APIs, CLIs, scripts, and reusable libraries using Python and Go.
  • Focus on reducing repetitive work, improving developer experience, and making platform capabilities easier for teams to adopt.
  • Apply software engineering best practices including testing, modular design, versioning, and maintainability to platform tooling and frameworks.

Partner with Engineering Teams

  • Work closely with data, AI, platform, and infrastructure teams to understand engineering challenges and convert them into scalable platform solutions.
  • Help define practical standards for:
    • Pipeline design
    • Deployment automation
    • Release management
    • Operational readiness
    • CI/CD governance
Must-Have Qualifications

  • Strong experience designing and building CI/CD frameworks for platform or engineering teams.
  • Expert-level knowledge of Google Cloud Platform and hands-on experience with GCP data services.
  • Deep experience with:
    • Dataproc
    • BigQuery
    • Dataform
    • Cloud Composer
    • GCS
    • Dataflow
    • Bigtable
    • Spanner
  • Strong experience with GitLab and GitLab CI/CD pipeline design.
  • Experience designing CI/CD pipelines for data platforms, analytics workloads, or AI/ML platform teams.
  • Strong understanding of data pipeline design including:
    • Batch processing
    • Streaming architectures
    • Orchestration
    • Transformation workflows
    • Environment promotion
  • Strong application development experience with Python.
  • Hands-on development experience with Go.
  • Ability to build reusable frameworks, deployment templates, automation utilities, and engineering standards.
  • Experience working with cross-functional engineering teams in platform, DevOps, or cloud engineering environments.
Technical Skills

Cloud Platform

  • Google Cloud Platform (GCP)

GCP Data Services

  • Dataproc
  • BigQuery
  • Dataform
  • Cloud Composer
  • GCS
  • Dataflow
  • Bigtable
  • Spanner

CI/CD & Automation

  • GitLab
  • GitLab CI/CD
  • Pipeline templates
  • Deployment automation
  • Environment promotion workflows

Programming

  • Python
  • Go

Data Engineering

  • Data pipeline design
  • Batch processing
  • Streaming workloads
  • Orchestration frameworks

Platform Engineering

  • Reusable tooling
  • Automation frameworks
  • Developer enablement
  • Self-service platforms

DevOps Practices

  • Version control
  • Release workflows
  • Automated validation
  • CI/CD governance

More Info

Job Type:
Industry:
Employment Type:

Key Skills

Cloud Spanner

Environment promotion workflows

Dataform

Streaming workloads

Deployment automation

Data pipeline design

Cloud Composer

Pipeline templates

Orchestration frameworks

Google Cloud Storage

GitLab CI CD

Similar Jobs

2-4 yrs
Gurugram, India, Gurugram
Skills:
Golang, Gcp, Terraform, Ruby, Helm, Azure, Kubernetes, Python, AWS, rbac, Amazon ECS
Noida
Skills:
AWS, Java, Oracle, Microservices, Python, Terraform, Agile Methodologies, PostgreSQL, AI-assisted software development tools