We are seeking an experienced Senior GCP Data Engineer with 5+ years of hands-on design and
development on Google Cloud Platform. The ideal candidate will act as a senior technical lead,
guiding the team, collaborating with stakeholders, and delivering high-quality, scalable data
solutions. Strong focus on data quality, governance, and performance optimization.
- Design, build, and maintain scalable data pipelines and architectures on Google Cloud Platform (BigQuery, Dataflow/Beam, Pub/Sub, Cloud Storage, Cloud
Composer, Dataproc, and related services).
- Can manage cloud storage (Lifecycle, versioning, retention policies, metadata
boundaries, access control on storage level)
- Expert in data modelling and analytics ready structure (portioning, structuring, denorm
vs norm and trade off, materialized view, design datasets)
- Maintain data cataloging, lineage and data asset documentation
Orchestrate pipelines (Airflow); monitor for failures and issue remediation
Control access to data asset (least privilege)
- Proficiency in SQL and at least one programming language common in data
engineering (Python, Java, Scala);
- Instrument pipelines with Cloud Monitoring and Cloud Logging; create dashboards for
data freshness, latency, and failure rates
- Set up alerting on critical failures, data quality thresholds, and cost anomalies
Implement unit and integration tests for data transformations (SQL tests in BigQuery,
tests in Dataproc jobs, end-to-end pipeline tests)
- Validate data quality post-ingestion and post-transformation; establish acceptable
data quality thresholds
- Document architecture, data models, DAGs, processing logic, and security
configurations
- Experience with version control (Git), CI/CD for data pipelines
Skills we do like:
- GCP Professional Data Engineer or other relevant cloud certifications.
- Experience with data governance frameworks and tools (e.g., Data Catalog, metadata
management).
- Familiarity with BI/reporting platforms and data visualization integration.
- Experience in industries requiring strict compliance and governance (e.g., finance)
