Job Description
About The Role
DAR | Data Engineer | GCP Data Engineer
GCP Data Engineer with deep experience building scalable data pipelines, real‑time and batch ingestion frameworks, and cloud‑native data platforms. Strong expertise in Python-based data engineering, workflow orchestration, and enterprise-grade data solutions leveraging GCP services including BigQuery and modern ingestion stacks, with strong emphasis on lakehouse architectures using Apache Iceberg or Delta Lake table formats.
5+ years of Data Engineering experience
5+ years of Python development
3+ years of batch and streaming processing (Airflow, Pub/Sub, Dataflow)
3+ years with Autosys, Airflow, and GCP environments
3+ years with BigQuery and GCP ingestion stack
3+ years with CI/CD tools and IAM
Strong ETL/ELT design and optimization experience
Hands-on expertise with Apache Iceberg or Delta Lake for scalable lakehouse implementations
Desired Qualifications
Strong expertise in streaming architectures
Advanced experience with Iceberg or Delta Lake (schema evolution, time travel, ACID)
Deep knowledge of data modeling and lakehouse design
Python ecosystem (Pandas, NumPy, PySpark)
Airflow + Autosys orchestration expertise
GCP lakehouse (BigQuery + GCS + Iceberg/Delta)
Data governance, lineage, and quality frameworks
DevOps (CI/CD, Terraform, Docker, Kubernetes/OpenShift)
BigQuery performance and cost optimization
API-based ingestion
Good to have: Data observability tools (OpenLineage, Datadog, Cloud Monitoring, Prometheus) and SQL Sever SSIS familiarity.
Skills: data engineering,autosys,airflow,ci,data,apache,gcp,cd,lake,python
