Senior Data Engineering

About The Role

DAR | Data Engineer | GCP Data Engineer

GCP Data Engineer with deep experience building scalable data pipelines, real‑time and batch ingestion frameworks, and cloud‑native data platforms. Strong expertise in Python-based data engineering, workflow orchestration, and enterprise-grade data solutions leveraging GCP services including BigQuery and modern ingestion stacks, with strong emphasis on lakehouse architectures using Apache Iceberg or Delta Lake table formats.

5+ years of Data Engineering experience

5+ years of Python development

3+ years of batch and streaming processing (Airflow, Pub/Sub, Dataflow)

3+ years with Autosys, Airflow, and GCP environments

3+ years with BigQuery and GCP ingestion stack

3+ years with CI/CD tools and IAM

Strong ETL/ELT design and optimization experience

Hands-on expertise with Apache Iceberg or Delta Lake for scalable lakehouse implementations

Desired Qualifications

Strong expertise in streaming architectures

Advanced experience with Iceberg or Delta Lake (schema evolution, time travel, ACID)

Deep knowledge of data modeling and lakehouse design

Python ecosystem (Pandas, NumPy, PySpark)

Airflow + Autosys orchestration expertise

GCP lakehouse (BigQuery + GCS + Iceberg/Delta)

Data governance, lineage, and quality frameworks

DevOps (CI/CD, Terraform, Docker, Kubernetes/OpenShift)

BigQuery performance and cost optimization

API-based ingestion

Good to have: Data observability tools (OpenLineage, Datadog, Cloud Monitoring, Prometheus) and SQL Sever SSIS familiarity.

Skills: data engineering,autosys,airflow,ci,data,apache,gcp,cd,lake,python