GCP Data Engineer

Key Skills: GCP, Data Engineer, Bigquery, ETL, Airflow

Roles and Responsibilities:

• Build and optimize scalable batch and real-time data pipelines on GCP.
• Develop and maintain ETL/ELT pipelines using Python and SQL.
• Implement event-driven and serverless workflows using Cloud Functions and Pub/Sub.
• Ingest and transform data into BigQuery and data lake environments using Dataflow, Dataproc, and Cloud Storage.
• Monitor, troubleshoot, and optimize cloud data workloads; apply CI/CD and cloud security best practices.

Skills Required:

• 4 - 12 years of relevant experience in data engineering on cloud platforms.
• Hands-on GCP experience across core data services (BigQuery, Dataflow, Dataproc, Pub/Sub, Cloud Storage).
• ETL/ELT development using Python and SQL for data transformation and loading.
• Batch and real-time data processing experience.
• Workflow orchestration and automation using Composer/Airflow, plus CI/CD and cloud security best practices.

Good to Have:

• Experience with Airflow/Composer for orchestration and scheduling.
• Additional ETL/ELT pipeline optimization experience for BigQuery workloads.

Education: Bachelor's degree in Computer Science, Engineering, or a related field.