GCP Data Engineer

Job Summary:

We are seeking a talented GCP Data Engineer to join our team and help us design and implement robust data pipelines and analytics solutions on Google Cloud Platform (GCP). The ideal candidate will have strong expertise in BigQuery, DataFlow, Cloud Composer, and DataProc, along with experience in AI/ML tools such as Google Vertex AI or Dialogflow.

Key Responsibilities:

• Design, develop, and maintain data pipelines and workflows using DataFlow, Cloud Composer, and DataProc.
• Develop optimized queries and manage large-scale datasets using BigQuery.
• Collaborate with cross-functional teams to gather requirements and translate business needs into scalable data solutions.
• Implement best practices for data engineering, including version control, CI/CD pipelines, and data governance.
• Work on AI/ML use cases, leveraging Google Vertex AI or Dialogflow to create intelligent solutions.
• Perform data transformations, aggregations, and ETL processes to prepare data for analytics and reporting.
• Monitor and troubleshoot data workflows to ensure reliability, scalability, and performance.
• Document technical processes and provide guidance to junior team members.

Qualifications:

• Experience: 35+ years of professional experience in GCP data engineering or related fields.

Skills:

• Proficiency in BigQuery, DataFlow, Cloud Composer, and DataProc.
• Exposure to Google Vertex AI, Dialogflow, or other AI/ML platforms.
• Strong programming skills in Python, SQL, and familiarity with Terraform for GCP infrastructure.
• Experience with distributed data processing frameworks like Apache Spark is a plus.
• Knowledge of data security, governance, and best practices for cloud platforms.