GCP Data Engineer

A GCP Big Query professional designs develops and optimizes largescale data warehouses ELT

ETL pipelines and SQL scripts within Google Cloud Responsibilities include managing data ingestion PubSub Dataflow optimizing performance and cost and implementing security governance Key skills include SQL Python Apache Airflow and Data modeling

Key Responsibilities

Data Architecture Modeling Design and optimize Big Query data models schemas and storage for performance and cost efficiency

Pipeline Development ETLELT Build scalable data pipelines and workflows using tools like Cloud Composer Airflow Dataflow and Dataproc

Query Optimization Write complex SQL scripts and tune performance to minimize Big Query slot usage

Data Integration Ingest transform and manage data from diverse sources into Big Query

Governance Security Implement data security access controls and best practices

Required Skills Qualifications

Core Technical Proficiency in Google SQL Python and Google Cloud Platform GCP services BigQuery Cloud Storage Dataflow

Data Processing Experience with Apache Spark Beam or Hadoop

Database Knowledge Strong understanding of relational RDBMS and NoSQL databases

Skills

Mandatory Skills : GCP Big Query, GCP Storage, Python for DATA