Senior Specialist - Data Engineering

A GCP BigQuery professional designs develops and optimizes largescale data warehouses ELTETL pipelines and SQL scripts within Google Cloud Responsibilities include managing data ingestion PubSub Dataflow optimizing performance and cost and implementing securitygovernance Key skills include SQL Python Apache Airflow and Data modeling

Key Responsibilities

Data Architecture Modeling Design and optimize BigQuery data models schemas and storage for performance and costefficiency

Pipeline Development ETL ELT Build scalable data pipelines and workflows using tools like Cloud Composer Airflow Dataflow and Dataproc

Query Optimization Write complex SQL scripts and tune performance to minimize BigQuery slot usage

Data Integration Ingest transform and manage data from diverse sources into BigQuery

Governance Security Implement data security access controls and best practices

Required Skills Qualifications

Core Technical Proficiency in GoogleSQL Python and Google Cloud Platform GCP services BigQuery Cloud Storage Dataflow

Data Processing Experience with Apache Spark Beam or Hadoop

Database Knowledge Strong understanding of relational RDBMS and NoSQL databases

Mandatory Skills : GCP BigQuery