Senior Data Engineer

A GCP BigQuery professional designs develops and optimizes largescale data warehouses ELTETL pipelines and SQL scripts within Google Cloud Responsibilities include managing data ingestion PubSub Dataflow optimizing performance and cost and implementing securitygovernance Key skills include SQL Python Apache Airflow and Data modeling

Key Responsibilities

• Data Architecture Modeling Design and optimize BigQuery data models schemas and storage for performance and costefficiency


• Pipeline Development ETLELT Build scalable data pipelines and workflows using tools like Cloud Composer Airflow Dataflow and Dataproc


• Query Optimization Write complex SQL scripts and tune performance to minimize BigQuery slot usage


• Data Integration Ingest transform and manage data from diverse sources into BigQuery


• Governance Security Implement data security access controls and best practices

Required Skills Qualifications

• Core Technical Proficiency in GoogleSQL Python and Google Cloud Platform GCP services BigQuery Cloud Storage Dataflow


• Data Processing Experience with Apache Spark Beam or Hadoop


• Database Knowledge Strong understanding of relational RDBMS and NoSQL databases