Job Title
Data Architect / Senior Data Engineer GCP BigQuery
Experience Required
- 10 12 years of overall experience in Data Engineering / Data Architecture
- Minimum 3+ years of hands-on experience with Google Cloud Platform (GCP) and BigQuery
Location
Chennai,Hyderabad,Bangalore,Pune
Job Summary
We are seeking an experienced
Data Architect / Senior Data Engineer to design, implement, and optimize
large-scale data warehouse and lakehouse solutions on Google Cloud Platform (GCP). The ideal candidate should possess deep expertise in
BigQuery architecture, data modeling, ETL/ELT frameworks, streaming data pipelines, and cloud data migration initiatives.
This role requires strong leadership capabilities to define data engineering standards, drive modernization programs, optimize platform performance and cost, and mentor engineering teams.
Key Responsibilities Data Architecture & Design
- Design and own BigQuery-based Data Warehouse and Lakehouse architectures for enterprise-scale analytics platforms.
- Build scalable and cost-efficient data platforms supporting large data volumes.
- Define architecture standards and governance frameworks across data platforms.
- Implement best practices for data security, scalability, reliability, and performance.
Data Modeling & Optimization
- Define and implement data modeling standards, including:
- Dimensional Modeling
- Wide Table Modeling
- Data Product Architecture
- Optimize BigQuery performance and cost using:
- Partitioning
- Clustering
- Query optimization
- Storage optimization
Data Engineering & Pipeline Development
- Architect and manage end-to-end batch and streaming data pipelines using:
- BigQuery
- Dataflow
- Cloud Composer (Airflow)
- Pub/Sub
- Cloud Storage
- Develop scalable ingestion frameworks for processing high-volume datasets.
- Build and maintain ETL/ELT pipelines for enterprise analytics.
Streaming & Large-Scale Processing
- Design real-time and near real-time ingestion architectures.
- Implement streaming solutions using Pub/Sub and Dataflow.
- Support large-scale distributed data processing workloads.
Migration & Modernization
- Lead migration initiatives from on-premises data warehouses to GCP/BigQuery.
- Modernize legacy analytics platforms and establish cloud-native architectures.
Quality, Governance & Operations
- Establish and maintain:
- Data Quality frameworks
- Data Governance standards
- Monitoring and observability
- Performance tuning practices
- Ensure compliance with enterprise data management policies.
Collaboration & Leadership
- Collaborate with stakeholders, analysts, and engineering teams to deliver business outcomes.
- Mentor junior engineers and drive engineering excellence.
- Define and implement CI/CD standards for data platforms.
Required Technical Skills Cloud & Data Platforms
- Google Cloud Platform (GCP)
- BigQuery (Advanced)
- Cloud Storage
Data Engineering
- GoogleSQL
- Python
- PySpark
- Apache Airflow / Cloud Composer
- ETL / ELT Pipelines
Streaming & Processing
- Pub/Sub
- Dataflow
- Large-scale distributed processing
Data Architecture
- Data Warehousing
- Lakehouse Architecture
- Dimensional Modeling
- Performance Optimization
Databases / Warehouse Exposure
Experience With One Or More
- Oracle
- Teradata
- Snowflake
- Databricks
- Other enterprise data warehouse platforms