GCP Data Architect

GCP Data Architect

Required Technical Skill Set

Google Cloud Platform (GCP) services. Strong hands-on experience with BigQuery Pub/Sub, data pipelines (batch and streaming) with Dataflow/Dataproc/Spark, SQL and Python

Desired Experience Range

10-15 yrs

Location of Requirement

Pan India

Desired Competencies

Must-Have

• Strong hands-on experience with BigQuery Pub/Sub, Python, data pipelines (batch and streaming) with Dataflow/Dataproc/Spark
• Proficiency in SQL
• Serverless Computing: Leverage GCP's serverless offerings such as Cloud Functions, App Engine, and Cloud Run.
• Infrastructure as Code (IaC):Develop and manage Terraform scripts for provisioning and managing GCP infrastructure, ensuring repeatability and consistency in deployments.
• Memory Management:Optimize the performance of applications and systems through effective memory management strategies, ensuring efficient resource utilization.
• Data Integration and Messaging: Design and implement messaging and event-driven architectures using Pub/Sub and other GCP services for real-time data processing and integration.
• Python Scripting: Write andmaintainPython scripts for automation tasks, custom solutions, and integration with GCP APIs.
• Best Practices and Governance:Establish and enforce best practices for cloud architecture, including security, cost management, and compliance. Implement governance models to ensure consistent cloud operations.
• Training and Mentorship: Provide training, guidance, and mentorship to internal teams and customers on GCP services and best practices.
• Troubleshooting and Support: Act as an escalation point for complex technical issues, providing hands-on support and guidance to resolve critical cloud-related challenges.

Role descriptions / Expectations from the Role

• Own end-to-end data architecture on GCP, including reference architectures, standards, patterns, and roadmaps.
• Design batch and streaming ingestion using Pub/Sub, Dataflow, Dataproc, Transfer Service, and partner tools; define schemas and contracts.
• Serverless Computing:Leverage GCP's serverless offerings such as Cloud Functions, App Engine, and Cloud Run.
• Infrastructure as Code (IaC):Develop and manage Terraform scripts for provisioning and managing GCP infrastructure, ensuring repeatability and consistency in deployments.
• Memory Management: Optimizethe performance of applications and systems through effective memory management strategies, ensuring efficient resourceutilization.
• Data Integration and Messaging:Design and implement messaging and event-driven architectures using Pub/Sub and other GCP services for real-time data processing and integration.
• Python Scripting:Write andmaintainPython scripts for automation tasks, custom solutions, and integration with GCP APIs.
• Best Practices and Governance: Establishand enforce best practices for cloud architecture, including security, cost management, and compliance. Implement governance models to ensure consistent cloud operations.
• Training and Mentorship:Provide training, guidance, and mentorship to internal teams and customers on GCP services and best practices.
• Troubleshooting and Support: Act as an escalation point for complex technical issues, providing hands-on support and guidance to resolve critical cloud-related challenges.