Description
We are looking for a skilled Google Cloud Data Engineer with 6-11 years of experience in the job market context of India. The ideal candidate should have a strong background in Python, Java, Bigquery, PySpark, and GCP.
Responsibilities
- Design and implement scalable data pipelines using Google Cloud Platform technologies
- Collaborate with data scientists and analysts to understand data requirements and provide optimal data solutions
- Optimize data structures and algorithms for large-scale data processing
- Ensure data quality and data governance across all data pipelines
- Design and implement data security and privacy measures
- Automate deployment and monitoring of data pipelines
Skills and Qualifications
- 6-11 years of experience in data engineering using Google Cloud Platform technologies
- Strong programming skills in Python and Java
- Experience with Bigquery and PySpark
- Experience with GCP services such as Cloud Storage, Pub/Sub, Dataflow, and Dataproc
- Experience with data modeling, data warehousing, and ETL processes
- Strong understanding of data security and privacy best practices
- Experience with automation tools such as Ansible, Terraform, and Kubernetes
- Bachelor's or Master's degree in Computer Science, Information Technology, or related field