Description
We are seeking an experienced GCP Data Engineer with expertise in Databricks to join our dynamic team in India. The ideal candidate will have a robust background in data engineering, capable of designing and building scalable data solutions on Google Cloud Platform. This role requires collaboration with cross-functional teams to deliver high-quality data pipelines and maintain data integrity.
Responsibilities
- Design and implement scalable data pipelines on Google Cloud Platform (GCP) using Databricks.
- Collaborate with data scientists and analysts to understand data requirements and deliver high-quality data solutions.
- Optimize and maintain existing data workflows and ETL processes for performance and reliability.
- Develop and manage data models, data architecture, and data governance policies.
- Monitor and troubleshoot data pipeline issues to ensure data integrity and availability.
- Create documentation for data systems and processes for future reference and compliance.
Skills and Qualifications
- 10-15 years of experience in data engineering, with a focus on GCP and Databricks.
- Proficiency in SQL and experience with data modeling techniques.
- Strong programming skills in Python, Scala, or Java.
- Experience with big data technologies such as Apache Spark, Apache Kafka, or similar.
- Knowledge of data warehousing solutions and ETL processes.
- Familiarity with cloud services (GCP specifically) and data storage solutions (e.g., BigQuery, Cloud Storage).
- Experience with version control systems like Git and CI/CD pipelines.
- Strong problem-solving skills and ability to work independently as well as in a team.
