Key Skills: Data Engineer, Big Data, GCP, Cloud (AWS / Azure / GCP)
Roles and Responsibilities:
- Design and implement data processing systems using Big Data technologies.
- Develop and maintain data pipelines for data ingestion and transformation.
- Utilize GCP services such as BigQuery and Pub/Sub for data management.
- Collaborate with data scientists and analysts to understand data requirements.
- Ensure data quality and integrity throughout the data lifecycle.
- Monitor and optimize data workflows for performance and efficiency.
Skills Required:
- Strong knowledge of Big Data technologies
- Experience with GCP (BigQuery, Pub/Sub)
- Proficiency in cloud platforms (AWS / Azure / GCP)
- Data pipeline development and ETL processes
- Good understanding of data quality and data management principles
Education: Relevant degree in Computer Science or related field
