We are looking for a highly skilled Mid to Senior Data Engineer with 59 years of experience and strong hands-on expertise in building scalable data platforms on Google Cloud Platform (GCP). The ideal candidate must have solid data engineering fundamentals, strong experience in ETL/ELT pipeline development, and good exposure to cloud data warehouse architectures. Experience in Teradata-to-GCP migration and data modernization initiatives will be a strong advantage.
Key Responsibilities
- Design, develop, and maintain scalable data pipelines using GCP services
- Build and optimize data ingestion, transformation, and data loading frameworks
- Create and maintain data models supporting analytics and reporting
- Implement strong data quality, validation, and monitoring frameworks
- Collaborate with architects, analysts, and business teams to develop technical solutions
- Optimize query performance and manage cloud storage costs
- Implement CI/CD best practices in data engineering workflows
- Support data migration and data modernization initiatives
- Document data architecture, pipeline design, and operational processes
Required Technical Skills:
Data Engineering Fundamentals
- Strong experience in ETL/ELT pipeline design and development
- Strong SQL skills with expertise in query optimization
- Strong programming skills in Python
- Good understanding of data warehousing concepts (Star/Snowflake schemas, SCD, partitioning, clustering)
- Experience handling structured and semi-structured data
Google Cloud Platform (GCP)
Hands-on experience in most of the following:
- BigQuery (data warehouse design, optimization, cost management)
- Cloud Storage
- Dataflow / Apache Beam
- Pub/Sub
- Cloud Composer (Airflow)
- Cloud Functions / Cloud Run (nice to have)
- IAM and security best practices
DevOps & DataOps
- Experience with CI/CD tools (Git, Jenkins, GitHub Actions, or similar)
- Experience with monitoring and logging (Stackdriver / Cloud Logging / Cloud Monitoring)
Good to Have Skills
- Experience in Teradata to GCP migration
Note: This role is open for Bengaluru, Hyderabad, Chennai & Pune.
Shift: 2PM to 11PM IST (Hybrid mode)