Job Title: Senior GCP Data Engineer
Experience: 712 Years
Location: Chennai, Bangalore, Hyderabad, Pune (Hybrid)
Timings: Full Time (As per company timings)
Notice Period: Immediate Joiner Only
Job Overview
We are seeking a seasoned
Senior GCP Data Engineer with strong experience in building, optimizing, and maintaining large-scale data processing systems on Google Cloud Platform. The ideal candidate should be hands-on with
BigQuery,
DataProc (PySpark), and workflow management using
Airflow DAGs. Experience with
Informatica is an added advantage. This role requires a proactive individual who can work independently as well as collaborate effectively within a team.
Key Responsibilities
- Design, develop, and maintain scalable data pipelines on GCP using BigQuery, DataProc, and related services.
- Develop PySpark jobs for ETL/ELT processing and data transformation activities.
- Build, schedule, and optimize workflows using Airflow DAGs.
- Work closely with cross-functional teams to understand business requirements and translate them into technical solutions.
- Ensure data availability, reliability, and performance across the platform.
- Conduct root cause analysis and resolve data-related issues.
- Follow best practices for coding, version control, and CI/CD integration.
- Collaborate with team members while also being capable of delivering independently.
- Proactively identify potential risks, issues, and bottlenecks, and communicate effectively to stakeholders.
Required Skills & Experience
- 7+ years of hands-on experience in data engineering.
- Strong experience with GCP BigQuery and DataProc (PySpark).
- Experience building and maintaining Airflow DAGs.
- Solid understanding of data modelling, ETL frameworks, and distributed data processing.
- Proven ability to work both as an individual contributor and as a team player.
- Excellent problem-solving skills and a proactive mindset.
- Flexible attitude and ability to adapt based on project needs.
Good to Have
- Experience with Informatica for ETL processes.
- Exposure to other cloud platforms or big data technologies.
- Understanding of CI/CD pipelines and DevOps practices.
