GCP Data Engineer (Pyspark/Scala/Kafka/Bigquery)
Experience: 5 - 12 Years
Location – Hybrid - Bangalore
iitjobs is looking for highly skilled Data Engineers with strong expertise in Scala, Kafka, Spark, and GCP. The ideal candidate should have hands-on experience building scalable data pipelines, processing large volumes of data, and working directly with clients to deliver high-quality data engineering solutions
Required Skills:-
- 5–12 years of overall experience in Data Engineering.
Strong hands-on experience with:
- Apache Kafka (streaming, producers/consumers, topic management)
- Apache Spark (batch & streaming)
- Scala (advanced programming expertise)
- Experience working on Google Cloud Platform (GCP)
- Solid understanding of data engineering concepts, distributed systems, and big data architectures.
- Experience working with large-scale data processing and pipeline development.
- Strong problem-solving and leadership skills.
Key Responsibilities:-
- Lead the design and development of scalable, fault-tolerant data pipelines and streaming architectures.
- Build and maintain real-time and batch data processing systems using Kafka, Spark, Scala and GCP
- Architect large-scale data solutions ensuring performance, reliability, and security.
- Collaborate with data scientists, analysts, and business stakeholders to deliver data-driven solutions.
- Mentor and guide junior engineers; drive best practices in coding, design, and deployment.
- Optimize data workflows and improve system efficiency and scalability.
- Implement monitoring, logging, and alerting mechanisms for data platforms.
- Drive adoption of modern data engineering practices (CI/CD, data quality frameworks, etc.).
