Senior Data Engineer - Spark / Scala

Job Title : Senior Data Engineer - Scala

Job Location : Bengaluru

Exp Range : 5-12 years

Position Overview : We are looking for a Software Development Engineer II (Data Engineering) with strong expertise in Apache Spark and Scala to design, build, and optimize large-scale data

pipelines and architectures.

You will be responsible for developing reliable, high-performance data systems that enable

advanced analytics and business intelligence across the organization. The ideal candidate is

passionate about building scalable data platforms, optimizing performance, and ensuring data

quality and reliability.

Key Responsibilities

Design, develop, and maintain scalable and efficient data pipelines.

Build and optimize complex datasets to meet business and technical requirements.

Identify, design, and implement process improvements automation, data flow

optimization, and infrastructure scalability.

Collaborate with cross-functional teams (Product, Data, Design, Engineering) to

support data-driven initiatives.

Ensure data quality, integrity, and security across all systems.

Support production (PROD) data systems and ensure high availability.

Work with data and analytics experts to enhance platform functionality and

performance.

Required Skills & Experience

Total Experience: 511 years, including 3+ years in Big Data development.

Proven experience in building scalable, high-volume data applications.

Strong hands-on experience in Apache Spark (Scala), Hadoop, and Hive.

Expertise in performance tuning, debugging, and optimization of big data

applications.

Strong understanding of Functional Programming, OOP principles, SOLID

design, and design patterns.

Experience with RDBMS and at least one NoSQL database (preferably

PostgreSQL).

Proficiency with build tools (Maven), version control systems (Git), and CI/CD

pipelines (Jenkins preferred).

Experience writing unit and integration tests using Scalatest