Spark / Data Pipeline Engineer

Now Hiring: Spark / Data Pipeline Engineer (35 Years Experience)

Location:Bengaluru, Karnataka, India

Open (Prefer candidates from top universities or enterprise-level companies)

We are looking for a talented Spark / Data Pipeline Engineer to join our team and work on scalable, distributed data applications. If you're passionate about building and optimizing data pipelines at scale, we'd love to speak with you!

Many candidates only know how to run Spark SQL, but we need someone who understands the fundamentals of data pipelines and how distributed systems work behind the scenes.

If you enjoy solving problems in scalable environments and working with massive datasets, this role is for you.

Must-Have Skills

• Strong hands-on experience with Spark & Spark SQL (35 Years)
• Solid SQL development skills
• Experience with Batch Processing and/or Data Streaming
• Understanding of HDFS
• Ability to monitor and modify existing pipelines
• Proven experience building new data pipelines

Screening Pointers

• Strong in Spark and SQL fundamentals
• Must have data pipeline knowledgenot just writing Spark SQL, but understanding how pipelines work end-to-end
• Experience with batch or streaming data
• Ability to troubleshoot and optimize at scale

Nice To Have

• Experience working with large-scale data (tables in the TB range)
• Python development experience is a plus (not mandatory)