- Posted a day ago
- Be among the first 20 applicants
Job Description
Senior Data Engineer | Scala + Apache Spark + Azure + SQL | Bangalore
Location: Bangalore
Role Summary
We are looking for a Senior Data Engineer with strong hands-on Scala programming experience to design and build scalable, enterprise-grade data platforms on Microsoft Azure.
Scala is the primary programming language for this role. You should have production-level experience developing data engineering solutions using Scala and Apache Spark, along with strong SQL skills and hands-on exposure to Azure data services.
You will translate client requirements into technical designs, build scalable batch and real-time data pipelines, and independently contribute to design discussions around performance, reliability and scalability.
Your Impact
- Design and develop production-grade data engineering solutions using Scala and Apache Spark
- Build scalable data ingestion, integration and transformation pipelines
- Develop batch and real-time/streaming data processing solutions
- Work with Microsoft Azure, particularly services such as Azure Databricks, Azure Data Factory (ADF), Synapse Analytics and Event Hubs
- Write and optimize complex SQL for large-scale data processing
- Design solutions for data storage, computation, analytics, search and aggregation
- Optimize Spark jobs and data pipelines for performance and scalability
- Integrate data from multiple heterogeneous sources
- Contribute to technical design and architecture discussions
- Build reliable and maintainable solutions following data engineering best practices
Your Skills & Experience
- 6–9 years of overall software/data engineering experience
- Minimum 4+ years of hands-on Big Data/Data Engineering experience
- Strong hands-on Scala programming experience
- Production-level experience building data engineering solutions using Scala
- Strong experience with Apache Spark using Scala
- Strong hands-on experience with SQL
- Strong working knowledge of Microsoft Azure
- Hands-on experience with one or more Azure data services such as: Azure Databricks, Azure Data Factory (ADF), Azure Synapse Analytics, Azure Event Hubs
- Experience developing scalable ETL/ELT and data processing pipelines
- Good understanding of distributed data processing and performance optimization
Set Yourself Apart With
- Deep Scala programming skills, beyond simply maintaining existing Spark jobs
- Experience writing clean, reusable and maintainable Scala code
- Strong understanding of the Scala + Spark ecosystem
- Experience optimizing large-scale Spark workloads
- Hands-on experience building production data platforms on Azure
- Experience designing both batch and real-time data pipelines
- Ability to independently participate in technical design and architecture discussions
A Tip from the Hiring Manager
Join the team to sharpen your engineering skills and expand your collaborative approach while directly impacting our clients and their businesses through scalable data solutions.
Company Description
Publicis Sapient is a digital transformation partner helping established organizations reach their digitally enabled future, both in how they work and how they serve their customers.
We help unlock value through a start-up mindset and modern methods, combining strategy, consulting, customer experience, agile engineering and problem-solving creativity. Our people across the globe bring together expertise in technology, data, consulting and customer experience to help accelerate our clients businesses by designing products and services their customers truly value.



