About the Role
The role involves hands-on knowledge of SPARK, Scala, Java, and RDBMS like MS-SQL/Oracle, along with an understanding of CI/CD tools like uDeploy. Knowledge of Vanguard and its landscape will be an additional advantage.
Responsibilities
- Development & Optimization: Develop, test, and deploy production-grade Spark applications in Scala, ensuring optimal performance, scalability, and resource utilization.
- Technical Leadership: Provide technical leadership and guidance to a team of data engineers, fostering a culture of technical excellence, collaboration, and continuous improvement.
- Code Review & Best Practices: Conduct rigorous code reviews, establish coding standards, and enforce best practices for Spark Scala development, data governance, and data quality.
- Performance Tuning: Identify and resolve performance bottlenecks in Spark applications through advanced tuning techniques (e.g., shuffling, partitioning, memory management, caching).
Qualifications
- Total Experience: 6-8 years
- Notice Period: Immediate to 30 days
Required Skills
- SPARK
- Scala
- Java
- RDBMS like MS-SQL/Oracle
Preferred Skills
- Knowledge of CI/CD tools like uDeploy
- Cloud OpenShift/AWS
