About Position:
We are looking for a skilled Data Engineering Specialist with strong proficiency in Java and Spark to join our dynamic team. In this role, you will design and implement scalable data pipelines, optimize performance, and work on transforming and aggregating data from multiple sources. You will collaborate closely with business stakeholders to understand requirements and deliver reliable, high-quality solutions.
- Role: Data Engineer
- Location: All Persistent Location
- Experience: 10 to 15 Years
- Job Type: Full Time Employment
What You'll Do:
- Design and develop scalable, reliable data pipelines to transform and aggregate data from multiple sources.
- Collaborate with stakeholders to understand business needs and identify appropriate data sources.
- Implement Spark-based solutions leveraging Spark Core, Spark SQL, RDDs, Datasets, and DataFrames.
- Optimize performance using techniques such as coaching, broadcasting, and other Spark optimization strategies.
- Work within Agile/Scrum methodology, participating in ceremonies and ensuring timely delivery.
- Communicate effectively with end clients via email and phone, maintaining professional etiquette.
- Contribute to deployment processes and CI/CD pipelines for smooth integration and delivery.
Expertise You'll Bring:
- Proficiency in Java with a strong understanding of its ecosystems.
- Hands-on experience in Data Engineering using Java and Spark.
- Basic knowledge of Linux and Linux scripting.
- Experience with Git Bash for version control.
- In-depth knowledge of Spark architecture and components (Spark Core, Spark SQL, RDD, Dataset, DataFrame).
- Familiarity with performance tuning and optimization techniques in Spark.
- Understanding of Azure/Cloud concepts and CI/CD pipelines.
- Knowledge of deployment pipeline concepts.
- Experience working in Scrum methodology and Agile practices.
Benefits:
- Competitive salary and benefits package
- Culture focused on talent development with quarterly growth opportunities and company-sponsored higher education and certifications
- Opportunity to work with cutting-edge technologies
- Employee engagement initiatives such as project parties, flexible work hours, and Long Service awards
- Annual health check-ups
- Insurance coverage: group term life, personal accident, and Mediclaim hospitalization for self, spouse, two children, and parents
Values-Driven, People-Centric & Inclusive Work Environment:
Persistent Ltd. is dedicated to fostering diversity and inclusion in the workplace. We invite applications from all qualified individuals, including those with disabilities, and regardless of gender or gender preference. We welcome diverse candidates from all backgrounds.
- We support hybrid work and flexible hours to fit diverse lifestyles.
- Our office is accessibility-friendly, with ergonomic setups and assistive technologies to support employees with physical disabilities.
- If you are a person with disabilities and have specific requirements, please inform us during the application process or at any time during your employment
Let's unleash your full potential at Persistent - persistent.com/careers
Persistent is an Equal Opportunity Employer and prohibits discrimination and harassment of any kind.
