About Position:
The role involves managing and supporting Hadoop‑based data pipelines with hands‑on work across Linux, SQL Server, ETL processes, and Big Data environments.
- Role: Hadoop Data Engineer
- Location: Pune
- Experience: 7 to 9 years
- Job Type:Full Time Employment
What You'll Do:
- Be responsible for monitoring and executing data loads.
- Manage and execute monthly/quarterly Hadoop‑based data pipelines.
- Work with HDFS, Hive, and other Hadoop ecosystem components for data processing and maintenance.
- Execute Linux commands, manage file systems, and develop/maintain shell scripts for automation.
- Monitor ETL batch loads, identify failures, and perform root‑cause analysis.
- Troubleshoot issues across Unix systems, SQL Server environments, and pipeline components.
- Work with SQL Server features, including archival processes and database‑related operational tasks.
- Modify or enhance ETL workflows based on evolving business or technical requirements.
- Write, optimize, and troubleshoot SQL queries, including joins, window functions, and performance tuning.
- Collaborate with cross‑functional teams to ensure timely delivery and smooth workflow.
Expertise You'll Bring:
- Strong hands‑on experience with Hadoop components.
- Experience working in Linux environments.
- Experience with SQL Server.
- Experience with ETL pipelines.
- Ability to debug issues across Unix, SQL environments, and Big Data environments.
- Experience supporting enhancements to existing pipelines.
Benefits:
- Competitive salary and benefits package
- Culture focused on talent development with quarterly growth opportunities and company-sponsored higher education and certifications
- Opportunity to work with cutting-edge technologies
- Employee engagement initiatives such as project parties, flexible work hours, and Long Service awards
- Annual health check-ups
- Insurance coverage: group term life, personal accident, and Mediclaim hospitalization for self, spouse, two children, and parents
Values-Driven, People-Centric & Inclusive Work Environment:
Persistent is dedicated to fostering diversity and inclusion in the workplace. We invite applications from all qualified individuals, including those with disabilities, and regardless of gender or gender preference. We welcome diverse candidates from all backgrounds.
- We support hybrid work and flexible hours to fit diverse lifestyles.
- Our office is accessibility-friendly, with ergonomic setups and assistive technologies to support employees with physical disabilities.
- If you are a person with disabilities and have specific requirements, please inform us during the application process or at any time during your employment
Let's unleash your full potential at Persistent
Persistent is an Equal Opportunity Employer and prohibits discrimination and harassment of any kind.
