Job Title: Hadoop Data Engineer
Location: Hyderabad
Experience: 6–10 Years
Preferred *Immediate joiners*
Job Summary
We are looking for an experienced Hadoop Data Engineer with 6–10 years of hands-on experience in designing, developing, and maintaining large-scale data processing solutions using the Hadoop ecosystem. The ideal candidate should have strong expertise in big data technologies, ETL development, distributed computing, and data engineering best practices. The role involves building scalable data pipelines, optimizing data processing workflows, and collaborating with cross-functional teams to deliver high-quality data solutions.
Key Responsibilities
- Design, develop, and maintain scalable ETL pipelines for processing large volumes of structured and unstructured data.
- Build and optimize big data solutions using the Hadoop ecosystem.
- Develop data processing applications using MapReduce and PySpark.
- Manage and maintain HDFS storage, file organization, and data lifecycle.
- Write efficient Python scripts for automation, data transformation, and orchestration.
- Develop complex SQL queries, stored procedures, and data validation scripts.
- Perform data cleansing, transformation, and integration from multiple source systems.
- Monitor and troubleshoot production data pipelines to ensure high availability and performance.
- Optimize Hadoop cluster performance and resource utilization.
Required Qualifications
- Bachelor's or Master's degree in Computer Science, Information Technology, Engineering, or a related field.
- 6–10 years of experience in Data Engineering and Big Data technologies.
- Strong experience in Hadoop ecosystem components.
- Hands-on expertise with Hive, HDFS, MapReduce, HBase, Sqoop, PySpark, Python, SQL, and ETL pipeline development.
- Experience handling large-scale distributed data processing.
- Strong analytical, debugging, and problem-solving skills.
- Excellent communication and stakeholder management skills.
Preferred Experience
- Experience with enterprise-scale data platforms.
- Experience working in Agile/Scrum environments.
- Exposure to cloud-based big data platforms.
Regards,
Manvendra Singh
[Confidential Information]
