Job Description: Hive and NiFi Developer
Position Title: Hive and NiFi Developer
Experience Required: 3-8 Years
Compensation Range: 11,00,000 - 12,00,000 per annum
About the Role:
We are looking for a talented Hive and NiFi Developer to join our data engineering team. The role involves developing, maintaining, and optimizing data workflows using Hive, NiFi, Spark, and cloud technologies to ensure efficient data processing and integration.
Key Responsibilities:
- Data Workflow Development: Design, develop, and maintain data workflows using Hive and NiFi.
- Data Processing: Implement data processing solutions using Spark to handle large volumes of structured and unstructured data.
- Cloud Integration: Utilize cloud technologies to enhance data workflows and ensure scalable, reliable data solutions.
- Performance Optimization: Optimize Hive queries and Spark jobs for performance and scalability.
- Data Integration: Integrate various data sources into the data pipeline, ensuring seamless data flow and consistency.
- Troubleshooting: Identify and resolve issues related to data workflows and processing, ensuring smooth operations and minimal downtime.
- Code Quality: Write clean, maintainable, and efficient code, following best practices and coding standards.
- Collaboration: Work closely with data scientists, analysts, and other developers to understand data requirements and deliver high-quality solutions.
- Documentation: Maintain comprehensive documentation of data workflows, code, and system configurations.
- Continuous Learning: Stay updated with the latest industry trends and technologies in data engineering and apply them to improve existing solutions.
Qualifications:
- Educational Background: Bachelor's degree in Computer Science, Information Technology, or a related field.
- Experience: 3-8 years of experience in data engineering with a focus on Hive, NiFi, and Spark.
Skills:
- Proficiency in Hive and NiFi for data workflow development.
- Strong knowledge of Spark for data processing.
- Experience with cloud technologies for data integration and processing.
- Familiarity with ETL processes and data integration techniques.
- Excellent problem-solving and troubleshooting skills.
- Strong communication and collaboration abilities.
Industry: Information Technology
