Big Data Engineer

Bangalore

Opening: 21-Feb-2023

Skills Required: Big Data, SQL, Java, ETL, NiFi, PySpark, Unix shell, Hive, Spark, Ansible, shell scripts, Pig, Go

Experience Required: Must have 3 Years + Experience in relevant field

Educational Qualification: BSc in Computer Science, Engineering or Relevant field ,MCA or BCA

Employment Type: Full Time

Workplace Options: Onsite

Opening Summary

We are seeking a talented and experienced Big Data Engineer with a passion for data management and analytics to join our team. The ideal candidate will have 4+ years of relevant experience with SQL, Hive, Spark and basic Unix shell scripting skills. The candidate must be familiar with ETL (Extract, Transform, Load) processes and be able to work with large data sets.

Requirements

• 4+ years of relevant experience in big data engineering
• Strong proficiency in SQL, Hive, Spark and basic Unix shell scripting
• Solid understanding of ETL processes
• Experience working with large data sets
• Familiarity with data modeling and data warehousing concepts
• Excellent problem-solving skills and attention to detail
• Strong communication skills and ability to work in a team environment
  
  

Responsibilities

• Develop and maintain scalable and high-performance big data solutions
• Design, develop and implement ETL processes
• Perform data analysis and data profiling to ensure data quality and integrity
• Collaborate with cross-functional teams including data scientists, business analysts, and product
• Managers to identify and solve complex business problems
• Develop and maintain documentation, including technical specifications and user guides
• Conduct code reviews and mentor junior team members
  
  

Preferred Qualification

Experience with Pig, Java, Go, NiFi and PySpark Worked on AMEX projects or experience in FSS domain Knowledge of distributed computing, Hadoop ecosystem, and NoSQL databases

Notes

• If you are passionate about big data and are looking for a challenging and rewarding opportunity, we encourage you to apply for this position.