Big Data Developer (Python, Spark, Hive, Impala)

What you will be doing:

• Build the framework and features for business as part of Data Services team
• Design, Develop and Test Big Data Ecosystem components and Solutions (Hive, MapReduce, SQOOP, Spark, HDFS, HBase, Kafka, Impala and Flume for data storage and analysis or other NoSQL technologies)
• Ability to provide technical support and technical quality control for all projects across all phases
• Program implementation skills including project portfolio management and the planning, reporting and directing the work of others across multiple implementation projects concurrently
• Understand the data structure how it is stored, what are the technologies used to store the data, how to fetch the available data in multiple tables, report design by using AG GRID.
• Day to day operations: Ensure All required data sets received and processed, adhoc data requirements deliverables, analysis of the existing listed reports in the UI.

What you bring:

• 7-10 years of experience in Data Warehouse or Reporting Solution, skill -set in Python, Spark, Hive, Impala, Hadoop Architecture and SQL Query.
• Good communication and presentation skills.
• Strong understanding of data flow, process and transformation.
• Good to have Knowledge of Linux.
• Good to have Banking domain experience.
• Knowledge of In-memory computation will be added advantage
• Experience in maintaining technical code standards and version control system.
• Fluency in most IT business architecture areas including business process design and governance.
• Proficiency in fine tuning the jobs for better performance