Senior Data Engineer

• Design, develop, and test the deployment and operation phases of the Enterprise Data Platform for both current and future projects.
• Review, build, or restructure data architecture and ensure its ongoing maintenance and testing.
• Establish and implement best practices for data management, reporting, and security.
• Enhance foundational data procedures, guidelines, and standards.
• Evaluate datasets to identify opportunities for improving data reliability, efficiency, and quality.
• Understand, design, acquire, and manage organizational datasets that support analytics to meet business objectives.
• Optimize data retrieval processes to aid in the creation of dashboards and other visualizations for stakeholders.
• Prepare core data for use in prescriptive and predictive modelling.

Requirements

• Degree in Computer Science, Computer Engineering or a related field
• Over 6 years expertise of Data Engineering  
• Experience with big data frameworks (e.g. Hadoop, Spark) and distributions (Cloudera, Hortonworks, MapR) 
• Experience with NoSQL databases (e.g. Cassandra, MongoDB, Neo4J, ElasticSearch) 
• Experience with querying tools (e.g Hive, Spark SQL, Impala)
• Strong analytical prowess, problem-solving abilities, and decision-making capabilities.
• Excellent written and verbal communication skills for effective collaboration and documentation