Data engineer

Key Responsibilities:

• Design develop and implement scalable data engineering solutions using modern Big Data technologies
• Build and maintain large scale digital platforms marketplaces and data driven applications
• Work on complex engineering projects utilizing cloud native architectures and distributed systems
• Collaborate with cross functional teams architects and fellow Power Programmers to deliver innovative solutions
• Participate in end to end software development lifecycle activities in Agile environments
• Develop high performance data pipelines and data processing frameworks
• Contribute to the architecture design coding testing and deployment of enterprise solutions
• Co create new products platforms and technology accelerators for clients
• Engage with technology communities open source initiatives and user groups
• Continuously learn and upskill on emerging technologies and industry trends

Technical Requirements:

• Strong experience in Big Data Technologies
• Hands on expertise in
• o Apache Spark
• o Scala
• o Hive
• o Kafka
• Strong understanding of distributed data processing and data pipeline development
• Experience working with cloud platforms and cloud native architectures
• Proficiency in software engineering best practices design patterns and Agile methodologies
• Strong problem solving and analytical skills

Additional Responsibilities:

• Technology Big Data Big Data ALL Technology Big Data Data Processing PySpark Technology Big Data Hadoop Hadoop Hive Technology Data Engineering Databricks Technology Functional Programming Scala Technology Java Apache Kafka Technology OpenSystem Python OpenSystem Python

Preferred Skills:

Technology->Data Engineering->Databricks,Technology->Big Data - Data Processing->PySpark,Technology->Big Data->Big Data - ALL,Technology->Functional Programming->Scala,Technology->OpenSystem->Python - OpenSystem->Python,Technology->Big Data - Hadoop->Hadoop->Hive,Technology->Java->Apache->Kafka