Data Engineer

Role & responsibilities

What You'll Do

Build the underneath data platform and maintain data processing pipelines using best in class technologies.

Special focus on R&D to challenge status-quo and build the next generation data mesh that is efficient and cost effective.

Translate complex technical and functional requirements into detailed designs.

Who You Are

• Strong programming skills(Python, Java, and Scala)
• Experience writingSQL, structuring data, and data storage practices
• Experience with data modeling
• Knowledge of data warehousing concepts
• Experienced building data pipelines and micro services
• Experience withSpark,Airflowand other streaming technologies to process incredible volumes of streaming data
• A willingness to accept failure, learn and try again
• An open mind to try solutions that may seem impossible at first
• Strong understanding of data structures, algorithms, multi-threaded programming, and distributed computing concepts
• Experience working on Amazon Web Services-AWS(EMR, Kinesis, RDS, S3, SQS and the like)

Preferred candidate profile

At least6+ yearsof professional experience as a software engineer or data engineer

Education: Bachelor's degree or higher in Computer Science, Data Science, Engineering, or a related technical field.