Senior Data Engineer

5-7 Years

This job is no longer accepting applications

Job Description

Responsibilities

Design, build, and test ETL processes using Python and SQL
Develop Python scripts to extract information from different data sources for business analytics
Build and maintain high-performance, reusable, and reliable Java/Python code
Create secure RESTful-based web services using XML, JSON, JavaScript, and jQuery
Work on data pipelines and data-centric applications using distributed storage platforms
Implement process automation using Python, VBA, and appropriate technologies
Collaborate with senior developers to implement Python code
Design, develop, and integrate Java services using the Spring Boot framework
Build and deploy ML models using Python on platforms like SageMaker or Azure ML
Identify and resolve performance issues in data systems
Support installation, configuration, and implementation of Java-based technologies
Collaborate with highly skilled Data Science teams to provide the best possible solutions for clients

Requirements

Bachelor's in Electrical Engineering or Computer Science required
5+ years of industry experience with hands-on experience in Apache technologies
Expertise in Python with knowledge of the Django web framework
Proficient in Java with strong fundamentals in object-oriented programming
Experience in creating test automation using Java/.NET, Selenium, etc.
Strong background in core Java, Spring framework, microservices, and Spring Boot
Knowledge of popular design patterns and Java frameworks
Ability to perform complex data analysis on large volumes of data
Experience with containerization using Docker and Kubernetes
Working knowledge of Linux/Unix administration and scripting languages like Python, Shell, etc.
Familiarity with relational databases and web-based data sources
Hands-on experience with MongoDB, MySQL, Java, JavaScript, etc.
Strong understanding of big data domains like Hadoop/MapReduce and ETL architectures

Desired Skills

Education

Bachelor's or Master's in Computer Science or a related technical discipline
Familiarity with software engineering skills including Java, Spark, Python, Scala, etc.