Spark & Kafka Developer

Job Description

Project Description:

You would be responsible for managing technology in projects and providing technical guidance and solutions for work completion.

(1.) To be responsible for providing technical guidance and solutions.

(2.) To ensure process compliance in the assigned module and participate in technical discussions and reviews.

(3.) To prepare and submit status reports for minimizing exposure and risks to the project or closure of escalations.

Responsibilities:

• Involvement in all phases of the development cycle

• Active participation in planning meetings

• Implement new features according to specifications

• Write unit, functional, or integration tests and perform unit testing

• Code review for other team members

• Automate the maintenance work with the development tools

Mandatory Skills Description:

- At least 7 years of experience in ETL Development Area

- Must have working knowledge of Apache Spark and Kafka Framework (kSQL, Mirror Maker, etc.)

- Strong programming skills in at least one of these programming languages (Groovy/Java)

- Good knowledge of Data Structure, ETL Design, and storage. Must have worked in streaming data environments and pipelines.

- Experience working in near-real-time/streaming data pipelines development using Apache Spark