Big Data Developer

Job Title Big Data Developer

Location BLR hybrid (could be fully onsite)

Interview rounds 2-3 max

Contract length 1 year

Tip SQL & Scala/Spark combination good to have. Snowflake DBT mandatory.

Job description:

3 years of hands-on Spark SQL, Scala, Python programming

Strong knowledge and at least 2 years experience of SQL (Hive, Postgres, HWC tables)

Candidates must have strong verbal, written and communication skills

Good to have skillset

DBT, Snowflake Development experience

Experience with on-premises environments Cloudera and Cloud AWS and Azure.

Experience with Airflow.

Experience with Clinical data

Agile and Lean SDLC process

Experience with Java and batch scripts

Key Responsibilities -

Produce clean, efficient code based on specifications.

Troubleshoot, debug and enhance code based on need

Create the rules for data mapping, transformation and enrichment to meet the requirements.

Perform informal testing of the rules and unit test

Recommend, review and execute improvements.

Participate in peer review of deliverables such as code, designs, and test plans.

Create technical/functional documentation as needed.

Assist with the design and development of software solutions requiring general domain knowledge and limited business experience.

Work at all layers of the application stack, including front-end user interface and backend development.

Troubleshoot code issues and evolve platforms to meet user requirements and needs.

Participate in the review of functional specifications and other validation deliverables as assigned.

Develop an introductory understanding of industry and quality standards.

Support development projects based on specific instructions and with limited discretion.

MINIMUM REQUIRED EDUCATION AND EXPERIENCE

• Candidates should possess a bachelor's degree and have a minimum of 3 years of Spark, Scala, Python programming and development experience