Specialist - Data Engineering

Role Hadoop GCP Data Engineer

Exp 4 years

Location Pune

Mandatory Skills

Must have good experience in below tech stack

oHadoop

oHive

oHDFS

oApache Spark

oScala

oGCP

oJenkins

oAirflow

oSQL

Hands on experience on Data migration and data processing on the Google Cloud stack specifically

oBig Query

oCloud Dataflow

oCloud DataProc

oCloud Storage

oCloud DataPrep

oCloud PubSub

oCloud Composer Airflow

Must have understanding Scala

Experience designing and deploying large scale distributed data processing systems with few technologies such as PostgreSQL or equivalent databases SQL Hadoop Spark Tableau

Proven ability to define and build architecturally sound solution designs

Demonstrated ability to rapidly build relationships with key stakeholders

Experience of automated unit testing automated integration testing and a fully automated build and deployment process as part of DevOps tooling

Must have the ability to understand and develop the logical flow of applications on technical code level

Strong interpersonal skills and ability to work in a team and in global environments

Should be proactive have learning attitude adjust to work in dynamic work environments

Exposure in Enterprise Data Warehouse technologies

Exposure in a customer facing role working with enterprise clients

Experience with industry standard version control tools Git GitHub automated deployment tools Ansible Jenkins and requirement management in JIRA

Exposure to DevOps Agile Project methodology such as Scrum and Kanban

Understanding of big data modelling techniques using relational and nonrelational techniques

Experience on Debugging the Code issues and then publishing the highlighted differences to the development teamArchitects

Understanding or experience of Cloud design patterns

Good to have Google Cloud Certification