Senior Hadoop DevOps Engineer (CI/CD | OpenShift)

Job Description:

Job Title: Senior Hadoop DevOps Engineer (CI/CD | OpenShift)

Location: Bangalore

Work mode: Onsite

Experience: Minimum 8 years

Hands on Tier – 2 production experience with Cloudera:

o Installing and maintenance

o Enabling security requirements for CDP

o Optimizing cluster performance

o Working with data engineers to optimize Spark job performance

o Automation – Ansible, data/analytics jobs CI/CD

o Observability

• Installation, configuration and maintenance of the CDP latest version of CDP 7.1.9 or CDP latest version experience with Cloudera data services 1.5.4 and 1.5.5

• Trouble shooting the Spark job , Hive Jobs and Yarn jobs

• CDP Containerization with data services

• experience in writing automation using Shell, Terraform, Groovy and

Ansible.

• Automated pipelines/workflows (GitHub Actions, Jenkins, ArgoCD etc.) for

data projects. Python based preferred.

• Automating security/regulatory checks

• Automated patching

• Containerization – Podman, Docker, OCP ,

• Container Management – Kubernetes/OpenShift

• Linux OS & Networking basics

• Source control (git)

• Agile engineering and practices

If interested please share CV's - [Confidential Information]