Hadoop Administrator

Top Skills Required

• Linux
• Hadoop
• Cloudera CDP
• Cluster Management
• Troubleshooting
• Performance Tuning
• Kubernetes

About this Role:

• Installation of on‑prem Hadoop clusters from scratch on bare metal or VMs
• Hardware sizing and capacity planning (CPU, memory, storage, network)
• Operating system preparation and tuning (RHEL 6/7/8, kernel, filesystem, ulimits)
• Deployment and lifecycle management of Cloudera platforms (HDP, CDH, CDP) using Cloudera Manager and Ambari
• In‑place and rolling upgrades, including HDP to CDP migrations
• Control node and OS migration as part of hardware or platform refresh
• Administration of Hadoop ecosystem components:
• HDFS, YARN, Hive, Zookeeper, NiFi, Solr
• On‑prem cluster operations:
• Node commissioning and decommissioning
• HDFS balancing, snapshots, trash management
• User and quota management
• Metadata and data backup and recovery
• Enterprise security implementation:
• Kerberos integration with Active Directory
• Ranger authorization and auditing
• KMS encryption zones (data at rest)
• TLS/SSL configuration (data in motion)
• Performance tuning and reliability:
• YARN scheduler and queue configuration
• Capacity planning and workload optimization
• Production incident management and Root Cause Analysis (RCA)