Hadoop Administrator (Linux / System Administrator)

Role: Manage, monitor and troubleshoot multi-node Hadoop clusters and Linux server environments, and support Data Scientists and Data Engineers.

Key Responsibilities

• Install, configure, maintain and upgrade Hadoop components (HDFS, YARN, Hive, HBase, Spark, Oozie, ZooKeeper).
• Perform HDP-to-Apache Hadoop migration and manage multi-node clusters.
• Administer Linux servers: users, permissions, disk, patching and troubleshooting.
• Monitor cluster health and performance using Ambari, Cloudera Manager and Linux utilities.
• Implement Kerberos security, backup, recovery and disaster recovery.
• Automate tasks using Shell scripting, Python and cron.
• Support RStudio Server, JupyterHub and Docker; resolve job failures.