Search by job, company or skills

H

Hadoop Admin - SRE

5-10 Years
new job description bg glownew job description bg glownew job description bg svg
  • Posted 10 hours ago
  • Be among the first 10 applicants
Early Applicant
Quick Apply

Job Description

Key Responsibilities:

  • Administer, monitor, and support the Hadoop ecosystem including HDFS, YARN, Hive, HBase, Spark, Kafka, and related big data services.
  • Manage and maintain Spark workloads for both batch and streaming applications, ensuring performance and resource efficiency.
  • Deploy, manage, and troubleshoot Hadoop/Spark clusters on Kubernetes platforms.
  • Ensure site reliability by implementing proactive monitoring, alerting, incident response, and root cause analysis (SRE best practices).
  • Automate infrastructure provisioning, configuration, and application deployments using Infrastructure as Code (IaC) and scripting.
  • Monitor system performance and plan capacity to optimize cluster resource utilization.
  • Manage AWS infrastructure components including EC2, S3, EKS (Kubernetes), IAM, VPC, and other cloud services.
  • Implement security best practices such as Kerberos, access controls, encryption, and service authentication.
  • Perform cluster upgrades, patching, backups, and disaster recovery planning and execution.
  • Collaborate with data engineering, DevOps, and application teams for seamless integration and operations.
  • Provide L2/L3 production support and participate in oncall rotations for critical incident handling.

More Info

Job Type:
Function:
Employment Type:
Open to candidates from:
Indian

About Company

Data & Strategy for your Talent, Market, R&D, and Growth Founded in 2003, Han Digital offers suite of strategic consulting and talent advisory to Fortune500 customers across Software/IT, BFSI, Semicon, Telco, Healthcare, and Engineering verticals. Our expertise spans Global Talent Intelligence, Market Research, GenAI Data Solutions, GCC Programs, Strategic Consulting, Executive Search and Talent Solutions. Our Core Focus Areas: 1.Global Capability Centers (GCCs), ER&D, and IT Pioneers: We offer a comprehensive strategic consulting suite for GCCs, ER&D, IT players, and tech startups in India, the Philippines & emerging ITBPM markets to scale and transform their businesses. 2.AI/MLOps Data Solutions: We empower GenAI players with all data annotation, content moderation, image sourcing, and data labeling, to enhance customer agility and innovation. 3.Executive Search and Hiring Solutions: Our executive search, specialized niche skill hiring and staffing cater specifically to the IT-BPM industry, helping you to find and hire the right talent. 4.Industry Research: We benchmark and provide custom market research to solve complex business problems related to the market, competition and growth. Why Han Digital •Proven Expertise: 20 years of expertise in talent intelligence and tracking over 15,000 niche technology skills. •Innovative Solutions: Offering scalable AI/MLOps data solutions to drive innovation and elevate customer experiences in the future of GenAI. •Hiring Partnerships: Yearly over 100,000 candidates and 5,000 job roles handled, helping niche technology and semiconductor hiring for Fortune 500 customers. Our Commitments to Excellence: At Han Digital, we believe in staying ahead of market trends through proven domain expertise and strong thought leadership.

Job ID: 139128085