Job Summary
We are seeking a highly skilled DevOps Hadoop Engineer to design, implement, and manage scalable infrastructure and big data platforms. The ideal candidate will have strong expertise in DevOps practices, CI/CD automation, container orchestration, infrastructure automation, and distributed data technologies. This role requires close collaboration with development, operations, and data engineering teams to deliver secure, reliable, and high-performing enterprise solutions.
Job Summary
We are seeking a highly skilled DevOps Hadoop Engineer to design, implement, and manage scalable infrastructure and big data platforms. The ideal candidate will have strong expertise in DevOps practices, CI/CD automation, container orchestration, infrastructure automation, and distributed data technologies. This role requires close collaboration with development, operations, and data engineering teams to deliver secure, reliable, and high-performing enterprise solutions.
Key Responsibilities
- Design, implement, and maintain CI/CD pipelines using Jenkins, GitOps, and other DevOps tools to streamline software delivery.
- Deploy, configure, and manage containerized applications using Kubernetes and OpenShift.
- Develop and maintain Infrastructure as Code (IaC) solutions using Terraform, Ansible, or similar automation tools.
- Architect, implement, and support big data platforms utilizing Hadoop, Spark, and Kafka technologies.
- Design and manage distributed data architectures to ensure scalable, reliable, and efficient data processing.
- Collaborate with Development, Operations, and Data Engineering teams to understand business requirements and deliver robust solutions.
- Implement monitoring, logging, and alerting solutions to ensure platform stability and operational excellence.
- Optimize system performance, scalability, and reliability across infrastructure and data platforms.
- Ensure adherence to security standards, governance policies, and regulatory compliance requirements.
- Troubleshoot production issues and provide timely resolution for critical incidents.
Required Skills
DevOps & Automation
- Jenkins
- GitOps
- CI/CD Pipeline Management
- Infrastructure Automation
- Terraform
- Ansible
Containerization & Orchestration
- Kubernetes
- OpenShift
- Docker
Big Data Technologies
- Hadoop Ecosystem
- Apache Spark
- Apache Kafka
Platform & Infrastructure
- Linux Administration
- Distributed Systems
- Infrastructure Management
- Performance Tuning
- Monitoring & Observability
Security
- Security Best Practices
- Compliance & Governance Standards
Required Experience
- DevOps and CI/CD: Design, implement, and manage CI/CD pipelines using tools like Jenkins and GitOps to automate and streamline the software development lifecycle.
- Containerization and Orchestration: Deploy and manage containerized applications using Kubernetes and OpenShift, ensuring high availability and scalability.
- Infrastructure Management: Develop and maintain infrastructure as code (IaC) using tools like Terraform or Ansible.
- Big Data Solutions: Architect and implement big data solutions using technologies such as Hadoop, Spark, and Kafka.
- Distributed Systems: Design and manage distributed data architectures to ensure efficient data processing and storage.
- Collaboration
- Work closely with development, operations, and data teams to understand requirements and deliver robust solutions.
- Monitoring and Optimization: Implement monitoring solutions and optimize system performance, reliability, and scalability. Security and Compliance: Ensure infrastructure and data solutions adhere to security best practices and regulatory requirements.
Preferred Qualifications
- Experience working in BFSI or highly regulated environments.
- Exposure to cloud platforms such as Azure, AWS, or GCP.
- Relevant certifications in Kubernetes, DevOps, Cloud, or Hadoop technologies.
- Experience with monitoring tools such as Prometheus, Grafana, ELK, or Splunk.
Why Join Us
- Opportunity to work on enterprise-scale Big Data and cloud-native platforms.
- Exposure to cutting-edge DevOps and automation technologies.
- Collaborative and innovation-driven work environment.
- Career growth opportunities within a global technology organization.
Interested candidates can apply by submitting their updated resume through the career portal.
