Kafka Admin

Job Description:

• We are seeking a skilled and motivated Kafka Administrator to manage maintain and optimize our Apache Kafka clusters
• The ideal candidate will have hands on experience in deploying configuring and monitoring Kafka environments ensuring high availability reliability and performance of data streaming systems
• You will collaborate with development DevOps and infrastructure teams to support real time data pipelines and streaming applications

Key Responsibilities:

• Install configure and manage Apache Kafka clusters in production and non production environments
• Monitor Kafka cluster health performance and capacity using tools such as Prometheus Grafana or similar
• Perform cluster tuning and optimization to ensure high throughput and low latency
• Manage Kafka topics partitions brokers replication and retention policies
• Implement and maintain data security including authentication SASL authorization ACLs and encryption SSL TLS
• Troubleshoot and resolve Kafka related issues including broker failures consumer lag and data inconsistencies
• Automate routine tasks using scripting Shell Python etc
• and configuration management tools
• Work closely with development teams to design scalable and fault tolerant data streaming solutions
• Perform upgrades patching and maintenance with minimal downtime
• Ensure backup and disaster recovery mechanisms for Kafka clusters
• Maintain documentation for configurations processes and troubleshooting guides

Technical Requirements:

• 2 5 years of experience working with Apache Kafka administration support
• Strong understanding of distributed systems and messaging architectures
• Hands on experience with Kafka ecosystem tools Zookeeper KRaft Kafka Connect Kafka Streams
• Experience with monitoring tools such as Prometheus Grafana or ELK stack
• Knowledge of Linux Unix systems administration
• Familiarity with cloud platforms like AWS Azure or GCP
• Experience with containerization and orchestration tools Docker Kubernetes is a plus
• Understanding of data pipelines ETL processes and streaming concepts
• Strong troubleshooting and analytical skills
• Good scripting knowledge Bash Python or similar

Additional Responsibilities:

• Bachelor s degree in Computer Science Information Technology or a related field

Preferred Skills: