Job Description:

We are seeking a skilled and motivated Kafka Administrator to manage maintain and optimize our Apache Kafka clusters
The ideal candidate will have hands on experience in deploying configuring and monitoring Kafka environments ensuring high availability reliability and performance of data streaming systems
You will collaborate with development DevOps and infrastructure teams to support real time data pipelines and streaming applications

Key Responsibilities:

Install configure and manage Apache Kafka clusters in production and non production environments
Monitor Kafka cluster health performance and capacity using tools such as Prometheus Grafana or similar
Perform cluster tuning and optimization to ensure high throughput and low latency
Manage Kafka topics partitions brokers replication and retention policies
Implement and maintain data security including authentication SASL authorization ACLs and encryption SSL TLS
Troubleshoot and resolve Kafka related issues including broker failures consumer lag and data inconsistencies
Automate routine tasks using scripting Shell Python etc
and configuration management tools
Work closely with development teams to design scalable and fault tolerant data streaming solutions
Perform upgrades patching and maintenance with minimal downtime
Ensure backup and disaster recovery mechanisms for Kafka clusters
Maintain documentation for configurations processes and troubleshooting guides

2 5 years of experience working with Apache Kafka administration support
Strong understanding of distributed systems and messaging architectures
Hands on experience with Kafka ecosystem tools Zookeeper KRaft Kafka Connect Kafka Streams
Experience with monitoring tools such as Prometheus Grafana or ELK stack
Knowledge of Linux Unix systems administration
Familiarity with cloud platforms like AWS Azure or GCP
Experience with containerization and orchestration tools Docker Kubernetes is a plus
Understanding of data pipelines ETL processes and streaming concepts
Strong troubleshooting and analytical skills
Good scripting knowledge Bash Python or similar

Technology->Java->Apache->Kafka