Kafka Professional

Key Responsibilities

Kafka Cluster Administration

• Install, configure, and manage Kafka clusters in production environments
• Ensure high availability, fault tolerance, and optimal performance of Kafka systems
• Monitor cluster health, brokers, topics, partitions, and consumer groups

Performance Tuning & Troubleshooting

• Identify and resolve performance bottlenecks in Kafka and middleware systems
• Perform root cause analysis for production issues and outages
• Optimize throughput, latency, and resource utilization across clusters

Operational Support (24/7 Environment)

• Provide L2/L3 production support with on-call responsibilities
• Ensure continuous system availability and quick incident resolution
• Handle escalations and critical production incidents

Automation & Scripting

• Develop automation scripts using Shell scripting and/or Python
• Implement infrastructure-as-code (IaC) practices for provisioning Kafka infrastructure
• Automate routine operational tasks to improve efficiency and reliability

Middleware & Cloud Integration

• Support integration of Kafka with enterprise middleware systems
• Work with Java-based application servers deployed on cloud platforms
• Ensure smooth data flow across distributed systems and applications

Monitoring & Maintenance

• Implement and manage monitoring tools for Kafka cluster observability
• Track system metrics, logs, and alerts to proactively identify issues
• Maintain documentation for system configurations and operational procedures

Collaboration & Stakeholder Support

• Work closely with development, DevOps, and infrastructure teams
• Support application teams in Kafka topic design and usage
• Participate in architecture discussions for scalable data streaming solutions