Kafka Admin

Key Responsibilities

• Stand up, configure, and administer on-premise Kafka clusters.
• Architect and create reference architecture and implementation standards for Kafka.
• Provide expertise in Kafka brokers, Zookeeper, Kafka Connect, Schema Registry, KSQL, REST Proxy, and Kafka Control Center.
• Ensure optimum performance, high availability, and stability of Kafka solutions.
• Create topics, set up redundancy clusters, deploy monitoring tools, and configure alerts.
• Provide stubs for producers, consumers, and consumer groups for onboarding applications from multiple platforms/languages.
• Administer Kafka platform including provisioning, access lists, Kerberos, and SSL configurations.
• Automate deployments using Docker, Jenkins, GitLab, and other automation tools.
• Perform data benchmarking, performance analysis, and tuning of Kafka clusters.
• Participate in design and capacity review meetings and provide recommendations for Kafka usage.
• Set up monitoring, alerting, and fine-tuning using Splunk, Prometheus, Grafana, or similar tools.
• Implement security measures, naming conventions, backup & recovery, and problem resolution strategies.
• Monitor, prevent, and troubleshoot security-related issues.
• Provide strategic vision for messaging queue infrastructure and ensure best practices are followed.
• Support 24x7 operations and participate in rotational on-call schedules.