Kafka Admin

Responsibilities :

Key Responsibilities:

Administer and support Kafka clusters, ensuring high availability, reliability, and performance across environments.

Perform Kafka broker provisioning, configuration, upgrades, patching, and capacity planning aligned to platform standards.

Manage topics, partitions, replication factors, retention policies, quotas, and ACLs based on application needs and governance guidelines.

Monitor cluster health and performance, analyze metrics/logs, and proactively address bottlenecks (latency, throughput, ISR issues).

Troubleshoot production incidents, perform root cause analysis, and drive corrective and preventive actions.

Support Confluent components as applicable (e.g., Schema Registry, Kafka Connect) and ensure smooth integration with client teams.

Implement and maintain security controls including authentication/authorization and secure configurations for data-in-motion.

Automate operational tasks and standardize runbooks, alerts, and operational procedures to improve platform efficiency.

Collaborate with application teams on onboarding, best practices, and performance tuning for producers/consumers.

Maintain documentation for architecture, configurations, operational processes, and change management activities.

Additional Responsibilities:

Minimum Qualifications:

Bachelor's degree (or equivalent) in Engineering/Computer Science/IT (BTech/BE/MCA/MSc or similar).

3-5 years of overall experience with at least 3 years in Kafka administration and operations.

Hands-on exerience administering Apache Kafka clusters, including configuration, scaling, and upgrades.

Working knowledge of Confluent platform components and operational practices.

Strong troubleshooting skills in distributed systems and experience handling production support and incident management.

Familiarity with Linux fundamentals, networking basics, and log/metric-based monitoring for platform health. Preferred Qualifications:

Experience operating Confluent Platform in enterprise environments, including Schema Registry and Kafka Connect administration.

Proven ability to tune Kafka performance (broker configs, partition strategy, replication, retention) for high-throughput workloads.

Experience implementing security best practices (ACLs, authentication/authorization) and aligning with governance requirements.

Exposure to automation and scripting to streamline Kafka operations and reduce manual effort.

Strong collaboration skills to guide producer/consumer teams on onboarding, standards, and operational readiness. Good to have skills: Kafka Connect, Schema Registry, Prometheus, Grafana

Technical and Professional Requirements:

Primary skills:Technology- Cloud Platform- AWS Data Analytics- Amazon Managed Streaming for Apache Kafka