Software Engineer

Wissen Technology

3-5 Years

Bengaluru, India

Posted 10 hours ago
Be among the first 10 applicants

Job Description

About the Role We are seeking an experienced Kafka Administrator with strong Python scripting skills to join our engineering team. The ideal candidate will have hands-on experience in Apache Kafka administration, cluster management, monitoring, troubleshooting, performance tuning, and production support, along with the ability to use Python for automation and operational tooling. The role will involve managing and supporting Kafka environments, ensuring high availability, reliability, scalability, and optimal performance of Kafka clusters. Key ResponsibilitiesAdminister, monitor, and maintain Apache Kafka clusters in development, testing, and production environments.
Manage Kafka brokers, topics, partitions, replication factors, consumer groups, and configurations.
Monitor Kafka cluster health, broker performance, replication status, consumer lag, throughput, and disk utilization.
Troubleshoot Kafka issues related to broker failures, under-replicated partitions, consumer lag, rebalancing, connectivity, performance, and message delivery.
Perform Kafka performance tuning and capacity planning based on workload and growth requirements.
Configure and manage Kafka retention, partitioning, replication, and other topic-level settings.
Manage Kafka security including authentication, authorization, ACLs, and secure communication.
Support Kafka cluster installation, configuration, upgrades, patching, and migration activities.
Implement and maintain monitoring and alerting for Kafka infrastructure.
Develop Python scripts and automation tools for Kafka administration, monitoring, health checks, reporting, and operational activities.
Automate routine administrative and support activities using Python and shell scripting.
Analyze Kafka logs and metrics to identify issues and perform root cause analysis.
Support Kafka producers and consumers by troubleshooting connectivity, configuration, throughput, and consumer-group related issues.
Collaborate with Application Development, DevOps, Infrastructure, QA, and Production Support teams.
Participate in production incident management, troubleshooting, and resolution.
Maintain operational documentation, configuration standards, and runbooks.
Follow best practices for Kafka availability, reliability, scalability, security, and disaster recovery.
Must-Have Skills3–5 years of hands-on experience with Apache Kafka administration and production support.
Strong understanding of Kafka architecture, including brokers, controllers, topics, partitions, replicas, producers, consumers, and consumer groups.
Hands-on experience with Kafka cluster administration and configuration.
Strong experience troubleshooting Kafka issues in production environments.
Good understanding of partitioning, replication, ISR, leader election, retention, consumer offsets, and consumer lag.
Experience with Kafka monitoring, metrics, alerting, and performance troubleshooting.
Experience managing Kafka topics, partitions, consumer groups, and broker configurations.
Understanding of Kafka security, ACLs, authentication, authorization, and SSL/TLS.
Experience with Python scripting for automation and operational tasks.
Good understanding of Linux/Unix environments and command-line tools.
Experience with Shell/Bash scripting.
Experience with Git and version control practices.
Strong debugging, troubleshooting, and problem-solving skills.
Good understanding of networking concepts relevant to Kafka, including TCP/IP, ports, DNS, and connectivity troubleshooting.
Good-to-Have SkillsExperience with Kafka Connect and/or Kafka Streams.
Experience with Confluent Kafka / Confluent Platform.
Experience with ZooKeeper-based and/or KRaft-based Kafka environments.
Experience with monitoring tools such as Prometheus, Grafana, Datadog, Splunk, or ELK.
Experience with Docker and Kubernetes.
Experience managing Kafka on AWS, Azure, or GCP.
Knowledge of cloud-managed Kafka services such as Amazon MSK, Confluent Cloud, or Azure Event Hubs.
Understanding of Kafka disaster recovery, backup/restore, replication, and multi-cluster architectures.
Experience with CI/CD and infrastructure automation.
Familiarity with databases such as PostgreSQL, MySQL, MongoDB, or similar technologies.
Preferred QualificationsBachelor's degree in Computer Science, Information Technology, or a related field.
Experience supporting high-volume, mission-critical Kafka environments.
Experience working in Agile/Scrum environments.
Strong communication and stakeholder management skills.
Ability to work effectively with development, infrastructure, DevOps, and production support teams.

More Info

Job Type:

Permanent Job

Industry:

Other

Function:

Information Technology

Employment Type:

Full time

About Company

Wissen Technology

Job ID: 152608895

Jobs by Skill - IT

Jobs by Skill - Non IT

International Jobs

Last Updated: 21-08-2026 09:57:21 PM

Homejobs in Bengaluru / BangaloreSoftware Engineer

Similar Jobs

Lead Software Engineer|9-12 Yrs|Bangalore,Chennai,Hyderabad,Pune

Capgemini

5-8 yrs

Hyderabad, Chennai, Bengaluru, Pune, India

Skills:

.Net Core, .NET 8, SQL Server, Css3, Microservices, Angular, Typescript, Html5, Azure Cloud Services, Microsoft Azure, Restful Apis, Angular Material, Azure DevOps, ASP.NET Core

Principal Software Engineer – Generative AI & Agentic Platforms

Infosys Limited

7-9 yrs

Bengaluru, India

Skills:

Java, Vue, React, Big Data, Angular, Gcp, Javascript, Software Engineering, C, Programming Languages, AWS, Ruby, Python, Azure, fine tuning, RAG techniques, OpenAI, security considerations, Hugging Face, embedding models, Privacy, LangChain, guardrail techniques, AWS Bedrock, responsible AI, LangGraph, Evaluation, Go, LLM frameworks, vector databases, SageMaker, prompt engineering