Kafka Engineer - Bangalore or Hyderabad - Immediate Joiners - WFO

Job Title:Kafka Engineer

Experience: 6-11 yrs

Location: Hyderabad or Bangalore (WFO-24*7 Shift)

Job Summary:

We are seeking an experienced Kafka Engineer with hands-on expertise in Confluent Kafka, Kafka on Cloud (MSK or Confluent Cloud), and strong proficiency in AWS services. The ideal candidate will be responsible for designing, implementing, and maintaining scalable event-streaming architectures that support our real-time data needs.

Role and Responsibilities:

1. Design, build, and manage Kafka clusters usingConfluent PlatformandKafka Cloud services (AWS MSK, Confluent Cloud).
2. Develop and maintainKafka topics, schemas (Avro/Protobuf), and connectorsfor data ingestion and processing pipelines.
3. Monitor and ensure the reliability, scalability, and security of Kafka infrastructure.
4. Collaborate with application and data engineering teams to integrate Kafka with other AWS-based services (e.g., Lambda, S3, EC2, Redshift).
5. Implement and manageKafka Connect,Kafka Streams, andksqlDBwhere applicable.
6. Optimize Kafka performance, troubleshoot issues, and manage incident response.

Required Skills:

1. 58 years of experience working with Apache Kafka and Confluent Kafka.
2. Strong knowledge of Kafka internals (brokers, zookeepers, partitions, replication, offsets).
3. Experience with Kafka Connect, Schema Registry, REST Proxy, and Kafka security.
4. Hands-on experience with AWS (EC2, IAM, CloudWatch, S3, Lambda, VPC, Load balancers).
5. Proficiency in scripting and automation using Terraform, Ansible, or similar tools.
6. Familiarity with DevOps practices and tools (CI/CD pipelines, monitoring tools like Prometheus/Grafana, Splunk, Datadog etc).
7. Experience with containerization (Docker, Kubernetes) is a plus.

Nice to Have:

1. Confluent Certified Developer or Administrator.
2. AWS Certified
3. CICD (AWS Code Pipeline, Harness)
4. Containers ( Docker, Kubernetes)