Role : Kafka Engineer
Experience : 510 Years
Location : Chennai
Employment Type : Full-time
Job Description :
We are seeking a highly skilled Kafka Engineer to architect, build, and manage a scalable Kafka ecosystem on AWS. The role involves hands-on experience with Kafka setup, MSK, infrastructure automation, ECS hosting, and monitoring solutions.
Key Responsibilities:
Kafka Setup & Architecture
- Set up Kafka foundational layers using a well-architected framework.
- Manage Kafka clusters, tuning, and administration.
AWS Hosting & Infrastructure
- AWS MSK setup using CloudFormation templates and GitLab deployment pipelines.
- Hosting and configuration of Kafka ecosystem components:
- Kafka Connect
- Kafka Proxy
- Schema Registry
- Cruise Control
- KSQL
- AKHQ (GUI)
- Deployment and management of services on AWS ECS.
Monitoring & Observability
- Build monitoring dashboards using Prometheus & Grafana for MSK.
- Host observability stack on ECS when required.
Automation & CI/CD
- ECS setup via CloudFormation.
- End-to-end deployment automation using GitLab CI/CD.
Required Skills:
- Strong Kafka administration and ecosystem expertise.
- Deep working knowledge of AWS MSK, ECS, CloudFormation & GitLab.
- Hands-on experience with Kafka ecosystem tools (Connect, Registry, Cruise Control, KSQL, AKHQ).
- Expertise in monitoring solutions using Prometheus & Grafana.
- Good understanding of cloud-native and distributed system architectures.
- Experience with containerization technologies such as Docker/ECS/EKS.
- Ability to work effectively in distributed/remote team environments.
Interested candidates kindly share your resume to [Confidential Information]
