Kafka Integration Specialist

We are seeking a highly skilled Kafka Integration Specialist with extensive experience in designing, developing, and integrating Apache Kafka solutions. You will be responsible for creating and maintaining Kafka-based data pipelines, managing clusters, and ensuring high availability and performance. This role requires a strong understanding of distributed systems and data streaming concepts to deliver robust, real-time integration solutions.

Roles & Responsibilities:

• Design, implement, and maintain Kafka-based data pipelines.
• Develop integration solutions using Kafka Connect, Kafka Streams, and other related technologies.
• Manage Kafka clusters, ensuring high availability, scalability, and performance.
• Collaborate with cross-functional teams to understand integration requirements and deliver robust solutions.
• Implement best practices for data streaming, including message serialization, partitioning, and replication.
• Monitor and troubleshoot Kafka performance, latency, and security issues.
• Ensure data integrity and implement failover strategies for critical data pipelines.

Skills Required:

• Strong experience in Apache Kafka (Kafka Streams, Kafka Connect).
• Proficiency in programming languages like Java, Python, or Scala.
• Experience with distributed systems and data streaming concepts.
• Familiarity with Zookeeper, Confluent Kafka, and Kafka Broker configurations.
• Expertise in creating and managing topics, partitions, and consumer groups.
• Hands-on experience with integration tools such as REST APIs, MQ, or ESB.
• Knowledge of cloud platforms like AWS, Azure, or GCP for Kafka deployment.
• Experience with monitoring tools like Prometheus, Grafana, or Datadog is a plus.
• Exposure to DevOps practices, CI/CD pipelines, and infrastructure automation is a plus.
• Knowledge of data serialization formats like Avro, Protobuf, or JSON is a plus.

QUALIFICATION:

• Bachelor's degree in Computer Science, Information Technology, or a related field.