Senior Data Engineer

Ciklum is looking for a Senior Data Engineer to join our team full-time in India.

We are a custom product engineering company that supports both multinational organizations and scaling startups to solve their most complex business challenges. With a global team of over 4,000 highly skilled developers, consultants, analysts and product owners, we engineer technology that redefines industries and shapes the way people live.

About the role:

As a Senior Data Engineer, become a part of a cross-functional development team. You will build the high-speed data highways transporting telemetry and logs to storage backends Loki and Prometh. This project transforms diverse telemetry from SCOM, SolarWinds, and Azure into a unified, AI-ready streaming architecture using Kafka and OpenTelemetry.

Responsibilities:

• Responsible for the building, deployment, and maintenance of mission-critical analytics solutions that process log and metric data at scale
• Contributes design, code, and configurations for real-time streaming and data ingestion via Apache Kafka
• Performs development of data pipelines to ensure total end-to-end responsibility of data flow from OTel Gateways to Loki and Prometheus
• Responsible for performance tuning of complicated data flows and stream processing logic
• Identify gaps and improve the platform's quality, robustness, and speed for the Virtual Engineer AI consumer

Requirements:

• 3+ years of experience coding in Python with solid CS fundamentals
• 2+ years contributing to production deployments of large backend data processing systems
• 1+ years of hands-on implementation experience with Kafka, Spark, or similar streaming technologies
• 2+ years of experience in cloud data platforms, specifically Azure
• Knowledge of Data Quality testing, automation, and telemetry visualization
• Experience designing

What`s in it for you

• Strong community: Work alongside top professionals in a friendly, open-door environment
• Growth focus: Take on large-scale projects with a global impact and expand your expertise
• Tailored learning: Boost your skills with internal events (meetups, conferences, workshops), Udemy access, language courses, and company-paid certifications
• Endless opportunities: Explore diverse domains through internal mobility, finding the best fit to gain hands-on experience with cutting-edge technologies
• Care: We've got you covered with company-paid medical insurance, mental health support, and financial & legal consultations

About us:

At Ciklum, we are always exploring innovations, empowering each other to achieve more, and engineering solutions that matter. With us, you'll work with cutting-edge technologies, contribute to impactful projects, and be part of a One Team culture that values collaboration and progress.

India is a strategic innovation hub for Ciklum, with growing teams in Chennai and Pune leading advancements in EdgeTech, AR/VR, IoT, and beyond. Join us to collaborate on game-changing solutions and take your career to the next level.

Want to learn more about us Follow us on Instagram, Facebook, LinkedIn.

Explore, empower, engineer with Ciklum!

Interested already We would love to get to know you! Submit your application. We can't wait to see you at Ciklum.