Experience-5-12 Years
Location:-Bangalore (Hybrid)
We are looking for an Azure Data Streaming Engineer who lives and breathes high-velocity data. If you are a Data Engineer who thinks like a Software Engineer, prioritising low latency, event-driven architecture, and clean code over simple batch ETL, this role is for you.
Responsibilities:
- Architect Real-Time Pipelines: Design and implement robust, scalable, and low-latency data streaming architectures.
- Build and Optimise: Develop high-performance data processing pipelines using Python, PySpark, and Databricks.
- Event-Driven Logic: Build complex event-driven workflows (e. g., real-time notifications, IoT telemetry processing, live logistics tracking).
- Bridge Backend and Data: Collaborate with software engineers to integrate data pipelines directly into application backends.
- Monitor and Scale: Ensure system reliability, uptime, and performance in a highconcurrency Azure environment.
Requirements;
- Strong Python Backend Coding: This is not a SQL-only role. You must be comfortable writing production-grade, maintainable Python code.
- Real-Time/Streaming Expertise: Hands-on experience with streaming datasets and realtime architectures (not limited to batch).
- Azure Mastery: Deep knowledge of the Azure Data ecosystem, specifically Azure Event Hubs and Azure IoT Hub.
- Processing Frameworks: Proven experience with PySpark and Databricks.
- Message Brokers: Professional experience with Apache Kafka or similar distributed streaming platforms.
- Data Fundamentals: Strong SQL skills for complex data transformation and analytical queries
