Job Summary
We are seeking a highly skilled Data & Edge Platform Engineer with expertise in Edge computing, broker systems, enterprise integration, and DataOps pipelines. The ideal candidate will design, build, and maintain scalable data systems and real-time pipelines leveraging modern programming languages such as Python and JavaScript.
This role involves working on distributed architectures, event-driven systems, and enterprise-grade data platforms to enable seamless data ingestion, processing, and delivery across edge and cloud environments.
________________________________________
Keywords : HiveMQ, MQTT Broker, Cedalo, Edge Broker, Highbyte, DataOPS
Key Responsibilities
Edge Computing & Distributed Systems
- Design and implement edge-based data processing solutions for low-latency and real-time analytics.
- Develop and deploy lightweight services on edge devices and gateways.
- Optimize data flow between edge, on-premise systems, and cloud platforms.
- Ensure resiliency, fault tolerance, and efficient resource utilization at the edge.
Broker & Enterprise Broker Systems (HiveMQ & Cedalo)
- Architect and manage message broker systems (e.g., HiveMQ, Cedalo).
- Build enterprise integration patterns using enterprise brokers or integration platforms.
- Implement event-driven architectures for real-time data streaming and ingestion.
- Monitor and tune broker performance for reliability and scalability.
Data Pipelines & Data Engineering
- Design and maintain end-to-end data pipelines for batch and streaming workloads.
- Develop ETL/ELT frameworks to transform and load data efficiently.
- Integrate structured and unstructured data sources across enterprise systems.
- Ensure data quality, consistency, and availability across pipelines.
DataOps & Automation (Highbyte)
- Implement DataOps practices including CI/CD for data pipelines.
- Automate data workflows, testing, validation, and deployments.
- Use orchestration tools (e.g., Airflow, Prefect) for pipeline scheduling and monitoring.
- Establish governance, lineage tracking, and observability for data systems.
Programming & Development
- Develop scalable backend systems using Python).
- Build APIs, microservices, and data processing modules.
- Use JavaScript (Node.js) for integration services, dashboards, or edge applications.
- Write clean, maintainable, and testable code following best practices.
________________________________________
Required Skills & Qualifications
- Bachelor's or Master's degree in Computer Science, Engineering, or related field.
- 4+ years of experience in data engineering, distributed systems, or platform engineering.
- Strong proficiency in:
- Python (data processing, APIs, automation)
- JavaScript / Node.js
- Hands-on experience with:
- Message brokers: HiveMQ, Cedalo
- Protocols : Kafka, MQTT, RabbitMQ, etc.
- Data pipeline tools: Highbyte, Ignition, Airflow, Spark, Flink (preferred)
- Experience with cloud platforms (Azure, AWS, or GCP).
- Knowledge of containers and orchestration (Docker, Kubernetes).
- Familiarity with CI/CD pipelines and DevOps practices.
________________________________________
Preferred Qualifications
- Experience in setting up and building pipeline in HiveMQ, Cedalo & Highbyte
- Experience with edge computing frameworks (Azure IoT Edge, AWS Greengrass).
- Knowledge of stream processing frameworks (Kafka Streams, Apache Flink).
- Experience in real-time analytics and event-driven architectures.
- Exposure to data governance, lineage, and observability tools.
- Understanding of security practices for distributed systems.
________________________________________
Key Competencies
- Strong analytical and problem-solving skills.
- Ability to work in cross-functional teams and enterprise environments.
- Excellent communication and documentation skills.
- Proactive mindset with focus on innovation and optimization.
________________________________________
Tools & Technologies
- Languages: Python, JavaScript (Node.js)
- Messaging: HiveMQ, Cedalo, Highbyte
- Protocols : Kafka, MQTT, RabbitMQ
- Data Tools: Airflow, Spark, Flink
- Cloud: Azure / AWS / GCP
- DevOps: CI/CD pipelines, Docker, Kubernetes
- Monitoring: Prometheus, Grafana, ELK stack
________________________________________
Work Environment
- Agile and collaborative team environment.
- Opportunity to work on cutting-edge Edge + Data + AI ecosystems.
- Exposure to enterprise-scale data platforms and modern architectures.
