Role Summary
We are looking for an experienced Data Architect to design and govern large-scale IoT data platforms that ingest, process, store, and analyze high-volume, high-velocity data including sensor telemetry, video streams, and audio streams.
The role requires strong expertise in streaming architectures, multimedia data pipelines, cloud-native data platforms, and data governance.
Key Responsibilities
IoT & Multimedia Data Architecture
- Design end-to-end data architectures for IoT ecosystems handling:
- Time-series sensor data
- Real-time and batch video streams (CCTV, edge cameras, drones)
- Audio streams (voice, acoustic signals, machine audio)
- Define reference architectures for edge cloud data flow.
- Architect solutions for low-latency ingestion, buffering, and processing.
Data Ingestion & Streaming
- Design ingestion pipelines using:
- MQTT, AMQP, REST, WebSockets
- Event streaming platforms (Kafka / managed equivalents)
- Handle real-time video/audio ingestion using RTSP, RTP, HLS, or WebRTC patterns.
- Ensure fault tolerance, backpressure handling, and scalability.
Storage & Data Modeling
- Define storage strategies for:
- Time-series data
- Large unstructured objects (video/audio)
- Metadata, annotations, and derived features
- Design data models for:
- Event data
- Multimedia metadata (frames, timestamps, object tags, transcriptions)
- Balance hot, warm, and cold storage tiers for cost optimization.
Processing & Analytics Enablement
- Architect pipelines for:
- Stream processing (real-time alerts, anomaly detection)
- Batch analytics and historical analysis
- Enable downstream use cases such as:
- Computer vision
- Speech-to-text
- Predictive maintenance
- Operational dashboards
- Support AI/ML feature extraction pipelines from video/audio streams.
Cloud & Edge Architecture
- Design cloud-native architectures (AWS / Azure / GCP).
- Integrate edge computing for:
- Pre-processing video/audio
- Bandwidth optimization
- Offline or intermittent connectivity scenarios
- Define deployment patterns using containers and orchestration.
Security, Governance & Compliance
- Define data governance standards for:
- Video/audio privacy
- Data lineage and metadata management
- Implement access control, encryption, and secure data sharing.
- Ensure compliance with data protection and industry regulations.
Architecture Leadership
- Work closely with:
- IoT engineers
- Video analytics teams
- Data engineers
- AI/ML teams
- Review designs, enforce best practices, and guide implementation teams.
- Create architecture documentation, diagrams, and standards.
Required Skills & Experience
Core Data Architecture
- 8+ years in data architecture / data platform design
- Strong understanding of distributed systems and event-driven architectures
- Experience designing high-throughput, low-latency pipelines
IoT & Streaming
- Hands-on experience with IoT data ingestion patterns
- Strong knowledge of streaming platforms
- Familiarity with real-time media streaming concepts
Multimedia Data
- Experience working with:
- Video pipelines (encoding, decoding, frame extraction)
- Audio pipelines (sampling, transcription workflows)
- Understanding of metadata management for multimedia data
Cloud & Platform
- Strong experience with at least one major cloud platform
- Experience with:
- Object storage
- Time-series databases
- Distributed compute engines
- Containerization and orchestration knowledge is a must
Data Governance & Security
- Knowledge of:
- Data cataloging
- Lineage
- Data access control
- Experience handling sensitive video/audio data
