Search by job, company or skills

Senior Data Architect

Senior Data Architect

coffeee.io
8-10 Years
Not Disclosed
Early Applicant
  • Posted 2 months ago
  • Be among the first 10 applicants

Job Description

Role Summary

We are looking for an experienced Data Architect to design and govern large-scale IoT data platforms that ingest, process, store, and analyze high-volume, high-velocity data including sensor telemetry, video streams, and audio streams.

The role requires strong expertise in streaming architectures, multimedia data pipelines, cloud-native data platforms, and data governance.

Key Responsibilities

IoT & Multimedia Data Architecture

  • Design end-to-end data architectures for IoT ecosystems handling:
  • Time-series sensor data
  • Real-time and batch video streams (CCTV, edge cameras, drones)
  • Audio streams (voice, acoustic signals, machine audio)
  • Define reference architectures for edge cloud data flow.
  • Architect solutions for low-latency ingestion, buffering, and processing.

Data Ingestion & Streaming

  • Design ingestion pipelines using:
  • MQTT, AMQP, REST, WebSockets
  • Event streaming platforms (Kafka / managed equivalents)
  • Handle real-time video/audio ingestion using RTSP, RTP, HLS, or WebRTC patterns.
  • Ensure fault tolerance, backpressure handling, and scalability.

Storage & Data Modeling

  • Define storage strategies for:
  • Time-series data
  • Large unstructured objects (video/audio)
  • Metadata, annotations, and derived features
  • Design data models for:
  • Event data
  • Multimedia metadata (frames, timestamps, object tags, transcriptions)
  • Balance hot, warm, and cold storage tiers for cost optimization.

Processing & Analytics Enablement

  • Architect pipelines for:
  • Stream processing (real-time alerts, anomaly detection)
  • Batch analytics and historical analysis
  • Enable downstream use cases such as:
  • Computer vision
  • Speech-to-text
  • Predictive maintenance
  • Operational dashboards
  • Support AI/ML feature extraction pipelines from video/audio streams.

Cloud & Edge Architecture

  • Design cloud-native architectures (AWS / Azure / GCP).
  • Integrate edge computing for:
  • Pre-processing video/audio
  • Bandwidth optimization
  • Offline or intermittent connectivity scenarios
  • Define deployment patterns using containers and orchestration.

Security, Governance & Compliance

  • Define data governance standards for:
  • Video/audio privacy
  • Data lineage and metadata management
  • Implement access control, encryption, and secure data sharing.
  • Ensure compliance with data protection and industry regulations.

Architecture Leadership

  • Work closely with:
  • IoT engineers
  • Video analytics teams
  • Data engineers
  • AI/ML teams
  • Review designs, enforce best practices, and guide implementation teams.
  • Create architecture documentation, diagrams, and standards.

Required Skills & Experience

Core Data Architecture

  • 8+ years in data architecture / data platform design
  • Strong understanding of distributed systems and event-driven architectures
  • Experience designing high-throughput, low-latency pipelines

IoT & Streaming

  • Hands-on experience with IoT data ingestion patterns
  • Strong knowledge of streaming platforms
  • Familiarity with real-time media streaming concepts

Multimedia Data

  • Experience working with:
  • Video pipelines (encoding, decoding, frame extraction)
  • Audio pipelines (sampling, transcription workflows)
  • Understanding of metadata management for multimedia data

Cloud & Platform

  • Strong experience with at least one major cloud platform
  • Experience with:
  • Object storage
  • Time-series databases
  • Distributed compute engines
  • Containerization and orchestration knowledge is a must

Data Governance & Security

  • Knowledge of:
  • Data cataloging
  • Lineage
  • Data access control
  • Experience handling sensitive video/audio data

More Info

Job Type:
Industry:
Employment Type:

Key Skills

Streaming architectures

Data cataloging

IoT data platforms

Multimedia data pipelines

Lineage

WebSockets

Data access control

Containers

About Company

Similar Jobs

12-14 yrs
Bengaluru, India
Skills:
Prince2, Waterfall, Power Bi, Tableau, Gcp, Agile, Databricks, Azure, AWS, Data Visualization Tools, Project Management Methodologies, Cloud Platforms, Machine Learning Concepts, Pmp
10-12 yrs
Bengaluru, India
Skills:
data engineering , Databricks, Data Modeling, Data Warehousing, LLMs, Microsoft Fabric, AWS data ecosystem, Enterprise data architecture, Applied AI solution design, AI technology stacks
7-10 yrs
Bengaluru, India
Skills:
Pyspark, Spark, Data Governance, Sql, Python, Generative AI, OCI Data Engineering, Delta Lake, Oracle AI Data Platform
9-11 yrs
Bengaluru, India
Skills:
Azure Synapse Analytics, Python, Spark PySpark, SQL and relational databases, Azure DevOps CI CD pipelines, Azure Data Factory complex pipeline orchestration, Azure Storage Data Lake ADLS Gen2, ETL ELT frameworks and data modeling concepts, performance tuning and large-scale data processing, Azure Data Engineering ecosystem, Azure Databricks advanced implementation optimization
10-15 yrs
Bengaluru, India
Skills:
Data Modeling, Pyspark, Databricks, Microsoft Azure, Sql, Data Configuration, Enterprise Data Architecture, Lakehouse Data Warehouse Architecture, Microsoft Fabric, Large-scale SAP Data Migration Integration