
Search by job, company or skills
Data Architect Streaming & Cloud Data Platform
Role Summary
We are seeking a Data Architect Real-Time Data Platform to design and govern a scalable, event-driven data architecture that ingests data from enterprise applications such as:
The solution will leverage Kafka for event streaming, Apache Flink for real-time processing, and Snowflake as the analytical data platform.
Role and Responsibilities:
Design and govern the end-to-end event-driven architecture
Define streaming patterns, schema governance, scalability, and fault-tolerance strategies.
Establish Snowflake data architecture (raw to curated layers) and performance optimization standards.
Ensure security, compliance, monitoring, and operational readiness of the platform.
Detailed Experience Requirements:
Architecture & Design
Define end-to-end event-driven architecture for enterprise data ingestion.
Design near real-time ingestion pipelines using Kafka.
Architect stream processing patterns using Apache Flink
Define Snowflake data models
Establish data contracts, schema evolution, and event versioning strategy.
Integration & Data Strategy
Architect ingestion strategies for CDC (Change Data Capture),API-based ingestion
Webhooks / event push,
Define integration blueprint for Oracle ERP, Fusion Cloud, CPQ, Salesforce.
Establish event schema governance (Avro/Protobuf/JSON schema registry).
Performance & Scalability
Design horizontal scalability for Kafka and Flink clusters.
Define partitioning, retention, replay strategies.
Optimize Snowflake performance (clustering, micro-partitions, warehouses).
DevOps & Reliability
Architect CI/CD pipelines for streaming components.
Define deployment patterns (Docker/Kubernetes).
Design monitoring framework (lag monitoring, Flink checkpointing, Snowflake performance metrics).
Required Skills
Apache Kafka (architecture, partitioning, schema registry)
Apache Flink (stateful streaming, exactly-once semantics)
Snowflake (data modeling, performance tuning)
Oracle ERP / Oracle Fusion integration patterns
Salesforce data ingestion
CDC tools (Debezium or similar)
Cloud & Infrastructure
Azure
Kubernetes
Infrastructure as Code (Terraform)
Best Regards,
Karthiga Kathiresan
Senior Recruiter
VDart Digital India
Ph: 9384153079
Email: [Confidential Information]
Website: www.vdartdigital.com
Job ID: 143839797