Job Description
Role : Senior Data Engineer
Location : Bangalore
Skills Required : Real Time Streaming (Flink/Java/Kafka)
Job Purpose
- Responsible to design, develop & manage Enterprise Data Warehouse modeling (Conceptual, Logical, Physical & Virtual), including model consolidation and integration.
- Responsible for how the data will be stored, consumed and managed within the Enterprise Data Warehouse.
- Responsible for continuous & continual driving of data usage across the organization to drive the business value.
- Provide guidance to developers, modelers and data administration concerning design and transition to the physical data environment.
- Recommend relational (RDBMS) and non-relational (NoSQL, Big Data, Doc DB) data storage technologies suitable to meet business and data needs based on deep understanding of data and existing/planned usage.
- Drives the evaluation and adoption of emerging data warehouse technologies including Banking & Financial sector Industry Standard Data Models for building an EDW.
- Liaise with support and operational units to ensure data processing SLAs are well defined and followed.
- Responsible for designing, facilitating & maintaining metadata (business glossary, definition, golden source, derivation logic, ownership, etc.), data lineage, quality, profiling, mining and master data management.
- Manage and establish standards for naming and abbreviation conventions, data definitions, ownership, documentation and change management procedures/techniques.
Main Tasks
- Data modelling from source systems Data Modelling.
- Have a deep understanding of various data modeling methodologies, design patterns and design principles in data warehousing.
- Proficient with & responsible to design raw data vault, data lake, data warehouse & mart.
- Lay guiding principles on sourcing data from various banking systems.
(ref:hirist.tech)
