Azure Databricks Architect _10 to 15 yrs_ Chennai

Qualification

1. Degree from a recognized university, preferably in Data Analytics or Computer Science domain;

1. Preferably with relevant certifications from Microsoft including Azure Data Engineer Associate

, Databricks

2

Responsibilities

1.Architect Data patterns like batch or real time data in the Azure lake and ensure requirements are well designed

2. Work with business stakeholders and create data marts to be used for reporting

3. Create and maintain data pipelines to transform and load data from data lake into Datawarehouse models

4. Create and maintain data marts, data catalogue, data lineage, etc.

5. Enable data quality checks and scheduling for timely delivery of data

6. Responsible for end-to-end building of requisite data models - Conceptual, Logical, Physical, work with partner teams - business users, DMO, etc. to ensure seamless implementation of the Entity Relationship from business / operational to logical, and to physical

7. Work with data owners, producers, and DMO to define criteria for authoritative data sources, ownership, and governance process; identify and determine the authoritative data sources (ADS) / Source System of Record (SSOR) from existing sources

8. Responsible for the tooling landscape for data modeling including the analysis / assessment, evaluation, and finalization of the tool platform

9. Design and coordinate the data model maintenance and update workflow including the frequency, scope, and review processes, etc.,; responsible for ensuring the data models are kept updated with implemented changes communicated with relevant stakeholders

3

Work or Professional Experience &

Functional or Technical Competencies

1. Must have knowledge of data warehouse concept (Star or snowflake) methodology and experience in designing data warehouse dimensional modelling;

2. Must have hands-on experience in Azure Data Factory, Azure Databricks , Datawarehouse, Spark programming in Scala or python (for batch and real time) and Python;

3. Must have at least 8+ years of Data architecture and atleast 2 years in designing in Azure Stack

4. Experience and knowledge in Financial Regulatory Reporting & Standards such as BCBS 239

5. Experience in building effective and robust data models - Conceptual, Logical, Physical coupled with a strong ability to conceptualize Entity-Relationships, apply normalization / denormalization for redundancy management, standardize naming conventions, etc.

6. Experience with data modeling tools and/or ER Diagramming tools such as ER Studio and/or Erwin is a plus

1. Experience in Data Management & Governance and associated platforms such as Collibra, Unity Catalog

4

Personal Attributes

1. Positive attitude and disposition

2. Ability to function independently or as a team player

3. Technical aptitude

4. Organized, systematic, logical

5. Willing to learn