Collect the data from different BUs with different operating systems into a centralized data lake harnessing azure technologies.
Implement automated data quality measures to sieve out bad quality data for timely rectifications by data sources.
Harmonize the data collected from different sources into standard and analyzable data definition per process per function.
Enable the timely availability of good quality to facilitate data-oriented management decisions.
Design, construct and maintain scalable Datawarehouse models to support PSA India wide data analytics needs.
Create and maintain data pipelines to transform and load data from data lake into Datawarehouse models.
Align to PSA data analytics policy, standards and best practices and document as required
Ensure data sets are arranged in a contextual manner to enable seamless data governance rules across the organisation.
Collaborate with the fellow tabular model developer, BUs database experts, and BUs process owners to ensure that data is collected, harmonized and ingested into BI tools in the right format to facilitate self-service analysis on Power BI.
Technical Requirements:
Degree from a recognised university, preferably in Data Analytics or Computer Science domain.
Must have at 5 10 years hands-on experience as a Data Engineer including at least two years using Microsoft azure data tools.
Must have thorough knowledge & hands-on experience in Azure concepts such as Azure integration runtime (AIR), Azure Data Factory (ADF), Azure Synapse Analytics / Datawarehouse, Azure Analysis Services, Azure Devops. Certifications would strengthen the application.
Must have strong foundation and hands on experience in database concepts such as SQL, data warehouse concepts (Star, snowflake) methodology and experience in designing data warehouse dimensional/ER modelling.
Good to have: Power BI Fabric, Azure Databricks end-to-end orchestration of data pipelines, all the way from data collection, to harmonization, to visualization, harnessing on unity catalogue frameworks for tighter security.
