Azure Data Engineer

Job description

• To extract, cleanse, transform and load various datasets into a common model and track changes across the data sets.
• Collaborate with the Data Analysts, Application Developers, Report Developers, Architects, Product Manager and other stakeholders to provide visibility into the data layer and related pipelines
• Identify opportunities to leverage data and create innovative solutions.
• Recent experience with building and deploying applications in Azure BI Stack (AzureDB, SQL Server, Data Lake, Blob Storage, CosmosDB, Event Hub, Stream Analytics, Azure Function, Power BI, etc.)
• Experience with SQL, SparkSQL, PySpark
• Experience with Python and an interest in Machine Learning
• Experience migrating data environments from on-prem to cloud (DMS)
• Experience in usage GitHub or Azure DevOPS Git
• Understanding in the design and development BI solution based on Kimball, Inmon, Data Vault methodology
• Understanding data governance principles and experience in implementing data controls and master data management based on SQL MDS will be advantage
• Experience in usage other DI Tools (Informatica, SSIS, etc.)
• Excellent problem-solving skills, strong verbal & written communication skills
• Ability to work independently as well as part of a team
• Ability to adapt new solutions in a fast changing environment