Collaborate with several stakeholders to deeply understand the needs of data practitioners to deliver at scale
Lead Data Engineers to define, build and maintain Data Platform
Work on building Data Lake in Azure Fabric processing data from multiple sources
Migrating existing data store from Azure Synapse to Azure Fabric
Implement data governance and access control
Drive development effort End-to-End for on-time delivery of high-quality solutions that conform to requirements, conform to the architectural vision, and comply with all applicable standards.
Present technical solutions, capabilities, considerations, and features in business terms. Effectively communicate status, issues, and risks in a precise and timely manner.
Further develop critical initiatives, such as Data Discovery, Data Lineage and Data Quality
Leading team and Mentor junior resources
Help your team members grow in their role and achieve their career aspirations
Build data systems, pipelines, analytical tools and programs
Conduct complex data analysis and report on results
5+ Years of Experience as a data engineer or similar role in Azure Synapses, ADF or relevant exp in Azure Fabric
Degree in Computer Science, Data Science, Mathematics, IT, or similar field
Must have experience executing projects end to end.
At least one data engineering project should have worked in Azure Synapse, ADF or Azure Fabric
Should be experienced in handling multiple data sources
Technical expertise with data models, data mining, and segmentation techniques
Deep understanding, both conceptually and in practice of at least one object orientated
library (Python, pySpark)
Strong SQL skills and a good understanding of existing SQL warehouses and relational
databases.
Strong Spark, PySpark, Spark SQL skills and good understanding of distributed processing frameworks.
Build large-scale batches and real-time data pipelines.
Ability to work independently and mentor junior resources.
Desire to lead and develop a team of Data Engineers across multiple levels
Experience or knowledge in Data Governance
Azure Cloud experience with Data modeling, CICD, Agile Methodologies, DockerKubernetes
