Data Engineer Microsoft Fabric
Role Summary
We are looking for a hands-on Data Engineer with strong expertise in Microsoft Fabric and Azure Data Engineering technologies. The ideal candidate will be responsible for designing, developing, maintaining, and optimizing scalable data pipelines and lakehouse solutions, ensuring reliable data delivery, performance, governance, and scalability across enterprise platforms.
Role & Responsibilities
Microsoft Fabric & Data Engineering :
- OneLake Management : Work with organizational OneLake structures and manage shortcuts for efficient data access.
- Medallion Architecture : Design and maintain Bronze, Silver, and Gold layers using Delta Lake tables.
- Data Pipeline Development : Build and manage pipelines using Fabric Data Factory and Notebooks.
- Data Modeling : Implement Star Schema dimensional models for BI and reporting.
Azure & Data Integration
- Data Ingestion : Build batch and incremental ingestion pipelines from ADLS Gen2, APIs, Azure SQL, and Blob Storage.
- Pipeline Orchestration : Use Fabric Data Factory / Azure Data Factory for ETL/ELT workflows.
- Automation Support : Support Azure Functions and Logic Apps for event-based triggers.
- Legacy Support : Maintain existing ADF and Synapse pipelines and support migration to Microsoft Fabric.
Data Processing & Optimization
- Spark Development : Develop and optimize PySpark notebooks.
- SQL Development : Write efficient queries, views, and stored procedures in Fabric Warehouse / Azure SQL.
- Performance Optimization : Apply partitioning, caching, and query tuning techniques.
- Monitoring & Troubleshooting : Monitor pipelines and resolve failures.
Governance & Security
- Access Management : Implement RBAC and secure access management.
- Data Quality : Ensure validation and consistency across data pipelines.
- Version Control : Work with Git integration and Azure DevOps.
- Metadata & Lineage : Support Microsoft Purview for cataloging and lineage.
Must-Have Skills
- Microsoft Fabric (Data Factory, OneLake, Synapse Data Engineering basics)
- Azure Data Services ADLS Gen2, Azure SQL, Blob Storage
- Strong SQL and performance tuning basics
- Python / PySpark
- Azure Data Factory / Fabric Pipelines
Good-to-Have Skills
- Azure Functions / Logic Apps
- Event Hubs / Streaming concepts
- Microsoft Purview
- Cosmos DB
Experience Required
- 6+ years of experience in Data Engineering
- Hands-on Microsoft Fabric experience preferred
- Strong Azure Data Engineering background acceptable
Key Competencies
- Strong analytical and problem-solving skills
- Good debugging and troubleshooting capabilities
- Strong understanding of ETL/ELT concepts
- Ability to translate business requirements into scalable solutions
- Effective collaboration with stakeholders
Preferred Certifications
- DP-203 : Azure Data Engineer Associate
- DP-700 : Fabric Data Engineer
(ref:hirist.tech)
