Job Details
Job Summary:
We are seeking an experienced Senior Data Engineer with strong expertise in Microsoft Fabric to support our enterprise data modernization and analytics transformation initiatives. The ideal candidate will have a deep understanding of data pipelines, lakehouse architecture, Power BI, Synapse integration, and experience in modernizing legacy data systems to cloud-native solutions. This role is critical in building scalable, secure, and high-performing data solutions on the Microsoft ecosystem.
Key Responsibilities:
- Design and implement data pipelines using Microsoft Fabric s Data Factory, Synapse Data Engineering, and OneLake components.
- Build and maintain lakehouse architectures leveraging Delta Lake, Parquet, and OneLake within Microsoft Fabric.
- Lead initiatives to modernize legacy ETL/ELT processes to cloud-native data pipelines.
- Work closely with Data Architects, BI Developers, and Analysts to deliver scalable data models for analytics and reporting.
- Optimize performance of Power BI datasets and reports through best practices in data modeling and DAX.
- Implement data governance and security controls, including Microsoft Purview, role-based access, and lineage tracking.
- Collaborate with cross-functional teams in cloud migration, especially from on-premises SQL/Oracle/Hadoop platforms to Microsoft Azure & Fabric.
- Evaluate and implement CI/CD practices for data pipelines using Azure DevOps or GitHub Actions.
- Required Skills & Qualifications:
- Bachelor s/Master s degree in Computer Science, Information Systems, or related field.
- 8+ years of experience in data engineering
- Strong hands-on experience with Microsoft Fabric components:
- Data Factory
- Lakehouse / OneLake
- Synapse Data Engineering
- Power BI
- Experience with data modeling (star/snowflake) and performance tuning in Power BI.
- Deep understanding of modern data architecture patterns including lakehouse, medallion architecture, and ELT frameworks.
- Expertise in SQL, PySpark, T-SQL, DAX, and Power Query (M language).
- Experience modernizing platforms from SSIS, Informatica, or Hadoop to cloud-native tools.
- Familiarity with Azure ecosystem Azure Data Lake, Azure SQL DB, Azure Functions, Azure Synapse, Azure Data Factory.
- Strong experience in CI/CD pipelines, preferably with Azure DevOps.
- Familiarity with data security, GDPR, HIPAA, and enterprise data governance.
Preferred Qualifications:
- Microsoft certifications such as:
- Microsoft Certified: Fabric Analytics Engineer Associate
- Azure Data Engineer Associate (DP-203)
- Experience with DataOps and Agile delivery methods.
- Knowledge of Machine Learning/AI integration with Fabric is a plus.
- Hands-on with Notebooks in Microsoft Fabric using Python or Scala.
Soft Skills:
- Strong analytical and problem-solving skills.
- Excellent communication and stakeholder management capabilities.
- Ability to lead projects, mentor junior engineers, and collaborate with cross-functional teams.
