Key Responsibilities

End-to-End Data Pipeline Development

Design, develop, and manage scalable data pipelines using Microsoft Fabric (Data Pipelines, Lakehouse, Warehouse, OneLake) and Azure Data Factory
Build robust ETL/ELT workflows supporting batch and near real-time data processing
Ensure efficient data ingestion from multiple sources including APIs, RDBMS, files, and streaming systems

Lakehouse Architecture & Data Modeling

Implement Medallion Architecture (Bronze, Silver, Gold layers) for enterprise data platforms
Design and optimize data models using star and snowflake schemas
Support modern lakehouse and data warehousing architectures

Data Processing & Engineering

Cloud Integration & Storage Management

Monitoring, Governance & Optimization

Implement data quality checks, monitoring, logging, and error handling frameworks
Use Azure and Fabric monitoring tools for performance optimization
Ensure compliance with data governance, lineage, and security standards (Microsoft Purview preferred)

Migration & Modernization

Collaboration & Leadership

Lead Data Engineer - R01558812