Azure Data Engineer (Data Fabric)
Azure Data Engineer (Data Fabric)
mushroom solutions- Posted 2 months ago
- Over 200 applicants have applied
Job Description
We are seeking a skilled and motivated Azure Data Engineer to join our growing data team. The ideal candidate will be responsible for designing, building, and maintaining scalable data pipelines and data platforms on Azure. You will work extensively with Azure data services to support ETL/ELT processes, data ingestion, data modeling, and analytics, enabling data-driven decision-making across the organization.
Responsibilities
Responsibilities
- Design, develop, and maintain ETL/ELT data pipelines using Azure Data Factory (ADF), including linked services, datasets, pipelines, and triggers.
- Ingest and manage data from multiple sources into Azure Data Lake Storage (ADLS Gen2), Azure SQL Database, and other Azure storage services.
- Build and automate workflows using Azure Logic Apps, including connectors, expressions, and workflow orchestration.
- Write efficient SQL queries, views, and stored procedures in Azure SQL Database / SQL Server.
- Ensure data quality, reliability, performance optimization, and monitoring of data pipelines.
- Design and implement data models to support analytics and reporting requirements.
- Collaborate with cross-functional teams such as data analysts, data scientists, and business stakeholders.
- Implement basic CI/CD concepts for data pipelines and deployments.
- Follow best practices for security, scalability, and cost optimization in Azure data solutions.
- Provide technical guidance and contribute to continuous improvement of data engineering practices.
- Qualification: Any degree.
- 1+ year of hands-on experience working with Azure data services.
- Solid understanding: ETL/ELT concepts, data modeling fundamentals.
- Basic CI/CD concepts.
- Good analytical and problem-solving skills.
- Ability to work independently and in an Agile team environment.
- Strong communication and collaboration skills.
- Azure Data Factory (ADF): pipelines, datasets, linked services, triggers.
- Azure Logic Apps - workflow automation, connectors, expressions.
- Azure Storage / ADLS Gen2 - file ingestion and data management.
- Azure SQL Database / SQL Server - SQL queries and stored procedures.
- Experience with Microsoft Fabric, including Data Pipelines, Lakehouse, Warehouse, and Dataflows.
- Knowledge of Delta Lake concepts.
- Experience with Power BI Dataflows.
- Basic knowledge of Python or Databricks.
- Familiarity with Azure Synapse Analytics.
- Experience with Azure DevOps and deployment pipelines.
- Azure Fabric Certification (or currently pursuing).
More Info
Key Skills
Azure SQL Database SQL Server
ETL ELT
CI CD
Azure Data Factory ADF
Azure Storage ADLS Gen2
