We are seeking a skilled and motivated Azure Data Engineer to join our growing data team. The ideal candidate will be responsible for designing, building, and maintaining scalable data pipelines and data platforms on Azure. You will work extensively with Azure data services to support ETL/ELT processes, data ingestion, data modeling, and analytics, enabling data-driven decision-making across the organization.
Responsibilities
- Design, develop, and maintain ETL/ELT data pipelines using Azure Data Factory (ADF), including linked services, datasets, pipelines, and triggers.
- Ingest and manage data from multiple sources into Azure Data Lake Storage (ADLS Gen2), Azure SQL Database, and other Azure storage services.
- Build and automate workflows using Azure Logic Apps, including connectors, expressions, and workflow orchestration.
- Write efficient SQL queries, views, and stored procedures in Azure SQL Database / SQL Server.
- Ensure data quality, reliability, performance optimization, and monitoring of data pipelines.
- Design and implement data models to support analytics and reporting requirements.
- Collaborate with cross-functional teams such as data analysts, data scientists, and business stakeholders.
- Implement basic CI/CD concepts for data pipelines and deployments.
- Follow best practices for security, scalability, and cost optimization in Azure data solutions.
- Provide technical guidance and contribute to continuous improvement of data engineering practices.
Requirements
- Qualification: Any degree.
- 1+ year of hands-on experience working with Azure data services.
- Solid understanding: ETL/ELT concepts, data modeling fundamentals.
- Basic CI/CD concepts.
- Good analytical and problem-solving skills.
- Ability to work independently and in an Agile team environment.
- Strong communication and collaboration skills.
Strong Experience
- Azure Data Factory (ADF): pipelines, datasets, linked services, triggers.
- Azure Logic Apps - workflow automation, connectors, expressions.
- Azure Storage / ADLS Gen2 - file ingestion and data management.
- Azure SQL Database / SQL Server - SQL queries and stored procedures.
Preferred/Good-to-Have Skills
- Experience with Microsoft Fabric, including Data Pipelines, Lakehouse, Warehouse, and Dataflows.
- Knowledge of Delta Lake concepts.
- Experience with Power BI Dataflows.
- Basic knowledge of Python or Databricks.
- Familiarity with Azure Synapse Analytics.
- Experience with Azure DevOps and deployment pipelines.
- Azure Fabric Certification (or currently pursuing).
This job was posted by Sai Kumar from Mushroom Solutions.
