Search by job, company or skills

Azure Data Engineer (Consultant)

Azure Data Engineer (Consultant)

Aarquench Solutions Private Limited
3-4 Years
Not Disclosed
Quick Apply
  • Posted a day ago
  • Over 100 applicants have applied

Job Description

Azure Data Engineer (Consultant)

Job Overview

  • Job Title: Azure Data Engineer (Consultant)
  • Experience: 3+ Years
  • Job Type: Contract
  • Contract Duration: 3 Months
  • Work Mode: 100% Remote
  • Work Shift: General Shift
  • Primary Skill: Azure Data Engineering

Job Description

We are looking for an experienced Azure Data Engineer with 3+ years of hands-on experience in Azure Data Factory (ADF), Azure Databricks, PySpark, and SQL.

The ideal candidate should have strong experience in designing and developing scalable ETL/ELT pipelines, data ingestion, transformation, and data cleansing processes. The candidate should be capable of building robust data processing solutions and optimizing data workflows to ensure performance and reliability.

Key Responsibilities

  • Design, develop, and maintain robust ETL/ELT pipelines using Azure Data Factory (ADF).
  • Build scalable data processing solutions using Azure Databricks and PySpark.
  • Develop and optimize complex SQL queries, stored procedures, views, and data models.
  • Ingest data from multiple sources, including APIs, databases, flat files, and cloud storage.
  • Implement data transformation, cleansing, and enrichment processes.
  • Monitor and troubleshoot data pipelines to ensure reliability and performance.
  • Collaborate with Data Architects, BI Developers, and Business Stakeholders to understand data requirements.

Primary Skills (Must-Have)

  • Hands-on experience with Azure Data Factory (ADF).
  • Strong experience with Azure Databricks.
  • Good programming knowledge of PySpark.
  • Strong SQL skills, including complex queries, stored procedures, views, and data modelling.
  • Experience in ETL/ELT pipeline development.
  • Experience in data ingestion, transformation, and cleansing.

Good to Have

  • Knowledge or experience with Microsoft Fabric.

More Info

Key Skills

Azure Data Factory (ADF)

SQL (Complex Queries

Views & Data Modelling)

ETL/ELT Pipeline Development

Data Ingestion

Transformation & Cleansing

About Company

www.skilltasy.com