Azure Data Engineer

Job description :

SOURCERIGHT TECHNOLOGIES (INDIA) PRIVATE LIMITED is looking for Azure Data Engineer to join our dynamic team and embark on a rewarding career journey.

1. Assure that data is cleansed, mapped, transformed, and otherwise optimised for storage and use according to business and technical requirements
2. Solution design using Microsoft Azure services and other tools
3. The ability to automate tasks and deploy production standard code (with unit testing, continuous integration, versioning etc.)
4. Load transformed data into storage and reporting structures in destinations including data warehouse, high speed indexes, real-time reporting systems and analytics applications
5. Build data pipelines to collectively bring together data
6. Other responsibilities include extracting data, troubleshooting and maintaining the data warehouse

Mandatory Skill Set :

Python, PySpark, Apache Airflow, Databricks, Azure Data Factory, SQL

• Build data pipelines and data processing jobs using Spark, Apache Airflow, Azure Data Factory and Databricks
• Involve in design and build of data service APIs