Azure Data Engineer

Job Requirements*

The successful candidate will be responsible for

• Design, build, and maintain data transformation pipelines using Databricks Asset Bundle & Git.
• Design, build, and maintain data transformation pipelines using PySpark and Databricks. Implement and maintain complex calculation engine.
• Manage efficiently large dataset.
• Manage SQL database – Databricks managed Tables
• Implement and maintain complex data calculation formula.
• Build Power BI report and maintain as per business requirement.
• Open to collaborate with Software Engineers.
• Participate in code reviews, design discussions, and software planning.
• Contribute to automation, testing, and deployment processes.

Key Responsibilities*

• Design, build, and maintain data transformation pipelines using Databricks Asset Bundle & Git.
• Design, build, and maintain data transformation pipelines using PySpark and Databricks. Implement and maintain complex calculation engine.
• Manage efficiently large dataset.
• Manage SQL database – Databricks managed Tables
• Implement and maintain complex data calculation formula.
• Build Power BI report and maintain as per business requirement.
• Open to collaborate with Software Engineers.
• Participate in code reviews, design discussions, and software planning.
• Contribute to automation, testing, and deployment processes.