Azure Databricks

Skills Required:

Expertise in Azure Data Lake, Azure Databricks, Azure Data Factory, Azure Synapse, Scala, Spark, Python and SQL Server.

Strong communication skills to interact effectively with stakeholders.

Positive attitude and a solution-oriented approach.

Good to Have Skills:

Experience with Power BI for data visualization.

Familiarity with VBA for automation.

Roles and Responsibilities:

Design, build, and manage data pipelines using Azure Data Factory, Azure Databricks, and Azure Data Lake.

Develop and optimize data workflows using Scala, Spark, and Python for large-scale data processing.

Implement and maintain data solutions leveraging Azure Synapse and SQL Server.

Ensure data quality, scalability, and performance in data processing and storage.

Support the creation of datasets and data models for reporting needs, including Power BI (if required).

Collaborate with business and technical teams to gather requirements and deliver tailored data solutions.

Adhere to data governance standards and ensure data security.

Prepare and maintain clear documentation for processes and workflows.