Azure Data Engineer

Job Details

Responsibilities:

• Monitor existing operational pipeline dashboards, and dashboard refactoring
• Monitor and optimize data workflows for performance and scalability.
• Implement monitoring capabilities and alerts for production data pipelines using Azure Log Analytics and KUSTO Query Language
• Troubleshoot and resolve issues related to data processing.
• Contribute to data engineering / Databricks internal wiki
• Collaborate with data scientists, analysts, and other engineers to ensure data reliability and availability.

Education:

• Bachelor s degree in computer science, Information Technology or any other related discipline

Preferred Certifications:

• Microsoft Certified Systems Administrator (MCSA)
• Microsoft Certified IT Professional
• ITIL, ITSM Certifications

Work Experience:

• 7-10 years of directly related or relevant experience, preferably in application support or system/application/database administration.
• In-depth knowledge of Microsoft Azure components Microsoft Pipelines
• Hands on experience on data lake activities such as Azure Data Factory, Event Hubs, Databricks, Synapse, Blob Storage, Log Analytics, Stream Analytics, etc
• Expertise on Azure Devops with hands on in developing and maintaining Microsoft Pipelines (commonly referred too as CI/CD)
• Expertise in developing and maintaining data pipelines using Debezium (not mandatory), Databricks and Azure services.
• Strong knowledge of data modeling, STAR Schema, ETL, and real-time data streaming.
• Experience creating dashboards and reports in Power BI or similar tool
• Familiarity with SQL, Python, and KUSTO Query Language
• Familiar with agile / scrum / kanban
• Exposure to Scripting/programming Languages (e.g. SQL, KQL, Python)

Skills and Knowledge:

• Excellent problem-solving skills and attention to detail.