Senior Data Engineer

Key Responsibilities

• Architect, maintain, and optimize scalable data pipelines, leveraging Azure Data Services, Azure DevOps, and select AWS components.
• Build and maintain pipelines in Azure Data Factory and/or Azure Synapse Analytics Pipelines.
• Monitor pipeline health and costs using Azure Monitor, Log Analytics, and custom dashboards.
• Assemble and manage large, complex datasets that meet functional and non-functional business requirements.
• Implement and maintain data quality frameworks using tools such as dbt tests and monitoring solutions.
• Collaborate with business intelligence analysts, data scientists and business stakeholders to understand requirements and deliver tailored solutions.
• Develop and maintain technical documentation, workflows, and best practices to ensure knowledge sharing across teams.
• Provide support for data-related incidents and participate in an on-call rotation when necessary.
• Demonstrate willingness to explore and learn new technologies and tools as our data ecosystem evolves and show enthusiasm for adopting upcoming technologies