Senior Data Engineer
- Posted 12 hours ago
- Be among the first 10 applicants
Job Description
About This Job
Acclime
Location: Ahmedabad, Gujarat, India
Work Mode: On-site
Industry: Software Development,Data Infrastructure and Analytics
Job Description
Key Responsibilities
Architect, maintain, and optimize scalable data pipelines, leveraging Azure Data Services, Azure DevOps, and select AWS components.Build and maintain pipelines in Azure Data Factory and/or Azure Synapse Analytics Pipelines.Monitor pipeline health and costs using Azure Monitor, Log Analytics, and custom dashboards.Assemble and manage large, complex datasets that meet functional and non-functional business requirements.Implement and maintain data quality frameworks using tools such as dbt tests and monitoring solutions.Collaborate with business intelligence analysts, data scientists and business stakeholders to understand requirements and deliver tailored solutions.Develop and maintain technical documentation, workflows, and best practices to ensure knowledge sharing across teams.Provide support for data-related incidents and participate in an on-call rotation when necessary.Demonstrate willingness to explore and learn new technologies and tools as our data ecosystem evolves and show enthusiasm for adopting upcoming technologies
Acclime
Location: Ahmedabad, Gujarat, India
Work Mode: On-site
Industry: Software Development,Data Infrastructure and Analytics
Job Description
Key Responsibilities
Architect, maintain, and optimize scalable data pipelines, leveraging Azure Data Services, Azure DevOps, and select AWS components.Build and maintain pipelines in Azure Data Factory and/or Azure Synapse Analytics Pipelines.Monitor pipeline health and costs using Azure Monitor, Log Analytics, and custom dashboards.Assemble and manage large, complex datasets that meet functional and non-functional business requirements.Implement and maintain data quality frameworks using tools such as dbt tests and monitoring solutions.Collaborate with business intelligence analysts, data scientists and business stakeholders to understand requirements and deliver tailored solutions.Develop and maintain technical documentation, workflows, and best practices to ensure knowledge sharing across teams.Provide support for data-related incidents and participate in an on-call rotation when necessary.Demonstrate willingness to explore and learn new technologies and tools as our data ecosystem evolves and show enthusiasm for adopting upcoming technologies
More Info
Job Type:
Industry:
Employment Type:
Key Skills
AWS components
Azure Synapse Analytics Pipelines
dbt tests
Azure Monitor
Log Analytics
Azure Data Services
About Company
Skills:
Azure Data Factory, Azure Synapse Analytics, Azure DevOps, AWS components, dbt, Log Analytics, Azure Monitor, Azure Data Services
Skills:
Data Factory, Power Query, Tsql, Python, Azure DevOps, OneLake, Purview, KQL, Dataflows, rbac, Notebooks, Microsoft Fabric