Key Responsibilities
- Design and implement data integration workflows using Azure Data Factory.
- Develop and maintain data pipelines to ingest, transform, and load data from various sources into Azure data services.
- Collaborate with data architects and analysts to understand data requirements and translate them into technical solutions.
- Monitor, troubleshoot, and optimize data pipelines for performance and reliability.
- Ensure data quality and integrity throughout the data lifecycle.
- Document data processes and workflows to facilitate knowledge sharing among team members.
- Stay updated on Azure Data Factory features and best practices to enhance the data engineering processes.
Required Skills & Qualifications
- Bachelor's degree in Computer Science, Information Technology, or a related field.
- Proven experience in Azure Data Factory and data integration technologies.
- Strong knowledge of data modeling, ETL processes, and data warehousing concepts.
- Proficiency in SQL and experience with Azure SQL Database, Azure Synapse Analytics, or other Azure data services.
- Familiarity with programming languages such as Python or C#.
- Excellent problem-solving skills and attention to detail.
- Strong communication and teamwork abilities.
