We are actively seeking an experienced Azure Data Engineer to join our client's team through Acme Services. This pivotal role requires hands-on experience in building and managing data solutions within the Microsoft Azure ecosystem. The ideal candidate will have mandatory expertise in Azure Data Factory and Azure Synapse, and will be responsible for designing, implementing, and optimizing data pipelines to support various analytical and reporting needs.
Key Responsibilities
- Azure Data Platform Development: Design, develop, and maintain robust data pipelines and data solutions leveraging the Azure ecosystem.
- Data Integration with Azure Data Factory: Utilize Azure Data Factory extensively for data ingestion, transformation, and orchestration across various sources and destinations.
- Data Warehousing with Azure Synapse: Implement and manage data warehousing solutions using Azure Synapse Analytics, including data modeling, querying, and optimization.
- Data Pipeline Optimization: Continuously monitor and optimize data pipeline performance, ensuring data quality, reliability, and efficiency.
- Collaboration & Support: Work closely with data scientists, analysts, and other engineering teams to understand data requirements and deliver effective solutions.
- (Optional, if applicable) Big Data Processing: (Good to have) Leverage Spark for complex data transformations and analytical workloads, enhancing data processing capabilities.
Skills
- Proven experience working as an Azure Data Engineer.
- Mandatory experience in Azure Data Factory.
- Mandatory experience in Azure Synapse.
- (Good to have) Experience in Spark.
- (Good to have) Azure Certification.
- Strong understanding of data warehousing concepts and ETL/ELT processes.
- Familiarity with various data storage options in Azure (e.g., Azure Data Lake Storage, Azure SQL Database).
- Excellent problem-solving and analytical skills.
Qualifications
- Bachelor's degree in Computer Science, Information Technology, or a related field.
- Demonstrable experience in cloud-based data engineering roles, specifically with Azure.
