Azure Data Engineer

We are actively seeking a highly skilled and self-motivated Azure Data Engineer to join our client's team through Acme Services. This pivotal role is responsible for designing, implementing, and migrating robust data solutions to the Azure cloud, with expertise in setting up data lake and data factory solutions. The ideal candidate will possess strong U-SQL and Stored Procedure skills, working knowledge of SSIS, SSAS, and SSRS, and hands-on experience in SQL performance tuning. You'll need to demonstrate proficiency in development, testing, and deployment best practices, coupled with excellent communication and teamwork abilities to deliver comprehensive data solutions.

Key Responsibilities

• Azure Data Solution Implementation: Lead the implementation and migration of data solutions to Azure cloud, with a focus on designing and setting up Azure Data Lake and Azure Data Factory solutions.
• Data Warehousing & ETL: Work extensively with Azure DW (Data Warehouse) and leverage strong U-SQL and Stored Procedure skills for data processing and transformation.
• Legacy System Integration: Utilize working knowledge in SSIS, SSAS, and SSRS for integrating with and migrating data from existing SQL Server environments.
• Performance Optimization: Apply hands-on experience on SQL performance and tuning to ensure optimal efficiency and speed of data operations.
• Development Lifecycle & Standards: Adhere to and implement best practices for development, testing, and deployment, ensuring high-quality solutions and following established coding standards.
• Solution Design & Decision Making: Possess the ability to understand the overall solution and design components to fit the overall solution. Take technical decisions and support them with justifications.
• Agile Collaboration & Independence: Work effectively in an Agile manner, demonstrating the ability to work independently without much guidance.
• Professional Conduct: Exhibit self-motivation, strong time management skills, results orientation, and excellent presentation, written, and verbal communication skills. Be a good team player with strong interpersonal skills.

Skills

• Knowledge in setting up data lake and data factory solutions.
• Experience in implementation and migration of data solutions to Azure cloud.
• Strong U-SQL and Stored Procedure skills.
• Working knowledge in SSIS, SSAS, SSRS.
• Hands-on experience on SQL performance and tuning.
• Proficiency in development testing, deployment knowledge, best practices, and coding standards.
• Ability to understand overall solution architecture and design fitting components.
• Strong analytical and decision-making skills with justification.
• Experience working in an Agile manner.
• Ability to work independently.
• Self-motivated, results-oriented, strong time management skills.
• Excellent presentation, written, and verbal communication skills.
• Good team player with strong interpersonal skills.

Technical Stack Required

• Azure DW
• Azure Data Lake
• Azure Data Factory
• PySpark
• USQL

Nice to Have

• Implementation and migration experience in Hadoop ecosystem such as Spark, Python, HDFS, and Machine Learning.