Azure Engineer

7-10 years
a month ago 105 Applied
Job Description

Requirements:

Azure Databricks, ADT, .NET core, Python/Pyspark, SSIS, SQL Healthcare Domain Experience required.
Position Overview:
  • We are seeking a skilled Azure Engineer to join our dynamic team.
  • As the Azure Engineer, you will play a pivotal role in architecting, implementing, and optimizing Azure pipelines solutions to support our data engineering and analytics initiatives.
  • You will collaborate closely with cross-functional teams to understand business requirements, design scalable data solutions, and lead the execution of projects.
  • Position will require knowledge and experience in the healthcare domain.

Key Responsibilities:
Design, development, and implementation of Azure and .NET core solutions ensuring alignment with business objectives and best practices.
Architecture and Design: Architect robust and scalable data pipelines on Azure Databricks
Data Engineering: Develop ETL processes, data ingestion pipelines, and data transformations to support data integration and analytics requirements.
Design and implemented real-time data integration pipeline to process semistructured data, across multiple DBMS. RDBMS and NoSQL using Kafka and PySpark
Implement and design web and data solutions that use the following Azure services: Azure function App, Azure queue Azure ,Web App, Azure storage, Azure Cosmos DB, Azure Data Factory.
Excellent knowledge of Python, PySpark, SQL/SSIS, C# etc.
Performance Optimization: Optimize Azure Databricks workloads for performance, reliability, and cost-efficiency, utilizing techniques such as partitioning, caching, and resource management.
Collaboration: Collaborate with data scientists, analysts, and business stakeholders to understand requirements, translate them into technical solutions, and deliver actionable insights.
Experience with data modeling is a plus with building data warehouse from scratch identifying Dimension and Fact entities using Star and Snowflake schema.
Documentation and Best Practices: Document architecture, design decisions, and technical guidelines, ensuring adherence to best practices and standards
Discovery and documentation of processes as-is and to-be
Creating and executing test plans to ensure the highest quality of products.
Creating data quality rules and ensuring verification
Creating and maintaining detailed documentation for all projects. Qualifications
Bachelor's degree in computer science/information technology or related field.
Minimum 5 years of experience in Azure and .NET core, MS SQL and Azure SQL and over 7 year of experience overall
Excellent knowledge of different software testing practices and techniques specifically as it relates data pipelines, data integration and building up of a data foundational architecture.
Excellent verbal and written communication skills.
Strong problem-solving and critical thinking skills.
Highly organized and detail-oriented

Informica Solutions is a newly established organization focused on data-driven businesses. Our mission is to fill the gap in talent acquisition by providing scientific and effective solutions. With over 15 years of management experience, we aim to change the game and simplify talent tracking and hiring processes. We work closely with selected businesses to headhunt talents using extensive scientific research and predictive analytics. Our approach goes beyond recruitment; we also assist with HR processes and help redesign the entire human capital landscape.

Career Advice to Find Better