Job Title: Azure Data Engineer
Experience: 5 8 Years
Location: Remote
Employment Type: Full-Time
Job Summary
We are seeking a highly skilled Data Engineer with 5 8 years of experience in designing, developing, and maintaining scalable data platforms, data warehouses, and analytics solutions. The ideal candidate will have strong expertise in data modeling, ETL development, SQL, Python, cloud-based data engineering, and business intelligence tools. The role requires collaboration with business stakeholders and technical teams to build robust data pipelines, reporting solutions, and data-driven insights that support strategic business decisions.
Key Responsibilities
- Design, develop, implement, and maintain enterprise-scale Data Lakes, Data Warehouses, and analytics platforms.
- Partner with business stakeholders and customers to understand data, reporting, and analytics requirements.
- Design and develop scalable ETL/ELT pipelines to ingest, transform, and load data into Data Lakes and Data Warehouses.
- Integrate data from multiple structured and unstructured sources to support business intelligence and decision-making.
- Build end-to-end data solutions, including data ingestion, transformation, modeling, reporting, and dashboarding.
- Develop and optimize data models to support reporting, analytics, and operational use cases.
- Collaborate with cross-functional teams to deliver flexible, scalable, and high-performance data solutions.
- Establish and maintain data quality standards, governance practices, and Service Level Agreements (SLAs).
- Apply best practices for handling, processing, and analyzing large-scale datasets.
- Develop and maintain reporting applications and self-service analytics solutions.
- Troubleshoot and optimize ETL jobs, data pipelines, and reporting systems.
- Participate in Agile ceremonies, sprint planning, code reviews, and continuous improvement initiatives.
Preferred Qualifications
- Hands-on experience with Azure Data Factory (ADF) for data ingestion and transformation workflows.
- Strong experience with Spark, PySpark, and Azure Databricks.
- Experience designing and implementing Data Lake solutions.
- Knowledge of MPP (Massively Parallel Processing) databases.
- Experience working with NoSQL databases such as Cosmos DB and MongoDB.
- Experience creating interactive dashboards and reports using Microsoft Power BI.
- Familiarity with scripting languages such as Python, PySpark, and JavaScript.
