Work Location: Bangalore/Pune
Experience: 4 to 10 years
Mandatory: MS Fabric, Python and Azure Data Factory experience
Job Description Azure Data Engineer
Mandatory Skills
- Bachelors degree in Computer Science or related field, or equivalent with minimum 4+ years of relevant experience.
- Minimum 3 years of consulting or client delivery experience in Azure-based data engineering.
- At least 1 year of hands-on experience developing data ingestion, processing, and analytics pipelines for big data, SQL-based systems, and data warehousing solutions such as Synapse, Azure Databricks, and Microsoft Fabric.
- Strong experience with Azure services including Fabric, OneLake, ADLS, Azure Data Factory, Azure Functions, and other Microsoft Fabric components.
- Practical experience (1+ years) with Big Data technologies such as Fabric, Databricks, Python, SQL, ADLS/Blob, PySpark/Spark SQL.
- Minimum 1 year of experience working with RDBMS.
- Good understanding of Big Data file formats and compression techniques.
- Experience using development tools like Azure DevOps, Visual Studio Team Services, Git, etc.
Roles & Responsibilities
- Design, build, and maintain data infrastructure using Azure cloud services.
- Develop and manage data pipelines and integrate data from multiple sources.
- Implement data security, privacy, and governance best practices.
- Monitor, troubleshoot, and optimize data flows for performance and cost efficiency.
Preferred Skills
- Experience building and deploying ETL solutions using ADF, Notebooks, Synapse Analytics, Azure Functions, and Microsoft Fabric.
- Hands-on expertise in developing ETL pipelines in Microsoft Fabric, including medallion architecture, metadata-driven ingestion, data quality frameworks, and SCD implementations using Fabric Notebooks or Databricks.
- Knowledge of Microsoft Co-pilot, GenAI basics, and relevant industry use cases.
- Microsoft certifications (e.g., DP-600, DP-203, DP-900, AI-102, AI-900) are an added advantage.
- Working knowledge of Power BI for reports, dashboards, and business insights.
- Understanding of Azure RBAC, IAM, access controls, and security standards.
- Familiarity with Microsoft's technology roadmap and evolving industry trends.
