Job Requirements:
Mandatory Skills
- Bachelor's or higher degree in Computer Science or a related discipline; or equivalent (minimum 13+ years work experience).
- Experience in stake holder management and working on proposals.
- Experience leading team of data engineers.
- At least 4+ years of experience in developing data ingestion, data processing and analytical pipelines for big data, relational databases such as SQL server and data warehouse solutions such as Synapse/Azure Databricks, Microsoft Fabric
- Hands-on experience implementing data ingestion, ETL and data processing using Azure services: Fabric, onelake, ADLS, Azure Data Factory, Azure Functions, services in Microsoft Fabric etc.
- Minimum of 5+ years of hands-on experience in Azure and Big Data technologies such as Fabric, databricks, Synapse, Python, SQL, ADLS/Blob, pyspark/SparkSQL.
- Minimum of 3+ years of RDBMS experience
Preferred Skills:
Technical Leadership & Demo Delivery:
- Provide technical leadership to the data engineering team, guiding the design and implementation of data solutions.
- Deliver compelling and clear demonstrations of data engineering solutions to stakeholders and clients, showcasing functionality and business value.
- Communicate fluently in English with clients, translating complex technical concepts into business-friendly language during presentations, meetings, and consultations.
ETL Development & Deployment on Azure Cloud:
- Design, develop, and deploy robust ETL (Extract, Transform, Load) pipelines using Azure Data Factory (ADF), Azure Synapse Analytics, Azure Notebooks, Azure Functions, and other Azure services.
- Ensure scalable, efficient, and secure data integration workflows that meet business requirements.
Microsoft Fabric Expertise:
- Develop and deploy ETL solutions using Microsoft Fabric, leveraging its capabilities for end-to-end data integration and analytics.
- Build and maintain medallion architecture (Bronze, Silver, Gold layers) in Microsoft Fabric to ensure data quality, scalability, and performance.
Generative AI & Microsoft Copilot:
- Exposure to Microsoft Copilot and Generative AI fundamentals, with the ability to identify and implement industry-relevant use cases (e.g., automated insights generation, data summarization, or predictive analytics).
- Leverage Gen AI tools to enhance data engineering workflows, such as automating data pipeline creation or improving data quality checks.
Power BI & Business Insights:
- Proficient in Microsoft Power BI for designing and developing interactive reports and dashboards.
- Generate actionable insights for business users by analyzing data trends and patterns, ensuring alignment with business objectives.
Azure Security & Access Management:
- Strong knowledge of Azure Role-Based Access Control (RBAC) and Identity and Access Management (IAM).
- Implement and manage access controls, ensuring data security and compliance with organizational and regulatory standards on Azure Cloud.
Location: Bangalore, Hyderabad, Pune
