Senior Data Engineer
Job Summary
We are seeking an experienced Senior Data Engineer with strong expertise in Microsoft Fabric, PySpark, Azure Databricks, Synapse Analytics, and SQL. The role involves
designing, developing, and optimizing large-scale data pipelines, ensuring data quality and
performance, and enabling data-driven insights for business growth. The ideal candidate will have deep hands-on experience in Azure data services and modern data engineering practices.
Primary Skills
- Proven experience in MicrosoftFabric for data integration, orchestration, and analytics.
- Strong proficiency in PySpark for scalable data transformation and processing.
- Expertise in Azure Databricks and Spark SQL for advancedETL and data modeling.
- Strong hands-on knowledge of Azure Synapse Analyticsfor warehousing and analytical workloads.
- Proficiency in SQL and relational databases, with focus on performance tuning and query optimization.
- Solid understanding of ETL/ELT processes, Delta Lake,and data lakehouse architectures.
- Knowledge of Azure Data Factory, Azure DevOps, and CI/CD pipelinesfor deployment automation.
- Understanding of data governance, security, and compliance (KeyVault, RBAC, Managed Identities).
Key Responsibilities
- Design, develop, and maintainscalable, end-to-end data pipelines using Microsoft Fabric, PySpark, and Databricks.
- Build and optimize data modelsand ETL workflows tosupport analytics, reporting, and machine learning.
- Integrate data from relational databases, APIs, and flat files intoAzure Data Lake (ADLS) and Synapse.
- Implement Delta Lake architecture toensure ACID compliance and maintain historical data versions.
- Collaborate with data architects, analysts, and business teams to translate business requirements into technical solutions.
- Optimize Spark and SQLperformance for high-volume data workloads.
- Implement monitoring, alerting, and logging solutions using Azure Monitor andLog Analytics.
- Contribute to data governance andsecurity standards, ensuring data quality and reliability across environments.
- Mentor junior engineers and promote best practicesin modern data engineering and Azure cloud technologies.
Preferred Skills
- Experience with Power BI or similar visualization tools for integrated analytics.
- Exposure to real-timedata processing andevent-driven architectures (Kafka, Event Hubs).
- Familiarity with CI/CD best practices usingAzure DevOps and Git-based workflows.
- Strong problem-solving, analytical, and communication skills.
Why Join KANINI
- Join KANINI's award-winning Data Engineering Team, recognized as the Outstanding Data Engineering Team at DES 2025
- Work on real-world problemsat the intersection of data, AI, and product development
- Be part of a collaborative, innovative, and growth-driven environment.
- Access to cutting-edge tools, leadership support, and continuous learning opportunities.
