Overview
Position Purpose
Lead the technical direction of StoneX's Azure data platform. You will own the platform architecture of our Lakehouse and BI semantic layer, guide a team of four engineers, and work directly with product, business, and technical stakeholders to deliver platform initiatives. This is a hands-on technical lead role — you set direction, review designs, and solve the hardest problems.
Responsibilities
Primary Responsibilities
- Own the architecture of the Azure data platform end-to-end — Databricks Lakehouse, Fabric, and the BI semantic layer (Power BI, SSAS/AAS).
- Engage directly with product, business, and technical stakeholders to identify, scope, and deliver data platform initiatives.
- Lead delivery across a team of four engineers — break down work, unblock, mentor, and raise the engineering bar through design and code reviews.
- Set standards for data modeling, PySpark/SQL quality, semantic-model design, testing, CI/CD, and production readiness.
- Own platform infrastructure as code (Terraform, Kubernetes, Helm) and the CI/CD, monitoring, and observability that supports it.
- Define and uphold SLAs for the platform; lead incident response; drive cost, performance, and reliability improvements.
- Partner with Architecture, Security, DevOps, Cloud Engineering, and Networks to meet enterprise and regulatory standards.
- Architecting AI platforms at scale — Claude, GitHub, Azure AI Foundry, and Databricks Mosaic AI
Required
Qualifications
- 8+ years of data engineering / data platform experience, including 2–3 years as a technical lead owning architecture and guiding engineers.
- Deep, hands-on expertise in Azure Databricks — Delta Lake, PySpark, Unity Catalog, cluster and performance tuning at scale.
- Strong experience with Microsoft Fabric and ADLS Gen2.
- Strong Python (PySpark) and SQL; proficient in at least one additional language (Java, C#, or similar).
- Hands-on with Docker, Git, Kubernetes, and IaC (Terraform, Ansible).
- Solid competencies across Azure cloud networking, identity management, storage, and compute.
- Track record of architecture and design authority on non-trivial platforms.
- Bachelor's degree in Computer Science, Mathematics, Electrical Engineering, or related discipline — or equivalent experience.
Preferred
- Financial services or other regulated-industry experience.
- Production experience with Microsoft Fabric (OneLake, Direct Lake).
- Data governance experience — Unity Catalog, lineage, data contracts, cost governance / FinOps on Databricks.
- Experience designing and operating BI solutions on Power BI and SSAS - dataset design, DAX, RLS, capacity and refresh.
- Familiarity with Kimball modeling patterns.
Working Environment
- Hybrid, Bangalore (4 days).
- Dynamic, time-sensitive environment.
- Travel as required.
