Job Title: Senior Databricks Architect
Experience: 1420 Years
Location - Bangalore, Hyderabad, Chennai, Gurgaon, Pune, Kolkata
Company Profile:- https://www.tredence.com/
Key Responsibilities
- Design and own end-to-end RGM data platform architecture on Azure using Databricks, supporting pricing, promotion, and POS analytics for CPG clients.
- Lead the architecture and implementation of Azure Lakehouse solutions, following Medallion (BronzeSilverGold) design principles.
- Provide deep technical leadership in Databricks and Azure Data Engineering, ensuring scalable, performant, and resilient solutions.
- Drive data assessment and profiling activities, including source system analysis, data quality gaps, granularity, latency, and readiness for analytics.
- Architect and implement robust, incremental data ingestion and processing frameworks for large-scale datasets.
- Build and oversee ADF and Databricks-based data pipelines, including orchestration, scheduling, monitoring, and failure handling.
- Design and govern dimensional data models (facts & dimensions) optimized for RGM analytics and downstream BI/reporting.
- Ensure data governance, quality, and observability, including lineage, completeness, accuracy, and timeliness across the platform.
- Implement security best practices using Azure RBAC, managed identities, and secure data access patterns within Databricks and ADLS.
- Optimize Databricks cluster configurations and compute usage to balance performance and cost efficiency.
- Act as a trusted client-facing architect, translating business requirements into technical solutions and presenting architecture to senior stakeholders.
- Collaborate with cross-functional teams (data engineers, analysts, product owners) and mentor junior architects and engineers.
- Stay current with Azure and Databricks advancements and continuously improve platform design, standards, and best practices.
