Job Description
About the Company
Brillio is seeking an experienced Databricks Architect with deep expertise in Azure Databricks and modern cloud-based data platforms. The ideal candidate should have recent hands-on experience architecting and delivering enterprise-scale solutions on Azure Databricks, driving data modernization initiatives, and leading technical teams.
About the Role
Brillio is seeking an experienced Databricks Architect with deep expertise in Azure Databricks and modern cloud-based data platforms. The ideal candidate should have recent hands-on experience architecting and delivering enterprise-scale solutions on Azure Databricks, driving data modernization initiatives, and leading technical teams.
Responsibilities
- Define and drive the architecture roadmap for enterprise data platforms using Azure Databricks.
- Design scalable, secure, and high-performance data solutions for batch and real-time processing.
- Architect data lakehouse solutions leveraging Databricks, Delta Lake, ADF, and Azure services.
- Provide technical leadership and governance on data engineering best practices.
- Lead solution reviews, performance optimization, and cost optimization initiatives.
- Collaborate with business, engineering, and architecture teams to deliver strategic data programs.
- Guide development teams on coding standards, CI/CD, DevOps, and deployment frameworks.
- Mentor junior engineers and architects on Databricks and Azure technologies.
Qualifications
- 10+ years of overall IT experience.
- Minimum 4+ years of hands-on experience with Databricks.
- Must have worked on Azure Databricks in recent projects.
- Strong expertise in PySpark, Spark Optimization, Delta Lake, and Data Lakehouse architectures.
- Experience designing enterprise-scale cloud data platforms.
- Exposure to migration and modernization programs from legacy/on-prem platforms to Azure.
- Strong stakeholder management and client-facing experience.
Required Skills
- Recent hands-on experience with Azure Databricks
- Databricks Architecture & Solution Design
- PySpark / Spark
- Azure Data Factory (ADF)
- Azure Data Lake Storage (ADLS Gen2)
- Delta Lake & Medallion Architecture
- Azure Synapse Analytics
- Python and SQL
- Data Warehousing & Data Modeling
- Cloud Architecture & Data Platform Modernization
Preferred Skills
- Databricks Certified Professional / Azure Certifications.
- Experience with Snowflake, Fabric, Airflow, Kafka, or Event Hub.
- Knowledge of Data Governance, Data Quality, and Security frameworks.
- Experience working in consulting or digital transformation environments.
Notice Period: Immediate to 30 Days Preferred
Equal Opportunity Statement
Brillio is committed to diversity and inclusivity.
More Info
Key Skills
Databricks Architecture Solution Design
Data Platform Modernization
Delta Lake Medallion Architecture
About Company
