DataBricks Developer

Synectics APAC

Indore, India

5-7 Years

Save

Posted 9 days ago
Be among the first 10 applicants

Early Applicant

Job Description

Key Responsibilities

Administer, configure, optimize, and support the Azure Databricks platform.
Design and deploy applications and data pipelines on Azure cloud infrastructure.
Configure and manage Databricks Clusters and Unity Catalog repositories.
Build and maintain scalable batch and real-time data pipelines using Azure data services.
Integrate Azure Databricks with on-premises databases, Power BI, and other enterprise systems.
Collaborate with data engineers, data scientists, architects, analysts, and business stakeholders to meet platform and analytics requirements.
Work closely with SMBC Platform teams, APIM, Azure DevOps, and Support teams.
Manage infrastructure integrations including networking, security, monitoring, and remote access.
Develop and deploy enterprise-grade data platforms supporting advanced analytics and AI use cases.
Provide technical guidance on architecture, design patterns, and Azure best practices.
Analyze business requirements and design Azure-based technical solutions.
Develop, test, and enhance Python-based data processing applications to improve performance and efficiency.
Own projects end-to-end, coordinating with IT teams, data stewards, and third-party vendors to deliver accurate insights.
Ensure data integration adheres to data quality, governance, and accessibility standards.
Enable streaming data use cases and implement standard big-data design patterns.
Collaborate with data scientists to operationalize models and integrate them into automated pipelines.
Review core code changes and support production deployments.
Support migration of Python-based data science models to multi-node Databricks compute environments.

Required Skills & Technical Expertise

Azure Databricks
Azure Data Factory
Azure Data Lake Storage
Azure Functions
Azure Event Grid
Azure Service Bus
Azure Log Analytics & Azure Monitor
Python (strong proficiency), R, SQL
SQL Server, Oracle / PL-SQL, T-SQL, Stored Procedures
Azure DevOps (CI/CD pipelines, release management)
Git / GitLab

Qualifications & Experience

5+ years of hands-on experience in Azure Cloud development.
Proven experience migrating legacy applications to Azure Databricks, Data Lake, SQL Database, and SQL Data Warehouse.
Strong understanding of distributed data processing and cloud-native architectures.
Experience with CI/CD pipelines and software configuration management.
Excellent interpersonal, communication, and stakeholder-management skills.
Ability to work independently and handle moderately complex technical challenges.