I
Azure Databricks, Genie
Job Description
- Primary skills: Azure Databricks, Genie
- Lead end-to-end implementation of data engineering solutions on Azure Databricks, ensuring scalability, reliability, and maintainability.
- Drive technical design discussions and translate business requirements into well-structured Databricks/Genie-based solutions.
- Provide technical guidance, code reviews, and mentorship to ensure consistent engineering standards across the team. Databricks & Genie Development
- Build and optimize notebooks, jobs, and workflows leveraging Azure Databricks and Genie capabilities.
- Develop reusable components and patterns to accelerate delivery across multiple use cases.
- Troubleshoot production issues, perform root-cause analysis, and implement preventive improvements. Performance, Quality & Operations
- Optimize cluster configurations, job performance, and resource usage to balance speed and cost.
- Establish monitoring and operational practices for pipeline health, failures, and SLAs.
- Ensure data quality checks and validation steps are embedded into pipelines and workflows. Minimum Qualifications:
- 5–8 years of overall experience in data engineering / analytics engineering roles with ownership of production-grade delivery.
- Strong hands-on experience with Azure Databricks and Genie for building and managing data workflows.
- Solid experience with Databricks development and operationalization (jobs, workflows, notebooks).
- Ability to lead technical discussions, perform reviews, and guide implementation best practices.
- Education: BTECH, MTECH, MCA, MSC. Preferred Qualifications:
- Experience designing scalable data processing patterns and reusable frameworks within Databricks environments.
- Proven track record of performance tuning and cost optimization for Databricks workloads in enterprise settings.
- Experience establishing engineering standards (branching, reviews, release practices) and mentoring team members.
- Strong stakeholder management skills with the ability to align technical delivery to business outcomes.
- Exposure to production support models, incident handling, and continuous improvement for data platforms.
More Info
Key Skills
Monitoring and operational practices
Data quality checks and validation
Databricks development
About Company
Skills:
Data Modelling, Microsoft Power Bi, Mulesoft, Marketo, Azure Databricks, Sql, Git, Azure Data Factory, Spark, Data Warehousing, MongoDB, Cosmos DB, Python, Etl, Data Lakes, NoSQL databases, Agile processes, Kingswaysoft
Skills:
Azure Synapse Analytics, Azure Databricks, Hive, Python, Scala, Pyspark, Azure SQL Database, Azure SQL Data Warehouse
Skills:
Azure Data Factory, Pyspark, Azure Databricks, Tsql, Python, Sql, Synapse
Skills:
Api Management, Apache Spark, Azure Databricks, Azure Data Factory, Terraform, Delta Lake Architecture, Azure Data Lake Storage Gen2, Service Principals, Azure Key Vault, Unity Catalog, Databricks Asset Bundles, rbac, CI CD pipelines, Event Grid, Azure Data Services
Skills:
snowflake , Git, Pyspark, Azure Databricks, Python, Sql, ELT, Etl, Azure DevOps