Project Role : Custom Software Engineer
Project Role Description : Develop custom software solutions to design, code, and enhance components across systems or applications. Use modern frameworks and agile practices to deliver scalable, high-performing solutions tailored to specific business needs.
Must have skills : Microsoft Azure Databricks
Good to have skills : NA
Minimum 3 Year(s) Of Experience Is Required
Educational Qualification : 15 years full time education
Summary:
We are seeking a Support & Operations Analyst to support, monitor, and optimize our data warehouse and reporting platforms. This role focuses on Databricks-based data pipelines, operational support, data quality, and ensuring reliable reporting for business stakeholders. The ideal candidate is hands-on with data operations, comfortable troubleshooting production issues, and able to collaborate across engineering, analytics, and business teams.
Key Responsibilities
Provide L1/L2 operational support for data warehouse and reporting systems
Monitor Databricks jobs, workflows, and clusters to ensure data availability, performance, and reliability
Troubleshoot and resolve data pipeline failures, performance issues, and reporting discrepancies
Perform root cause analysis and implement preventive fixes
Support and maintain Databricks notebooks, jobs, and workflows
Monitor and optimize Spark performance, cluster configuration, and costs
Assist in deployment, scheduling, and orchestration of data pipelines
Collaborate with data engineers to improve pipeline stability and scalability
Work with reporting teams to resolve data-related issues in dashboards and reports
Maintain clear runbooks, SOPs, and incident documentation
Participate in on-call or scheduled support rotations (if applicable)
Experience in production support or operations for data platforms
Implement and maintain monitoring, alerting, and logging for data processes
Required Skills
Strong experience with Databricks (Apache Spark)
Administering Databricks workspaces and Unity Catalog for centralized data governance and access control
Managing Azure AD (Entra ID) integration, SCIM provisioning, RBAC, and secure Secret Scopes, VNets, ADLS, Paas Services.
Proficiency in SQL server databases & TSQL
Familiarity with BI tools (ADF, ADLS, Power BI)
Scripting experience (Python, Power Shell, Tsql)
Exposure to CI/CD for data pipelines
Additional Information:
- The candidate should have minimum 3 years of experience in Microsoft Azure Databricks.
- This position is based at our Hyderabad office.
- A 15 years full time education is required., 15 years full time education
