Azure Databricks ETL Pipeline Specialist (DevOps)

Key Responsibilities:

• Design, develop, and maintain data pipelines using Azure Databricks.
• Collaborate with cross-functional teams to identify, analyze, and prioritize project requirements.
• Develop and maintain ETL processes ensuring data accuracy, integrity, and consistency.
• Troubleshoot and resolve data pipeline failures or errors efficiently.
• Optimize data pipeline performance to improve efficiency, scalability, and reliability.
• Implement and maintain best practices for CI/CD, monitoring, and automation.
• Ensure compliance with security and regulatory standards across data operations.
• Participate in code reviews and provide technical guidance to team members.