Data Pipeline Development: Develop and maintain robust data pipelines using Azure Databricks and Azure Data Factory (ADF) for structured and semi-structured data sources.
Data Optimization: Optimize performance of data pipelines and ensure high data quality.
Collaboration: Work closely with cross-functional teams to support data integration, analytics use cases, and reporting requirements.
Data Integration Support: Assist in integrating various data sources into a unified analytics environment.
Performance Monitoring: Continuously monitor data pipelines for reliability, efficiency, and scalability.
