Design, develop, test, and deploy robust and scalable data pipelines using Azure Databricks, PySpark, and Spark SQL for processing large volumes of structured and unstructured data.
Implement workflow orchestration using Azure Data Factory and Databricks Workflows to automate ETL/ELT processes.
Implement and maintain CI/CD pipelines for Databricks notebooks, scripts, and configurations using Azure DevOps or GitHub Actions, promoting code across dev, test, and prod environments.
Develop and maintain healthcare data models, including data entities, relationships, and data flows, to support healthcare analytics and decision-making.
Design and implement enterprise-wide BI architectures. Develop and maintain data warehouses and data marts.
Develop and maintain reports, dashboards, and data visualizations. Collaborate with stakeholders to understand business needs and provide data-driven insights