Data Factory, Pyspark, Python, Validation Rules, Sql, Technical Documentation, OneLake, lineage, Bronze Silver Gold medallion layering, CDC patterns, Cleansing, alerting, incremental ingestion, Copy Activity, access controls, Spark notebooks, data quality checks, pipeline monitoring, conformance, exception workflows, schema-on-read, watermarking, Lakehouse, Delta Lake, Microsoft Fabric, distributed data processing, metadata capture

Power Bi, Azure, Microsoft Fabric