Scala, Apache Spark, Data Quality, Databricks, Data Governance, Azure DevOps, Logging, Alerting, Security, Cloud Platforms, GitHub Actions, Monitoring

data warehouses , snowflake , BigQuery, Pyspark, Kafka, Sql, Docker, Terraform, Spark, Databricks, Azure, Kubernetes, Python, Airflow, data lakes, dbt, ELT frameworks, cybersecurity principles

Java, Scala, Apache Spark, Kafka, Databricks, Python, AirFlow, Hive SQL, AWS EMR, Big Data ecosystems, GCP BigQuery

Apis, Validation Rules, Data Quality, data pipelines, reconciliation frameworks, data correctness, automated monitoring, automated testing frameworks, data quality metrics, quality engineering best practices, evaluation datasets, AI-powered Analytics Agent, response accuracy