Apache Spark, automating data quality validation, data transformation using SQL, serverless ETL using AWS Glue, AI-assisted coding tools, designing system solutions at scale, managing and maintaining data pipelines

snowflake , Pyspark, Sql, Pandas, Databricks, Python, AWS, Glue Catalog, Agentic AI architecture, Data Catalog, Unity Catalog, ETL frameworks, RAG AI data pipelines, MCP API-based data access patterns, Data Mesh, Spark-based systems, Metadata platforms