Data Quality (DQ) rules, Metadata Management, Unix, Databricks, Python, Data lineage techniques, Master data management, Data modeling methodologies, Big Data storage architecture

Workflows, Apis, Cloudformation, Pyspark, Sql, Devops, MLops, Terraform, Spark, Databricks, Azure, Python, AWS, Databricks Lakehouse, dbt

Spark SQL, Pyspark, Apache Spark, Sql, Git, Hive, Linux, Hiveql, Data Modelling, Python, Hadoop Hdfs, Apache Iceberg, Parquet, Distributed-system troubleshooting, Spark performance tuning, Source-to-target mapping, Hive Metastore, Large-volume ETL data migration, Data validation reconciliation

Azure Data Factory, Pyspark, Databricks, Sql, Azure DevOps, CI CD workflows, ADLS Gen2, Event Hub, Azure-native technologies, Azure SQL Database

BigQuery, Scala, Apache Spark, Kafka, Dataproc, Jenkins, Git, Hive, Gcp, Etl, workflow orchestration tools, CI CD, Pub Sub, GCS

snowflake , BigQuery, AWS Glue, Redshift, Sql, Data Integration, Azure Sql, ELT, Azure Data Factory, Gcp, Data Architecture, Databricks, Azure, Python, AWS, Etl, Airflow, Cloud Data Platforms

Automated Testing, ELT, Python, Apis, Sql, Git, Data Quality, Spark, Databricks, Etl, file-based integration, lineage, CI CD, access controls, metadata, observability, data pipeline development, workflow orchestration, event processing, data contracts, Unity Catalog, data models, transformations, Delta Lake, cloud data platforms

T-sql, Azure Data Bricks, Pl Sql, Sql, Azure Data Factory, Azure Functions, Azure Data Lake, Databricks, Cosmos DB, Python, Analysis Services, Logic Apps, Azure SQL Database, App Service, Delta Lake, Blob Storage

Scikit-learn), Machine Learning frameworks (TensorFlow, Sql, Pytorch, Python, Gcp, LangChain, Generative AI, MLflow, LangSmith, LangGraph, GraphQL APIs, Langfuse, Azure AI, LlamaIndex, Anthropic Claude, Google Gemini, OpenAI, Large Language Models