Data Quality (DQ) rules, Metadata Management, Unix, Databricks, Python, Data lineage techniques, Master data management, Data modeling methodologies, Big Data storage architecture

Workflows, Apis, Cloudformation, Pyspark, Sql, Devops, MLops, Terraform, Spark, Databricks, Azure, Python, AWS, Databricks Lakehouse, dbt

Spark SQL, Pyspark, Apache Spark, Sql, Git, Hive, Linux, Hiveql, Data Modelling, Python, Hadoop Hdfs, Apache Iceberg, Parquet, Distributed-system troubleshooting, Spark performance tuning, Source-to-target mapping, Hive Metastore, Large-volume ETL data migration, Data validation reconciliation

snowflake , BigQuery, AWS Glue, Redshift, Sql, Data Integration, Azure Sql, ELT, Azure Data Factory, Gcp, Data Architecture, Databricks, Azure, Python, AWS, Etl, Airflow, Cloud Data Platforms

snowflake , Java, Scala, Pyspark, Apache Spark, Sql, Gcp, Terraform, Docker, Databricks, Azure, Python, Kubernetes, AWS, Airflow, Deequ, Great Expectations, Prefect

Java, Scala, Restful Apis, Kubernetes, Python, Sql, OLAP and OLTP systems, big data engineering

bigtable , Pyspark, PostgreSQL, Kafka, Avro, Cloud Storage, Terraform, Docker, Elasticsearch, Python, Spark SQL, Java, BigQuery, Google Cloud Platform, Scala, Apache Spark, Dataproc, Sql, Oop, DataFlow, Kubernetes, Airflow, Pub Sub, Cloud Composer, Parquet

Java, BigQuery, Hadoop, Data Modeling, Kafka, ELT, Microservices, Data Quality, Hive, MLops, Spark, Databricks, Data Governance, Python, Kubernetes, Etl, Airflow, HDFS, Delta Lake, CI/CD

Automated Testing, ELT, Python, Apis, Sql, Git, Data Quality, Spark, Databricks, Etl, file-based integration, lineage, CI CD, access controls, metadata, observability, data pipeline development, workflow orchestration, event processing, data contracts, Unity Catalog, data models, transformations, Delta Lake, cloud data platforms

T-sql, Azure Data Bricks, Pl Sql, Sql, Azure Data Factory, Azure Functions, Azure Data Lake, Databricks, Cosmos DB, Python, Analysis Services, Logic Apps, Azure SQL Database, App Service, Delta Lake, Blob Storage