Data Modeling, Sql, Spark, Data Integration, Python, data pipeline development, OneLake, schema management, data quality frameworks, Reconciliation, incremental processing, Pipelines, Notebooks, partitioning, performance optimization, Lakehouse architecture, Microsoft Fabric, Azure data services, Validation

Github, Tableau, Databricks, Dataproc, Informatica, Python, Sql, Airflow, Dataform, Google BigQuery

Kubernetes, Apache Spark, Hadoop, Numpy, Pyspark, Kafka, Pandas, AWS, Node.js, FastAPI, Azure, Docker, Flask, Data Modeling, Milvus, LlamaIndex, GenAI LLMs, Python Ecosystem, Databricks Delta Lake, LangChain, Pinecone

Data Engineer, Python, Sql, Pandas, BigQuery, Etl, Docker, Polar

snowflake , Apache Airflow, Pyspark, Amazon Kinesis, Apache Kafka, Python, Sql, Delta Lake on Databricks, Data Quality Validation, Databricks Workflows

snowflake , Cloudformation, Pyspark, Kafka, Sql, Apache Airflow, Spark Streaming, Kinesis, Terraform, Databricks, Kubernetes, Python, Prefect, DuckDB, dbt, Delta Lake

Aws Lambda, Amazon S3, Apache Spark, AWS Glue, Kafka, Sns, AWS IAM, Python, Apache Iceberg, Airflow, AWS EMR, EventBridge

AWS, Power Bi, SSIS, Python, Kinesis, Pyspark, Kafka, Spark, Advanced Sql, dbt, Data pipeline automation

snowflake , Etl, Sql, Python, Spark

data reconciliation , snowflake , Databases, Data Warehousing, Kafka, Sql, ELT, Gcp, Spark, Databricks, Azure, Etl, AWS, data quality checks, Airflow, Data Validation