Spark SQL, Distributed Computing, Pyspark, Apache Spark, Data Governance, Data Warehousing, Sql, ELT, Gcp, Agile, Databricks, Azure, Python, Etl, AWS, Databricks certification, Streaming frameworks, Auto Loader, Unity Catalog, Delta Lake, Lakehouse architecture, CI/CD for data pipelines

Performance Tuning, Pyspark, Sql, ELT, Azure Security, Git, Identity access management, Python, Logging, Etl, Power BI Semantic Models, Automated deployment, Data quality monitoring, Troubleshooting, Production Support, CI-CD practices, Delta Lake, Lakehouse architecture, Microsoft Fabric, Dimensional data modelling, OneLake Lakehouse Data Pipelines, Fabric Notebooks

Cloud-native data architectures (Azure preferred), Azure Data Factory, Pyspark, Databricks, Python, Sql, Apache Airflow, Adf, Azure Logic Apps, Delta Lake, Event triggers, LLM data pipelines, Orchestration frameworks, MLflow, ADLS Gen2 Blob Storage, ETL/ELT patterns

Data Services, Data Architecture, API design, Data Modeling, AI ML concepts, data pipelines, data-serving APIs, low-level system design, data platforms, data ingestion

Terraform or equivalent Infrastructure as Code (IaC), Apache Spark, Big Data Technologies, Version Control, Docker, Rest Apis, Python, Kubernetes, Serverless architectures, Event-driven workflows, Testing and deployment practices, CI/CD pipelines

Azure Synapse, Apis, Power Bi, Databricks, Sql, Azure DevOps CI CD pipelines, Azure Data Warehouse, ETL processes

Git, Azure Data Factory, Power Bi, Pyspark, Spark, Databricks, Sql, Python, Azure DevOps, Azure Pipelines, Delta Lake

snowflake , Azure Data Factory, Data Transformation, Sql, ETL processes

BigQuery, SQL Server, Sql, Cloud Storage, Terraform, Spark, Apache Beam, Couchbase, Rest Apis, DataFlow, Python, Data Lake, Data Warehouse, Cloud Build, Cloud Composer, Dataplex, datastream, Cloud Functions, CI/CD pipelines, Lakehouse, Google Cloud Professional Data Engineer certification, File or object-storage sources, Pub/Sub