Apache Airflow, Spark, Apache Beam, Python, Data Platform Management, Data Layer Design, dbt, Google Cloud Ecosystem, Google Cloud Services, Data Pipeline Development

data engineering , Data Transformation, Power Bi, Data Modeling, Sql, ELT, Git, Microsoft Azure, Python, Etl, Azure DevOps, table maintenance, data quality checks, OneLake, data pipelines, schema validation, Spark notebooks, cloud data platforms, ADF pipelines, Lakehouse tables, Microsoft Fabric

Strong SQL including analytical functions and query optimisation, Fluent use of coding agents and LLM tooling, Testing lineage and governance, ETL and ELT batch and streaming in Python, Production ownership of data systems

BigQuery, Hadoop, Pyspark, Data Warehousing, Bash, Sparksql, Dataproc, Sql, Cloud Storage, Hive, Gcp, Iam, DataFlow, Python, Airflow, DataFrame, Pub Sub

Java, Hive, Hadoop, Scala, Spark, Nodejs, Emr, Python, Sql, AI code generation tools

BigQuery, Logging, Tableau, Sql, Gcp, App Engine, Python, GCP IAM, Looker, Monitoring, Production Support, AI LLM applications, Spanner, batch streaming pipelines

Nosql, data mining, Python Programming, Sql, ML methodologies, Statistical Techniques, GenAI LLM data pipelines

Github, Tableau, Databricks, Dataproc, Informatica, Python, Sql, Airflow, Dataform, Google BigQuery