Spark SQL, Scipy, Pyspark, Azure Databricks, Numpy, Pandas, Azure Data Lake, Python, RDDs, Databricks Notebooks, MLflow, DataFrames, Synapse Analytics, Delta Lake, Blob Storage, Spark Pools

Distributed Computing, Hadoop, Pyspark, Data structures, Unix Scripting, Data Management, Python, Cloud environment, Data Ops, CI/CD, Data pipelines, Data transformation and integration

Pyspark, Azure Synapse Analytics, Apache Spark, Azure Databricks, Python, Sql, Databricks Unity Catalog, Azure Data Lake Storage ADLS, Delta Lake, Azure SQL Database, Azure Data Factory ADF

Java, Scala, Sql, Python, Data Modeling, Version Control Tools, Kafka, Automation, Batch Data Pipelines, Data Mesh Governance Principles, Schema Governance

data discovery , Performance Tuning, Kafka, Data Modeling, Slas, Data Lineage, Python, Google Cloud Platform, Clustering, Sql, Metadata Management, Data lakehouse principles, Streaming architectures, Google BigQuery, Partitioning, Data pipelines, Parquet, Incremental processing, Feature engineering workflows, Dimensional models, Data quality and observability practices, SLOs, Google Cloud Storage, Pub/Sub, Data versioning

Devops, Java, BigQuery, Dataproc, Sql, ELT, Cloud Storage, Compute Engine, Spark, Apache Beam, DataFlow, Data Analytics, Kubernetes, Python, Etl, Air Flow, Colab, cloud security best practices, Looker, Data Lake Engineering, Pub Sub, Vertex AI

· 3–5 years of experience working with GCP, ReactJS and Python. · Strong SQL and data modelling experience on BigQuery or an equivalent cloud data warehouse. · Experience building ETL/ELT pipelines using GCP-native tools (Dataflow, or similar). · Python backend development (FastAPI or similar) and REST API design. · Experience with core GCP services: BigQuery, Secret Manager., Iam, Cloud Composer, Cloud Functions, Cloud Run

Advanced Sql, Sql Development, Hadoop, Hive, Big Data, Data Analysis, HDFS, Large-Scale Data Management, Data Processing, Data Validation

Cloud Computing, Machine Learning, Computer Science

Rest Api Testing, Test automation, Data Migration Testing, Soapui, Hpqc, Postman, Sql, AWS, Logistics transportation or TMS domain experience