GCP Data Engineer
Job Description
Unnesting of JSON files in Google BigQuery
Google Cloud Run (using container services, python)
Hands on experience in GCP services like composer, cloud function, cloud run
Experience in developing CI/CD pipelines.
Experience in DBT scripts, docker files and knowledge on datavault is a plus.
Strong technical knowledge and hands on experience of python or java
Role: Data Engineer
Industry Type: IT Services & Consulting
Department: Data Science & Analytics
Employment Type: Full Time, Permanent
Role Category: Data Science & Machine Learning
Education
UG: Any Graduate
PG: Any Postgraduate
More Info
Job Type:
Industry:
Function:
Employment Type:
About Company
Skills:
data engineering , Pyspark, Kafka, Data Warehouse, ELT, Terraform, Python, BigQuery, Google Cloud Platform, Big Data, Dataproc, Sql, Gcp, Spark, Data Lake, DataFlow, Etl, Airflow, Pub Sub, Cloud Composer, Real-time Processing, GKE, Looker, GCS
Skills:
Google Cloud Platform (GCP), Cloud Composer (Airflow), BigQuery, Git, Pyspark, Sql, ETL/ELT pipelines
Skills:
Gcp, Data Engineer
Skills:
Cloud Storage, Pyspark, Dataproc, Python, Terraform, Google Cloud Platform, Tekton, Airflow, Cloud SQL, DataFusion, Data Flow, DataPlex, Confluent Kafka
Skills:
Sql, Dataproc, Python, Gcp, Pyspark, Kafka, Airflow, Cloud Run, Cloud Function, Big Query, Pubsub, Data Flow