Search by job, company or skills

Gcp Data Engineer

2-6 Years
Quick Apply
  • Posted a month ago
  • Over 200 applicants have applied

Job Description

Key Responsibilities:

  • Design & Implement Data Pipelines: Develop and optimize ETL/ELT pipelines using Dataflow, BigQuery, and Cloud Composer (Airflow).
  • Data Integration: Work with structured and unstructured data sources, integrating data from on-premise and cloud-based systems.
  • Data Warehousing & Modeling: Design high-performance data models in BigQuery, ensuring scalability and cost efficiency.
  • Automation & Infrastructure as Code (IaC): Implement Terraform for provisioning GCP resources and automate deployments.
  • Streaming & Batch Processing: Work with Pub/Sub, Dataflow (Apache Beam), and Kafka for real-time and batch data processing.

Required Skills & Qualifications:

  • Education: Bachelors or Masters degree in Computer Science, Data Engineering, or a related field.
  • 7+ years of experience in data engineering, cloud data solutions, and pipeline development.
  • GCP Expertise: Hands-on experience with BigQuery, Scala, Dataflow, Pub/Sub, Cloud Storage, Cloud Composer (Airflow), Vertex AI, and IAM Policies.
  • Programming: Proficiency in Python, SQL

More Info

Job Type:
Industry:
Function:
Employment Type:

About Company

Job ID: 111421427

Similar Jobs

Gurugram, Gurugram, India

Skills:

UnixBigQueryPostgreSQLApache SparkELTApache AirflowCloud StorageGitDockerLinuxMySQLMongoDBDataFlowKubernetesPythonEtlCloud Pub SubGCP services

Gurugram, Gurugram, India

Skills:

BigQueryHivePysparkSparkDataprocDataFlowMapreduceGCS

Gurugram, Noida, Delhi NCR

Skills:

PysparkPythonGCP Data Engineer

Gurugram, Gurugram, India

Skills:

JavaHadoop EcosystemCassandraPysparkScalaSqlCloud StorageGitSparkMongoDBApache BeamDataFlowPythonNoSQL databasesCloud Composer

Gurugram, Gurugram, India

Skills:

HiveHadoopPysparkBashData Warehousing ConceptsSparksqlPythonSqlBig Data TechnologiesAirflowDataFrame