T
Data Engineer
T
- Posted 20 hours ago
- Be among the first 10 applicants
Job Description
A Google Cloud Platform (GCP) Data Engineer designs, builds, and manages secure, scalable data processing systems and pipelines to turn raw data into actionable insights.
Exp- 6 to 10
PAN india
Essential Core Skills
- Programming & Querying: Strong proficiency in SQL for data analysis and relational databases, alongside Python or PySpark for automation and pipeline scripting.
- Core GCP Tools: Deep understanding of BigQuery (data warehousing/analytics), Cloud Storage (GCS) (blob storage), and Pub/Sub (real-time messaging).
- Processing & Orchestration: Expertise in Dataflow (batch/streaming via Apache Beam), Dataproc (managed Spark/Hadoop), and Cloud Composer (workflow orchestration via Apache Airflow).
- Modern Data Stack: Familiarity with transformation tools like dbt, Dataform, and data governance frameworks like Dataplex.
More Info
About Company
Skills:
Distributed Computing, BigQuery, Hadoop, Pyspark, Apache Spark, Google Cloud, Jenkins, Hive, shell scripting, Python Programming, AWS ecosystem, Git repository, CDC operations, UNIX operating system concepts, Agile delivery model, Cloudera Hortonworks Data Platform, Data historical load, AWS S3 Filesystem operations
Skills:
Azure Synapse, Pyspark, Databricks, Python, Sql, Azure Devops, Eventhub, Relational Databases, non-relational databases, Azure Datafactory, Big Data pipelines architectures
M
Skills:
Pyspark, Apache Spark, Kafka, Sql, Apache Airflow, Terraform, Docker, Databricks, Data Governance, Azure, Kubernetes, Python, AWS, Infrastructure as Code
Skills:
snowflake , Java, Streaming, Scala, ELT, Cloudera, Agile, Databricks, Azure, Python, AWS, Etl, Data lakes, Medallion-layered data structures, Data pipeline frameworks
Skills:
stream processing , Azure Databricks, Azure cloud services, Sql, Big data tools, Message queuing, Relational SQL Databases