Search by job, company or skills

N

GCP Engineer

3-7 Years
Save
  • Posted 3 days ago
  • Over 100 applicants
Quick Apply

Job Description

  • Be an integral part of large-scale client business development and delivery engagements by understanding the business requirements.
  • Hands-on with Dataflow/Apache beam and Realtime data streaming
  • Engineer ingestion and processing pipelines on GCP using python libraries, Java, BigQuery and composer.
  • Automate the repeatable tasks into a framework that can be reused in other parts of the projects.
  • Handle the data quality, governance, and reconciliation during the development phases.
  • Being able to communicate with internal/external customers, desire to develop communication and client-facing skills.
  • Understand and contribute in all the agile ceremonies to ensure the efficiency in delivery.
  • Qualification & Experience:
  • A bachelor s degree in Computer Science or related field.
  • Minimum 5 years of experience in software development.
  • Minimum 3 years of technology experience in Data Engineering projects
  • Minimum 3 years of experience in GCP.
  • Minimum 3 years of experience in python programming.
  • Minimum 3 years of experience in SQL/PL SQL Scripting.
  • Minimum 3 years of experience in Data Warehouse / ETL .
  • Ability to build streaming/batching solutions.
  • Exposure to project management tools like JIRA, Confluence and GIT .
  • Ability to define, create, test, and execute operations procedures.
  • Must have skills:
  • Strong understanding of real time streaming concepts
  • Strong problem solving and analytical skills.
  • Good communication skills.
  • Understanding of message queues like Kafka, Rabbit MQ, PubSub
  • Understanding of fast data caching systems like Redis/Memory Store
  • GCP experience - 3+ years
  • Dataflow/Apache beam hands of experience - Custom templates
  • Understanding of Composer
  • Good experience with Big Query and PubSub
  • Good hands-on experience with Python
  • Hands on experience with modular java code development involving design patterns - Factory, Reflection, etc.
  • Good to have skills:
  • GCP Professional Data Engineer certification is an added advantage.
  • Understanding of Terraform script.
  • Understanding of Devops Pipeline
  • Identity and Access Management, Authentication protocols
  • Google drive APIs, One drive APIs

More Info

About Company

Neal Analytics was a native ML/AI Microsoft Solution Partner. It operated as a privately owned corporation from 2011 to 2021, was acquired by Fractal late December 2021, and its operations were fully integrated into Fractal and it ceased to exist as a brand and company on April 1st 2023. Learn more about Fractal at https://fractal.ai Fractalis one of the most prominent providers of Artificial Intelligence to Fortune 500®companies. Fractal's vision is to power every human decision in the enterprise, and bring AI, engineering, and design to help the world's most admired companies. Fractal currently has over 4000 employees across 16 global locations, includingtheUnited States, UK,Ukraine,India,Singapore, andAustralia. Fractal has been recognized as 'Great Workplace' and 'India'sBest Workplaces for Women' in the top 100 (large) category by The Great Place to Work®Institute. It has also been featured as a leader in Customer Analytics Service Providers Wave™ 2021, Computer Vision Consultancies Wave™ 2020 & Specialized Insights Service Providers Wave™ 2020 by Forrester Research Inc.,

Job ID: 120691677

Similar Jobs

Gurugram, Bengaluru

Skills:

NosqlGcpBigQueryPythonEtl

Bengaluru, India

Skills:

Data ModelingDataFlowPythonSqlBig QueryPub SubAPI scriptingAirflowData MappingComposer DAGsGoogle Cloud SDK

Bengaluru, India

Skills:

JavaBigQueryScalaApache SparkSqlELTGitData WarehousingDataFlowPythonEtlData Lakes

Bengaluru, India

Skills:

BigQueryPythonSqlELTEtl

Bengaluru, India

Skills:

bigtable JavaBigQueryPostgreSQLSqlApache AirflowNosqlCloud StorageGitRDBMSTerraformMySQLApache BeamPythonCloud FunctionsCloud DataflowDataformCloud Deployment ManagerFirestoreCloud ComposerdbtCloud SQL