GCP Data Engineer (Senior) with skills Data Engineering, Big Data for location Bangalore, India

. Design, code, and develop new features/fix bugs/add enhancements

. Analyze and improve efficiency, scalability and stability of various system resources

. Lead and Mentor junior engineers and drive a culture of technical perfection.

. Drive creative and innovative solutions to complex problems, exemplifying good technical discernment.

. Drive improvements and new approaches to address potential systemic pain points and technical debt, anticipate and avoid problems.

. Take a hands-on approach in the development of prototypes, independently and with others, to establish design decisions and/or technical feasibility.

• Evaluate, Install, Setup, Maintain and Upgrade, Data Engineering, Machine Learning and CI/CD infrastructure tools hosted on Cloud (GCP/AWS)

• Drive the CI/CD infrastructure tooling related work in collaboration with various internal teams to get the user stories, epics, goals to closure

• Propose, participate, implement architecture level enhancements/changes strategically through Dev/Stage/Prod environments

• Design, evangelize, deliver comprehensive best practices & efficient usage of available tooling resources/capabilities to run high-performance systems

• Provide innovative & strategic solutions along with cost & risk analysis, to improve stability, scalability, performance of the tools infrastructure

• Perform troubleshooting, analysis, and resolution of environmental issues

• Innovate and automate processes/tasks to improve operational efficiency

• Document and maintain application setup, runbooks, administration guides and troubleshooting guides

Required Skills:

. Proficiency with a deep learning framework such as TensorFlow

. Experience in building data engineering pipelines

. Experience in Python, Spark/PySpark/Hadoop.

. Understanding or hands on experience with ML Platforms like Google Vertex AI.

. Expertise in building Cloud Native application (GCP/AWS)

. Programming Skills

o Algorithms

o Design Skills

o Refactoring Skills

o Debugging Skills

o Unit testing Skills

. CI/CD

o Jenkins

o Github Actions

. Database

o SQL Databases (Oracle/MySQL/MSSQL etc.,)

o No SQL Databases

o Data Lake, Snowflake, Big Query

Education:

. Graduate in any discipline

Experience:

. 5 - 7 Years.