Data Engineer

About the Company

Resource to have good skills in RDBMS (MySQL, PostgreSQL) and also GCP databases along with Data Engineering exposure.

About the Role

Strong data engineering hands-on experience with Airflow, Spark and GCP services like Composer, Dataproc, Dataflow, etc.

Responsibilities

• Strong technical hands-on experience and knowledge of GCP database products – Cloud SQL, Spanner, BigQuery, etc., their advantages, features offered, limitations and ideas to overcome those limitations, maintaining service infrastructure and debugging issues.
• Deep expertise in MySQL and PostgreSQL including schema design, performance tuning, query optimization and DB administration.
• Solid understanding of OLTP and OLAP architectures and practical experience working with both types of systems.
• Deep expertise working with Docker, Kubernetes and Helm (OpenShift/GKE/AKS/EKS).
• Strong scripting and automation skills in Python, Shell, and Terraform for Infrastructure management.
• Knowledge on Java - Spring, Hibernate, JPA, connection pooling etc. is a plus to recommend solutions to applications for debugging connectivity and performance issues from their end.
• Proficiency in GCP networking, design, and configuration.
• Knowledge on GCP Private Service Connect concepts.
• Experience with GCP IAM – user and service account access, permissions, roles, policies, best practices.
• Strong problem-solving and analytical ability with a keen focus on delivering tangible outputs.
• Willingness and genuine interest to work on new Database product POCs and bringing them to Production.
• Prior experience supporting enterprise-scale database solutions on GCP.

Qualifications

Education details

Required Skills

Strong data engineering hands-on experience with Airflow, Spark and GCP services.

Preferred Skills

Knowledge on Java - Spring, Hibernate, JPA, connection pooling etc.

Pay range and compensation package

Pay range or salary or compensation

Equal Opportunity Statement

Include a statement on commitment to diversity and inclusivity.