GCP Data Engineer

Responsibilities:

Data Platform Development & Implementation:

Design, develop, and implement scalable and efficient data pipelines using GCP services (e.g., Dataflow, Cloud Functions, Workflows) for ETL/ELT processes, adhering to established architectural guidelines.

Build robust and scalable solutions for orchestrating data workflows, handling dependencies, and ensuring data integrity.

Develop and optimize data models and data warehouse solutions in BigQuery, ensuring performance and data integrity.

Write complex and highly optimized SQL queries to extract, transform, and load data from various sources

Define and enforce best practices, standards, and guidelines for data platform development and usage.

Evaluate new technologies and methodologies to continuously improve our data platform capabilities and efficiency.

Technical contribution & Collaboration:

Provide technical expertise and guidance to junior team members.

Participate actively in code reviews and contribute to improving code quality and standards.

Collaborate closely with the Data Platform Tech Lead, data scientists, analysts, and other stakeholders to understand data requirements and propose effective technical solutions.

Contribute to the documentation of data pipelines, data models, and development processes.

Proactively identify and troubleshoot complex data-related issues and implement effective solutions.

Stay up-to-date with the latest data engineering trends and technologies and share knowledge with the team.

Consulting and Collaboration:

Consulting various data delivery teams related to data onboarding and other data platform capabilities

Consult with data analysts on data modeling, product design, and BI tool utilization.

Collaborate with business stakeholders to understand their data needs and translate them into technical requirements.

Platform Administration and Management:

Administer and manage the business intelligence platform Sisense and understanding its capabilities

Ensure the security and compliance of the data platform, implementing appropriate measures to protect sensitive information.

Technical Skills:

Expert SQL & Python: Mastery in writing production-grade Python code and advanced SQL (including performance tuning, query optimization, and complex window functions).

Deep Cloud Foundation Architecture(GCP focus): Extensive hands-on experience designing scalable solutions using BigQuery, Cloud Run, Cloud Functions, Data Catalog, Workflows, and IAM.

Backend & DevOps Engineering: Strong ability to manage CI/CD pipelines (CircleCI), Docker containerization, and microservices architecture.

Data Modeling & ETL/ELT: Proven track record in designing efficient data models (Star/Snowflake schemas) and robust data pipelines for large-scale datasets.

BI Proficiency (Sisense focus): Experience building semantic layers for Business Intelligence tools; deep expertise in Sisense is a significant advantage.

Full-Stack Capabilities: Experience with React JS, Typescript and a basic understanding of front-end development concepts is highly desirable.

Technical Leadership: Ability to lead architectural decisions, conduct code reviews, and mentor junior engineers.

Warm & Regards,

Harshini Gadam

Mail: [Confidential Information]

Website:astroideasoftway.com