GCP Data Engineer

TCS has been a great pioneer in feeding the fire of Young Techies like you. We are a global leader in the technology arena and there's nothing that can stop us from growing together.

TCS is Hiring for GCP Data Engineer

Experience Range: - 6 +

Job Locations : Bangalore, Noida, Hyderabad , Mumbai, Kolkata , Pune .

Technical/Functional Skills

1. Expertise on GCP services Airflow/Cloud Composer/Google Cloud storage, Data Modelling skills.
2. Hands-on experience in developing, maintaining, and supporting Airflow / Cloud Composer DAGs.
3. Strong Python/Pyspark programming skills, including experience working with GCP APIs.
4. Experience with GCP Data Engineering services including BigQuery, Dataflow, Dataproc, Pub/Sub, Cloud Functions, Cloud Composer, and Cloud Storage.
5. Proficient in writing complex SQL queries and stored procedures in BigQuery.
6. Experience in cost, performance, and runtime optimization of Airflow / Composer DAGs and BigQuery SQL/stored procedures.
7. Ability to stay current with emerging and existing GCP services and provide guidance to technical teams as cloud capabilities evolve.
8. Relevant GCP certifications such as Google Cloud Professional Architect or Google Professional Data Engineer.
9. Experience working with BI platforms, reporting tools, data visualization products, and ETL engines.
10. Experience with any MPP data warehouse such as Netezza, SQL Server, Teradata, etc.
11. Strong ability to communicate and present complex technical concepts clearly and appropriately based on the audience, across all levels of the organization.
12. Client-focused mindset, able to build strong working relationships with stakeholders and ensure prompt, clear, and effective communication.

Roles & Responsibilities

1. Build and maintain ETL / ELT pipelines

• Build, maintain, and troubleshoot ETL/ELT pipelines using GCP services.
• Ingest, transform, and load data from relational databases, APIs, streaming data, and flat files.
• Work with ETL data load techniques and workflows in the GCP stack
• Develop and maintain pipelines to move large volumes of data across platforms using tools such as Python and Dataflow.

1. Data modeling, querying, and transformation

• Develop and maintain data models for storage, retrieval, and analysis.
• Demonstrate strong proficiency in SQL for querying, manipulation, and optimization.
• Use Python, PySpark, or Java for data manipulation, scripting, and automation.

1. Integrate data from multiple sources

1. Have hands-on exposure to CI/CD and Git in the GCP environment

1. Use scripting and automation for improving and enhancing existing systems and automating ETL processes.

1. Work on reporting data requirements and understanding customer needs.