Data Engineer

Job Title: GCP Data Engineer/BigQuery Developer

Relevant Experience (in Yrs.) 5-8 years

Location: Hyderabad, Pune

Technical/Functional Skills

1) Expertise on GCP services Airflow/Cloud Composer/Google Cloud storage/ BigQuery,

2) Experience in developing. maintaining and supporting Airflow/Composer DAG's

3) Good hands-on experience in Python programming, working with GCP API's

4) Experience with Data Engineering services in GCP- Big Query, Data flow, DataProc Pub-Sub, Cloud Function, Composer, Storage etc.

5) Experience with writing complex queries, stored procedures in BigQuery

6) Experience in cost/process/run time optimization of Airflow/Composer DAG's and/or stored procedure/queries in BigQuery

7) Extensive experience supporting software development projects utilizing GCP technologies. Past roles may include systems architect, software developer, and/or systems engineer

8) Stay up to date with existing and new cloud services, providing guidance to technical teams as available cloud capabilities evolve

9) Relevant certifications such as Google Cloud Professional Architect, Google Professional Data Engineer

10) Experience with BI platforms, reporting tools, Data visualization products, ETL engines

11) Experience with any MPP (Netezza, SQL Server, Teradata, etc.)

12) Ability to communicate and present complex issues and ideas with precision and clarity, adjusting appropriately for the audience; ability to communicate effectively at all levels of the organization

13) Client satisfaction-focused; establishes relationships with business partners and ensures prompt, clear dedicated, and effective communications with these partners

Roles & Responsibilities

1) Ensure success in designing, building, and migrating applications, software, and services on the GCP platform

2) Act as subject matter expert on GCP and work with business units, software developers, security, and IT to design and build applications and services within GCP

3) Provide end-to-end solution expertise to determine best architecture and cloud services to meet the business requirements

4) Architectural design reviews, including alignment with future state architecture, evaluation of technology alternatives, cost impact analyses and consistency across Information Systems

5) Lead all the activities assigned for respective application Troubleshooting and Issue, providing resolutions to various teams

6) Staying updated with the latest GCP services, features, and best practices is essential

7) Works effectively in a team environment; addresses conflicts appropriately, and builds productive partnerships with customers,