Job Description
Project Role : Data Engineer
Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems.
Must have skills : Google BigQuery
Good to have skills : NA
Minimum 7.5 year(s) of experience is required
Educational Qualification : 15 years full time education
Job Summary:
- As a Data Engineer, you will be responsible for designing, developing, and maintaining data solutions to support data generation, collection, and processing. This role involves creating data pipelines, ensuring data quality, and implementing ETL (Extract, Transform, Load) processes to migrate and deploy data across systems. Your day will primarily revolve around working on data solutions, optimizing data pipelines, and ensuring data compliance and quality.
Roles & Responsibilities:
Subject Matter Expertise (SME):
- Act as an SME in the field of data engineering, leveraging your expertise to guide the team and make informed decisions.
Team Collaboration & Management:
- Collaborate with and manage the team to ensure optimal performance and meet project goals.
- Take responsibility for team decisions and engage with multiple teams, contributing to key decisions impacting the project and the organization.
Data Architecture & Design:
- Lead the data architecture design and implementation for various data solutions.
- Work on data modeling and design of databases, ensuring systems are efficient, scalable, and meet business needs.
Pipeline Optimization:
- Optimize data pipelines for performance, scalability, and reliability, ensuring efficient data flow across systems.
Data Quality & Compliance:
- Conduct data quality assessments and ensure the data meets quality standards.
- Ensure data compliance with regulatory standards and organizational policies.
ETL Implementation:
- Lead the design and implementation of ETL processes for migrating and integrating data between various systems.
Professional & Technical Skills:
- Must Have Skills:
- Proficiency in Google BigQuery: Expertise in Google BigQuery for large-scale data processing and querying.
- Data Modeling & Database Design: Strong understanding of data modeling concepts and database design principles.
- Cloud-Based Data Solutions: Experience working with cloud-based data solutions, especially those integrated with BigQuery.
- SQL & Scripting Languages: Proficiency in SQL and scripting languages used for data processing and transformation.
- Data Warehousing: Hands-on experience with data warehousing concepts, ensuring data is properly stored, organized, and easily accessible.
Additional Information:
- Experience: A minimum of 7.5 years of experience working with Google BigQuery and related data technologies.
- Location: This position is based at our Pune office.
- Education: A 15 years full-time education is required.
