Data Engineer

Project Role : Data Engineer

Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems.

Must have skills : Large Language Models (LLMs)

Good to have skills : NA

Minimum 3 Year(s) Of Experience Is Required

Educational Qualification : 15 years full time education

Summary:

As a Data Engineer, a typical day involves designing, developing, and maintaining comprehensive data solutions that support data generation, collection, and processing activities. The role includes creating efficient data pipelines to facilitate smooth data flow, ensuring the accuracy and integrity of data throughout its lifecycle. Additionally, the position requires implementing processes to extract, transform, and load data, enabling seamless migration and deployment across various systems. This role demands continuous monitoring and optimization of data workflows to support organizational needs and enhance overall data management capabilities.

Roles & Responsibilities:

• Expected to perform independently and become an SME.
• Required active participation/contribution in team discussions.
• Contribute in providing solutions to work related problems.
• Collaborate with cross-functional teams to understand data requirements and deliver scalable data solutions.
• Monitor and troubleshoot data pipelines to ensure reliability and performance.
• Document data processes and workflows to maintain transparency and facilitate knowledge sharing.
• Support junior team members by providing guidance and sharing best practices.
  
  

Professional & Technical Skills:

• Must To Have Skills: Proficiency in Large Language Models (LLMs).
• Experience in designing and optimizing data pipelines for large-scale data processing.
• Strong understanding of data integration techniques and ETL processes.
• Familiarity with data storage solutions and data quality assurance methods.
• Ability to work with diverse data formats and ensure data consistency across systems.
  
  

Additional Information:

• The candidate should have minimum 3 years of experience in Large Language Models (LLMs).
• This position is based at our Bengaluru office.
• A 15 years full time education is required.