Data Engineer

Project Role : Data Engineer

Project Role Description : --Resource should have 5+ years of work exp. Strong data warhouse knowledge + Data Analytics in Banking Domain, along with hands on SQL+Python Skills + DQ - Develop, optimize, and maintain complex SQL queries - Good understanding on data, users and should be able to write python code to generate reports. - Build automated data pipelines using Python (Pandas, NumPy, SQLAlchemy, PySpark, etc.). - Integrate data from multiple sources (APIs, flat files, cloud storage, third-party systems). -Experience in Handling DWH & Cl

Must have skills : Python Frameworks

Good to have skills : Ab Initio

Minimum 2 Year(s) Of Experience Is Required

Educational Qualification : 15 years full time education

Summary:

In the role of Data Engineer, a typical day involves managing and enhancing data infrastructure to support business analytics and reporting needs. This includes developing and refining data pipelines, integrating diverse data sources, and ensuring data quality and accessibility. The role requires close collaboration with various teams to understand data requirements and deliver reliable data solutions that drive informed decision-making. Continuous monitoring and optimization of data workflows are essential to maintain efficiency and accuracy in data handling processes.

Roles & Responsibilities:

• Expected to perform independently and become an SME.
• Required active participation/contribution in team discussions.
• Contribute in providing solutions to work related problems.
• Collaborate with cross-functional teams to gather and analyze data requirements.
• Ensure data pipelines are robust, scalable, and maintainable to support evolving business needs.
• Assist in troubleshooting and resolving data-related issues promptly to minimize downtime.
• Document processes and workflows to facilitate knowledge sharing and onboarding of new team members.
  
  

Professional & Technical Skills:

• Must To Have Skills: Proficiency in Python Frameworks, Ab Initio.
• Experience in developing and optimizing complex SQL queries to extract and manipulate data efficiently.
• Strong knowledge of data warehousing concepts and best practices for data storage and retrieval.
• Hands-on experience with building automated data pipelines using Python libraries such as Pandas, NumPy, SQLAlchemy, and PySpark.
• Ability to integrate data from multiple sources including APIs, flat files, cloud storage, and third-party systems.
• Familiarity with data quality management and validation techniques to ensure accuracy and consistency of data.
  
  

Additional Information:

• The candidate should have minimum 2 years of experience in Python Frameworks.
• This position is based at our Pune office.
• A 15 years full time education is required.