Data Engineer

Project Role : Data Engineer

Project Role Description : --Resource should have 5+ years of work exp. Strong data warhouse knowledge + Data Analytics in Banking Domain, along with hands on SQL+Python Skills + DQ - Develop, optimize, and maintain complex SQL queries - Good understanding on data, users and should be able to write python code to generate reports. - Build automated data pipelines using Python (Pandas, NumPy, SQLAlchemy, PySpark, etc.). - Integrate data from multiple sources (APIs, flat files, cloud storage, third-party systems). -Experience in Handling DWH & Cl

Must have skills : Python Frameworks

Good to have skills : Ab Initio

Minimum 2 Year(s) Of Experience Is Required

Educational Qualification : 15 years full time education

Summary:

As a Data Engineer, your typical day involves managing and enhancing data infrastructure to support business needs. You will engage in designing and maintaining data pipelines, ensuring seamless integration of data from various sources. Collaboration with team members to understand data requirements and deliver timely solutions is a key part of your routine. You will also monitor data workflows to maintain accuracy and efficiency, contributing to the overall data strategy within the organization. Your role is pivotal in enabling data-driven decision-making by ensuring reliable and accessible data systems.

Roles & Responsibilities:

• Expected to perform independently and become an SME.
• Required active participation/contribution in team discussions.
• Contribute in providing solutions to work related problems.
• Collaborate with cross-functional teams to gather and analyze data requirements.
• Design, develop, and maintain scalable data pipelines to support analytics and reporting.
• Monitor and troubleshoot data workflows to ensure data quality and system reliability.
• Document processes and best practices to facilitate knowledge sharing within the team.
  
  

Professional & Technical Skills:

• Must To Have Skills: Proficiency in Python Frameworks.
• Good To Have Skills: Experience with Ab Initio.
• Strong knowledge of data warehousing concepts and architecture.
• Experience in developing and optimizing complex SQL queries.
• Familiarity with data integration techniques and tools.
• Ability to work with large datasets and perform data transformation using Python libraries.
  
  

Additional Information:

• The candidate should have minimum 2 years of experience in Python Frameworks.
• This position is based at our DDC 1 - STPI location.
• A 15 years full time education is required.