Senior Data Engineer

Location Name: Pune Corporate Office - Mantri

Job Purpose

We are looking for a highly motivated Senior Data Engineer to join our team. The successful candidate who knows data bricks/SQL/PySpark/Power BI/ADF. The Data Engineer will be responsible for designing, building, and maintaining the data infrastructure that supports our data bricks. The ideal candidate will have a strong background in data management and be well-versed in the latest data engineering technologies.

Duties And Responsibilities

•  Design and implement data pipelines to support the data bricks/data lakehouse
•  Test and validate data integrity in the lakehouse
•  Develop data pipeline for data extractions (ADF)
•  Optimize data query/pipeline performance
•  Good understanding of Financial service domains and understanding of data
•  Stay current with the latest data engineering technologies and best practices
  
  

Required Qualifications And Experience


Required Experience & Skills

•  Developing and managing data bricks/ADF/Power BI/Microsoft Fabric
•  Strong experience in data management and data engineering and data modelling
•  Proficient in SQL and one or more programming languages such as Python or Pyspark
•  Experience with cloud-based data lakehouse technologies such as AWS Lake Formation, Azure Data Lake Storage, or Google BigQuery
•  Strong problem-solving and analytical skills
•  Excellent communication and collaboration skills
•  Bachelor's degree in computer science, engineering, or a related field