Search by job, company or skills

T

Data Engineer (Pyspark and Palantir)

new job description bg glownew job description bg glownew job description bg svg
  • Posted 4 hours ago
  • Be among the first 10 applicants
Early Applicant

Job Description

Role : Data Engineer(Pyspark & Palantir)

Location: Bangalore

Experience range: 5 to 10yrs

Notice period: 0-30/45 days or Immediate joiners are preferred

Mode of Interview: Virtual

Date of Interview: 18th Dec,25(Thursday)

Time of Interview: 10am to 2pm

Ex-TCSers are not allowed and experience range less than 5yrs will not be considered

Key Responsibilities:

  • Design, develop, and maintain data pipelines and ETL workflows using PySpark, SQL, and Palantir Foundry.
  • Collaborate with data architects, business analysts, and actuarial teams to understand reinsurance data models and transform complex datasets into usable formats.
  • Build and optimize data ingestion, transformation, and validation processes to support analytical and reporting use cases.
  • Work within the Palantir Foundry platform to design robust workflows, manage datasets, and ensure efficient data lineage and governance.
  • Ensure data security, compliance, and governance in line with industry and client standards.
  • Identify opportunities for automation and process improvement across data systems and integrations.
  • Required Skills & Qualifications:

    • 5-10 years of overall experience in data engineering roles.
    • Strong hands-on expertise in PySpark (data frames, RDDs, performance optimization).
    • Proven experience working with Palantir Foundry.
    • Good understanding of reinsurance including exposure, claims, and policy data structures.
    • Proficiency in SQL, Python, and working with large datasets in distributed environments.
    • Experience with cloud platforms (AWS, Azure, or Google Cloud Platform) and related data services (e.g., S3, Snowflake, Databricks).
    • Knowledge of data modeling, metadata management, and data governance frameworks.
    • Familiarity with CI/CD pipelines, version control (Git), and Agile delivery methodologies.

    Thanks & Regards

    Shilpa Silonee

    BFSI TAG Team

    More Info

    Job Type:
    Industry:
    Employment Type:

    Job ID: 137398661