Custom Software Engineer

Project Role : Custom Software Engineer

Project Role Description : Design, build and configure applications to meet business process and application requirements.

Must have skills : Palantir Foundry, PySpark, Python (Programming Language), MySQL

Good to have skills : NA

Minimum 5 Year(s) Of Experience Is Required

Educational Qualification : 15 years full time education

Summary:

As an Application Developer, you will engage in the design, construction, and configuration of applications tailored to fulfill specific business processes and application requirements. Your typical day will involve collaborating with team members to understand project needs, developing innovative solutions, and ensuring that applications are optimized for performance and usability. You will also participate in testing and debugging processes to ensure the applications function as intended, while continuously seeking ways to enhance application efficiency and user experience.

Roles & Responsibilities:

Develop and maintain robust data pipelines and workflows within the Palantir Foundry platform.

Leverage Pyspark and Python for large-scale data processing, transformation, and integration across diverse data sources.

Design, implement, and optimize advanced SQL queries for data extraction, manipulation, and analysis.

Collaborate closely with business analysts, data scientists, and other engineers to translate business requirements into scalable data solutions.

Ensure data quality, integrity, and security throughout the data lifecycle.

Troubleshoot, debug, and optimize data workflows for performance and reliability.

Document architecture, processes, and best practices for ongoing support and knowledge sharing.

Required Skills & Qualifications

Palantir Foundry: Proven experience building data pipelines, managing datasets, and deploying applications within Foundry. Specifics required are as follows:

• Practical skills required to build and maintain production-grade data pipelines, data connections, and ontologies
• General knowledge of platform capabilities and specific applications within the Foundry suite that are useful for performing the job of data engineer
• DATA PIPELINE DEVELOPMENT IN FOUNDRY
  
  

Develop transforms on structured (tabular) and unstructured datasets in Foundry

Apply best practices when building data pipelines

• DATA PIPELINE MAINTENANCE IN FOUNDRY
  
  

Effectively investigate and fix common issues in data pipelines

Contribute to logic changes and performance improvements to transform pipelines feeding mission critical workflows

Familiarity with recommended support structures

• DATA CONNECTION AND INTEGRATION IN FOUNDRY
  
  

Familiarity with architecture and capabilities of Data Connection

Set up sources and syncs ingesting tabular data or raw files from external systems to Foundry

• ONTOLOGY DESIGN AND DEVELOPMENT IN FOUNDRY
  
  

Provide data engineering context during ontology design and implement pipelines backing ontology objects and links based on application requirements

Spark/Pyspark: Strong expertise in distributed data processing and transformation using Spark/Pyspark.

Python: Proficiency in Python for scripting, automation, and data wrangling tasks.

SQL: Advanced skills in writing efficient SQL queries for complex data manipulation and reporting.

Familiarity with data modeling, ETL processes, and best practices in data engineering.

Experience working with large and complex data sets from multiple sources.

Excellent problem-solving, communication, and collaboration skills.

Additional Information:

• The candidate should have minimum 3 years of experience in Palantir Foundry.
• A 15 years full time education is required.