Data Engineer II

About the Role

As a Data Engineer, you'll be responsible for implementing and maintaining data pipelines and databases that support our analytics and reporting needs. You'll work with a variety of data sources and technologies to ensure that high-quality data is available to stakeholders when they need it. You'll collaborate with team members to understand requirements and translate them into effective data solutions.

Key Responsibilities

• Develop and maintain data pipelines and ETL processes using Python, PySpark, and other technologies
• Implement data models and structures in databases including MongoDB and SQL Server
• Configure and manage data workflows in Palantir platforms to ensure reliable data processing
• Collaborate with data scientists, analysts, and business stakeholders to understand data requirements
• Ensure data quality by implementing validation procedures and monitoring systems
• Troubleshoot and resolve data issues to maintain system performance
• Apply best practices for data engineering, including documentation and testing
• Participate in code reviews to maintain high standards of code quality
• Stay current with emerging data technologies and recommend improvements

About the Team

We are a team that believes in engineering excellence and that our leaders should also be engineers themselves. We build applications that are carefully designed, thoughtfully implemented by working together with product owners. Quality and stability are first-class deliverables in everything we do, and we lead by example by embedding high standards into our processes.

About You

You're a detail-oriented professional with a passion for working with data. You enjoy solving problems and finding efficient ways to process and manage information. You work well in collaborative environments and can effectively communicate technical concepts. You're committed to continuous learning and improving your skills in data engineering technologies.

We are looking for candidates who meet these requirements:

• Bachelor's degree in computer science, Engineering, or related field with 6+ years of experience in data engineering or related roles
• Proficiency in Python programming with experience building data pipelines and ETL processes
• Experience with PySpark for data processing and analytics
• Working knowledge of Palantir and Azure Data Factory & AI Foundry platforms for data integration and analysis
• Familiarity with database technologies including MongoDB and SQL Server, with solid SQL skills
• Experience implementing and maintaining data pipelines in production environments

These are additional nice to have:

• Experience with cloud platforms (AWS, Azure, or GCP) and their data services at enterprise scale
• Advanced knowledge of data visualization tools like Tableau, Power BI, or similar
• Expertise with real-time data processing frameworks such as Kafka or Spark Streaming