Senior Data Engineer

Job Designation: Senior Data Engineer

About us:

Pixis is a US-based codeless technology company that develops accessible AI to empower brands to scale their performance marketing efforts and augment their decision-making seamlessly. Since its inception, Pixis has been on a mission to develop powerful AI infrastructure that equips marketers across countries with robust plug-and-play AI products, 200+ proprietary, self-evolving AI models without having to write a single line of code.

The company has raised a total funding of $209M across Series A, B, C and C1, and is backed by recognized investors including SoftBank Vision Fund 2, Touring Capital, Grupo Carso, General Atlantic, Celesta Capital and Chiratae Ventures. Our customer base includes global brands such as DHL Express, Joe & The Juice, Claroshop, Allbirds, L'Oreal, HDFC Bank, Skoda, Swiggy, Clar and SmartAsset, to name a few Today Pixis talented and diverse team of 300+ spread across over 14 geographies is focused on building incredibly transformative AI products to help customers get the most out of their marketing and demand generation efforts.

Get ready to embark on an AI venture at https://pixis.ai/

Why Pixis

We at Pixis believe that nothing is impossible, when you fail fast you learn faster, zero hierarchy, put the team above everything else, get constructive feedback that helps you build better products, and disagree if you disbelieve. These values guide us in everything we do, and is reflected in our employees and the products we build together.

Ideal Candidate:

Pixis AI seeks a talented, driven Data Engineer to join its Data Platform team. The ideal candidate will build and maintain scalable data infrastructure and solutions to support the company's AI-powered marketing platform. The role involves working with technologies like Apache Flink, Nessie, Lakehouse Architecture, Apache Iceberg, Apache Doris, and Prefect

Key Responsibilities:

• Design, develop, and maintain scalable data pipelines and systems using streaming technologies like Apache Flink.
• Work on Lakehouse architecture to enable efficient data storage, management, and processing.
• Implement data versioning and cataloguing using Apache Nessie and optimize data for analytics and querying with Apache Iceberg.
• Design and manage large-scale, real-time data flows for various use cases like streaming, batch processing, and analytics.
• Work on advanced data modelling techniques and performance optimization using Apache Doris.
• Implement and maintain orchestration workflows using Prefect to ensure the smooth execution of complex data pipelines.
• Collaborate with cross-functional teams to deliver scalable solutions.
• Monitor and ensure data quality, performance, and security within the pipeline.
• Continuously research and evaluate new technologies, tools, and approaches to enhance the data platform.

Skills & Qualifications: Required:

• 4+ years of experience in data engineering, building scalable data pipelines, and processing frameworks.
• Hands-on experience with stream processing technologies like Apache Flink.
• Experience with Lakehouse architectures, including data lakes and data warehouses.
• Proficiency in Apache Iceberg for managing large-scale datasets.
• Knowledge of Apache Nessie for version-controlled data lakes.
• Experience with modern orchestration tools like Prefect, Airflow, or similar.
• Proficiency in distributed systems, SQL, and data modelling.