Senior Data Engineer

We're looking for someone very tech-savvy, with PySpark experience, real-time streaming, and ideally experience with trading data/teams.

Streaming Data Expertise

• Proven experience designing, building, and maintaining real-time data streaming solutions using modern event-driven architectures.
• Strong understanding of low-latency data processing for energy trading, market data feeds, telemetry, and operational systems.

Python & PySpark Proficiency

• Advanced hands-on experience with Python and PySpark for large-scale data engineering, transformation, and analytics workloads.
• Ability to optimize distributed processing pipelines and develop robust, production-grade data solutions.

Business Engagement & Solution Design

• Strong communication and stakeholder management skills with the ability to translate complex business requirements into scalable technical solutions.
• Experience working directly with trading, risk, operations, and business teams to deliver measurable business value.

Data Governance & Medallion Architecture

• Deep understanding of data governance principles, including data quality, lineage, cataloging, security, and compliance.
• Proven experience implementing and managing Medallion Architecture (Bronze, Silver, Gold) to support trusted and scalable analytics platforms.

Experience in MS Data Fabric

You should be an expert in implementing and establishing MS data fabric in the process.

Security-First Engineering Mindset

• Designs and implements data platforms based on rigorous security principles, including least-privilege access, data protection, auditing, and regulatory compliance.
• Ensures security is embedded throughout the data lifecycle and solution architecture.

Independent Delivery & Ownership

• Self-motivated and capable of working independently with minimal supervision.
• Demonstrates strong ownership, problem-solving ability, and the capacity to drive initiatives from design through implementation and operational support.