Principal Data Engineer

The purpose of this role is to help shape the LME’s strategic data platform which can reliably process, store, and serve high-volume, high-velocity trading data at scale, while providing engineering teams with reusable, self-service capabilities that accelerate the delivery of trading and analytical solutions.

Success in this role means delivering a highly scalable and resilient data platform that becomes the engineering foundation for all data-intensive trading workloads, enabling faster innovation, improved reliability, reduced operational complexity, and better utilisation of market and trading data across the organisation.

A candidate for this position must have got working experience in IT organisation as a technologist who has evolved from a strong background in hands on software development:

10+ years of experience with software development, preferably working with JVM based languages (Java/Scala/Kotlin).

Provide expertise on the development of highly scalable data platforms, data warehouses (SQL server, Postgres), and modern data lakes.

Solve complex scalability, reliability, latency, and performance challenges associated with large-scale distributed systems.

Provide self-service platform capabilities that allow engineering teams to onboard, process, discover, and consume data efficiently.

Influence technology strategy and roadmaps across Trading Technology, Data Engineering, and Platform Engineering functions.

Build high-volume distributed data platforms capable of processing billions of events per day and managing terabytes scale datasets.

Develop modern Data Lakehouse platforms leveraging S3-compatible object storage, Apache Iceberg, Spark, and Trino.

Build real-time streaming integration using Apache Kafka and Apache Flink for low-latency event processing, enrichment, and data distribution.