AI Jobs Map

FDJ UNITED · London Area, United Kingdom

Senior Cloud Data Engineer - KSP

seniorfull timePosted 4 days ago
Apply on LinkedInLinkedInOpens the original posting. AI Jobs Map never asks for your details.

Stack mentioned

data-engineeringawsmachine-learningetldbtsqlapache-kafkaapache-flinkdata-governanceobservabilitydata-sciencedata-modelingapache-airflowsystem-design

Focusing on our Sportsbook product, we’re looking for a Senior Data Engineer to help build and evolve our next-generation data platform, powering trusted, scalable, and real-time data assets across multiple brands and markets.

You’ll primarily work on our Sportsbook Data Platform — a modern, event-driven lakehouse built on AWS and aligned to medallion architecture principles — delivering high-quality, well-governed data products that support analytics, trading insight, and machine learning use cases. This platform underpins critical decision-making across trading, risk, personalisation, and analytics, and represents a key step forward in standardising and scaling our data ecosystem.

What You’ll Do

- Design and build scalable batch and streaming data pipelines, supporting ingestion, transformation, and serving layers.

- Develop and maintain data assets aligned to medallion architecture (bronze, silver, gold), ensuring clear ownership, quality, and usability.

- Model sportsbook domain data (bets, offers, rewards, digital data) into reusable, well-defined datasets for downstream consumption.

- Implement data transformation logic using modern tooling (e.g. dbt, Spark, SQL-based frameworks), ensuring consistency and testability.

- Build and optimise streaming data pipelines (Kafka/Flink or equivalent) to enable near real-time data availability.

- Ensure data quality and reliability through validation frameworks, observability, and robust handling of late-arriving or inconsistent data.

- Design data contracts and schemas that enable reliable integration between upstream event producers and downstream consumers.

- Optimise pipelines and storage for performance and cost efficiency within AWS.

- Collaborate with analytics, data science, and machine learning teams to translate business requirements into high-quality data assets.

- Contribute to data governance practices, including metadata management, lineage, and discoverability.

What You’ll Work On

- A modern sportsbook data platform built on AWS, supporting both real-time and batch data processing.

- Medallion-aligned data layers enabling progressive refinement from raw ingestion through to curated, business-ready datasets.

- Streaming pipelines that ingest and process high-volume sportsbook events (bets, pricing, settlements).

- Curated data assets powering trading analytics, risk monitoring, and customer personalisation models.

- Integration with semantic layers, BI tools, and machine learning platforms.

- Data governance and metadata tooling to improve transparency, trust, and reuse across the organisation.

Your Experience

- 5+ years experience in data engineering, building and maintaining scalable data platforms.

- Strong SQL and data modelling skills, with experience designing analytical datasets.

- Experience with modern data stack tools (e.g. dbt, Spark, Airflow, or similar orchestration and transformation frameworks).

- Experience with cloud-based data platforms, ideally AWS.

- Understanding of medallion architecture or similar data layering approaches.

- Experience working with streaming technologies (Kafka, Flink, or similar).

- Strong understanding of data quality, testing, and observability practices.

- Experience designing schemas and handling data consistency challenges in distributed systems.

- Ability to work closely with stakeholders to translate business needs into scalable data solutions.

- Proactive mindset with the ability to operate in evolving environments and iterate on solutions.

Nice to Have

- Experience in sports betting, trading, or financial data domains.

- Familiarity with event-driven architectures and real-time data products.

- Experience with semantic layers (e.g. Cube.js) or metrics-layer design.

- Exposure to data governance and metadata tools (e.g. OpenMetadata, Hive Metastore).

- Experience supporting machine learning workflows and feature engineering pipelines.

#SDELONDON #TECHLONDON #seniordataengineerUK #SQLEngineer

More jobs at FDJ UNITED