Senior Data Platform Engineer (Python)

Stack

Responsibilities

• ▹Design, build and maintain scalable, secure Python data pipelines orchestrated with Apache Airflow, landing data cleanly into the AWS data lake (S3) and warehouse (Postgres/Redshift)
• ▹Own the ingestion and transformation layer: improve throughput, reduce latency and make it straightforward to onboard new data sources without accruing technical debt
• ▹Write clean, testable, well-documented Python that junior engineers can learn from
• ▹Apply CI/CD best practices and Terraform (IaC) to make pipeline deployments repeatable, auditable and consistent across environments
• ▹Add meaningful monitoring and alerting so issues surface early
• ▹Use Docker to containerize workloads and ensure portability across environments
• ▹Enforce data governance fundamentals: access control, schema validation, data quality checks and GDPR compliance baked into the pipeline layer
• ▹Define and maintain standards for how data is ingested, validated and promoted through the platform
• ▹Actively contribute to the move toward a modern Lakehouse architecture, working hands-on with Iceberg, Spark, Kafka and dbt as they are adopted incrementally
• ▹Bring a pragmatic view to tooling decisions, knowing when to adopt something new and when to keep it simple
• ▹Mentor junior engineers through code reviews, pairing and technical guidance
• ▹Give meaningful input on architecture and tooling decisions

Requirements

• ▹5+ years building and operating production Python data pipelines at scale
• ▹Hands-on AWS experience: S3, Redshift, Postgres and the surrounding ecosystem
• ▹Apache Airflow in production: DAG design, scheduling, backfill management and reliability
• ▹Terraform, Docker and CI/CD in real delivery environments
• ▹Strong SQL and a solid grasp of data modelling principles

Nice to have

• ▹Spark, Apache Iceberg, Kafka and dbt: the Lakehouse patterns and tooling the team is moving toward (exposure is a head start, not a requirement on day one)
• ▹Kubernetes for data workloads
• ▹Observability tooling (Grafana or equivalent) for pipeline monitoring and alerting
• ▹Experience in online gambling, betting or fintech
• ▹ML or fraud detection background

Soft skills

What we offer

• ▹A consulting engagement with genuine ownership and influence
• ▹A fast-scaling data platform and a team that takes engineering quality seriously
• ▹Exposure to a modern Lakehouse stack
• ▹Competitive day rate
• ▹Collaborative, low-ego team
• ▹Hybrid working model with self-organization

About the company

FDJ UNITED is one of Europe's leading betting and gaming operators, with a vast portfolio of brands and a presence in around fifteen regulated markets. It has more than 5,000 employees and aims to prove that entertainment and safety can go hand in hand.