Backend Engineer II - Data Platform

Stack

Responsibilities

• ▹Design, build and operate the backend services and APIs behind the data catalog, lineage and publishing systems, and evolve them as the platform adopts new storage technologies and new kinds of data; hold them to a high bar for correctness, performance and reliability
• ▹Develop and run the batch and streaming pipelines that keep metadata current: processing platform events and audit logs, and turning lineage and metadata into data products other teams build on
• ▹Own projects end to end: turn the needs of teams using the platform into technical designs, drive them through delivery and rollout, and own the results in production
• ▹Take part in on-call for critical services, build in observability and quality checks by default, and use automation, including AI tooling, to reduce toil

Requirements

• ▹Solid experience building and running backend services and APIs in production with Java, with care for API design, versioning and backward compatibility
• ▹Comfortable with SQL; experience with data pipelines or a cloud data warehouse such as BigQuery, Snowflake or Databricks
• ▹Working understanding of data engineering concepts such as orchestration, metadata management, data quality, governance and lineage
• ▹Ability to break problems down into clear, shippable steps, reason through tradeoffs and risks, and converge on clear recommendations
• ▹Ownership of the quality of what you ship, including code written with AI assistance, and care for operating it well after launch

Nice to have

• ▹Hands-on experience with batch or streaming frameworks like Beam, Flink or Spark

Soft skills

What we offer

• ▹Based in Stockholm or London, with flexibility to work where you work best
• ▹Possibility to work from home, with some in-person meetings
• ▹Reasonable accommodations available during the interview process

About the company

Spotify's data platform team builds the systems in which every dataset at Spotify is registered, published and traced: the source of truth for what data exists, where it lives, who owns it and how it flows between pipelines. The team builds on open standards such as OpenLineage and Apache Iceberg.