← Back to list

Job
· Principal
Staff Software Engineer - Databases, Tempo | United Kingdom | Remote
Software Engineer
• Principal
• Remote
• Full-time
•
United Kingdom
Build Tempo, the open-source distributed tracing backend behind Grafana Cloud Traces — evolving it from a SaaS database into a platform powering Grafana's next-generation, AI-driven observability products.
Responsibilities
- ▹Lead multi-quarter technical initiatives from problem framing through rollout (e.g., trace aggregation APIs, autoscaling cells)
- ▹Own the architecture of core Tempo components: ingestion, storage, query, and metrics generation
- ▹Drive design reviews and sharp trade-offs on performance, cost, and complexity
- ▹Design APIs for humans and agents — structured, deterministic, discoverable interfaces
- ▹Drive operational excellence against concrete SLOs (P99 write latency, incident recurrence, TCO)
- ▹Partner with Product and sibling teams (App Observability, Asserts, Drilldown, Grafana Assistant)
- ▹Mentor engineers through code review, design feedback, and pairing on hard problems
- ▹Participate in on-call for the services you help build
- ▹Contribute to the open-source Tempo project
Requirements
- ▹Track record of technical leadership on complex, multi-quarter initiatives spanning design, delivery, and operations
- ▹Deep, hands-on experience building and operating distributed data systems (ingestion pipelines, storage engines, query execution)
- ▹Strong software craftsmanship — clean, robust, maintainable, performant code
- ▹Strong Go, or a path to it — deep experience in other systems languages (Rust, C, C++) translates well
- ▹Operational mindset: owning production services, carrying a pager, treating SLOs as a product feature
- ▹Customer focus and pragmatism, breaking problems into short feedback loops
- ▹Leadership through writing and collaboration, communicating clearly in a fully remote, asynchronous environment
Nice to have
- ▹Experience with tracing, OpenTelemetry, or large-scale observability systems
- ▹Experience designing query languages, SQL/TraceQL-like engines, or programmatically consumable APIs
- ▹Experience with columnar storage formats (e.g., Parquet)
- ▹Experience operating multi-tenant, multi-cell SaaS infrastructure on Kubernetes
- ▹Experience building for AI/LLM consumers: structured APIs, deterministic outputs
- ▹Open-source contribution or maintainership
- ▹On-call experience with Grafana, Prometheus, Loki, or Tempo
- ▹Experience in a fully remote, globally distributed team
Soft skills
Technical leadershipWritten communicationMentoring
What we offer
- ▹GBP 103,958 – GBP 124,750 base compensation (United Kingdom)
- ▹Equity and bonus (if applicable)
- ▹100% remote, global culture
About the company
Grafana Labs is the company behind the open observability cloud, founded on open source, open standards, and open culture. 35M+ users and 7,000+ customers — including Anthropic, Bloomberg, NVIDIA, Microsoft — trust Grafana Labs. A 100% remote company with 1,600+ team members across 40+ countries.
Languages: Angol: Felsőfok
Similar jobs

Job
· Principal
Staff Software Engineer (Agentic Engineering)
Coder
Github Actions
+7
£113,000–£170,000/yr
gross
🌍 Remote
🗣️ EN

Job
· Principal
Staff Software Engineer – Identity and Access, Identity Squads | UK | Remote
Grafana Labs
Opentelemetry
+3
£100,000–£124,000/yr
gross
🌍 Remote
🗣️ EN

Job
· Principal
Principal Software Engineer
Mastercard
+14
💰 Salary: not specified
🏢 On-site
London
🗣️ EN

Job
· Principal
Staff Software Engineer, Data Platform
Agility Robotics
FlinkCppDatabricks
+11
$191,000–$299,000/yr
gross
🌍 Remote
🗣️ EN

Job
· Principal
Staff Software Engineer, Storage
CoreWeave
CppClickhouse
+3
$207,000–$303,000/yr
gross
🏢 On-site
California
🗣️ EN

Job
· Principal
Staff Software Engineer, Model Infrastructure
Harvey
AI/MLFlinkCpp
+8
$236,000–$290,000/yr
gross
🏢 On-site
San Francisco
🗣️ EN