Senior Infra Engineer: Observability

Stack

Responsibilities

• ▹Build ingestion pipelines to consume 1M+ RPS streams of logs, metrics and other telemetry
• ▹Build scalable, fault tolerant alerting engines that notify users in real time of threshold breaches
• ▹Craft rich backend observability APIs, working with product to build great experiences
• ▹Provide APIs to access real-time log and metrics streams for the Dashboard and Product teams
• ▹Build Golang/Rust gRPC services from scratch capable of supporting tens of thousands of users and the million-plus to come
• ▹Define infrastructure that can be torn down, failed over and reconstituted from scratch using immutable infrastructure principles with Terraform and Ansible
• ▹Write Engineering Requirement Documents to take something from idea to defined tasks, implementation and monitoring its success
• ▹Interface with the TypeScript and GraphQL edge to expose microservice APIs for internal and potentially external consumption

Requirements

• ▹Strong understanding of distributed systems; enjoy building fault tolerant, resilient and scalable services
• ▹Interest in VictoriaMetrics, ClickHouse and other systems for building observability stacks from the ground up
• ▹Solid intuition about how long solutions will last: in startups, 2-3 orders of magnitude, or 12-18 months
• ▹The tact to implement a solution, create monitors for its error boundaries and document requirements for when you are not around
• ▹Great sense of direction and prioritization amid the ambiguity of an early-stage startup
• ▹Grit to dive into a problem, implement a solution, scale it and replace it when needed
• ▹Great communication skills

Soft skills

What we offer

• ▹Great salary
• ▹Full health benefits including dependents
• ▹Strong equity grants
• ▹Equipment stipend
• ▹Very few meetings: just Monday and Friday
• ▹High autonomy and ownership

About the company

Railway's mission is to make software engineers higher leverage, offering an all-encompassing solution from deployment to service-to-service communication. It is a globally distributed startup with a small, high-ownership team: 21 people at the time of writing, serving hundreds of thousands of users.