Senior Database Administrator (ClickHouse)

Stack

Responsibilities

• ▹Own the reliability and performance of production ClickHouse clusters, self-hosted on Kubernetes or on managed services
• ▹Design a standard architecture and tooling to grow to dozens of multi-node clusters without operational work growing at the same pace
• ▹Manage the whole cluster lifecycle as code: provisioning, configuration, scaling, upgrades and migrations
• ▹Build monitoring and alerting that catch problems before users notice them
• ▹Own backups and disaster recovery and test restores regularly
• ▹Keep clusters secure by default
• ▹Plan capacity and keep infrastructure costs under control
• ▹Be the go-to ClickHouse expert for developers, DevOps engineers, other DBAs and engineering leadership, from schema design and ingestion to query performance
• ▹Handle routine database requests and automate as many as possible
• ▹Step in during rare production emergencies, including outside business hours, then lead the database-side root-cause analysis and contribute to the postmortem
• ▹Keep documentation and runbooks up to date and share knowledge with the team

Requirements

• ▹Deep, DBA-level knowledge of ClickHouse from production use: how it stores, merges, replicates and queries data, and why a cluster behaves as it does
• ▹Strong SQL, including optimising complex analytical queries and reviewing schema design
• ▹Ability to design architecture and automation that holds up across dozens of multi-node clusters
• ▹Production experience running and maintaining stateful workloads on Kubernetes well beyond initial deployment
• ▹Production use of a Kubernetes operator to run databases (any engine, e.g. CloudNativePG, Zalando Postgres Operator, Altinity, the official ClickHouse operator)

Nice to have

• ▹Experience running a large fleet of databases (dozens or hundreds of instances), not necessarily ClickHouse

Soft skills

About the company

Tabby is a fintech offering interest-free, fee-free split payments online and in store. It has 25+ million users and 70,000+ partner brands, is the largest fintech in the GCC region, and launched in 2019.