Senior Search Engineer, Index Team

Stack

Responsibilities

• ▹Design and improve the URL frontier and crawl job scheduling system
• ▹Own and evolve the indexing strategy and ranking implementation
• ▹Investigate and fix index quality issues (spam, stale content, deduplication, coverage gaps)
• ▹Work with the Search team so index improvements translate into better results for users

Requirements

• ▹5+ years of backend engineering experience in production information retrieval/search systems
• ▹Prior experience with search index infrastructure, URL frontier systems, or crawl scheduling
• ▹Deep expertise across the information retrieval stack (index design, relevance scoring, ranking optimization, near-duplicate detection, query engine architectures, graph-based signal extraction)
• ▹Strong database skills, comfortable with complex PostgreSQL schemas and queries at scale
• ▹Proficiency in Python and/or Rust
• ▹Ability to reason about large-scale data pipelines (throughput, correctness, idempotency, operational reliability)

Nice to have

• ▹Experience with observability tooling (Prometheus, Grafana, or similar)
• ▹Comfort with Redis for distributed state and queue management
• ▹Experience with distributed job scheduling or work queue systems
• ▹Experience operating systems where correctness and data quality are the primary constraints

Soft skills

About the company

Kagi builds an ad-free, tracking-free, user-centric search engine (Kagi Search, Orion browser, Kagi Assistant, Kagi News, Kagi Summarizer, Kagi Translate) for a surveillance-free internet.