Staff Software Engineer, AI Platform

Stack

Responsibilities

• ▹Design and build platform-level abstractions and systems that improve all of Harvey's agentic products
• ▹Own infrastructure for model integration, routing, and evaluation
• ▹Build evaluation frameworks and tooling that let every team measure and improve AI quality
• ▹Partner closely with product engineering, PMs, and design to launch cutting-edge AI products
• ▹Evaluate, prototype, and integrate the latest advancements in AI and agentic systems

Requirements

• ▹8+ years of experience building backend systems, with at least 1+ year focused on AI/ML engineering
• ▹A track record of technical leadership across teams
• ▹Experience building and shipping multi-model or multi-provider AI systems in production
• ▹Familiarity with context management, session state, or memory systems
• ▹A track record of building internal platforms, SDKs, or shared infrastructure that other engineering teams actually adopted
• ▹Strong judgment about abstractions; pragmatic about shipping incrementally
• ▹A bias toward full ownership; navigates ambiguity well

Nice to have

• ▹Experience building evaluation frameworks
• ▹Experience with agent/function-calling architectures
• ▹Familiarity with legal or other high-stakes professional services domains
• ▹Time at early-stage or hyper-growth startups

Soft skills

About the company

Harvey is transforming how legal and professional services operate by combining frontier agentic AI, an enterprise-grade platform, and deep domain expertise. It serves 1500+ customers in 60+ countries, with strong product-market fit and world-class investor support.