← Back to list

Job
· Senior
Senior Software Engineer, Agents
Software Engineer
• Senior
• Hybrid
• Full-time
•
New York, USA
As a Software Engineer, Agents, you'll build the systems that make Harvey's AI agents indispensable to legal professionals: designing environments and actions for agentic work, making model selection decisions, managing context windows, building optimal tools, and developing evals for faster iteration.
Responsibilities
- ▹Partner with customers and PMs to understand legal workflows, design practical evaluations, and ship agents that get the job done
- ▹Optimize agent performance through prompt engineering, model selection, tool design, skill writing, context window management, and eval harness development
- ▹Work with the model infra team to design and implement infrastructure for low-latency agent execution, including caching strategies, parallel tool calls, and subagent patterns
- ▹Improve observability and instrumentation to profile agent behavior, identify bottlenecks, and drive optimization decisions
- ▹Stay current on developments in agentic systems and bring those learnings back to the products
Requirements
- ▹Passion for building effective domain-specific agents
- ▹Iterative mindset: build proof of concepts, make decisions quickly, and ship v0s
- ▹Comfortable with when and how to use evaluations to drive quality
- ▹Humble and adaptable about code and frameworks, driving adoption of new best practices
- ▹5-8 years (post-BS/MS) of software engineering experience
- ▹Proficiency in Python and experience working with LLM APIs and agent frameworks
- ▹Experience shipping user-facing products, either on the backend or full-stack
Soft skills
Humble and adaptable mindsetIterative, fast decision-making work styleCuriosity and staying current on developments in agentic systems
About the company
Harvey builds an enterprise-grade, agentic AI platform for legal and professional services, serving 2,400+ customers in 70+ countries.
Languages: Angol: Felsőfok
Similar jobs

Job
· Senior
Sr Software Engineer
ServiceNow
AI/MLJunit
+7
$143,200–$193,300/yr
gross
🏢 On-site
Santa Clara
🗣️ EN

Job
· Senior
Senior Software Engineer, Security Factory: Code Security
GitLab
Llm
+2
$139,200–$235,200/yr
gross
🌍 Remote
USA only
🗣️ EN

Job
· Senior
Senior Fullstack Software Engineer, AI Observability & Evals Platform (NY)
LangChain
LangchainLlm
+2
$180,000–$240,000/yr
gross
🏢 On-site
San Francisco
🗣️ EN
Job
· Senior
Senior Software Engineer – LLVM/Fuzzing/Program Analysis
Quantum Minds
CppLlm
💰 Salary: not specified
🌍 Remote
USA only
🗣️ EN
Job
· Senior
Senior Software Engineer - Security/Infrastructure
Afterquery
AI/MLLlm
+1
$200,000–$350,000/yr
gross
🏢 On-site
San Francisco
🗣️ EN
Job
· Senior
Senior Software Engineer - Backend & Machine Learning
Hume AI
AI/MLCpp
+12
$180,000–$250,000/yr
gross
🏢 On-site
New York
🗣️ EN