Senior / Staff AI Model Engineer

Stack

Responsibilities

• ▹Design and build evaluation systems that measure correctness, safety, latency and regression risk across market analysis, portfolio/risk reasoning and trading workflows, including order placement
• ▹Develop and maintain benchmarks: curated golden sets, scenario suites, stress and adversarial cases, and continuously refreshed test corpora
• ▹Build automated quality gates and regression workflows that block releases when key metrics degrade
• ▹Define safe tool/action contracts with engineering and product (deterministic previews, confirmations, auditability)
• ▹Own model improvement loops tied to evals: data collection and labeling, error taxonomy, prompt/tooling changes and, where appropriate, fine-tuning
• ▹Design and operate monitoring and incident response for AI: telemetry, alerting, root cause analysis
• ▹Develop a deep understanding of trading concepts (margin, shorting, portfolio margin, risk, execution) and express them clearly to users

Requirements

• ▹At least 8 years of experience shipping production software; strong proficiency with any programming language
• ▹Strong computer science fundamentals, testing methodology and systems design
• ▹Experience building evaluation frameworks, test harnesses and benchmark suites for complex systems (LLMs, agents, search, retrieval, ranking, recommenders)
• ▹Experience running model improvement cycles: dataset curation, labeling/QA, offline experimentation and deploying changes with measurable impact
• ▹Ability to define metrics, build measurement pipelines and drive engineering and product decisions from data

Soft skills

About the company

Clear Street is modernizing the brokerage ecosystem. Founded in 2018, the financial services firm built a cloud-native clearing and custody system integrated with central clearing houses and exchanges.