We're looking for a Research Engineer to own evaluation pipelines, build data tooling, and partner with research and infra to prototype, train, and deploy state-of-the-art voice models for Sesame's real-time companion experience.
Stack
Responsibilities
- ▹Own evaluation pipelines: design, build, and automate offline and live evals for speech and multimodal models
- ▹Build tooling for safe, versioned, privacy-aware dataset curation and discovery
- ▹Partner with research and infra to prototype, train, and deploy state-of-the-art voice models
- ▹Scale training and inference for LLM-class workloads, optimizing latency, throughput, and cost
- ▹Wire up monitoring and live evals to surface quality regressions early
- ▹Move ideas from whiteboard to production quickly, leaving a clean trail of tests and dashboards
Requirements
- ▹Expert-level PyTorch
- ▹Proven software engineer who loves ML, comfortable writing production code across the stack
- ▹Hands-on experience training or fine-tuning large language or other large-scale models
- ▹Evaluation expert: designed metrics and harnesses that actually predict user happiness
- ▹Deep knowledge of the ML lifecycle: dataset ops, training pipelines, eval frameworks, deployment, monitoring
- ▹History of shipping complex projects to production, especially user-facing online ML systems
- ▹High agency and judgment for when to sprint solo vs. pull in the team
- ▹Track record of setting technical direction and driving consensus
Soft skills
High agency and proactivitySetting technical direction and building consensusCollaboration with research, infra, and productFast, iterative pace of work
What we offer
- ▹401(k) with employer match up to 3.5% of compensation
- ▹100% employer-paid health, vision, and dental coverage for you and your dependents
- ▹Unlimited PTO and sick time
- ▹Flexible spending account with employer matching up to $1,650/year
- ▹Guardian Employee Assistance Program (EAP)
- ▹Opportunity to share in the company's success through competitive stock options
About the company
Sesame is building a future where computers are lifelike — able to see, hear, and collaborate with us in natural, human ways. The team brings together founders from Oculus and Ubiquity6 alongside proven leaders from Meta, Google, and Apple, spanning deep hardware and software expertise.
Similar jobs
Job
Head of Sales Strategy & Analytics
Fireworks AI
AI/ML
💰 Salary: not specified
🏢 On-site
🇺🇸 Remote +1
🗣️ EN
Job
Member of Technical Staff - GPU Infrastructure
Prime Intellect
Langchain
+3
💰 Salary: not specified
🌍 Remote
🇺🇸 San Francisco
🗣️ EN
Job
Autonomy Engineer - Deep Learning
Skydio
AI/ML
$14,200–$23,100/mo
gross
🌍 Remote
🇺🇸 San Mateo
🗣️ EN

Job
Software Engineer, Workload Enablement
OpenAI
💰 Salary: not specified
🌍 Remote
🇺🇸 San Francisco
🗣️ EN

Job
Staff Software Engineer, Backend Infrastructure
Sesame
💰 Salary: not specified
🏢 On-site
🇺🇸 San Francisco
🗣️ EN

Job
Forward Deployed Engineer US
RunPod
AI/ML
+9
$8,300–$15,000/mo
gross
🌍 Remote
🇺🇸 Remote - USA
🗣️ EN