← Zurück zur Liste

Stelle
· Senior
Senior Software Engineer, Model Evaluation
Softwareentwickler
• Senior
• Vor Ort
• Vollzeit
•
San Francisco, USA
About the Role Join an early-stage AI team building agents for manufacturing operations. You will create benchmarks and train models against real procurement and supply-chain workflows, helping ensure agents can handle customer-facing tasks reliably. What You'll Do Design and build evaluation suites for supplier sourcing, qualification, compliance documents, purchase orders, freight, and order tracking. Work with procurement and manufacturing experts to scope tasks, write reference answers and rubrics, and build graders. Train and fine-tune models, using evaluation results to guide experiments. Identify agent failures, improve production systems, and measure whether changes work. Help establish the team's research and evaluation practices. What We're Looking For At least 3 years of experience, operating at a senior or staff level. Hands-on experience designing benchmarks and evaluations, including authoring tasks, reference solutions or rubrics, and quality checks. Practical experience training and fine-tuning models, not only using models through APIs. Ability to work closely with non-ML domain experts and translate their knowledge into measurable tasks. Supply-chain, procurement, manufacturing, or early-stage startup experience is helpful. Compensation & Benefits Base salary is $180,000 to $250,000 annually, plus equity. Visa sponsorship details were not provided. Location Hybrid in San Francisco, California, United States.
Ähnliche Stellen

Stelle
· Senior
Sr Java Developer
QuinStreet
+1
💰 Gehalt: keine Angabe
🌍 Remote
nur USA
🗣️ EN

Stelle
· Senior
Senior Software Engineer, Applied AI
Aura
Data Science
+4
127 514–182 163 €/Jahr
brutto
🌍 Remote
nur USA
🗣️ EN

Stelle
· Senior
Senior Software Engineer, Behavior Planning
Aerovect
AI/MLCppRos
💰 Gehalt: keine Angabe
🔀 Hybrid
South San Francisco - Hybrid
🗣️ EN

Stelle
· Senior
Senior Software Engineer, Cloud Payments
MongoDB
+1
114 762–225 882 €/Jahr
brutto
🏢 Vor Ort
Atlanta
🗣️ EN
Stelle
· Senior
Senior Software Engineer, Frontend
comfy-org
💰 Gehalt: keine Angabe
🏢 Vor Ort
San Francisco
🗣️ EN

Stelle
· Senior
Sr Software Engineer I, Forward Deployed Engineering
Axon
128 425–205 479 €/Jahr
brutto
🏢 Vor Ort
Sterling
🗣️ EN