Software Engineer - Training Product

Stack

Responsibilities

• ▹Design ergonomic APIs and abstractions to model complex resources and lifecycles
• ▹Work throughout the stack (API layer, backend and database implementation, infra layer; frontend is a plus) to implement features
• ▹Fine-tune and deploy models to develop intuition around training workflows
• ▹Partner closely with model developers and research engineers to understand post-training requirements and pain points
• ▹Drive long-term improvements to reliability of systems and development velocity
• ▹Fix bugs and resolve customer issues with urgency

Requirements

• ▹5+ years experience building software applications
• ▹Deep knowledge of the web stack, databases, and distributed systems
• ▹Experience developing developer tooling or infrastructure products for external or internal users
• ▹Good taste in product, particularly developer-oriented tools
• ▹Interest in ML/AI infrastructure and willingness to learn
• ▹Driven by high agency and ownership
• ▹Strong communication skills bridging technical depth and business needs

Nice to have

• ▹Experience launching features and products through different release cycles (MVP, Beta, GA)
• ▹Experience with model development methods like Supervised Fine-Tuning, Reinforcement Learning, Synthetic Data Generation, LoRA, Full Finetunes
• ▹Familiarity with open source training stacks and frameworks (NCCL, PyTorch, Megatron, NemoRL, VeRL, Axolotl, HF Trainer) and distributed training techniques (FSDP, DeepSpeed)
• ▹Experience developing AI products, tooling, or agents
• ▹Frontend fluency

Soft skills

What we offer

• ▹Competitive compensation, including meaningful equity
• ▹100% coverage of medical, dental, and vision insurance for employee and dependents
• ▹Flexible PTO policy including company-wide Winter Break
• ▹Paid parental leave
• ▹Fertility and family-building stipend through Carrot
• ▹Company-facilitated 401(k)
• ▹Exposure to a variety of ML startups, offering learning and networking opportunities

About the company

Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma and Writer. The company recently raised a $1.5B Series F led by Altimeter Capital, Conviction Partners, and Spark Capital.