Engineering Manager - Forward Deployed Engineering (LLM)

Stack

Responsibilities

• ▹Lead, mentor and grow a team of Forward Deployed Engineers, guiding technical direction and career development
• ▹Set clear goals and ensure timely, high-quality delivery across multiple customer-facing projects
• ▹Align team priorities with company and customer goals, balancing short- and long-term initiatives
• ▹Player-coach: drive strategic product initiatives and customer engagements hands-on
• ▹Develop and maintain software systems and product features in production, primarily in Python
• ▹Design, implement and deploy Baseten solutions end-to-end for customer projects

Requirements

• ▹Bachelor's, Master's or Ph.D. in Computer Science, Engineering or related field
• ▹4+ years of professional software engineering experience, including 1+ year in a leadership or mentorship capacity
• ▹Strong Python programming skills, with production experience building or optimizing ML inference systems
• ▹Proven experience with LLMs, inference optimization or serving frameworks (e.g. vLLM, TensorRT, Triton, Hugging Face, Ray Serve)
• ▹Familiarity with observability, profiling and cost/performance tradeoffs in production ML systems
• ▹Excellent communication and collaboration skills, driving outcomes in ambiguous, fast-paced environments

Nice to have

• ▹Experience leading customer-facing engineering teams or working directly with enterprise partners
• ▹Deep understanding of GPU infrastructure, distributed inference or model compression techniques

Soft skills

What we offer

• ▹Competitive compensation, including meaningful equity
• ▹100% coverage of medical, dental and vision insurance for employee and dependents
• ▹Flexible PTO policy including company-wide Winter Break (offices closed from Christmas Eve to New Year's Day)
• ▹Paid parental leave
• ▹Fertility and family-building stipend through Carrot
• ▹Company-facilitated 401(k)
• ▹Exposure to a variety of ML startups, offering unparalleled learning and networking opportunities

About the company

Baseten powers mission-critical inference for the world's most dynamic AI companies, including Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma and Writer. By combining applied AI research, flexible infrastructure and seamless developer tooling, Baseten helps companies at the frontier of AI bring cutting-edge models into production. The company is growing quickly and recently closed a $1.5B Series F round led by Altimeter Capital, Conviction Partners and Spark Capital.