Software Engineer - Infrastructure

Stack

Responsibilities

• ▹Develop infrastructure components for the ML inference platform using Python and Go
• ▹Implement and maintain Kubernetes deployments for model serving
• ▹Contribute to the inference orchestration layer for model deployments
• ▹Build and enhance monitoring systems for model performance metrics
• ▹Implement efficient resource management solutions for ML workloads
• ▹Support infrastructure automation to improve ML deployment workflows

Requirements

• ▹Bachelor's degree or higher in Computer Science or related field
• ▹Proficient coding abilities in one or more languages; Go proficiency is a plus
• ▹Working knowledge of Kubernetes and containerization
• ▹Basic understanding of machine learning concepts and model serving
• ▹Familiarity with distributed systems concepts

Nice to have

• ▹Experience with basic monitoring and logging tools
• ▹Interest in ML/AI infrastructure and willingness to learn

Soft skills

What we offer

• ▹Competitive compensation including meaningful equity
• ▹100% coverage of medical, dental and vision insurance for employee and dependents
• ▹Flexible PTO including a company-wide winter break (closed between Christmas Eve and New Year's Day)
• ▹Paid parental leave
• ▹Fertility and family-building stipend through Carrot
• ▹Company-facilitated 401(k)
• ▹Exposure to a variety of ML startups, offering great learning and networking opportunities

About the company

Baseten powers mission-critical inference for some of the world's most dynamic AI companies, including Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma and Writer. By combining applied AI research, flexible infrastructure and seamless developer tooling, they help companies bring cutting-edge models into production. The company is growing fast and recently closed a $1.5B Series F round led by Altimeter Capital, Conviction Partners and Spark Capital.