Senior Technical Program Manager, Machine Learning Infrastructure

Stack

Responsibilities

• ▹Manage the program portfolio covering inference, efficiency, serving, and endpoints to keep infrastructure scaling
• ▹Lead end-to-end coordination and execution, with heavy cross-functional collaboration with Modeling and customer-facing teams
• ▹Identify pain points and establish processes so the team can focus on development
• ▹Build a culture of continuous improvement, liaising with incident management leads
• ▹Manage overlapping projects and programs, ruthlessly prioritizing
• ▹Collaborate with stakeholders to set and track timelines, deliverables, budgets, and scope
• ▹Deliver clear, timely updates across engineering, leadership, and non-technical teams
• ▹Act as a tactical and strategic partner to senior leads across the program

Requirements

• ▹5+ years of Technical Program Management experience focused on Machine Learning Infrastructure (inference, serving, efficiency, endpoints)
• ▹In-depth technical knowledge of ML infrastructure design and engineering best practices
• ▹Experience working in chaotic, fast-paced, low-structure environments
• ▹Pragmatic, able to operate at both tactical and strategic levels

Nice to have

• ▹Hands-on technical experience in a hands-on capacity
• ▹Experience working with ML teams, understanding how ML models are built

Soft skills

What we offer

• ▹Weekly $75/£75 (or local equivalent) lunch stipend
• ▹Full health and dental benefits, plus a separate mental health budget
• ▹RRSP/401K/pension matching
• ▹100% parental leave top-up for up to 6 months, either parent
• ▹Annual enrichment benefits: arts & culture, fitness/wellness, quality time, workspace improvement credit
• ▹Education & learning stipend for conferences, courses, coaching
• ▹6 weeks paid vacation (30 working days)
• ▹Travel budget to other offices plus annual company offsite
• ▹$500 home office stipend

About the company

Cohere is the leading security-first enterprise AI company, building cutting-edge foundation models and end-to-end products for real business problems. Co-headquartered in Toronto and San Francisco, with offices in London, New York City, Montreal, Seoul, Germany, and Paris.