Audio Inference Engineer, Model Efficiency

Stack

Responsibilities

• ▹Advance core audio model serving metrics such as latency, throughput, and quality
• ▹Dive deep into systems to identify bottlenecks
• ▹Deliver creative solutions for audio processing and streaming workloads
• ▹Collaborate closely with training and serving infrastructure teams for seamless integration
• ▹Focus especially on real-time and streaming audio inference

Requirements

• ▹Significant experience developing high-performance audio or machine learning inference systems
• ▹Proficiency in C++ and Python
• ▹Hands-on experience with deep learning models for audio, speech, or language applications
• ▹A bias for action and a strong results-oriented mindset

Nice to have

• ▹GPU programming, low-level system optimization, model parallelization across multiple GPUs
• ▹Experience with duplex real-time streaming architectures
• ▹Internals of ML frameworks for audio (PyTorch, TensorFlow, or specialized audio libraries)
• ▹Experience with inference frameworks like vLLM, SGLang, TensorRT-LLM, or custom distributed inference systems
• ▹Sequence modeling (e.g. transformers for audio/speech) and end-to-end audio pipeline optimization

Soft skills

What we offer

• ▹Weekly lunch stipend of about $75/£75 (or local equivalent)
• ▹Full health and dental benefits, with a separate mental health budget
• ▹RRSP matching, 401K, or pension scheme
• ▹100% parental leave top-up for up to 6 months, for either parent
• ▹Annual enrichment benefits: arts & culture, fitness/wellness, quality time, workspace improvement
• ▹Education & learning stipend for conferences, courses, and coaching
• ▹6 weeks (30 working days) of paid vacation
• ▹Budget for traveling to other offices, plus an annual company offsite
• ▹$500 home office stipend; co-working benefit for remote employees

About the company

Cohere is the leading security-first enterprise AI company, building cutting-edge foundation models and end-to-end products that solve real business problems. Co-headquartered in Toronto and San Francisco, with key offices in London, New York City, Montreal, Seoul, Germany and Paris.