Member of Technical Staff, Integration/RL Team (Research Engineer)

Stack

Responsibilities

• ▹Design and write high-performing, scalable software for training models
• ▹Develop new tools to support and accelerate research and LLM training
• ▹Coordinate with infrastructure, efficiency and serving engineering teams as well as scientific teams (Agent, Multimodal, Multilingual)
• ▹Craft and implement techniques to speed up training cycles across SFT, offline preference and RL regimes
• ▹Research, implement and experiment with ideas on the compute and data infrastructure
• ▹Collaborate closely with scientists, engineers and other teams

Requirements

• ▹Extremely strong software engineering skills, with a focus on test-driven development, clean code and low technical debt
• ▹Proficiency in Python and ML frameworks such as JAX, PyTorch and/or XLA/MLIR
• ▹Experience using and debugging large-scale distributed training strategies (memory/speed profiling)

Nice to have

• ▹Experience with distributed training infrastructures (Kubernetes) and frameworks such as Ray
• ▹Hands-on experience with the post-training phase of model training, with a focus on scalability and performance
• ▹Experience in ML, LLM and RL academic research

Soft skills

What we offer

• ▹Weekly lunch stipend ($75/£75 or local equivalent)
• ▹Full health and dental benefits, including a mental health budget
• ▹RRSP matching, 401(k) or pension scheme
• ▹100% parental leave top-up for up to 6 months, for either parent
• ▹Annual enrichment benefits (arts & culture, fitness/wellness, workspace improvement credit)
• ▹Education & learning stipend for conferences, courses and coaching
• ▹6 weeks of paid vacation (30 working days)
• ▹Travel budget to other offices plus an annual company offsite
• ▹$500 home office stipend and co-working benefit for remote employees

About the company

Cohere is a leading security-first enterprise AI company, building frontier foundation models and end-to-end AI products for real-world business problems. It is a global team co-headquartered in Toronto and San Francisco, with offices in London, New York City, Montreal, Seoul, Germany and Paris.