Member of Engineering (Evaluations)

Responsibilities

• ▹Research and implement evaluations and benchmarks, both for base models and for instruction-following models
• ▹Collaborate with both applied research and product teams to define meaningful metrics and evaluations that capture progress on real-world software development skills
• ▹Work within a team: plan future steps, discuss, and communicate clearly with peers

Requirements

• ▹Experience with Large Language Models (LLM)
• ▹Strong understanding and intuition of LLMs and their limitations
• ▹Strong engineering background
• ▹Strong programming skills, ideally across multiple languages
• ▹Familiar with the full software development life cycle
• ▹Linux
• ▹Strong algorithmic skills
• ▹Multiple languages, including Python

Soft skills

What we offer

• ▹Fully remote work & flexible hours
• ▹37 days/year of vacation & holidays
• ▹Health insurance allowance for you and dependents
• ▹Company-provided equipment
• ▹Wellbeing, always-be-learning and home office allowances
• ▹Frequent team get-togethers
• ▹Great diverse & inclusive people-first culture

About the company

Poolside is building toward Artificial General Intelligence by accelerating software development itself, reshaping the developer experience with agentic systems, coding assistants, and the frontier models that power them. The team works remotely across Europe and North America, gathering in person for 3 days each month plus longer off-sites twice a year.