Senior Software Engineer, AI Training - Ireland

Stack

Responsibilities

• ▹Evaluate AI-generated coding interactions end to end
• ▹Judge whether outputs are useful, correct at a high level and aligned with how a strong engineer would think
• ▹Assess the quality of explanations and reasoning, not just the code
• ▹Distinguish between levels of response quality (what makes something a 2 vs a 4)
• ▹Give clear, opinionated written feedback on what worked, what didn't, and what felt misleading
• ▹Help define what great looks like when working with tools like Cursor, Codex and Claude Code

Requirements

• ▹Senior, Staff or Principal-level engineer (or equivalent experience)
• ▹Strong background in TypeScript/JavaScript or Python
• ▹Hands-on experience with at least one of OpenAI Codex, Claude Code or Cursor
• ▹Deep familiarity with modern AI-assisted dev workflows
• ▹Able to evaluate code without executing it or reviewing every line
• ▹Strong written and spoken English (B2 or above): you will write detailed feedback and record short video explanations
• ▹High bar for what good engineering looks like

Nice to have

• ▹Prior exposure to prompt design or evaluation workflows
• ▹Experience mentoring senior engineers or defining engineering standards

Soft skills

What we offer

• ▹Remote, worldwide
• ▹Rate of $100-$200/hour depending on experience and location
• ▹10-20 hours/week, flexible
• ▹Ongoing engagement: projects run from about two weeks to a few months, with new ones offered to evaluators who do well
• ▹No interview: one take-home exercise with a recorded Loom walkthrough