Senior Software Engineer - AI Code Testing & Evaluation

Stack

Responsibilities

• ▹Build realistic developer environments: codebase, infrastructure, tickets, docs, conversations
• ▹Design tasks from intermediate states of these environments, defining what solved means
• ▹Write tests that accept all valid solutions and reject incorrect ones
• ▹Iterate on tasks and tests based on QA feedback, analyzing agent solutions and failures

Requirements

• ▹5+ years in software development
• ▹Core stack: Python (FastAPI), JavaScript/TypeScript (React), Docker, Postgres, Kafka, Redis
• ▹Experience writing tests (functional, integration)
• ▹English proficiency B2+

Soft skills

What we offer

• ▹Flexible, self-managed schedule
• ▹Up to $40/hr equivalent, depending on level and pace

About the company

Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems.