Senior Python Engineer - AI Coding Agent Evaluation (Freelance)

Stack

Responsibilities

• ▹Build realistic developer environments: codebase, infrastructure, tickets, docs, conversations
• ▹Design tasks from intermediate states of these environments, defining what counts as solved
• ▹Write tests that accept all valid approaches and reject incorrect ones
• ▹Iterate on tasks and tests based on QA feedback and analysis of agent solutions

Requirements

• ▹8+ years in software development
• ▹Core stack: Python (FastAPI), JavaScript/TypeScript (React), Docker, Postgres, Kafka, Redis
• ▹Experience writing tests (functional, integration)
• ▹English proficiency B2+

What we offer

• ▹Up to $150/hr compensation, depending on level and pace
• ▹Flexible, self-paced scheduling

About the company

Mindrift connects freelance specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems.