DevOps Engineer - AI Model Evaluator

Stack

Responsibilities

• ▹Reviewing model-generated implementations, identifying bugs, edge cases and reliability issues
• ▹Comparing outputs from multiple frontier models

Requirements

• ▹2+ years of professional DevOps, SRE, or Cloud Engineering experience
• ▹Experience with AWS, Azure, GCP, Kubernetes, Terraform, CI/CD pipelines, or observability tooling
• ▹Regular use of AI coding agents like Cursor, Claude Code, Codex, Windsurf, Gemini CLI, or similar tools
• ▹Ability to evaluate model-generated infrastructure and reliability engineering solutions

What we offer

• ▹$400 per accepted task
• ▹Compensation is tied to accepted work

About the company

Mercor connects elite creative and technical talent with leading AI research labs.