UI/UX Design Expert - Evaluator

Stack

Responsibilities

• ▹Design precise, task-specific grading criteria for real-world digital product and UX deliverables
• ▹Score AI-generated and human work samples against criteria with detailed written justifications
• ▹Apply consistent, evidence-based judgment for reproducible and defensible scores
• ▹Incorporate structured feedback from senior reviewers and iterate quickly on work
• ▹Work independently and asynchronously to evaluate and improve AI model performance

Requirements

• ▹5+ years of professional experience in product design, UI/UX, or design systems
• ▹Background at leading digital-product and UX studios or in-house product-design teams
• ▹Experience in Product/UI/Design Systems Design, UX Lead, or UX Writing
• ▹Deep fluency in interaction and visual design, design systems, and Figma
• ▹Exceptionally strong written communication skills
• ▹Detail-oriented and comfortable with peer-reviewed judgment

Nice to have

• ▹Prior experience with AI training, evaluation, or human-data projects

Soft skills

What we offer

• ▹Compensation of $80-150/hour
• ▹Remote work

About the company

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, its investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.