Data Analyst (AI Evaluation)

Stack

Responsibilities

• ▹Review datasets and task outputs for accuracy, completeness and adherence to guidelines
• ▹Identify and flag inconsistencies, errors and outputs that deviate from instructions
• ▹Apply structured rubrics and evaluation criteria consistently across large datasets
• ▹Use sound judgment and document rationale in ambiguous scenarios
• ▹Escalate recurring data issues for further analysis
• ▹Give clear, actionable written and verbal feedback with suggested resolution paths
• ▹Work accurately through high volumes of repetitive data review

Requirements

• ▹3–5+ years of experience in data review, data quality, quality assurance or analytical roles
• ▹Proven expertise reviewing, validating and critiquing data or deliverables against explicit criteria
• ▹Ability to follow detailed written instructions and apply complex rubrics precisely
• ▹Comfort with ambiguity and making justifiable decisions when guidelines are incomplete
• ▹Advanced attention to detail and error spotting
• ▹Strong written and verbal communication
• ▹Baseline spreadsheet fluency

Soft skills

What we offer

• ▹Remote work

About the company

The client is a rapidly growing, venture-backed AI company that helps leading AI organisations build, evaluate and improve models. It matches professionals to projects through its own AI-driven assessment platform and has raised over $40 million.