Data Scientist - AI Evaluation

Stack

Responsibilities

• ▹Design task-specific grading criteria for data science deliverables
• ▹Evaluate AI-generated and human-created work
• ▹Write detailed justifications for evaluations
• ▹Apply consistent, evidence-based judgment
• ▹Incorporate feedback and iterate on submitted work

Requirements

• ▹1+ years of professional data science experience
• ▹Experience at a leading tech, research, or quantitative firm
• ▹Strong Python, SQL, statistical modeling, and ML skills
• ▹Exceptional written communication skills
• ▹Detail-oriented approach to evaluating complex work

Soft skills

What we offer

• ▹Flexible, independent, asynchronous work
• ▹High hourly pay ($100-150/hour)

About the company

Mercor connects elite creative and technical talent with leading AI research labs, headquartered in San Francisco.