AI Evaluation Specialist

Role Overview

This contract role is for an AI Evaluation Specialist working remotely from the United Kingdom. The position focuses on assessing AI-generated content and visual outputs to ensure they meet high standards for quality, clarity, usefulness, and user experience. The work commitment is flexible, ranging from 10 to 40 hours per week, and compensation is paid at an hourly rate between $22 and $70.

What You’ll Do

• Carefully examine AI-produced outputs and judge them for quality, readability, practical usefulness, and overall user experience.
• Spot gaps, contradictions, and areas that could be improved across different content formats and visual experiences.
• Use defined evaluation rules to provide thoughtful, detailed feedback that helps improve model performance.
• Work with teams across functions to shape and improve quality benchmarks, scoring methods, and review procedures.
• Keep evaluations accurate and consistent so the results are dependable and usable.
• Help refine evaluation workflows and contribute to better ongoing practices.

What We’re Looking For

• Native-level English ability at C1 or C2 standard.
• Very strong reading comprehension and a sharp eye for detail.
• Good observational ability, along with strong editorial or aesthetic judgment.
• Comfort making clear, consistent decisions in situations where the right answer is not obvious.
• Strong written and spoken communication skills.

Application Process

• Submit an easy application through the hiring platform.
• Watch for email instructions about the next stage.
• Complete a resume review and interview stage.