AI Evaluation Specialist

Role overview

This contract position is for an AI Evaluation Specialist who will assess AI-generated content and experiences from a quality and usability perspective. The assignment is fully remote and requires a weekly commitment of 10 to 40 hours. Compensation is set at $22 to $70 per hour.

What you will do

• Carefully examine AI-created outputs and judge how clear, useful, accurate, and user-friendly they are.
• Spot gaps, contradictions, weak points, and opportunities to improve across different content formats and visual outputs.
• Use defined evaluation frameworks to give detailed, thoughtful feedback that can help improve the model.
• Work with other teams to shape and improve quality benchmarks, scoring methods, and review procedures.
• Keep assessments consistent and precise so the findings can be trusted and acted upon.
• Help refine evaluation processes and contribute ideas for better workflows and standards.

What we are looking for

• Native-level English ability at C1 or C2 standard.
• Strong reading comprehension and a sharp eye for detail.
• Good observational ability, along with sound editorial or visual judgment.
• Comfort with critical thinking and consistent decision-making in unclear situations.
• Excellent written and spoken communication skills.

Application process

The application flow includes a resume review and an interview stage, followed by next-step communication through email.