Crossing Hurdles

AI Evaluation Specialist

Crossing Hurdles

Remote · Contract

Be the first to apply

Experience
Any
Salary
USD 22 – USD 70 / hour
Openings
1
Posted
5 hours ago
Work mode
Work from home
Eligibility
Candidates with native-level English proficiency at C1 or C2 who can commit to a remote contract role for 10 to 40 hours per week are suitable for this position.
Resume
Required to apply

Job description

Role Overview

This is a contract-based remote position focused on evaluating AI-produced content and experiences. The work centers on assessing quality, clarity, usefulness, and the overall experience from a user’s point of view.

Compensation & Commitment

Pay is set at $22 to $70 per hour. The expected workload is flexible, ranging from 10 to 40 hours each week.

What You’ll Do

  • Examine AI-generated responses and judge them for accuracy, clarity, usefulness, and user experience.
  • Spot gaps, inconsistencies, and opportunities to improve across different kinds of content and visual outputs.
  • Use defined evaluation criteria to give structured, detailed feedback that can guide model improvements.
  • Work with different teams to shape and improve quality benchmarks, scoring methods, and review workflows.
  • Keep assessments highly consistent and precise so the results remain dependable and actionable.
  • Help strengthen evaluation methods and ongoing best practices over time.

Requirements

  • Native-level English ability at C1 or C2 standard.
  • Excellent reading comprehension and strong attention to detail.
  • Sharp observational ability with sound editorial or aesthetic judgment.
  • Strong critical thinking skills and the ability to stay consistent in unclear situations.
  • Excellent written and spoken communication skills.

Additional Information

The role is remote and based in Ireland. No fixed start date, duration, or vacancy count was specified.

Leave it if you'd like a reply — we won't use it for anything else.

Click to browse, drag & drop, or paste a screenshot

PNG, JPG, GIF, MP4, WebM, MOV · Max 20MB each · Up to 5 files