- Experience
- Any
- Salary
- USD 70 – USD 70 / hour
- Openings
- 1
- Posted
- 3 days ago
- Work mode
- Work from home
- Education
- Bachelor's degree
- Eligibility
- Native English speakers with strong legal analysis, critical reading, or structured writing experience may apply. A bachelor’s degree from a globally ranked institution is preferred.
- Resume
- Required to apply
Job description
Role Overview
This remote contract opportunity involves assessing AI-generated answers and producing structured written feedback. The work supports research efforts aimed at strengthening the accuracy, reliability, and overall quality of AI systems.
Compensation & Schedule
The position pays $70 per hour and offers a flexible, self-scheduled time commitment.
Responsibilities
- Examine LLM-generated responses using defined evaluation criteria and identify mistakes, omissions, reasoning flaws, and opportunities for improvement.
- Prepare concise but detailed written explanations that support each evaluation with clear evidence, not just quick observations.
- Use balanced and direct judgment when scoring outputs, including marking down weak or inaccurate model responses when needed.
- Work carefully through task instructions and maintain accuracy so scores and notes can be repeated and verified consistently.
Candidate Profile
The ideal person brings a background in legal analysis, careful reading, or structured written assessment in either academic or professional settings. The role also calls for a strong ability to spot nuance, implied meaning, and weaknesses in logic across complex text. Candidates should be able to produce polished written work independently without depending on AI writing tools. Native-level English fluency is required, and a bachelor’s degree from a globally ranked institution is preferred.
Additional Information
This is a contract-based remote role. Applicants are expected to proceed through the provided easy-apply process.