AI Evaluation Specialist (Remote, Contract)

Position Overview

This contract role involves assessing AI-produced content to ensure it meets quality, clarity, and usability standards while enhancing user experience. The position offers a flexible schedule with 10 to 40 hours of work per week and remote working arrangement.

Key Responsibilities

• Critically review AI-generated outputs for quality and clarity across multiple content and visual formats.
• Detect inconsistencies and areas for improvement to enhance overall content effectiveness.
• Use structured evaluation criteria to provide detailed and constructive feedback to support model improvements.
• Work collaboratively with various teams to establish and refine quality metrics, scoring methods, and review procedures.
• Ensure evaluations are accurate and consistent to deliver actionable insights.
• Participate in ongoing improvements of evaluation processes and best practices.

Qualifications and Skills

• Native-level English fluency at C1 or C2 proficiency.
• Exceptional reading comprehension with strong attention to detail.
• Excellent observational abilities with refined editorial or aesthetic judgment.
• Critical thinking to consistently provide high-quality feedback in uncertain or ambiguous situations.
• Strong verbal and written communication skills.

Additional Information

• Compensation range: $22 to $70 per hour.
• Application includes resume evaluation and interview stages.