Data Evaluator

About the Role

This position is with Mercor, a company that connects highly skilled creative and technical professionals with leading AI research labs. The team is based in San Francisco and is backed by investors such as Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.

Role Overview

You will work as a Software / AI / IT / data evaluator, reviewing AI-produced work and judging it against detailed, domain-specific quality standards. The role is remote and structured as a contract assignment with pay in the range of $80 to $120 per hour.

Key Work Areas

• Assess AI-generated content using subject-specific evaluation rubrics.
• Spot factual mistakes, visual or aesthetic issues, and formatting or presentation problems in documents, spreadsheets, and slide decks.
• Write precise, well-organized feedback that helps improve model outputs.
• Use strong domain knowledge to judge accuracy, completeness, and quality.
• Operate independently and asynchronously while meeting deadlines.

Required Background

Candidates should have at least 5 years of professional experience in Software / AI / IT / data. Strong English fluency, either native or professional, is required. You should also be very comfortable using Microsoft Office and Google Workspace, with particular strength in Slides.

Preferred Profile

An advanced degree, such as a Master's or higher, from a reputable institution is preferred.

Application Steps

The application process typically takes 20 to 30 minutes and includes three steps: uploading a resume, completing an AI interview based on the resume, and submitting the form.

Support Information

If you need help or want more details about the interview flow and platform, support is available through the provided help channel.

Additional Information

The company reviews applications every day. To be considered, all application steps, including the AI interview, should be completed.