Rubrics Grader - Remote Contract Position

About Mercor

Mercor is a company that links top-tier creative and technical professionals with premier AI research laboratories. Based in San Francisco, it receives backing from prominent investors like Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.

Role Overview

We are seeking a skilled grader with expertise in rubrics and the ability to work fluently with JSON-formatted data. This contract position is fully remote and compensates between $50 and $175 per hour.

Primary Responsibilities

• Assess AI model outputs by applying predefined grading rubrics to ensure precision and uniformity.
• Interpret and analyze outputs structured in JSON format for evaluation.
• Review provided task descriptions and grading rubrics to uphold quality standards.
• Operate independently to complete assignments within 12 to 24 hours.
• Maintain meticulous attention to detail to apply rubric criteria consistently.

Candidate Requirements

• Must be available to commence work on Saturday, July 25.
• Proficient in reading and understanding JSON data files.
• Reside within the United States.

Preferred candidates will have previous experience working with Mercor and applying detailed rubrics.

Additional Information

• The application process involves submitting a resume, completing an AI-driven interview based on your resume, and filling out a form; this process takes approximately 20 to 30 minutes.
• Applications are reviewed on a rolling basis and the start date is Saturday, July 25.
• For interview and platform details, candidates can consult the resources provided by Mercor or contact support at [email protected].
• Timely completion of all application steps, including the AI interview, is necessary for consideration.