Evaluation Specialist

Overview

This remote hourly contract role is for a Rubrics Expert who will design and improve scoring frameworks for a wide range of assessments. The position is based in the United States and requires a commitment of 10 to 40 hours per week.

What you'll do

• Create well-structured scoring rubrics suited to different subjects and evaluation needs.
• Build and refine scoring approaches so they remain clear, equitable, and aligned with assessment goals.
• Run calibration sessions with evaluators and subject experts to support consistent scoring across reviewers.
• Test assessments through pilots, review the data, and apply ongoing quality checks to strengthen reliability.
• Study performance results to spot patterns and suggest improvements to the rubrics.
• Develop straightforward feedback models based on rubric outcomes so learners and performers can improve.
• Work closely with instructional designers, educators, and other stakeholders to raise the quality and impact of assessments.

What we're looking for

• Hands-on experience creating and applying assessment rubrics.
• Strong understanding of scoring methods, calibration practices, and validation techniques.
• Ability to interpret performance data and use insights to enhance evaluation systems.
• Background in maintaining quality control within structured assessment processes.
• Excellent written and verbal communication skills with sharp attention to detail.
• Capability to turn rubric results into clear, practical feedback.
• Independent, well-organized, and comfortable working remotely with cross-functional teams.

Application process

The hiring flow is estimated to take about 20 minutes and includes three steps: sharing a resume, completing a 15-minute interview, and submitting a form.