Data Science Expert - Remote Contractor

Role Overview

We are collaborating with a leading AI research organization to hire skilled data scientists for a contracted project aimed at assessing how effectively AI systems perform authentic data science tasks. Unlike typical data science roles, your main responsibility will be to set clear standards of excellence by developing grading criteria tailored to specific tasks, and rigorously evaluating completed work samples with thorough written explanations.

Key Responsibilities

• Develop precise grading rubrics for evaluating real-world data science outputs such as analyses, models, dashboards, experimental reports, and recommendations.
• Assess both AI-produced and human-generated work based on these criteria, providing detailed justifications for each assigned score.
• Maintain unbiased, reproducible, and defensible scoring through evidence-based judgment.
• Adapt and refine your evaluations by integrating structured feedback from senior reviewers quickly.

Ideal Qualifications

• Minimum of 5 years professional experience in data science within the industry.
• Experience in business operations, product, or growth data science roles at prestigious technology firms.
• Strong expertise in experimental design, A/B testing, metric formulation, SQL and Python analytics, and presenting insights to executive-level stakeholders.
• Exceptional written communication skills.
• Meticulous, consistent decision-making and openness to peer review and calibration.
• Previous work related to AI training, evaluation, or human-data projects is highly desirable.

Application Process

• Submit your resume or technical background details to initiate consideration.
• Selected candidates may be invited to complete a brief technical assessment or provide additional materials.

Contract and Payment Details

• You will be engaged as an independent contractor.
• The role is fully remote with flexible scheduling.
• Project duration may vary depending on organizational needs and individual performance.
• Payments are made weekly via Stripe or Wise based on work completed.

We welcome applicants regardless of legally protected characteristics and will provide reasonable accommodations on request.