Data Science Expert (Remote Contractor)

Role Overview

We are collaborating with a premier AI research entity to onboard seasoned data scientists for a project that assesses AI systems' capability in performing practical data science tasks. Instead of generating deliverables, your core role will involve defining the standards of excellence by creating detailed grading frameworks and evaluating both AI-produced and human data science outputs with thorough written justifications.

Key Responsibilities

• Develop accurate, task-specific evaluation criteria tailored to various data science outputs such as analyses, models, dashboards, experiment results, and strategic written recommendations.
• Evaluate samples produced by AI and humans following these criteria, providing comprehensive written explanations for every given score.
• Maintain consistency and ensure all judgments are evidence-based to guarantee reproducibility and defendability of scores.
• Quickly incorporate structured feedback from senior reviewers to refine and improve assessments.

Required Qualifications

• Over five years of industry experience as a professional data scientist.
• Experience working within business operations, product development, or growth data science teams at leading technology firms.
• Expert knowledge in experimental design including A/B testing, metric formulation, analysis using SQL and Python, and presenting insights effectively to executive-level stakeholders.
• Exceptional written communication skills.
• High attention to detail, reliability in judgment, and openness to peer review and calibration.
• Preferred but not required: prior participation in AI training, AI evaluation, or projects involving human-data interaction.

Application Process and Employment Details

• Submit your CV or details of your technical background to initiate the application.
• Selected candidates may need to undertake a short technical evaluation or provide further details about their experience.
• This position is offered as a fully remote independent contractor role with flexible scheduling.
• Engagement duration is variable and subject to modification based on project demands and individual performance.
• Payments are disbursed weekly via Stripe or Wise, depending on the services provided.

Equal Opportunity

All qualified candidates will be considered regardless of legally protected status. Reasonable accommodations will be provided upon request.