Data Scientist

Role Overview

This position involves developing precise grading standards tailored to data science outputs such as exploratory data analysis, statistical modeling, machine learning workflows, experimentation with A/B tests, feature engineering, and authoring technical reports or notebooks.

Key Duties

• Creating detailed, task-specific evaluation metrics for various data science deliverables.
• Assessing AI-generated or human-produced work based on these grading criteria.
• Providing comprehensive written explanations supporting evaluation decisions and scores given.
• Maintaining consistent and evidence-backed judgments ensuring reproducible and justifiable assessments.
• Integrating structured feedback from senior evaluators and refining assessments accordingly.

The exact responsibilities may differ depending on the specific project requirements.

Qualifications and Candidate Profile

• At least one year of professional experience in data science.
• Background in prestigious technology, research, or quantitative organizations, including leading FAANG companies, AI research laboratories, or high-caliber quantitative funds, or equivalent experience.
• Proficient in Python, SQL, statistical modeling, machine learning, experimentation, causal inference, and translating complex real-world datasets into robust analyses.
• Superior written communication skills with the capability to effectively communicate technical results.
• Meticulous and consistent in evaluating complex outputs with attention to detail.
• Open to constructive feedback and adept at aligning judgments with established standards.