This page was automatically translated and may contain errors. View in English.
Weekday AI (YC W21)

AI Evaluation Specialist

Weekday AI (YC W21)

Remote 兼职

抢先申请

经验
任何
薪水
USD 70 – USD 70 / hour
职位空缺
1
发布
17 小时前
工作模式
在家办公
学历
学士学位
恢复
需要申请

职位描述

About the Role

This position supports a leading AI research project dedicated to enhancing the quality, precision, and reasoning capabilities of cutting-edge artificial intelligence systems. It invites skilled analytical professionals with strong critical thinking and communication abilities to meticulously evaluate AI-generated responses across diverse topics.

Key Responsibilities

  • Assess AI-generated content for correctness, clarity, logical structure, and comprehensiveness.
  • Detect factual inaccuracies, gaps in reasoning, contradictions, and unsupported assertions.
  • Utilize structured evaluation frameworks and thorough quality standards to appraise responses.
  • Compose clear, succinct, and evidence-based explanations for evaluation decisions.
  • Point out both positive aspects and areas needing enhancement within AI outputs.
  • Apply uniform evaluation practices consistently across multiple tasks.
  • Adhere strictly to detailed project guidelines and assessment criteria.
  • Ensure objectivity, precision, and reproducibility in all evaluations.
  • Work independently to deliver high-quality outcomes.

Qualifications

  • Bachelor's degree from a globally recognized university, preferably from top-ranked institutions.
  • Outstanding analytical and problem-solving skills.
  • Excellent written communication abilities, capable of clearly articulating complex reasoning.
  • Advanced critical reading skills, including identifying nuanced arguments, implicit meanings, logical inconsistencies, missing context, and weak or unsupported reasoning.
  • Meticulous attention to detail and consistent application of structured evaluation guidelines.
  • Ability to manage responsibilities autonomously and efficiently.
  • Fluency in English at a native level.

Preferred:

  • Experience in content evaluation, research, quality assurance, editing, or analytical review.
  • Knowledge of AI, large language models, or AI evaluation techniques.
  • Experience with structured annotation or assessment frameworks.
  • Capability to deliver thoughtful, impartial, and well-substantiated written evaluations meeting defined quality standards.

Engagement Details

  • Independent contractor role.
  • Fully remote with flexible scheduling allowing work at your convenience.
  • Project duration is flexible and can be adjusted according to business requirements and individual performance.
  • Compensation is $70 per hour, with weekly payments processed upon submission of approved work.
  • No visa sponsorship is available for this role.

Why Participate

  • Make meaningful contributions to the advancement of next-generation AI technologies.
  • Help enhance the reasoning, accuracy, and dependability of sophisticated AI systems.
  • Engage in stimulating intellectual projects with practical impact.
  • Collaborate indirectly with top-tier AI researchers by providing high-caliber evaluation outputs.

Equal Opportunity

Applicants will be evaluated fairly without discrimination based on legally protected characteristics. Reasonable accommodations are provided upon request.

Contract Specifics

  • Contractor status with independent working arrangements.
  • Work is completely remote and scheduled by the contractor.
  • Payments are made weekly based on completed and approved assignments.
  • This role does not involve access to confidential or proprietary information.

如果您希望收到回复,请留下您的信息——我们不会将您的信息用于其他用途。

点击浏览拖放,或 粘贴 截图

PNG、JPG、GIF、MP4、WebM、MOV 格式 · 每个文件最大 20MB · 最多 5 个文件

🤖
在线·即时人工智能帮助