Philosophy Quality Assurance Lead

Role overview

This is a remote contractor position focused on quality leadership for philosophy-related AI training work. The person in this role will oversee consistency, accuracy, and reviewer performance across projects involving philosophy content. The work is hourly and remote, with an emphasis on maintaining high standards for both generated content and human review.

The role supports a fast-growing AI data services company that supplies training data to major AI companies and foundation model labs. By strengthening the conceptual precision, logical soundness, and contextual quality of philosophy datasets, this position contributes directly to better AI model performance.

There is no active project available at the moment. Candidates who are a strong fit may be contacted first when suitable philosophy opportunities open up, and may also gain access to future work through the expert network.

What the role involves

You will assess AI-generated philosophy material and the work of trainers and QA reviewers against detailed project rubrics. The work includes checking for conceptual accuracy, argument structure, logical validity, philosophical nuance, interpretation quality, formatting, clarity, and instruction adherence. You will also look for repeated quality problems, share precise written feedback, and help contributors stay aligned with expectations.

In addition to review work, you will support onboarding, update documentation, communicate changes to trainers and QAs, and help re-engage contributors who are inactive. The role requires strong philosophy knowledge, excellent English communication, careful attention to detail, and a structured approach to remote quality workflows.

Selection process

The hiring process includes an AI interview, a domain-specific task, and a conversation with a recruiter.

Required background

Applicants should have a background in philosophy or a closely related discipline, such as ethics, logic, political theory, humanities, religious studies, classics, or cognitive science. A bachelor’s, master’s, or PhD degree in one of these areas is expected.

At least 3 years of relevant experience is required in philosophy research, teaching, writing, editing, academic review, ethics review, logic instruction, or similar humanities-based work. Strong English skills are needed for reviewing guidelines, writing feedback, and coordinating with remote teams.

Experience with formal logic, moral philosophy, applied ethics, analytic philosophy, continental philosophy, ancient philosophy, philosophy of science, political philosophy, or AI ethics is considered an advantage. Prior experience leading or supporting distributed teams of researchers, writers, reviewers, educators, annotators, or QA specialists is also preferred.

Comfort using remote collaboration tools such as Discord, Google Sheets, Google Docs, trackers, dashboards, and project management platforms is important. The work also calls for strong organization, the ability to maintain style guides and FAQs, and familiarity with AI training, data annotation, LLM evaluation, academic QA, ethics review, or rubric-based assessment.

Core work areas

• Monitor quality by checking philosophy tasks, identifying issues, and sharing ongoing feedback while escalating serious or repeated problems.
• Review AI outputs covering philosophical explanations, argument analysis, ethical reasoning, philosopher summaries, logic exercises, and conceptual comparisons.
• Keep trainers and QAs informed about guideline updates, workflow changes, expectations, and philosophy-specific review standards through Discord and other channels.
• Answer trainer and QA questions clearly, especially those related to logic, philosophical interpretation, validity, distinctions between concepts, ethics, and rubric use.
• Track contributor activity, contact inactive team members, encourage re-engagement, and report availability concerns.
• Build and maintain project resources such as style guides, trackers, FAQs, quality notes, examples, honeypots, calibration tasks, and onboarding material.
• Organize and lead onboarding or training calls to explain workflows, rubrics, standards, and philosophy review requirements.
• Make sure trainers and QAs apply the review framework consistently as project expectations change.
• Identify weak reasoning, bias, overconfidence, misleading claims, shallow ethics, and other quality or integrity issues in philosophical content.
• Suggest process improvements and help develop scalable QA systems for philosophy-focused AI training work.

Additional information

This role is described as hourly and remote, and the source states that it is a contractor position. No immediate assignment is available right now, but suitable candidates may be contacted when relevant projects begin.