Neuroscience QA Lead - Remote

Role overview

This remote contractor position is for a Neuroscience Quality Assurance Lead who will help maintain high standards across neuroscience and cognitive science AI training work. The role focuses on checking the consistency, scientific soundness, and performance of trainers and QA contributors involved in these projects.

You will assess AI-produced neuroscience and cognitive science content as well as review work completed by trainers and QAs. Your job will be to compare outputs against project rules, give clear written feedback, and make sure everyone involved follows the required quality bar. The work calls for a strong command of neuroscience or cognitive science, excellent written English, careful attention to detail, and a structured approach to communication and workflow management.

The organization is an AI data services company that supports major AI companies and foundation-model labs with training data. In this role, your quality leadership will help improve AI systems by making sure scientific training data remains accurate, evidence-based, ethically responsible, well explained, and aligned with client needs.

There is not an active project ready for immediate assignment at the moment. Qualified candidates may be contacted first when relevant work becomes available and may also gain access to future opportunities through the expert network.

Responsibilities

• Review neuroscience and cognitive science items, identify quality concerns, and provide ongoing feedback to contributors through direct messages.
• Check AI-generated explanations, research summaries, study interpretations, brain-behavior claims, and reasoning steps for scientific accuracy and clarity.
• Share project updates, rule changes, workflow adjustments, and review expectations with trainers and QAs through remote communication channels.
• Answer questions from trainers and QAs on neural mechanisms, cognition, experimental design, statistical interpretation, ethical limits, and rubric application.
• Reach out to inactive contributors, encourage them to resume work, follow up on availability, and escalate participation issues when necessary.
• Build and maintain project materials such as style guides, trackers, FAQs, examples, calibration tasks, honeypots, onboarding documents, and quality notes.
• Plan and conduct onboarding and training sessions to explain expectations, workflows, scoring rubrics, and neuroscience-specific review standards.
• Keep trainers and QAs aligned so that review guidelines are applied consistently as projects change over time.
• Identify and flag misleading, pseudoscientific, clinically unsafe, overconfident, or ethically problematic claims about the brain, behavior, cognition, or mental health.
• Improve QA workflows by spotting repeated issues and helping design scalable processes for neuroscience and cognitive science training work.

Requirements

• Academic or professional background at bachelor’s, master’s, PhD, MD/PhD, or equivalent level in neuroscience, cognitive science, psychology, neurobiology, cognitive psychology, computational neuroscience, neurology-adjacent research, biology, biomedical sciences, or a closely related field.
• Very strong written English skills for following instructions, communicating with teams, and giving precise feedback.
• At least 3 years of experience in neuroscience or cognitive science research, teaching, lab work, academic review, science communication, experimental design, data analysis, or a similar scientific workflow.
• Solid understanding of neural systems, cognition, perception, attention, memory, learning, language, decision-making, neuroanatomy, neural signaling, research methods, and brain-behavior relationships.
• Ability to assess content using detailed rubrics and identify neuromyths, unsupported causal claims, weak study interpretation, incorrect terminology, pseudoscience, and misleading clinical implications.
• Familiarity with EEG, fMRI, behavioral experiments, computational modeling, neuropsychological assessment, statistics, Python, R, MATLAB, cognitive tasks, or literature review is an advantage.
• Prior experience leading or supporting remote teams of researchers, reviewers, educators, annotators, science writers, or QAs is strongly preferred.
• Comfort using remote collaboration and tracking tools such as Discord, Google Sheets, Google Docs, trackers, dashboards, and project management systems.
• Strong organizational habits and attention to detail for managing style guides, FAQs, trackers, onboarding materials, calibration tasks, and documentation.
• Experience with AI training, data annotation, LLM evaluation, scientific QA, academic review, psychology or neuroscience content review, or rubric-based evaluation is a plus.

Additional information

This is an hourly remote contractor role. The selection process includes an AI interview, a domain-specific task, and a recruiter interview. The position does not have an immediate project attached, but qualified candidates may be contacted for future assignments.

Location

Remote; location listed as Ireland.