- Experience
- 3+ yrs
- Salary
- —
- Openings
- 1
- Posted
- 3 weeks ago
- Work mode
- Work from home
- Education
- Bachelor's or Master's degree
- Eligibility
- Candidates with the required degree and at least 3 years of relevant experience in QA, editing, content review, AI training, annotation, education, or related review work may apply. Experience supporting remote teams and familiarity with AI/LLM QA workflows are preferred.
- Resume
- Required to apply
Job description
Role overview
This remote, hourly contractor position is for an English Quality Assurance Lead who will oversee consistency, quality, and trainer performance across AI training initiatives. The role centers on reviewing English AI outputs as well as the work produced by trainers and QAs, checking each item against project rules, and delivering clear written feedback that helps contributors meet the required standard.
You will assess whether work is accurate, coherent, logically sound, grammatically correct, appropriately toned, well formatted, and aligned with instructions and project rubrics. In addition, you will identify repeated quality problems, share updates with trainers and QAs, support onboarding, maintain project records, and help reactivate contributors who have gone inactive.
This opportunity sits within a rapidly expanding AI data services company that supplies training data to major AI organizations and foundation model labs. Your leadership in quality control will directly contribute to improving AI systems by ensuring training data remains precise, consistent, well documented, and aligned with client needs.
Important note: there is no active project available right now. However, if you are a fit, you may be contacted first when relevant work opens up, and you may also gain access to future opportunities through the expert network.
Responsibilities
- Review submitted work, flag quality issues, and share ongoing feedback through direct messages while escalating recurring or serious problems.
- Keep trainers and QAs informed on Discord about new instructions, workflow updates, project changes, and quality expectations.
- Answer contributor questions quickly and clearly so that instructions, exceptions, and edge cases are understood correctly.
- Reach out to inactive contributors, encourage them to resume activity, follow up as needed, and report any availability concerns.
- Build and maintain project documentation such as style guides, trackers, FAQs, quality notes, examples, honeypots, and onboarding resources.
- Plan and lead onboarding or training sessions for trainers and QAs, explaining standards, workflows, rubrics, and expected output quality.
- Make sure all trainers and QAs apply the guidelines consistently and stay updated when project requirements change.
- Spot recurring issues, suggest process improvements, and help establish scalable QA practices for future work.
Requirements
- A bachelor’s or master’s degree in English, Linguistics, Communications, Journalism, Education, AI/Data Annotation, Quality Assurance, or a closely related field.
- Excellent command of English, including grammar, clarity, tone, structure, register, and the ability to provide strong written feedback.
- At least 3 years of professional experience in quality assurance, editing, content review, AI training, education, annotation, localization QA, or another related review workflow.
- Prior experience leading or supporting remote teams of trainers, annotators, reviewers, editors, or QAs is strongly preferred.
- Ability to assess work against detailed guidelines and rubrics, identify quality gaps, and explain issues in a constructive way.
- Strong written and interpersonal communication skills for answering questions, giving updates, and sharing actionable feedback.
- Comfort working in fast-paced remote environments with tools such as Discord, Google Sheets, Google Docs, trackers, dashboards, and project management platforms.
- High attention to detail and strong organization for managing style guides, FAQs, trackers, onboarding materials, honeypots, and related documentation.
- Dependable, self-managed, and able to handle activation follow-ups, escalations, and quality checks across time zones.
- Experience with AI training, data annotation, large language models, prompt and response evaluation, or rubric-based LLM QA is a strong advantage.
Additional information
This is an hourly contract role based remotely. The employer notes that project availability is not immediate, so suitable candidates may be contacted for future opportunities rather than current active work.
About the company
The company is an AI data services provider that supports some of the world’s largest AI companies and foundation-model labs with high-quality training data.