- Experience
- 3+ yrs
- Salary
- —
- Openings
- 1
- Posted
- 3 weeks ago
- Work mode
- Work from home
- Education
- Bachelor’s or Master’s degree
- Eligibility
- Candidates with the required degree and at least 3 years of relevant professional experience in QA, editing, review, AI training, annotation, localization QA, or a similar field can apply. Experience supporting remote teams and familiarity with AI training or LLM evaluation is advantageous.
- Resume
- Required to apply
Job description
Role overview
This remote contractor position is for an English Quality Assurance Lead who will guide quality, consistency, and trainer performance across AI training assignments. The work is hourly and fully remote, with no active project available at the moment. If you are a good fit, you may be contacted first when suitable work opens up, and you could also be considered for future opportunities through the expert network.
The employer is a fast-growing AI data services company that supports training data needs for some of the world’s largest AI companies and foundation-model labs. In this position, your quality leadership will help raise the standard of AI model training by making sure the data is accurate, consistent, clearly documented, and aligned with client requirements.
What you will do
- Review AI-generated English content as well as trainer and QA work, then judge it against project instructions and quality rubrics.
- Check submissions for accuracy, clarity, reasoning quality, grammar, tone, formatting, and correct instruction-following.
- Provide detailed written feedback and surface repeated issues so they can be corrected at the source.
- Keep trainers and QAs informed about guideline changes, workflow updates, and quality expectations.
- Answer contributor questions clearly and quickly so instructions and edge cases are understood correctly.
- Reach out to inactive contributors, encourage them to resume work, track follow-ups, and flag availability concerns when required.
- Build and maintain project documentation such as style guides, FAQs, trackers, examples, honeypots, quality notes, and onboarding material.
- Run onboarding and training sessions with trainers and QAs to explain standards, rubrics, workflows, and expectations.
- Make sure all contributors apply guidelines in a consistent way as projects change over time.
- Look for repeated quality problems, suggest process changes, and help design scalable QA systems for future projects.
Candidate profile
The ideal candidate brings a strong command of English, especially grammar, clarity, tone, register, structure, and the ability to give high-quality written feedback. You should also have at least 3 years of professional experience in quality assurance, editing, content review, AI training, education, annotation, localization QA, or a similar review-based function.
Experience guiding remote teams of trainers, annotators, reviewers, editors, or QAs is preferred. You should be comfortable working with detailed rubrics, identifying quality gaps, and explaining issues in a constructive way. Strong written communication, organization, and self-direction are essential, especially when working across time zones and handling follow-ups, escalations, and contributor activation.
Experience with AI training, data annotation, large language models, prompt or response evaluation, or rubric-based LLM QA is a plus. Familiarity with tools such as Discord, Google Sheets, Google Docs, trackers, dashboards, and project management systems will also be helpful.
Education
A bachelor’s or master’s degree in English, Linguistics, Communications, Journalism, Education, AI/Data Annotation, Quality Assurance, or a related discipline is required.
Additional notes
This opportunity is listed as a contract role and is based remotely in the United States. The role is hourly. No immediate project is available, but qualified candidates may be contacted for upcoming work and future expert-network opportunities.