- Experience
- 3+ yrs
- Salary
- —
- Openings
- 1
- Posted
- 3 days ago
- Work mode
- Work from home
- Education
- Bachelor’s or Master’s degree
- Eligibility
- Applicants with a bachelor’s or master’s degree in one of the listed relevant fields and at least 3 years of experience in QA, editing, content review, AI training, education, annotation, localization QA, or a related review workflow are well suited for this role. Experience with remote team leader…
- Resume
- Required to apply
Job description
Role overview
This remote contractor position is for an English Quality Assurance Lead who will help uphold quality, consistency, and trainer performance across AI training initiatives. The work centers on reviewing English-language AI outputs and reviewer/trainer submissions, checking them against project rules, and delivering clear written feedback that improves future work.
You will evaluate submissions for correctness, clarity, reasoning strength, grammar, tone, formatting, and compliance with task instructions and rubrics. The role also includes identifying repeated issues, sharing updates with trainers and quality reviewers, supporting onboarding, maintaining key documentation, and helping re-engage contributors who are inactive or inconsistent.
This is part of a fast-scaling AI data services organization that supplies training data to major AI companies and foundation model teams. The quality leadership in this role contributes directly to improving model performance by ensuring data is accurate, consistent, well documented, and aligned with client needs.
Please note that there is no active project available immediately for this position. If you are a match, you may be contacted first when suitable opportunities open up, and you may also gain access to future assignments through the expert network.
Employment details
This is a remote contract role with hourly compensation.
Responsibilities
- Review submitted work, flag quality concerns, and give ongoing feedback through direct messages while escalating serious or repeated issues.
- Keep trainers and QAs informed in Discord about guideline updates, workflow changes, and expectations for quality.
- Answer contributor questions quickly and clearly so instructions and edge cases are well understood.
- Reach out to inactive contributors, encourage them to become active again, track follow-ups, and note any availability concerns.
- Build and update documentation such as style guides, trackers, FAQs, quality notes, examples, honeypots, and onboarding resources.
- Organize and lead onboarding and training calls to explain project rules, workflows, rubrics, and standards.
- Make sure trainers and QAs apply guidelines consistently and stay aligned as project requirements change.
- Find recurring quality problems, suggest improvements to the workflow, and support the creation of scalable QA processes for future work.
Requirements
- Bachelor’s or master’s degree in English, linguistics, communications, journalism, education, AI/data annotation, quality assurance, or a related field.
- Strong command of English, including grammar, clarity, tone, register, structure, and the ability to write useful feedback.
- At least 3 years of professional experience in QA, editing, content review, AI training, education, annotation, localization QA, or a similar review-based role.
- Prior experience leading or supporting remote teams of trainers, annotators, reviewers, editors, or QAs is highly desirable.
- Ability to assess work against detailed rubrics, spot quality gaps, and explain issues in a constructive way.
- Excellent written and verbal communication skills for answering questions, sharing updates, and giving actionable feedback.
- Comfort working in fast-paced remote environments with tools like Discord, Google Sheets, Google Docs, trackers, dashboards, and project management platforms.
- Strong organization and attention to detail, with the ability to maintain guides, FAQs, trackers, onboarding documents, honeypots, and related records.
- Self-driven and dependable, with the capacity to manage activation, follow-ups, escalations, and quality checks across time zones.
- Experience with AI training, data annotation, large language models, prompt-response evaluation, or rubric-based LLM QA is a strong advantage.
Additional information
The role is hourly and remote. There is currently no immediate project attached to this position, but qualified candidates may be considered first when relevant opportunities arise. This also opens access to future projects through the expert network.
Work environment
You will collaborate with distributed teams and manage quality workflows across time zones, with communication and coordination taking place through online collaboration tools.