- Experience
- 3+ yrs
- Salary
- —
- Openings
- 1
- Posted
- 3 weeks ago
- Work mode
- Work from home
- Education
- Bachelor's degree
- Eligibility
- Candidates with a bachelor’s or master’s degree in a relevant discipline, along with at least 3 years of experience in QA, review, editing, content evaluation, AI training, annotation, localization QA, or similar work. Those with remote team leadership experience and exposure to AI/LLM evaluation a…
- Resume
- Required to apply
Job description
Role overview
This is a remote, hourly contractor position for an English Quality Assurance Lead. The role focuses on keeping AI training work accurate, consistent, and aligned with project rules by reviewing English content and evaluating the work of trainers and QA team members.
You will assess submissions for correctness, clarity, reasoning strength, grammar, tone, formatting, and compliance with task instructions and project rubrics. In addition to reviewing output, you will give detailed written feedback, identify repeated issues, support onboarding, maintain key documentation, and help re-engage contributors who are not actively participating.
The position sits within a fast-growing AI data services organization that supplies training data to major AI companies and foundation model labs. The work you do will directly contribute to improving AI models by helping ensure the data they learn from is reliable, consistent, and properly documented.
Please note that there is no active project attached to this role at the moment. If you are a strong fit, you may be contacted first when relevant work becomes available, and you may also be considered for future projects through the expert network.
Responsibilities
- Review sample submissions, identify quality problems, and share ongoing feedback through direct messages while escalating serious or repeated concerns.
- Keep trainers and QA contributors informed on Discord about updated item rules, workflow changes, and expectations around quality.
- Answer contributor questions clearly and quickly so that instructions, exceptions, and edge cases are understood correctly.
- Reach out to inactive or unresponsive contributors, encourage them to return to work, track follow-ups, and flag availability concerns when needed.
- Build and maintain project materials such as style guides, trackers, FAQs, quality notes, examples, honeypots, and onboarding resources.
- Plan and lead onboarding or training calls for trainers and QAs, covering project standards, rubrics, workflows, and quality expectations.
- Make sure all trainers and QAs apply the guidelines in a consistent way and stay aligned as the project changes.
- Look for recurring quality gaps, suggest workflow improvements, and help shape QA processes that can scale to future projects.
Requirements
- A bachelor’s or master’s degree in English, Linguistics, Communications, Journalism, Education, AI/Data Annotation, Quality Assurance, or a closely related field.
- Excellent command of English, including grammar, clarity, tone, structure, and the ability to write useful feedback.
- At least 3 years of professional experience in QA, editing, content review, AI training, education, annotation, localization QA, or similar review-based work.
- Prior experience leading or supporting remote teams of trainers, annotators, reviewers, editors, or QA specialists is preferred.
- Strong skill in evaluating work against detailed rubrics, spotting quality gaps, and explaining issues in a constructive way.
- Very good written communication skills for handling questions, sending updates, and sharing actionable feedback.
- Comfort using fast-paced remote collaboration tools such as Discord, Google Sheets, Google Docs, trackers, dashboards, and project management systems.
- Highly organized and detail-focused, with the ability to manage documentation, onboarding resources, FAQs, trackers, and related materials.
- Self-motivated and dependable, with the ability to manage activation, follow-ups, escalations, and quality checks across multiple time zones.
- Experience with AI training, data annotation, large language models, prompt/response evaluation, or rubric-based LLM QA is a strong advantage.
Additional information
This is a contract role with remote work setup and hourly compensation structure. The company operates in the AI data services space and supports training-data work for leading AI organizations. The role is designed for candidates who can step in quickly when project demand arises.