YO IT Consulting

English QA Lead

YO IT Consulting

Remote · Contract

Be the first to apply

Experience
3+ yrs
Salary
Openings
1
Posted
1 week ago
Work mode
Work from home
Education
Bachelor’s degree
Eligibility
Candidates with a bachelor’s or master’s degree in an English- or quality-related field, plus at least 3 years of relevant QA/review experience, can apply. Prior experience supporting remote contributor teams and familiarity with AI training or LLM evaluation will strengthen the profile.
Resume
Required to apply

Job description

Role overview

This remote contractor position focuses on leading English quality assurance work for AI training initiatives. The role is centered on reviewing generated English content as well as trainer and QA output, checking that everything meets project standards, and making sure quality remains consistent across distributed teams.

You will assess work for accuracy, clarity, reasoning quality, grammar, tone, formatting, and compliance with project rubrics. In addition, you will provide written feedback, surface recurring issues, support onboarding, keep documentation current, and help bring inactive contributors back into work when needed.

The company operates in AI data services and supports training data efforts for major AI companies and foundation model labs. Your work will contribute directly to improving AI model quality by keeping training data accurate, consistent, well documented, and aligned with client expectations.

This position is hourly and remote. There is currently no immediate project assigned; however, qualified candidates may be contacted first when relevant opportunities become available and may also gain access to future work through the expert network.

What you'll do

  • Review submitted work, identify quality problems, and share ongoing feedback through direct messages while escalating repeated or serious concerns.
  • Keep trainers and QAs informed on Discord about updated item guidelines, workflow changes, and quality standards.
  • Answer contributor questions clearly and quickly so that instructions and edge cases are understood correctly.
  • Reach out to inactive contributors, encourage them to re-engage, track follow-ups, and flag availability issues when required.
  • Build and maintain project materials such as style guides, trackers, FAQs, quality notes, examples, honeypots, and onboarding resources.
  • Plan and conduct onboarding and training calls to walk trainers and QAs through expectations, workflows, rubrics, and quality benchmarks.
  • Make sure guidelines are applied consistently across all trainers and QAs as project requirements change.
  • Look for recurring quality problems, suggest process improvements, and help design scalable QA workflows for future projects.

Requirements

  • A bachelor’s or master’s degree in English, Linguistics, Communications, Journalism, Education, AI/Data Annotation, Quality Assurance, or a closely related field.
  • Excellent command of English, including grammar, clarity, tone, structure, register, and the ability to produce strong written feedback.
  • At least 3 years of professional experience in QA, editing, content review, AI training, education, annotation, localization QA, or a similar review-based role.
  • Prior experience leading or supporting remote teams of trainers, annotators, reviewers, editors, or QA professionals is strongly preferred.
  • Proven ability to work from detailed rubrics and guidelines, identify quality gaps, and explain issues in a constructive way.
  • Strong written and verbal communication skills, including the ability to handle contributor questions and share project updates effectively.
  • Comfort using remote collaboration tools such as Discord, Google Sheets, Google Docs, trackers, dashboards, and project management platforms.
  • Strong organizational habits and attention to detail, with the ability to maintain documentation and quality resources.
  • Dependable, self-managed, and able to handle contributor activation, follow-ups, escalations, and quality checks across time zones.
  • Experience with AI training, data annotation, large language models, prompt/response evaluation, or rubric-based LLM QA is a strong advantage.

Additional information

This is a contract role, and the work is hourly. The job is remote, and the employer is looking for someone who can operate effectively across distributed teams. The role is not tied to an immediate project at the moment, but it is intended to position qualified candidates for future assignments.

Leave it if you'd like a reply — we won't use it for anything else.

Click to browse, drag & drop, or paste a screenshot

PNG, JPG, GIF, MP4, WebM, MOV · Max 20MB each · Up to 5 files