AI Quality Analyst

About Innodata

Innodata is a worldwide data engineering company listed on Nasdaq as INOD. The company focuses on the close connection between data and artificial intelligence, with a mission to support responsible AI advancement through trusted data, evaluation methods, and human expertise. It offers adaptable solutions, platforms, and services for teams building or using generative AI, and brings more than 36 years of experience in delivering high-quality data and strong outcomes.

Role overview

This opportunity is part of Innodata’s Subject Matter Expert (SME) on Demand program, where contributors support leading technology companies working on generative AI and large language models. The work is part-time, remote, flexible, and project-based rather than a conventional full-time position. It is suitable for people who want to contribute on their own schedule while helping shape the future of AI.

The role is designed for people with strong language and reasoning abilities, including writers, linguists, educators, researchers, and others with a deep interest in how language and logic power AI systems.

What the role involves

• Assessing AI model or algorithm outputs against structured evaluation questions and judging how well they perform.
• Tagging specific parts of content instead of evaluating the entire item as one unit.
• Applying fixed labels or categories to items.
• Reviewing content for quality and suitability.
• Creating labels that help explain concepts, trends, or patterns.
• Producing additional training data through transformations such as image rotation, flipping, cropping, paraphrasing text, summarizing text, or modifying audio/video signals like speed and pitch to improve dataset variety and reduce overfitting.
• Checking whether product features function according to project guidelines.
• Marking model outputs to determine whether content fits a specific condition, such as clickbait, gaming videos, or branded content.
• Ranking or ordering items according to defined criteria or preferences.
• Writing prompts or questions that will be used to generate AI responses.
• Completing relevance-rating tasks using a scoring scale such as 1-3 or 1-5.
• Generating responses to prompts using a language model or another AI system.
• Rewriting text while keeping the original meaning intact and improving clarity, style, or guideline compliance.
• Condensing longer text or data into short summaries.
• Transcribing speech or audio into written form.
• Translating written or spoken content from one language to another.
• Collecting and organizing different types of data for training, evaluating, or fine-tuning AI models, including text, images, video, audio, and other digital content.

Requirements

• A bachelor’s degree or higher in a humanities field is required.
• Advanced academic qualifications such as a master’s degree or PhD are strongly preferred.
• Professional-level or expert-level English proficiency is required, at C1/C2 level.

Additional information

This position is not a standard full-time job. It is structured as a part-time, remote, flexible, project-specific role.

Safety notice

Applicants should be cautious about recruitment scams from people or organizations pretending to represent employers. Innodata does not request payment, bank details, or sensitive personal information during hiring. If someone suspects a scam, they can report it to verifyjoboffer@innodata.com and may also report it to the FTC via its job scam reporting channel.

Compensation

The expected pay is $15 per hour, and the final rate may vary depending on experience, skills, and qualifications.