English Specialist

About the Role

We are seeking a proficient English-speaking specialist to contribute to the evaluation and enhancement of advanced language models. The position involves crafting a variety of prompts spanning multiple topics to rigorously test and compare outputs from AI platforms.

Key Duties and Responsibilities

• Generate diverse prompts across a broad spectrum of subjects to challenge large language models.
• Conduct simultaneous prompt submissions to ChatGPT and Claude, recording both screen activity and audio commentary.
• Evaluate and verbally analyze the responses from each model in real time, identifying strengths, weaknesses, and notable distinctions.
• Deliver comprehensive, well-structured oral feedback in clear American English, outlining reasoning and preferences.
• Maintain professional clarity and precision in spoken and written communication throughout recording sessions.
• Apply project documentation guidelines to ensure standardized evaluation criteria and accurate outcomes.
• Work collaboratively with project standards to facilitate ongoing improvements of AI models.

Candidate Profile

• Fluency in spoken and written American English with clear diction and the capacity to express natural opinions and insights.
• Experience interacting with large language models such as ChatGPT, Claude, Gemini, or equivalents.
• Understanding of AI evaluation methodologies.
• Comfortable with lengthy screen and audio recording sessions conducted in an interruption-free environment.
• Excellent critical thinking, analytical skills, and meticulous attention to detail.
• Prior experience in data annotation, AI training, quality assurance, content evaluation, or research is beneficial.
• Possession of a robust technical setup including a dependable computer, steady internet access, and ability to record superior quality audio and video.