Language Model Analyst - English & Kannada (Part-time, Remote)

About Mercor

Mercor is a company dedicated to connecting top-tier creative and technical professionals with leading artificial intelligence research laboratories. Headquartered in San Francisco, our investors include notable figures such as Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.

Role Overview

We are hiring a Language Model Analyst specializing in English and Kannada to join us on a contract basis. This is a fully remote, part-time position with compensation ranging from $15 to $20 per hour.

Key Responsibilities

• Verify facts by utilizing trustworthy public resources and additional tools.
• Produce high-quality human evaluation data by highlighting strengths, improvement areas, and factual errors in model responses.
• Evaluate the quality of reasoning, clarity, tone, and completeness in outputs.
• Ensure that the model's responses correspond with desired conversational conduct and system guidelines.

Qualifications

Essential:

• Possess a bachelor's degree.
• Be a native Kannada speaker.
• Have substantial experience with large language models (LLMs).
• Exhibit excellent English writing skills.
• Maintain strong attention to detail.
• Background or experience in fields requiring structured analytical thinking.

Preferred:

• Prior involvement in RLHF, model evaluation, or data annotation.
• Experience in writing or editing superior quality written content.
• Skilled at comparing multiple outputs and making nuanced qualitative assessments.

Application Procedure

• Submit your resume.
• Complete an AI interview based on your resume.
• Fill out the required application form.

Additional Information & Support

• Details about the interview process and platform can be found on the company’s talent resources.
• For assistance, contact support via email.
• Applications are reviewed daily; ensure your AI interview and application are fully completed to be considered.