Data Analyst (AI Evaluation)

Overview

We are seeking a US-based Data Analyst specializing in AI evaluation to join as a short-term contractor for a retail-focused project lasting approximately 20 weeks. The role offers compensation of $15.3 per hour and is fully remote with a requirement to align up to 4 working hours with Pacific Standard Time (PST).

Key Responsibilities

• Evaluate AI-generated outputs by referencing data from connected Google Workspace applications.
• Judge AI responses for their correctness, contextual relevance, personalization, and overall completeness.
• Detect any missing contextual information, inaccuracies, or irrelevant content in AI outputs.
• Provide structured feedback based on evaluation results and submit findings accordingly.
• Execute evaluation tasks rigorously following the project's guidelines and quality standards.
• Ensure the confidentiality and privacy of data throughout the project.

Candidate Requirements

• Substantial experience in roles involving analytics, evaluation, or knowledge processing.
• Must be a resident of the United States.
• Active user of Google Workspace, particularly Gmail as the primary email platform.
• Regularly utilize Google applications such as Drive, Calendar, Chat, Docs, Sheets, Slides, and Meet.
• Demonstrate strong analytical mindset, critical thinking abilities, and proficient written communication skills.
• Comfortable assessing AI-generated content and adhering to structured evaluation protocols.
• Agree to provide necessary Google Workspace permissions and commit to working 40 hours per week, including a minimum 4-hour overlap with PST.

Application Procedure

• Submit application via the provided form.
• Complete the required Google form and ICF form.
• Undergo a delivery review process.
• Successful candidates will be shortlisted following evaluation.