Quality Analyst - AI Personalization (Remote)

Role Overview

We are recruiting for a full-time Quality Analyst position focused on AI personalization features. This remote role involves evaluating an AI model's ability to personalize responses by integrating information from past interactions such as conversations, emails, searches, and user activities. The job combines creative prompt crafting with detailed analysis of AI-generated outputs to enhance the model's performance.

Key Responsibilities

• Evaluate AI-generated personalized responses using your own personal context.
• Create complex, multi-turn prompts to challenge the AI's integration of varied personal data sources.
• Analyze responses for accuracy, relevance, grounding, and helpfulness, spotting incorrect or artificial personalization.
• Compare AI outputs side-by-side to identify subtle differences in quality and precision.
• Provide thorough feedback to guide improvements in AI personalization capabilities.

Required Skills and Qualifications

• Strong proficiency in English, both written and reading comprehension.
• Experience in prompt engineering or designing test cases for AI or machine learning models.
• Ability to critically assess nuanced, ambiguous AI responses with analytical rigor.
• Understanding of personalization concepts and evaluation criteria in AI technologies.
• Acute attention to detail for detecting minor inconsistencies in AI outputs.
• Comfortable enabling use of your primary Google account and personal data for testing purposes.
• Availability to work full-time within your local timezone to support a global team operating 24/7.

Additional Information

This position provides an exceptional opportunity to contribute to cutting-edge AI development at a globally recognized leader in technology and internet services. The employer is committed to equal opportunity, considering all qualified applicants based strictly on skill and expertise.