Quality Analyst - AI Personalization (Remote)

Position Overview

We are recruiting a full-time Quality Analyst to work remotely evaluating a novel personalization feature within an AI system. The role involves assessing how effectively the AI model integrates contextual information such as past conversations, emails, search history, and user activity to generate relevant and accurate responses. This position demands creativity in prompt design alongside analytical review of the AI's outputs.

Key Responsibilities

• Evaluate personalized AI-generated answers leveraging your own experiences as contextual input.
• Create complex, multi-turn prompts that challenge and test the model's capability to accurately integrate personal data sources.
• Analyze AI responses for correct grounding, coherence, and usefulness, identifying any errors in personalization or imprecise associations.
• Conduct side-by-side comparison of different AI model outputs to detect subtle differences in accuracy and relevance.
• Provide comprehensive feedback on the AI system's behavior to enhance its personalization effectiveness.

Required Qualifications and Skills

• Strong command of English language, with excellent reading and writing skills.
• Experience in prompt engineering or formulating test cases for AI models.
• Ability to scrutinize subtle and complex AI responses with analytical precision.
• Understanding of personalization concepts and evaluation techniques in AI technologies.
• High attention to detail to uncover nuanced inconsistencies in model outputs.
• Willingness to utilize your primary personal Google account and enable access to your personal data for assessment purposes.
• Availability for full-time work aligned with your local time zone to support a 24-hour global operations team.

Additional Information

This role provides a chance to contribute to a leading global technology and internet company by supporting the advancement of sophisticated AI systems that produce tangible business results.

Equal Opportunity Commitment

The organization is committed to hiring based on skills and qualifications alone. All applicants with appropriate expertise are encouraged to apply, regardless of background or previous work history.