Quality Analyst - AI Personalization (Remote)

About the Role

We are recruiting a Quality Analyst to join our client's team remotely on a full-time basis. This position involves evaluating a new personalization feature for an AI model, which incorporates data from previous interactions such as conversations, emails, searches, and other user activities to generate relevant and personalized responses.

Key Responsibilities

• Assess the quality of AI-generated personalized replies using your own personal context as a reference.
• Create innovative, multi-turn prompts designed to challenge the AI's integration of personal data sources accurately.
• Evaluate responses for accuracy, grounding in personal data, and helpfulness, identifying any incorrect or forced personalization.
• Compare AI outputs side-by-side to identify nuanced differences in relevance and precision.
• Provide comprehensive feedback to enhance the AI model's personalization abilities.

Required Qualifications and Skills

• Strong command of English with advanced reading and writing skills.
• Experience in prompt creation or test case design for AI models.
• Analytical skills to interpret subtle and ambiguous AI responses critically.
• Understanding of AI personalization strategies and evaluation methodologies.
• Meticulous attention to detail for detecting subtle inconsistencies in AI outputs.
• Willingness to share your primary Google account data sources to facilitate assessment.
• Availability full-time within your local timezone to support round-the-clock global operations.

Additional Information

This opportunity allows you to contribute to a leading company in technology, information, and internet sectors, helping to shape state-of-the-art AI solutions with significant business impact.

Equal Opportunity Employment

Our client promotes a skills and merit-based hiring process welcoming candidates from diverse backgrounds without discrimination based on history or experience.