- Experience
- Any
- Salary
- —
- Openings
- 1
- Posted
- hace 4 horas
- Work mode
- Work from home
- Resume
- Required to apply
Job description
Role Overview
We are recruiting for a full-time AI Quality Analyst position focused on evaluating a new AI personalization feature. The role involves assessing how effectively the AI model integrates data from past interactions such as conversations, emails, search history, and user activity to provide meaningful and relevant responses. The position requires creativity in prompt design as well as strong analytical skills to evaluate AI-generated content.
Key Responsibilities
- Assess the quality of AI responses personalized using your own life experiences as context.
- Develop original multi-turn prompts that challenge the AI’s ability to correctly integrate personal data sources.
- Evaluate AI outputs for accuracy, grounding, and helpfulness by identifying erroneous personalization and forced linkages.
- Analyze side-by-side AI responses to detect subtle quality and relevance differences.
- Provide comprehensive feedback about the AI model’s behavior to enhance personalization effectiveness.
Required Qualifications and Skills
- Strong proficiency in English, both written and reading.
- Experience in prompt engineering or creating test scenarios for AI model evaluation.
- Strong analytical capability to interpret complex or ambiguous AI-generated responses.
- Knowledge of personalization frameworks and evaluation metrics applied within AI contexts.
- Meticulous attention to detail to spot minor inconsistencies in AI outputs.
- Willingness to utilize your primary personal Google account and activate personal data sources for model assessment.
- Availability to work full-time within your own time zone to support global 24/7 operations.
Additional Information
This position offers the chance to collaborate with a prominent leader in the technology, information, and internet industries, contributing toward innovative AI developments that have significant business impact.
Equal Opportunity Employer Statement
We focus on hiring candidates based on skills and expertise without discrimination on the basis of background or prior employment. All qualified applicants will be considered strictly by their demonstrated technical knowledge and abilities.
Compensation
Competitive salary will be offered commensurate with experience.