- 经验
- 任何
- 薪水
- —
- 职位空缺
- 1
- 发布
- 2小时前
- 工作模式
- 在家办公
- 合格
- Applicants with relevant skills and qualifications from any background are encouraged to apply. This opportunity welcomes all qualified candidates regardless of previous work history or experience.
- 恢复
- 需要申请
职位描述
Role Overview
We are seeking a Quality Analyst to evaluate a cutting-edge AI personalization feature. This full-time remote position involves assessing the AI model's ability to incorporate contextual information from past conversations, emails, searches, and activity logs to generate relevant, personalized responses. The role blends innovative prompt design with detailed analysis of AI-generated outputs.
Key Responsibilities
- Assess the relevance and quality of AI-generated personalized responses using your own experiences as contextual data.
- Create multi-turn, inventive prompts aimed at rigorously testing the model's capacity to integrate diverse personal data sources.
- Evaluate the AI responses for accuracy, coherence, and overall helpfulness, detecting any errors in personalization or forced relevance.
- Perform comparative analysis of AI responses side-by-side to identify subtle differences in precision and applicability.
- Offer comprehensive feedback on AI behavior to support improvements in personalization quality and performance.
Required Skills and Qualifications
- Strong command of English with excellent reading and writing skills.
- Experience in prompt engineering or creating test scenarios for AI systems.
- Skilled at critically analyzing complex and ambiguous AI responses with attention to subtle nuances.
- Knowledge of personalization principles and relevant AI evaluation metrics.
- High attention to detail for spotting discrepancies in model outputs.
- Willingness to use your primary personal Google account and activate data sharing features for evaluation purposes.
- Availability for full-time work aligned with your local time zone in a global, 24-hour operational environment.
Additional Information
The role provides an exciting opportunity to work with a leading technology and internet company developing impactful AI technology. The employer values diversity and is an equal opportunity organization committed to hiring based on skill and qualifications alone.