Quality Analyst - AI Personalization (Remote)

Role Overview

We are seeking an experienced Quality Analyst to evaluate and enhance an AI model's personalization features. This full-time remote position involves assessing how effectively the AI integrates information from prior conversations, emails, search activities, and other personal data to generate relevant and accurate responses. The role requires creativity in prompt design combined with a rigorous analytical approach to evaluating AI outputs.

Primary Responsibilities

• Analyze personalized AI responses by reflecting on your own personal experiences as the contextual backdrop.
• Create complex, multi-turn prompts to effectively test the model's capability in accurately integrating varied personal data sources.
• Critically examine AI-generated content for accuracy, relevance, grounding, and usefulness, identifying inappropriate personalization or forced connections.
• Perform comparative reviews of AI responses presented side-by-side to detect nuanced differences in quality and precision.
• Deliver comprehensive feedback regarding the AI's behavior to assist in improving personalization accuracy.

Required Skills and Qualifications

• Strong proficiency in English, both in reading and writing.
• Experience in prompt engineering or designing test cases for AI systems.
• Analytical skills to interpret subtle and ambiguous AI responses effectively.
• Understanding of AI personalization concepts and evaluation metrics.
• Meticulous attention to detail to spot minor inconsistencies in AI outputs.
• Comfort with using your personal primary Google account and authorizing access to personal data sources for analysis purposes.
• Availability to work full-time within your local timezone supporting a 24-hour global operational schedule.

Additional Information

This position presents a valuable opportunity to contribute to leading-edge technological advancements within a recognized global technology and internet industry leader. The company embraces diversity and promotes equal opportunity, evaluating candidates solely on skills and qualifications without bias.