职位描述

Role Summary

We are recruiting on behalf of a client for a full-time AI Quality Analyst specializing in English language evaluation. This remote position involves assessing a new AI personalization feature by analyzing how effectively it consolidates past conversations, emails, search history, and activities to generate relevant responses. The job demands a mix of innovative prompt creation and detailed review of AI-generated content.

Key Responsibilities

Assess the quality of personalized AI responses using your personal experience as a reference.
Create inventive, multi-turn prompts designed to evaluate the model's accuracy in integrating personal data sources.
Analyze model outputs for accuracy, contextual grounding, and helpfulness; identify any flawed personalization or artificial associations.
Compare side-by-side AI response variants to discern subtle differences in relevance and precision.
Deliver comprehensive feedback aimed at enhancing the AI model's personalization performance.

Required Qualifications & Skills

Fluency in English with excellent reading and writing skills.
Experience in prompt engineering or test case design for AI systems.
Strong analytical skills to interpret nuanced and ambiguous AI replies.
Understanding of AI personalization concepts and evaluation metrics.
Keen attention to detail for spotting minor inconsistencies in output.
Willingness to link your primary Google account and activate personal data for evaluation purposes.
Availability for full-time work within your local time zone supporting a 24/7 global operations team.

Additional Information

This role provides the chance to engage with a global technology leader in the Information and Internet sector, contributing to the advancement of sophisticated AI systems with significant business impact.

Equal Opportunity Statement

Hiring decisions are made strictly on skills and qualifications, welcoming applicants from any background, experience, or previous employment history.

Quality Analyst (Remote)