Quality Assurance Specialist

Role overview

This remote contract role supports the evaluation of a personalization-focused AI feature for a client project. The work centers on checking how well an advanced AI system uses signals from prior user activity, such as conversations, emails, search behavior, and video content, to produce responses that feel more relevant and useful. The position also requires strong Japanese language ability so localized outputs can be reviewed accurately.

What you will do

• Create and improve prompts from a personal-user point of view to test personalization behavior.
• Review AI-generated answers against set criteria, including grounding, use of user context, and usefulness.
• Inspect model results to spot trends, inconsistencies, and opportunities to strengthen personalization logic.
• Work with AI researchers and engineers by sharing clear, data-backed feedback on model output quality and relevance.
• Record evaluation results in a structured way so they can be used to refine the personalization system further.

What we are looking for

• Native-level or near-native Japanese fluency, both written and spoken, along with an understanding of cultural nuance relevant to localized personalization.
• Background in QA, data analysis, or AI evaluation, especially with language models or conversational AI.
• Ability to judge response quality using structured review standards such as relevance, coherence, and contextual grounding.
• Comfort with AI systems that combine multiple data types, including text, email, search, and video, and with the way user context is assembled.
• Excellent analytical ability and a sharp eye for detail, with the skill to turn findings into practical feedback.
• Experience in remote collaboration, including asynchronous communication and organized documentation habits.

Additional information

This role is meant for a full-time engagement on a remote, work-from-anywhere basis. Compensation is described as competitive. The opportunity offers exposure to advanced AI training workflows, high-quality data systems, and a team of specialists in AI research and engineering. It is intended to help improve a cutting-edge AI platform used by global enterprises and to shape the future of personalization technology.

Equal opportunity

Selection is based on skills and expertise. Candidates from all backgrounds are encouraged to apply, and all applications are assessed only on demonstrated capability and qualifications.