Data Annotator (English) - Remote Contract Role

Overview

This role offers a short-term contract position as an LLM AI Quality Analyst specializing in personalization. The position is fully remote, requiring a commitment of 20 hours per week over the span of one month, with compensation set at $11.5 per hour. The start date is immediate.

Primary Responsibilities

• Craft multi-turn conversational prompts utilizing personal context to test AI models.
• Evaluate AI-generated personalized responses for relevance, factual grounding, and usefulness.
• Analyze and identify correct versus incorrect incorporation of personal data within AI outputs.
• Conduct side-by-side evaluations and rank multiple AI model responses.
• Detect grounding mistakes, poor inference, and situations where personalization is inappropriately forced.
• Document clear, logically structured explanations referencing specific points in conversations.
• Extract and confirm model debug details and the sources of data used.
• Ensure strict data privacy by deleting conversations after evaluations are completed.

Required Qualifications and Skills

• Proficiency in English, both reading and writing.
• Extensive experience in data annotation, AI quality assessment, content moderation, or related analytical tasks.
• Excellent analytical skills and meticulous attention to detail.
• Capability to assess complex, subtle, or ambiguous AI-generated content effectively.
• Comfortable using a personal Google account with enabled data sources.
• Possess a bachelor's degree or equivalent experience in relevant analytical disciplines.
• Strong written communication skills with the ability to provide structured and clear feedback.
• Highly self-driven and capable of working autonomously in a remote environment.
• Access to a reliable desktop or laptop along with a stable internet connection.

Application Process

• Complete the application form.
• Fill in the informed consent form (ICF).
• Undergo an assessment stage.