AI Model Evaluator

Role Overview

We are seeking an AI Model Evaluator to contractually assess and critique AI-generated outputs ensuring their accuracy and reliability. This remote position offers a flexible workload ranging from 10 to 40 hours per week with compensation between $22 and $70 per hour.

Key Responsibilities

• Assess AI-produced content across multiple fields for correctness and performance quality.
• Provide comprehensive and constructive feedback aimed at enhancing AI model capabilities.
• Interpret extensive datasets and evaluate outputs for clarity, factual accuracy, and goal conformity.
• Detect patterns and subtle irregularities in AI outputs through advanced reading comprehension and detailed attention.
• Effectively communicate insights and observations to team members both verbally and in writing.
• Simulate practical scenarios to test and report on the AI model's effectiveness and usability from a user perspective.

Candidate Requirements

• Native or near-native English speaker with proficiency at C1 or C2 level.
• Exceptional reading comprehension and analytical thinking skills.
• Strong attention to detail with the ability to perceive nuanced differences.
• Capable of delivering clear, actionable, and subject-matter-informed feedback.
• Excellent organizational skills and the ability to manage time efficiently in a remote setting.

Additional Information

• This is a contract role offering remote work.
• Compensation varies between $22 and $70 per hour, depending on expertise and performance.
• Commitment required is flexible, from 10 up to 40 hours weekly.

Application Process

• Submission of applications through an online portal.
• Follow-up via email regarding the subsequent steps.
• Participation in resume screening and an interview stage is required.