English Specialist

Job Overview

We are seeking an English Specialist to generate diverse prompts and evaluate large language models such as ChatGPT and Claude. This role focuses on creating challenging inputs, recording evaluation sessions, and providing detailed verbal and written comparisons to improve AI capabilities.

Key Duties and Responsibilities

• Develop varied prompts spanning multiple topics to rigorously test language models.
• Conduct simultaneous prompt submissions to ChatGPT and Claude while recording screen and microphone outputs.
• Verbally assess and contrast results from both models in real time, identifying strengths, weaknesses, and distinct differences.
• Deliver structured and clear verbal feedback in fluent American English, explaining judgments and preferences.
• Maintain professional, clear communication during recordings.
• Follow documentation to ensure consistent evaluation criteria and precise project outcomes.
• Work alongside project standards to facilitate ongoing enhancement of AI models.

Qualifications and Preferred Attributes

• Excellent spoken and written American English skills with clear pronunciation and the ability to express natural opinions effectively.
• Experience with large language models like ChatGPT, Claude, Gemini, or related systems.
• Understanding of AI evaluation processes.
• Able to record audio and video for extended periods in a quiet environment.
• Strong critical thinking, analytical skills, and keen attention to detail.
• Prior experience in data annotation, AI training, quality assurance, content evaluation, or research is beneficial.
• Possess a reliable computer setup, stable internet, and capability to produce high-quality audio/video recordings without interruptions.