LLM Business Analyst / Data Annotator / Data Analyst

Role Overview

This short-term remote contract is for a detail-focused business analyst role supporting evaluation and annotation work. The position centers on quality review, accuracy checks, and structured reasoning across model outputs and data.

Key Work

• Compare two outputs side by side and judge them on quality, accuracy, and relevance.
• Verify facts to spot errors, mismatches, or unsupported claims.
• Write clear, well-organized explanations for each evaluation decision.
• Work within defined evaluation rules and quality benchmarks.

Tools and Daily Tasks

• Use browser-based applications and extensions to assist with review and analysis.
• Carry out basic command-line actions when needed for the workflow.
• Record observations clearly and share insights with stakeholders when required.
• Repeat review cycles with a focus on data quality, output assessment, and structured judgment.

Who This Role Suits

• People who have previously handled evaluation, annotation, QA, or audit-related tasks.
• Those with experience reviewing data quality, content, or model outputs.
• Candidates with a background in business analysis, operations, or process improvement are preferred.
• Applicants should be comfortable using a computer in a professional environment, along with browser extensions and online tools.
• Basic command-line usage is expected; advanced coding is not required.
• This is a full-time commitment of 8 hours per day and 40 hours per week, with at least 4 to 5 hours overlapping PST.

Additional Information

This is a remote short-term contract lasting 2 months. The role begins immediately.

Application Process

• Submit the application.
• Review the assessment instructions before taking the assessment.
• Complete the assessment.
• Confirm the assessment once finished.