Mercor

Language Model Evaluator - English & Bengali

Mercor

Remote · Contract

Be the first to apply

Experience
Any
Salary
USD 15 – USD 20 / hour
Openings
1
Posted
3 weeks ago
Work mode
Work from home
Education
Bachelor's degree
Eligibility
Native Bengali speakers with a bachelor’s degree, strong English writing skills, significant LLM experience, and a background in analytical work such as research, policy, analytics, linguistics, or engineering can apply.
Resume
Required to apply

Job description

About the Role

This contract opportunity is with a company that connects top-tier creative and technical professionals with leading AI research organizations. The work is fully remote and focused on evaluating and improving language model outputs.

Position Details

Role: Generalist - English & Bengali
Type: Contract
Location: Remote
Compensation: $15–$20 per hour

What You Will Do

  • Check facts using reliable public sources and outside tools.
  • Produce high-quality human evaluation data by spotting strengths in responses, identifying weaknesses, and flagging factual mistakes.
  • Review response quality across reasoning, clarity, tone, and completeness.
  • Verify that outputs follow the expected conversational style and system instructions.
  • Work on your own schedule, independently and asynchronously, while helping improve model performance.

Required Qualifications

  • A bachelor’s degree is required.
  • You must be a native Bengali speaker.
  • Substantial hands-on experience with large language models is needed.
  • Strong English writing ability is essential.
  • You should have excellent attention to detail.
  • Applicants should have a background in a field that depends on structured analytical thinking, such as research, policy, analytics, linguistics, or engineering.

Preferred Experience

  • Previous work in RLHF, model evaluation, or data annotation is an advantage.
  • Experience producing or editing polished written content is valuable.
  • Comfort comparing multiple answers and making nuanced qualitative judgments is preferred.

Application Process

  • Submit your resume.
  • Complete an AI interview based on your resume.
  • Fill out and submit the application form.

Resources and Support

  • Interview process details and platform information are available in the company’s documentation.
  • For help or support, contact the support team by email.

Additional Information

The hiring team reviews applications every day. Candidates should finish both the AI interview and the rest of the application steps to be considered.

Leave it if you'd like a reply — we won't use it for anything else.

Click to browse, drag & drop, or paste a screenshot

PNG, JPG, GIF, MP4, WebM, MOV · Max 20MB each · Up to 5 files

🤖
Online · instant AI help