- Experience
- Any
- Salary
- USD 15 – USD 20 / hour
- Openings
- 1
- Posted
- 2 weeks ago
- Work mode
- Work from home
- Education
- Bachelor's degree
- Eligibility
- Native Odia speakers with a bachelor’s degree, strong English writing skills, and meaningful experience using large language models can apply. Experience in RLHF, model evaluation, annotation, or editorial work is welcome.
- Resume
- Required to apply
Job description
About the Role
This opportunity is for a generalist language model analyst working remotely. The position focuses on reviewing AI outputs, performing fact-checks, and producing high-quality evaluation data for model improvement.
About the Company
Mercor connects top creative and technical professionals with leading AI research labs. The company is based in San Francisco and is backed by Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.
Role Details
- Position: Generalist - English & Odia
- Employment type: Contract
- Work mode: Remote
- Pay rate: $15–$20 per hour
Key Responsibilities
- Verify information against reliable public sources and external tools.
- Produce strong human evaluation data by spotting strengths, weaknesses, and factual mistakes in responses.
- Judge the quality of reasoning, the clarity of communication, the tone, and how complete the answer is.
- Check that model outputs follow the expected conversational style and system instructions.
Required Qualifications
- A bachelor’s degree is required.
- You must be a native Odia speaker.
- Applicants should have substantial hands-on experience using large language models.
- Strong English writing ability is essential.
- A high level of attention to detail is needed.
- Experience in work that requires structured and analytical thinking is important.
Preferred Background
- Previous exposure to RLHF, model evaluation, or data annotation is an advantage.
- Experience creating or editing polished written content is helpful.
- Ability to compare multiple outputs and make nuanced quality judgments is desirable.
Application Process
The application takes about 20 to 30 minutes and includes uploading a resume, completing an AI interview based on your resume, and submitting the form.
Support and Resources
For interview-process details and platform guidance, candidates can refer to the company’s help documentation. For support, contact the listed support email address.
Additional Notes
The team reviews applications every day. Candidates should complete both the AI interview and the full application steps to be considered for this opportunity.