Language Model Analyst - Generalist (English & Tamil)

About the Role

This opportunity is with Mercor, a company that links high-caliber creative and technical professionals with major AI research teams. The organization is based in San Francisco and is backed by Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.

The opening is for a generalist role working with English and Tamil. It is a remote contract position offering $15–$20 per hour.

What You’ll Do

• Verify facts by using reliable public references and outside tools.
• Create strong human evaluation data by spotting strengths, weaknesses, and factual errors in responses.
• Review the quality of reasoning, the clarity of expression, the tone, and how complete each answer is.
• Check that model outputs follow the intended conversational style and system instructions.

What We’re Looking For

• A bachelor’s degree.
• Native-level Tamil fluency.
• Substantial hands-on experience with large language models.
• Strong English writing ability.
• Excellent attention to detail.
• Experience or a background in fields that require structured analytical thinking, such as research, public policy, analytics, linguistics, or engineering.
• Experience in RLHF, model assessment, or data annotation is a plus.
• Ability to write or edit high-quality content is preferred.
• Comfort comparing multiple outputs and making nuanced qualitative judgments.

Application Steps

The application can be completed in about 20–30 minutes and includes three steps: submitting a resume, completing an AI interview based on that resume, and sending in the form.

Support

For interview and platform details, refer to the company’s documentation. For assistance, contact support via email.

Additional Information

The hiring team reviews applications every day. To be considered, the AI interview and all application steps should be completed.