Job description

About the Role

Mercor is a bridge connecting top creative and technical talents with leading AI research institutions. Our headquarters is located in San Francisco, supported by renowned investors. We are seeking a Language Model Analyst fluent in English and Tamil for a contract position.

Role Responsibilities

Verify factual accuracy of content utilizing reliable public resources and external verification tools.
Create precise human evaluation datasets by identifying the strengths, weaknesses, and factual errors in model responses.
Evaluate the logical coherence, clarity, tone, and completeness of generated replies.
Ensure that the AI model's responses adhere to expected conversational norms and internal system protocols.

Qualifications

Bachelor's degree required.
Native Tamil language proficiency essential.
Extensive experience working with large language models.
Exceptional English writing capabilities.
Meticulous attention to detail.
Experience in areas demanding structured analytical skills, such as research, policy work, analytics, linguistics, or engineering.

Preferred Expertise

Exposure to Reinforcement Learning with Human Feedback (RLHF), model assessment, or data annotation tasks.
Background in composing or editing superior written materials.
Skilled at comparing different outputs and providing detailed qualitative evaluations.

Application Process

Submit resume.
Complete an AI-driven interview based on your resume.
Fill out the submission form.

Additional Information

The AI interview and application procedure takes approximately 20 to 30 minutes.
Detailed interview and platform guidelines are available through Mercor's documentation (contact support for access).
For support, applicants can reach out via email.
Our recruiting team reviews applications every day; completing the AI interview and application fully is essential for consideration.

Language Model Analyst (English & Tamil) - Part-time Remote Role