- Experience
- Any
- Salary
- USD 15 – USD 20 / hour
- Openings
- 1
- Posted
- 5 days ago
- Work mode
- Work from home
- Education
- Bachelor's degree
- Eligibility
- Candidates who are native Marathi speakers, have a bachelor's degree, strong English writing skills, significant experience with large language models, and a background suited to analytical evaluation work can apply.
- Resume
- Required to apply
Job description
About the Role
This remote contract role is focused on evaluating and improving AI model outputs for a team that works with leading AI research labs. The position is for a generalist fluent in English and Marathi and offers compensation of $15–$20 per hour.
Key Responsibilities
- Verify information against reliable public references and supporting tools.
- Create high-quality human evaluation examples by spotting what a response does well, where it falls short, and where it contains factual errors.
- Judge the quality of reasoning, the clarity of the writing, the tone, and whether the response is complete.
- Check that model outputs follow the expected conversational style and system instructions.
- Work on your own schedule, independently and asynchronously, while meeting deadlines and helping improve model performance.
Qualifications
- A bachelor's degree is required.
- You must be a native Marathi speaker.
- Applicants should have substantial hands-on experience using large language models.
- Strong English writing ability is essential.
- Meticulous attention to detail is needed.
- A background in work that requires structured analytical thinking is preferred.
Preferred Experience
- Experience in RLHF, model evaluation, or annotation work is a plus.
- Prior work writing or editing polished content is preferred.
- Ability to compare multiple outputs and make nuanced quality judgments is valuable.
Application Process
The application is expected to take about 20–30 minutes and includes three steps: uploading a resume, completing an AI interview based on the resume, and submitting the form.
Support Information
If you need assistance, help is available through the provided support contact. Additional details about the interview process and platform can be found in the employer's candidate documentation.
Additional Information
The hiring team reviews applications on a daily basis. To be considered, candidates should finish both the AI interview and the application steps.