- Experience
- Any
- Salary
- USD 15 – USD 20 / hour
- Openings
- 1
- Posted
- 1 week ago
- Work mode
- Work from home
- Education
- Bachelor's degree
- Eligibility
- Open to candidates who meet the qualification requirements, including a bachelor’s degree, native Urdu proficiency, strong English writing ability, and experience with LLMs. This is a remote part-time contract role.
- Resume
- Required to apply
Job description
About the Role
This contract opportunity is for a remote generalist role focused on evaluating AI model outputs in English and Urdu. The company works with leading AI research teams and is backed by well-known investors in the technology and venture capital space.
What You’ll Do
- Check information against reliable public references and other external tools.
- Produce high-quality evaluation data by spotting strong points, weaknesses, and factual errors in responses.
- Review how well responses reason, how clearly they are written, whether the tone is appropriate, and how complete they are.
- Confirm that outputs follow the expected conversational style and system instructions.
- Work independently on an asynchronous schedule and deliver within deadlines while helping improve model quality.
Qualifications
Applicants should have a bachelor’s degree, be a native Urdu speaker, and have substantial hands-on experience with large language models. Strong English writing ability, careful attention to detail, and experience in areas that require structured analytical thinking are also important.
Preferred Experience
- Prior exposure to RLHF, model evaluation, or data annotation tasks.
- Experience creating or editing polished written content.
- Comfort with comparing several outputs and making nuanced quality judgments.
Compensation
This role pays between $15 and $20 per hour.
Application Process
The application is expected to take about 20 to 30 minutes. Candidates need to upload a resume, complete an AI-based interview using their resume, and then submit the form.
Support
If you need help with the process or platform-related questions, support is available through the company’s help contact. Additional interview and platform details are provided in the company’s documentation.
Additional Information
The team reviews applications every day, so applicants should finish all steps of the application process to be considered. The role is remote and designed for part-time work.