Language Model Analyst - English & Marathi | Part-time Remote Role

About the Role

Mercor is an organization that bridges top creative and technical professionals with cutting-edge AI research laboratories. Operating from San Francisco, our supporters include prominent investors such as Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.

We are seeking a Generalist fluent in English and Marathi to join us on a contract basis. This fully remote position offers a competitive pay rate between fifteen to twenty dollars per hour.

Key Responsibilities

• Perform fact verification utilizing reputable public sources and external verification tools.
• Create insightful human evaluation data by pinpointing the strengths, improvement needs, and factually incorrect responses.
• Evaluate responses for reasoning quality, clarity, tone appropriateness, and completeness.
• Ensure AI model outputs adhere to conversational norms and system guidelines.
• Operate independently and asynchronously to meet deadlines while contributing to enhanced AI model performance.

Qualifications

• Possession of a bachelor's degree.
• Native proficiency in Marathi language.
• Substantial usage experience with large language models (LLMs).
• Advanced English writing ability.
• Keen attention to detail.
• A background or familiarity with fields requiring structured and analytical thinking.

• Experience that is beneficial includes involvement with Reinforcement Learning from Human Feedback (RLHF), prior exposure to model evaluation or data annotation projects.
• Skills in crafting or editing high-quality written content.
• Experience comparing multiple outputs and making nuanced qualitative assessments.

Application Process

• Submit a resume document.
• Complete an AI-driven interview based on submitted resume.
• Fill and submit the application form.

Support and Additional Info

• For detailed information regarding the interview process and platform use, please refer to Mercor's official resources.
• For assistance, candidates may contact support at support@mercor.com.
• The recruitment team evaluates applications daily, so applicants are encouraged to finalize all application steps promptly for consideration.