Instructional Designer - AI Rater Guidelines Writer (Remote, Part-time)

About the Role

Mercor bridges top-tier creative and technical specialists with prominent AI research institutions. Based in San Francisco, our investors comprise Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.

We are seeking an AI Rater Guidelines Writer with expertise in linguistics or instructional design to join us on a contract basis. This fully remote position offers competitive pay between $45 and $65 per hour.

Key Responsibilities

• Collaborate with research and program teams to clarify vague program requirements and develop actionable, clear instructions tailored for human raters across diverse domains.
• Create comprehensive, unambiguous rating guidelines and rubrics to ensure consistent assessments by raters, including handling special or edge cases.
• Critically review draft guidelines for potential contradictions, ambiguities, or gaps in coverage and revise accordingly until raters can apply them independently without further inquiries.
• Interpret program specifications from sectors such as finance, retail, insurance, legal, and sports into precise, domain-specific rater instructions.
• Work closely with subject matter experts and program leaders to maintain consistency and accuracy throughout the set of guidelines.

Required Qualifications

• Minimum of three years' professional background in linguistics, instructional design, technical writing, or similar disciplines.
• Proven experience in crafting or refining guidelines and rubrics for human raters within a Generative AI or Reinforcement Learning Human Feedback environment.
• Capability to handle multiple industry domains and translate complex domain-specific details into clear instructions.
• Demonstrated success in identifying and resolving ambiguities and contradictions in technical documentation.
• Availability to commit reliably to a workload of at least 35 hours weekly during weekdays.
• Excellent written communication skills suited for elaborating complex guidance in understandable terms.

Additional Information

• This is a contract position with flexible remote work arrangements.
• Compensation ranges from $45 to $65 per hour based on experience and expertise.

Application Process

• Submit your resume.
• Complete an AI-driven interview centered on your resume approximately 20–30 minutes in duration.
• Fill out and submit the application form to be considered.

Support and Resources

• Details about the interview process and access to the platform can be found upon engagement.
• For assistance or queries, contact support@mercor.com.

Please note that applications are reviewed on a daily basis. Completion of all interview and application steps is essential to be considered for this opportunity.