Healthcare Content Evaluator

Role Overview

Participate in an innovative project focused on advancing clinical knowledge by assessing and comparing responses generated by AI models on complex medical cases. Your expert evaluation will play a key role in enhancing how emerging systems approach diagnosis, treatment, and patient care.

Key Responsibilities

• Evaluate paired model-generated answers to identical clinical prompts to identify which better exemplifies superior medical reasoning.
• Review and analyze the reasoning processes of each model, utilizing input documentation provided to make evidence-driven decisions.
• Clearly explain and justify which output excels, considering clinical precision, patient safety, and quality of reasoning.
• Provide detailed written feedback that directly influences improvements to model behaviors by the research team.
• Engage in onboarding and specialized calibration sessions to maintain consistent evaluation standards.

Qualifications and Requirements

• Possesses an advanced medical or biomedical degree (MD, DO, PharmD, PhD) or equivalent professional clinical experience.
• Experience in clinical practice, medical research, or specialized biomedical domain.
• Proficient in applying current clinical guidelines and evidence-based medical practices to intricate scenarios.
• Excellent written communication skills with meticulous attention to detail.
• Capable of working autonomously with flexible scheduling while consistently meeting evaluation criteria.

Compensation and Work Terms

• Payment offered at $150 per hour.
• Fully remote position with an hourly contract and rolling start, with possible contract extensions.