Psychology Quality Assurance Lead

Overview

This role involves leading quality assurance efforts focused on psychology-related AI training projects, operating fully remotely under a contract basis. You will oversee the quality, consistency, and performance of trainers and quality assurance contributors delivering psychology content generated by AI. Your responsibilities include evaluating outputs against project criteria, delivering detailed written feedback, and ensuring compliance with standards related to psychological accuracy, ethical considerations, mental health safety, and clear formatting.

Key Responsibilities

• Conduct random quality checks on psychology-related items and identify recurring or significant issues.
• Assess AI-generated psychology explanations and related content against project rubrics for accuracy, appropriateness, and ethical compliance.
• Communicate updates and guidelines to trainers and QA personnel on collaboration platforms.
• Address queries from trainers and QA staff regarding psychological concepts, evidence assessment, ethical standards, and rubric interpretations.
• Encourage and manage activation of contributors showing inactivity, track follow-ups, and report availability concerns.
• Develop and maintain documentation including style guides, FAQs, calibration exercises, onboarding resources, and quality reports.
• Conduct onboarding and training sessions for new trainers and QA members on project workflows and expectations.
• Promote uniform application of psychology-specific review criteria and quality standards across teams.
• Identify and flag content with ethical or safety risks such as stigmatizing language or inappropriate diagnostic advice.
• Recommend process enhancements to address quality deficiencies and scale QA efforts effectively.

Candidate Profile

• Educational background at bachelor’s level or higher in psychology, clinical psychology, counseling, neuroscience, social work, behavioral science, psychiatry-related research, education, or closely aligned disciplines.
• Proficient English communication skills, both written and verbal, capable of interpreting guidelines and providing concise feedback.
• A minimum of three years of relevant experience in psychology-related research, clinical practice, academic writing, behavioral sciences, or mental health content evaluation.
• Deep understanding of psychological theories, research methodologies, developmental and abnormal psychology, ethics, and evidence-based practices concerning mental health safety.
• Ability to critically judge psychology content quality with attention to common issues like overdiagnosis, unsupported claims, flawed interpretations, and pseudoscientific elements.
• Familiarity with cognitive behavioral therapy, trauma-informed communication, personality theories, behavioral strategies, research designs, statistics, and ethical guidelines is preferred.
• Experience managing or supporting remote teams involved in psychology research, education, clinical work, or quality assurance is highly valued.
• Comfort working in dynamic remote environments using tools like Discord, Google Sheets and Docs, and project management platforms.
• Strong organizational skills supporting maintenance of documentation, quality tracking, onboarding programs, and calibration tasks.
• Experience with AI training projects, data annotation, large language model evaluation, or psychology-related QA is advantageous.

Selection Process and Additional Information

The recruitment process includes an AI-based interview, a domain-specific practical task, and a standard interview with recruiting personnel. It is important to note that there is no immediate project available. However, qualified candidates will be prioritized for upcoming opportunities and gain access to future projects within the expert network.