Psychology Quality Assurance Lead - Remote Contract Role

Job Overview

This remote, contractor position seeks a Psychology Quality Assurance Lead responsible for supervising and enhancing quality, consistency, and trainer performance in psychology-focused AI training initiatives. The role involves meticulous review of AI-generated psychology content along with evaluations of trainer and QA team outputs to ensure they align with project protocols.

Key Responsibilities

• Conduct quality spot checks on psychology-related items, identify any quality shortcomings, provide clear written feedback, and escalate significant recurring problems.
• Assess AI-produced psychology explanations, mental-health related content, research summaries, behavioral advice, and theory applications to confirm psychological accuracy and safety compliance.
• Communicate proactively with trainers and QA personnel regarding guideline updates, project adjustments, workflow processes, and specific psychology review standards via platforms such as Discord.
• Address and clarify queries from trainers and QAs on psychological concepts, ethical considerations, rubric interpretations, and mental health safety promptly.
• Monitor and activate contributors who show inactivity, encouraging their re-engagement while tracking follow-ups and noting availability issues.
• Develop and maintain essential project documentation including style guides, FAQs, quality trackers, onboarding guides, calibration tasks, and examples to support consistent quality standards.
• Facilitate onboarding and training sessions for trainers and QAs, detailing workflow expectations, project rubrics, and psychology-related review criteria.
• Ensure alignment and consistency in applying psychology review guidelines across all contributors, adapting as projects evolve.
• Identify and flag any unsafe, diagnostically inappropriate, stigmatizing, or pseudoscientific content that violates ethical or safety norms.
• Propose and implement process improvements to address quality gaps and to elevate QA workflows for scalable, efficient operations within psychology AI training projects.

Candidate Profile

• Possession of a Bachelor's, Master's, PhD, PsyD, or equivalent professional qualification in Psychology or a related discipline such as Clinical Psychology, Counseling, Behavioral Science, Neuroscience, Social Work, Psychiatry-adjacent research, or Education.
• Strong command of English to comprehend guidelines, communicate effectively across teams, and deliver detailed written feedback.
• Minimum of three years' experience in relevant fields including psychology research, clinical or counseling environments, academic writing, mental health content review, psychological assessment, or associated areas.
• Deep understanding of psychological theories, research methodologies, cognitive and social psychology, abnormal psychology, ethics, and mental health safety.
• Skill in evaluating psychology content with adherence to rubrics, identifying issues such as overdiagnosis, unsafe advice, not evidence-based claims, flawed interpretations, pseudoscience, stigmatizing language, or inappropriate therapeutic recommendations.
• Preferred familiarity with cognitive behavioral therapy (CBT), developmental psychology, trauma-informed communication, behavioral interventions, mental health literacy, research design, statistical analysis, and ethical guidelines.
• Proven track record in managing or supporting remote teams of experts, including researchers, clinicians, educators, reviewers, annotators, or QAs.
• Adeptness with fast-paced remote work environments and proficiency with digital tools such as Discord, Google Workspace apps (Sheets, Docs), and project management systems.
• Highly organized and attentive to detail with experience in maintaining documentation like style guides, FAQs, and calibration materials.
• Experience related to AI training, data annotation, large language model evaluation, psychology QA, or mental-health content review considered a significant advantage.

Additional Details

This role is with an expanding AI Data Services provider delivering training data to leading AI organizations worldwide. Although there is currently no immediate project, qualified candidates will be prioritized for forthcoming engagements and gain access to additional projects through the expert network. The selection process includes an AI-based interview, domain-relevant assignments, and recruitment interviews.