Legal Quality Assurance Lead

Role overview

This remote contractor position is for a Legal Quality Assurance Lead responsible for maintaining quality and consistency across legal AI training initiatives. You will review AI-produced legal content and the work of trainers and QAs, compare outputs against project rubrics, and give clear written feedback to uphold high standards.

The role centers on evaluating legal reasoning, spotting issues, checking jurisdictional fit, verifying citation and source handling, reviewing clarity and formatting, and ensuring instructions are followed closely. You will also help identify repeated quality problems, share updates with trainers and QAs, assist with onboarding, keep documentation current, and re-engage contributors who are inactive.

This opportunity sits within a fast-scaling AI data services business that supports some of the largest AI companies and foundation-model labs. Your work will help improve legal training data so that model outputs are accurate, careful, well-reasoned, and aligned with client expectations.

There is no active project immediately available for this role. However, candidates who are a strong fit may be contacted first when relevant work becomes available, and may also gain access to future projects through the expert network.

Job details

Location: Remote

Engagement: Hourly contractor position

Type: Contract

Key responsibilities

• Review legal items on a spot-check basis, surface quality problems, provide feedback through direct messages, and escalate repeated or serious concerns.
• Assess AI-generated legal explanations, research answers, contract analyses, policy interpretations, case summaries, compliance guidance, and issue-spotting tasks for accuracy, caution, and readability.
• Keep trainers and QAs informed about updated guidelines, workflow changes, quality standards, and project-specific legal review expectations.
• Answer questions from trainers and QAs promptly and clearly, especially on legal reasoning, jurisdiction, citations, source quality, disclaimers, contract language, compliance interpretation, and rubric use.
• Reach out to inactive or unresponsive contributors, encourage reactivation, follow up on availability, and flag participation issues where needed.
• Build and maintain project materials such as style guides, trackers, FAQs, quality notes, examples, honeypots, calibration tasks, and onboarding resources.
• Run onboarding and training sessions for trainers and QAs so they understand the workflow, expectations, rubrics, and legal review standards.
• Keep review practices aligned so all trainers and QAs apply the legal quality framework consistently as project requirements change.
• Identify unsafe, misleading, overly certain, or jurisdictionally unsuitable legal outputs, especially where content could be seen as personalized legal advice.
• Suggest process improvements and help create scalable QA systems for legal AI training work.

Candidate profile

• A bachelor’s degree, JD, LLB, LLM, or a similar qualification in Law, Legal Studies, Paralegal Studies, Compliance, Public Policy, or a related discipline.
• Strong English communication skills for understanding instructions, coordinating with teams, and delivering precise legal feedback in writing.
• At least 3 years of professional experience in legal practice, legal research, contract review, compliance, regulatory analysis, paralegal work, legal operations, legal writing, legal education, or a comparable field.
• Solid command of legal concepts including reasoning, issue spotting, contract interpretation, legal research, statutory interpretation, case analysis, compliance, risk assessment, and legal writing conventions.
• Ability to judge legal content against detailed rubrics and catch problems such as unsupported conclusions, fabricated citations, jurisdiction mismatches, overly confident advice, missing caveats, incorrect standards, weak reasoning, or unclear explanations.
• Working knowledge of common legal workflows and tools such as contract review, legal memoranda, case summaries, regulatory guidance, citation checking, legal databases, document review, compliance checklists, or policy analysis is an advantage.
• Prior experience guiding or supporting remote teams of trainers, annotators, reviewers, lawyers, paralegals, legal writers, researchers, or QAs is highly desirable.
• Comfort using remote collaboration tools and systems such as Discord, Google Sheets, Google Docs, trackers, dashboards, and project management platforms.
• Strong organization and attention to detail, with the ability to maintain style guides, FAQs, trackers, onboarding documents, honeypots, calibration tasks, and related quality materials.
• Experience in AI training, data annotation, large language models, prompt and response evaluation, legal content QA, or rubric-based LLM assessment is a strong plus.

Additional information

This is an hourly remote contractor role in which legal quality leadership directly supports the development of AI models by improving the accuracy, reasoning quality, clarity, caution, and documentation of legal training data.

The role is focused on future project readiness rather than an immediate assignment, so selected candidates may be contacted when suitable work arises.

Terms and conditions

There is no immediate project available at present. Qualification for the role may place you among the first experts contacted for upcoming opportunities and may provide access to future projects through the expert network.