YO IT Consulting

Political Science Quality Assurance Lead

YO IT Consulting

Remote · Contract

Be the first to apply

Experience
3+ yrs
Salary
Openings
1
Posted
4 weeks ago
Work mode
Work from home
Education
Bachelor’s degree
Eligibility
Candidates with a degree in a relevant social science field and at least 3 years of related experience can apply. The role is best suited to professionals with strong English, solid political science expertise, and experience in research, policy, review, or remote QA work.
Resume
Required to apply

Job description

Role Overview

This remote contractor position is focused on quality leadership for political science AI training work. You will oversee the consistency, accuracy, and performance of trainers and QA contributors across projects, making sure outputs meet the required standards before they move forward.

The work centers on reviewing AI-produced political science content and reviewer output, checking it against project rubrics, and giving clear written feedback. You will be responsible for spotting patterns of error, guiding contributors on expectations, supporting onboarding, keeping documentation current, and helping reactivate team members who are not consistently engaged.

The broader company is an AI data services provider that supports major AI companies and foundation model labs. Your contribution will help improve political science training data so that it is accurate, balanced, well-supported, and aligned with client needs.

What You Will Be Checking

  • Conceptual accuracy and correctness of political science content.
  • Institutional knowledge and descriptions of political systems or bodies.
  • Comparative context, political theory, policy reasoning, and source awareness.
  • Sensitivity to bias, neutrality, clarity, formatting, and instruction adherence.
  • Compliance with project-specific scoring rules and review rubrics.

Core Duties

  • Review samples of political science work, identify defects, and send detailed corrective feedback.
  • Monitor quality trends and escalate repeated or serious problems when needed.
  • Answer trainer and QA questions about institutions, comparative politics, public policy, international relations, bias, and rubric interpretation.
  • Share updates about guideline changes, workflow shifts, and quality expectations through remote communication channels.
  • Follow up with inactive contributors, encourage participation, and report availability concerns.
  • Create and maintain trackers, FAQs, style guides, examples, calibration tasks, honeypots, and onboarding documentation.
  • Plan and deliver onboarding or training sessions to explain workflows, standards, and political-science-specific review practices.
  • Keep review standards aligned across the team as project needs evolve.
  • Identify recurring gaps in output and recommend process improvements that make QA work more scalable.
  • Flag unsupported, misleading, outdated, ideologically one-sided, inflammatory, or poorly framed claims.

Candidate Profile

This role suits someone with substantial academic or applied experience in political science or a closely related field, along with strong written English and a disciplined eye for detail. You should be comfortable working independently in a remote setting and managing review workflows with structure and consistency.

The selection process includes an AI interview, a subject-specific task, and a conversation with a recruiter. There is no immediate project assigned for this position; however, qualified candidates may be contacted first when suitable opportunities become available and may also gain access to future work through the expert network.

Additional Information

This is an hourly remote contractor engagement. The role is not an immediate placement, and future project access depends on relevant openings arising later.

The process for selection includes multiple stages, beginning with an AI interview and followed by a domain task and recruiter interview.

Terms and Conditions

Applicants should note that this role is tied to future project availability rather than an active project at the moment. Engagement will depend on qualification, project demand, and matching opportunities within the expert network.

Eligibility

Applicants should have a degree in Political Science, International Relations, Public Policy, Government, Political Theory, Security Studies, Law, Sociology, Economics, or another closely related social science discipline. A minimum of 3 years’ experience in political science research, teaching, policy analysis, public affairs, international relations, political writing, academic review, or similar analytical work is expected.

Strong English communication skills are required, along with familiarity in political institutions, comparative politics, public policy, political theory, governance, electoral systems, state capacity, civil society, political behavior, and related subjects. Experience with remote team leadership, AI training, data annotation, LLM evaluation, policy QA, academic review, fact-checking, or rubric-based review is a strong advantage.

Tools and Working Style

You should be comfortable using remote collaboration and tracking tools such as Discord, Google Sheets, Google Docs, dashboards, trackers, and project management systems. Success in this role depends on organized communication, careful documentation, and the ability to maintain consistent standards across distributed contributors.

Leave it if you'd like a reply — we won't use it for anything else.

Click to browse, drag & drop, or paste a screenshot

PNG, JPG, GIF, MP4, WebM, MOV · Max 20MB each · Up to 5 files

🤖
Online · instant AI help