Political Science Quality Assurance Lead

Role overview

This is a remote, hourly contractor position for a Political Science Quality Assurance Lead. The role focuses on keeping political science AI training work accurate, consistent, and aligned with project standards while also supporting trainer performance across distributed teams.

You will review AI-produced political science content as well as trainer and QA outputs, measure them against detailed guidelines, and give clear written feedback. The work includes checking for conceptual accuracy, knowledge of institutions, comparative context, political theory correctness, policy reasoning, awareness of sources, sensitivity to bias, clarity, formatting, instruction adherence, and compliance with project rubrics.

In addition to review work, you will surface repeated quality problems, share updates with trainers and QAs, support onboarding, keep documentation current, and help re-engage contributors who are not active. This position is part of a fast-growing AI data services company that provides training data to major AI firms and foundation model labs. Your work will help improve AI systems by making sure political science data is balanced, well-contextualized, analytically sound, and in line with client expectations.

There is no project available immediately for this role. However, qualified candidates may be contacted first when relevant opportunities come up and may also gain access to future work through the expert network.

Selection process

The hiring process includes an AI interview, a subject-specific task, and a conversation with a recruiter.

Responsibilities

• Monitor quality by reviewing samples, identifying problems, sharing feedback through direct messages, and escalating recurring or serious issues.
• Assess political science content for accuracy, balance, and quality across explanations, comparative analyses, policy summaries, theory discussions, institutional descriptions, and reasoning.
• Keep trainers and QAs informed through Discord about guideline changes, workflow updates, quality expectations, and political-science-specific standards.
• Answer team questions promptly and clearly, especially on institutions, comparative politics, public policy, political theory, international relations, bias, and rubric interpretation.
• Follow up with inactive contributors, encourage them to resume work, track status updates, and report availability concerns.
• Build and maintain documentation such as style guides, trackers, FAQs, quality notes, examples, honeypots, calibration tasks, and onboarding resources.
• Plan and lead onboarding or training calls to explain expectations, workflows, rubrics, quality benchmarks, and review requirements for political science projects.
• Make sure trainers and QAs apply the review framework consistently and understand changes as the project evolves.
• Identify misleading, one-sided, unsupported, outdated, inflammatory, or poorly contextualized political claims and flag them appropriately.
• Recommend workflow improvements and help create scalable QA processes for political science AI training programs.

Requirements

• A bachelor’s, master’s, or PhD in Political Science, International Relations, Public Policy, Government, Political Theory, Security Studies, Law, Sociology, Economics, or a closely related social science discipline.
• Excellent English skills for reading project guidance, coordinating with teams, and providing precise written feedback.
• At least 3 years of experience in political science research, teaching, policy analysis, public affairs, international relations, political writing, academic review, or similar analytical work.
• Strong knowledge of political institutions, comparative politics, international relations, public policy, political theory, electoral systems, governance, state capacity, civil society, and political behavior.
• Ability to judge content against detailed rubrics and detect oversimplification, ideological slant, unsupported claims, incorrect institutional descriptions, faulty causal reasoning, or weak comparative analysis.
• Preferred familiarity with democracy and authoritarianism, political economy, public administration, constitutional systems, electoral politics, conflict studies, international organizations, policy evaluation, or survey research.
• Experience leading or supporting remote teams of analysts, researchers, reviewers, educators, annotators, or QAs is strongly preferred.
• Comfort working in fast-paced remote settings with tools such as Discord, Google Sheets, Google Docs, trackers, dashboards, and project management platforms.
• Strong organizational habits and close attention to detail, with the ability to maintain style guides, FAQs, trackers, onboarding material, calibration tasks, and related documentation.
• Experience with AI training, data annotation, LLM evaluation, policy QA, academic review, fact-checking, or rubric-based review is a strong advantage.

Additional information

This role is structured as an hourly remote contractor position. The company notes that there is no immediate project currently available, but suitable candidates may be contacted first for future opportunities and could be added to the broader expert network. The selection steps consist of an AI interview, a domain-specific task, and a recruiter interview.

Work setup

Location: Remote. Country/region listed: Ireland.