Head of Testing (AI)

About Newcode.ai

Newcode.ai is revolutionizing how law firms and legal professionals apply AI to deliver practical, impactful solutions. Joining our energetic and expanding team means collaborating closely with visionary founders to drive AI and legal innovation, influencing both our product and the future landscape of legal work.

As a rapidly growing startup, we are constantly evolving with shifting priorities and developing new processes on the fly. Success here requires adaptability, initiative, and a proactive problem-solving mindset. Those who excel are comfortable with ambiguity, take ownership, and contribute to building a strong company foundation.

Role Overview

We are seeking a Head of Testing to lead the vision, strategy, and execution for assessing the quality of our AI-driven products. This role involves designing comprehensive testing frameworks and standards to measure product functionality, usability, reliability, and performance, with a particular focus on evaluating AI outputs. You'll work closely with Engineering and Legal Engineering teams to establish and grow a world-class testing function that ensures the delivery of dependable, high-quality solutions.

Key Responsibilities

• Develop and implement an all-encompassing testing strategy tailored to AI products at Newcode.
• Formulate testing frameworks and methodologies to evaluate functionality, usability, accuracy, performance, and reliability.
• Design processes to assess AI outputs, including defining quality benchmarks and success criteria.
• Prepare detailed test plans, cases, and documentation supporting product releases.
• Identify risks, gaps, and opportunities for improvement through thorough product testing.
• Collaborate with Engineering to enhance product quality and development workflows.
• Set up repeatable workflows for regression, user acceptance, and release validation tests.
• Analyze testing data to offer actionable insights for product improvements.
• Develop AI evaluation best practices focusing on accuracy, consistency, hallucination risk, and edge cases.
• Contribute to defining quality standards as Newcode expands its offerings and customer base.
• Lead the growth and evolution of the testing function, including team building and process refinement.

Required Qualifications

• A minimum of five years in software testing, quality assurance, or related technical roles.
• Demonstrated experience testing AI-powered products, machine learning systems, or large language model applications.
• Deep understanding of AI evaluation techniques and performance measurement.
• Experience creating testing frameworks and quality processes from inception.
• Ability to clarify complex technical problems into actionable insights.
• Strong analytical skills with meticulous attention to detail.
• Proven ability to work cross-functionally with Engineering, Product, and Customer teams.
• Capacity to thrive in a dynamic startup environment with shifting priorities.
• Familiarity with automation tools and testing frameworks.
• Outstanding written and verbal communication capabilities.
• Experience establishing quality teams or functions in growing organizations.

Preferred Skills

• Background in legal technology, enterprise software, or regulated sectors.
• Experience assessing LLM applications, AI agents, or generative AI workflows.
• Knowledge of the legal domain or experience collaborating with legal professionals.

Benefits and Culture

• Join a culture built on trust, excellence, respect, and accountability where diverse voices fuel creativity and every contribution counts.
• Collaborate with talented, driven colleagues on pioneering legal engineering solutions with practical impact.
• Enjoy significant ownership and growth opportunities, helping to shape your role as the company scales.
• Be part of an inclusive workplace that values initiative, integrity, teamwork, and a broad range of perspectives.

Ready to influence the future of AI-driven legal services? Apply now to join Newcode.ai's mission to build smarter, more efficient AI-powered solutions.