Robotics Evaluation Specialist

Job Overview

Join as a Robotics Evaluation Specialist on a contract basis, working remotely to contribute to training advanced AI systems through high-quality, real-world interaction data. This role is essential in shaping AI model performance by executing and assessing robotics tasks via video.

Primary Responsibilities

• Perform physical tasks on camera following exact and detailed instructions to evaluate robotics systems.
• Analyze the responses of robotic systems to your actions to ensure accurate performance evaluation.
• Provide structured and clear written feedback regarding the accuracy of robotic system evaluations.
• Systematically document observations, including potential edge cases, to support consistent data collection.
• Collaborate asynchronously with the client team to enhance evaluation procedures and share insights.
• Uphold data integrity and confidentiality throughout the evaluation process.
• Support the ongoing refinement of robotics evaluation pipelines based on empirical findings.

Qualifications and Skills

• Demonstrated experience with robotics workflows or related hands-on robotics projects.
• Exceptional attention to subtle differences in task results.
• Excellent written and verbal English communication skills, ideally native or near-native proficiency.
• Ability to follow complex instructions precisely without deviation.
• Versatile mindset comfortable performing diverse, simple physical actions on camera.
• Skilled at documenting and delivering structured feedback reports.
• Access to a reliable internet connection and an environment suitable for remote video task execution.

Preferred Experience

• Background in paused or historical robotics evaluation pipelines.
• Experience in robotics engineering, human-computer interaction, or automation testing.
• Familiarity with providing evaluation feedback or user testing processes.