What the work actually looks like

You receive short clips — often a few seconds — of a robot arm or a person carrying out a task, plus the written directive the clip was meant to fulfil. Your job is to decide whether the action was completed, whether the end state matches what the instruction described, and where exactly the action starts and stops. A large share of tasks are pairwise: two clips, same instruction, which one better satisfies it and why. Another large share is correction work — an AI-generated annotation already exists with a proposed action boundary, a text description, and feedback points, and you fix the timing, tighten the wording, or flag that the description asserts something the frames do not show.

Motion graphics people are recruited for this because the underlying skill is reading movement precisely: noticing that a grasp slipped a frame before contact, that an object was nudged rather than placed, that two attempts were stitched into what looks like one motion. Scrubbing frame by frame, distinguishing occlusion from failure, and describing motion in unambiguous language are the daily tools.

What the screen measures

  • Frame-level perception under follow-up. Expect to be asked how you'd set an action boundary when contact and intent don't coincide, and to defend the choice.
  • Rubric discipline. Whether you can apply a written definition that conflicts with your aesthetic instinct, and prefer the guideline over your taste.
  • Written precision. Annotation text is the deliverable; vague verbs like "moves" or "adjusts" cost quality scores.
  • Calibration and consistency. Whether your judgments would match your own from two hours earlier, and what you do with genuinely ambiguous clips.

Logistics

Fully remote, contractor engagement, asynchronous — tasks are pulled from a queue rather than scheduled. Most contributors commit a stated weekly minimum (commonly 10–20 hours) and are asked to be honest about it, since throughput consistency matters more than volume. A calibration or qualification batch usually precedes paid work, and rate placement within the band tends to track agreement with gold-standard items and the quality of written justifications. You'll need a machine and browser that handle video scrubbing smoothly and a stable connection.