What the work actually is

Each item lands as a complete package: a realistic task written the way it would come across your counter or your desk, an AI agent's full attempt at it, the files the agent produced, and a scoresheet an AI grader already filled in. Your job is four judgments. Whether the task is one that genuinely arises in this job, described the way a real requester would describe it. Whether the domain content holds — the DUR logic, the state board rule, the chain-of-custody note, the shrink math, the reorder point — or whether something is subtly wrong in a way only someone who does this daily would catch. Whether the grader's eleven yes/no answers survive contact with the files. And whether the reported score matches the band you'd assign yourself: usable by a practitioner, acceptable, or not.

Budget about an hour per item. Most of that hour is spent with the files open, checking figures against each other, not reading in the abstract. Every judgment carries a short written reason, so the writing is constant even though it's brief.

What the screen is looking for

  • A real practice history in one of four lanes. Pharmacists with an active US license and 4+ years of community or retail dispensing and counseling. Private investigators licensed where the state requires it, with 4+ years running their own casework and writing their own reports. General and operations managers with 5+ years owning a store or multi-site P&L including staffing and inventory. First-line retail supervisors with 4+ years over a sales floor, its schedule and its shrink.
  • Error-catching instinct. The listing is explicit: people who have caught someone else's mistake before it reached a customer. A DUR intervention, a surveillance report that wouldn't survive a deposition, an inventory count that didn't reconcile.
  • Weaker fits are named. Corporate category or merchandising roles that never ran a location, and PIs whose practice is entirely public-records lookup.
  • Near-native business English and numeric comfort. You write a reason for every judgment, and you need to be able to open a spreadsheet or PDF and tell whether the numbers reconcile.

Logistics

Fully remote and asynchronous; you pick up items when you have the hour. Observed pay for this band is $55–65/hr — stated as observed on the platform, not guaranteed to any individual. The entry point is a recorded interview of roughly fifteen minutes about your own area of practice. Once you're onboarded, the first task is a short intake profile you complete yourself, unaided — treat it as part of the evaluation rather than paperwork.