What the work involves

Generalist evaluation projects cover the territory that doesn't fit a specialist queue: household finance, travel planning, consumer contracts, insurance paperwork, event logistics, retail and warranty disputes, personal admin. On a typical task you'll be given a document — a lease, a benefits summary, a spreadsheet, a slide deck, a policy letter — along with a model-generated summary, answer, or edit of it. Your job is to judge whether the output is accurate against the source, whether it's actually useful to the person who'd be reading it, and then to write the rationale in a form a reviewer can audit. Some projects ask you to produce the reference answer yourself before the model sees the prompt.

The writing matters more than the score. "Incorrect" is worth little; "the model reports the deductible as $1,500, but page 3 lists $1,500 in-network and $3,000 out-of-network, and the user's question was about an out-of-network visit" is the artifact the project is buying.

What the screen looks for

  • A nameable domain. "Generalist" describes breadth of assignment, not vagueness of background. Screens go badly when a candidate can't point to two or three areas where they've done real professional work.
  • Source discipline. Whether you check claims against the document rather than against what sounds plausible.
  • Tooling that's genuinely fluent. Excel, Word and PowerPoint appear in the task material constantly — reading a formula, spotting a broken table, judging whether a deck's structure holds.
  • Guideline adherence. Rubrics on these projects are long and occasionally counterintuitive. Reviewers watch for people who substitute their own standard.

Logistics

Fully remote and asynchronous, with eligibility limited to the US, Europe, UK or Canada. Most contributors work in blocks of a few hours against a weekly target rather than fixed shifts. Volume is project-driven and uneven — a queue can run for six weeks and then pause. Rates observed on this listing span $80–160/hr and vary by project and domain; nothing here is guaranteed.