What the work involves

You write prompts in Ukrainian that push a model into territory where it might fail: politically loaded framings, war-related content, medical and legal misinformation, extremism, self-harm, dual-use technical requests. Then you apply a written taxonomy to classify what you and the model produced — was the prompt adversarial, was the refusal correct, was the response subtly wrong in a way an English-speaking reviewer would miss? Much of the value you add is in the justification field: a short, legible written argument in English explaining why a Ukrainian phrasing is coded, euphemistic, regionally specific, or carries a connotation the literal translation loses.

Expect guidelines to change. Taxonomies get revised mid-project, edge cases get reclassified, and you may be asked to relabel earlier batches. Consistency across your own work matters as much as being right on any single item — graders often measure inter-annotator agreement and check whether you label the same case the same way twice.

What the platform screens for

  • Real Ukrainian fluency, not translation ability. Screens typically include a free-response task in Ukrainian and probe for register, dialect awareness, and surzhyk or Russian-influenced phrasing.
  • Written English that carries a technical argument. Your rationales are read by people who don't speak Ukrainian; they must stand on their own.
  • Judgment on dual-use content. Mercor screens for people who can write a realistically dangerous-sounding prompt for testing purposes without actually publishing operational harm, and who know where that line sits.
  • Rule-following under ambiguity. Whether you apply a guideline as written when you disagree with it, and flag the disagreement separately rather than silently deviating.

Logistics

Fully remote and asynchronous, roughly 7 hours per week, with work drawn from a queue rather than scheduled shifts. Start is immediate; projects of this type often run in waves, with volume rising and falling week to week. The $38–42/hr band is as observed on this listing and is not a guarantee — rates on Mercor vary by project, assessed skill tier, and locale. Based in Ukraine or Eastern Europe is a stated preference only; applicants elsewhere are explicitly welcomed.