Applied Health & Medicine Benchmark Specialist

$94–119/hrrate as listed

Write and verify expert-level multiple-choice questions across clinical medicine, imaging, pharmacovigilance, health economics, and allied health for an AI benchmarking effort on Mercor. Each item needs one defensible correct answer, nine subtly wrong distractors, a step-by-step solution, and citations to peer-reviewed literature or clinical guidelines.

Summary, eligibility guidance and screening preparation are prepared by Sidequest from the platform's posting. Check the source listing before applying.

What the work involves

You are assigned to one of two tracks. In authoring, you produce original questions in your subdomain — items that test reasoning a board-certified clinician or doctoral researcher would need, not facts a search engine returns. Each item requires a self-contained stem, one correct option, nine plausible-but-wrong alternatives, a difficulty rating (Medium ≈ intro undergraduate, Hard ≈ advanced undergraduate, Expert ≈ post-graduate and above), a markdown chain-of-thought solution, and 1–5 references from peer-reviewed journals or clinical guidelines. In verification, you audit pre-written items for accuracy, ambiguity, missing information, and solvability, edit where needed, and write a justification for every change.

The hardest part is usually the distractors. Nine options that are each individually defensible-looking — reflecting real diagnostic confusions, dosing errors, causal-inference mistakes, or guideline misreadings — are what make the benchmark discriminating. Items that collapse to a single obvious answer get returned.

What the platform screens for

Verifiable credentials: MD, DO, PhD, or advanced doctoral candidacy in medicine, biomedical science, or public health. A master's degree can qualify with unusually deep subdomain specialization.
Depth under follow-up: expect the AI interviewer to press on a specific claim you make and ask you to defend or qualify it.
Named subdomain: "internal medicine" is weaker than "inpatient heart failure management" or "signal detection in spontaneous adverse-event reporting."
Citation discipline: familiarity with the primary literature and current guidelines in your area, and the judgment to distinguish a strong source from a convenient one.
Written clarity: concise, unambiguous English under length pressure.

Logistics

Fully remote and asynchronous, with no fixed shifts. Expected commitment is 10+ hours per week; contributors typically report the first several items taking substantially longer than later ones as the rubric and distractor conventions become familiar. Observed pay for this listing is $94–119/hr, set by credentials, domain scarcity, and track — not guaranteed, and rates can shift between cohorts.

What they look for

MD, DO, PhD, or advanced doctoral candidate in medicine, biomedical sciences, or public health
Graduate-level clinical reasoning and biomedical research methodology
Ability to write unambiguous, self-contained multiple-choice items with expert-level distractors
Fluent citation of peer-reviewed literature and current clinical guidelines
Clear, concise written English and markdown formatting
Board certification, clinical practice, or peer-reviewed publications (strong plus)

Before you apply

Would you pass this screen?

Drawn from what this listing actually requires. Answered in your browser — nothing is sent to us, and we do not store your answers.

Do you hold an MD, DO, PhD, or DDS in medicine, biomedical sciences, public health, or a closely related field, or are you currently a doctoral candidate in one of these fields?
Medical degree or doctoral credential · required
Do you have board certification in a medical specialty, active clinical practice hours, or at least 2 published peer-reviewed papers in a health or medical field within the last 5 years?
Board certification or clinical/research track record · preferred
Can you demonstrate advanced (post-graduate or clinical) level expertise in at least one of these domains: Clinical Medicine & Surgery, Medical Imaging & Diagnostics, Pharmacovigilance, Healthcare Management & Economics, or Rehabilitation and Allied Health?
Advanced knowledge in at least one listed domain · required
Is English your primary language or have you completed advanced academic or professional training entirely in English?
Fluent written English · preferred
Can you commit to at least 10 hours per week of asynchronous work for this role?
Availability: 10+ hours per week · required

0 of 5 answered

Included with this listing

Interview prep — 11 questions

Matched to what this platform's screening actually measures. Answer each out loud in 60–90 seconds: claim → concrete example → implication.

What it tests: Can they distinguish between surface-level recall and conceptual mastery, and do they have concrete experience crafting or validating assessment content at graduate or clinical level?
A strong answer: A strong answer names a specific domain (e.g., pharmacology, cardiac surgery, medical imaging), describes a question or review where they had to eliminate ambiguity or ensure plausibility of distractors, and explains the pedagogical reasoning—e.g., 'I made sure the correct answer required synthesis of two mechanisms, not lookup of a fact.'
Where people lose it: Vague, generic descriptions ('I made sure it was accurate') or conflating rigor with difficulty. Also, admitting they've never written or reviewed assessment content at this level—the role demands hands-on expertise in constructing medical questions.