The work
You receive a set of prompts covering Australian corporate and commercial law — the sort of questions that arise in transactional practice, from Corporations Act mechanics and FIRB thresholds to takeover and scheme procedure, warranty and indemnity drafting, and directors' duties. You run each prompt through two separate LLM platforms, read both outputs closely, and score them against a rubric the client supplies. Every evaluation is accompanied by short written feedback: what the model got right, exactly where it went wrong, and why the error matters to a practitioner relying on the answer.
The hard part is not spotting obvious nonsense. It is catching answers that read fluently and cite the right-sounding provisions while misstating a threshold, importing a US or UK concept, or relying on a case that has been distinguished. Reviewers who can point to the specific section, rule or case that the model mishandled produce far more useful signal than reviewers who write "mostly correct".
What the screen looks for
- Law-firm grounding in transactional work. At least 2 years (3+ preferred) in corporate/M&A or transactional practice at a firm. In-house is acceptable only if you moved within the last two years off a firm base.
- Australian qualification and current command of the law, including recent amendments and regulator guidance, not just what was true when you last ran a deal.
- Rubric discipline — consistent scoring across a batch, without drifting toward leniency as fatigue sets in.
- Written precision. Feedback is read by engineers and other lawyers; vague comments are discarded.
Logistics
Fully remote and asynchronous — you pick your own hours within the deadline for each batch. Initial commitment is roughly 10 hours, with strong potential for continued work if your evaluations hold up under quality review. Observed pay for this listing is $100–120/hr; rates on Mercor vary by project and are not guaranteed. All work sits under NDA, so prompts, model outputs and the client's identity stay confidential.