The work
Mercor is staffing a benchmarking project for a legal AI company that wants to know how well large language models handle real questions of German law. You will be given prompt sets covering corporate and transactional matters — think GmbH and AG governance, share purchase agreements, Umwandlungsrecht, notarial requirements, W&I and liability caps, merger control triggers, Gesellschaftervereinbarungen. You run each prompt through two platforms, read both answers closely, and score them against a rubric the client supplies. Every evaluation gets a short written justification in precise German or English, depending on task instructions.
The judgment being bought is not "which answer sounds better." It is whether a model has cited the right paragraph of the GmbHG or AktG, whether it has silently imported a US or English-law assumption into a German fact pattern, whether a stated notarisation requirement actually exists, and whether an answer that reads fluently would nonetheless mislead a client or a junior associate. Confidently wrong answers are the main thing this project is built to catch.
What the screen looks for
- Law-firm provenance. At least two years (three or more preferred) in corporate/M&A or transactional practice at a firm. In-house is acceptable only if you moved within the last two years and the firm years came first.
- German qualification and genuine doctrinal command — expect follow-ups that go past the label on your CV into specific statutory provisions and deal mechanics.
- Rubric discipline. The client wants scores that are reproducible across reviewers, not personal impressions.
- Written precision in German. Feedback that is vague or hedged is not usable as training signal.
Logistics
Fully remote and asynchronous — you pick your hours within task deadlines. The initial commitment is roughly 10 hours, with a stated potential for continued work if the benchmark expands. All work sits under NDA, which means prompts, model outputs and client identity stay confidential. Pay in the $140–150/hr range has been observed on this listing; rates on Mercor vary by project and are not guaranteed.