Linguistics Specialists

$40–50/hrrate as listed

micro1 is contracting linguistics specialists to review human–LLM conversations and rate model responses against instruction-following rubrics. The work rewards precision in grammar, usage, and semantics over creative writing, and pay has been observed at $40–50/hr.

Summary, eligibility guidance and screening preparation are prepared by Sidequest from the platform's posting. Check the source listing before applying.

The work

You read transcripts of conversations between people and large language models, then judge whether the model's response actually did what was asked. That means checking factual and logical consistency, but more specifically the things a linguist notices first: agreement errors, ambiguous scope, register mismatches, calques and non-native phrasing, misread anaphora, subtle semantic drift between a prompt and its answer. Each task ends with written feedback — short, specific, and traceable to a guideline clause rather than to taste.

A typical session involves working through a queue of items in a web tool, applying a rubric that may run several pages, and occasionally recording verbal commentary or joining a calibration call. You will also flag places where the guidelines themselves are ambiguous; coordinators expect that, and specialists who surface edge cases early tend to stay on projects longer.

What the screening looks for

Native U.S. English proficiency, which micro1 treats as a hard requirement for this engagement, not a preference.
Verifiable linguistic training or practice — graduate coursework, a research area, editorial or lexicographic work, corpus or annotation experience. Expect follow-up questions that test whether you can talk about your subfield without notes.
Rubric discipline: whether you can suppress your own stylistic preferences and score to a stated standard, including when the standard produces a result you personally dislike.
Feedback quality: concise, actionable, and legible to an engineer who is not a linguist.

No prior AI or machine learning experience is expected. Familiarity with annotation guidelines or editorial style manuals is a useful proxy and worth mentioning.

Logistics

Remote, contractor engagement, restricted to the US and Western Europe. Work is largely asynchronous against weekly throughput expectations, with occasional synchronous calibration or feedback sessions in overlapping business hours. Volume on evaluation projects fluctuates with client demand — treat it as a variable-hour contract rather than steady part-time employment, and confirm expected weekly hours with the coordinator before committing.

What they look for

linguistics analysis
grammar and usage evaluation
written communication
attention to detail
guideline-based evaluation

Before you apply

Would you pass this screen?

Drawn from what this listing actually requires. Answered in your browser — nothing is sent to us, and we do not store your answers.

Is English your native language—meaning you grew up as a first-language English speaker?
Native English proficiency · required
Do you have either a degree-level qualification in linguistics or a related field (e.g., applied linguistics, computational linguistics) or at least three years of professional experience in language analysis, editorial work, translation, or linguistic evaluation?
Linguistics or language analysis background · required
Are you available to begin contributing to this project within the next two weeks?
Immediate availability · preferred
Are you based in the United States or Western Europe?
US or Western Europe location · required

0 of 4 answered

Included with this listing

Interview prep — 11 questions

Matched to what this platform's screening actually measures. Answer each out loud in 60–90 seconds: claim → concrete example → implication.

What it tests: Whether the candidate has genuine linguistic depth (academic credentials, specialized employment) versus generic writing ability, and whether their expertise aligns with close-reading of model outputs rather than content creation.
A strong answer: A clear narrative of either advanced academic study (linguistics degree, computational linguistics, applied linguistics) or years in a role requiring deep language expertise (copyediting, translation, language instruction, linguistic research)—specific to analyzing language structure, correctness, and nuance rather than general communication.
Where people lose it: Conflating 'I write well' or 'I'm an English major' with linguistic expertise; failing to distinguish between writing ability and the capacity to identify grammatical errors, semantic issues, or instruction-following failures in model outputs.