What the work involves
You build assessment items grounded in real sociological content — stratification, methods, theory, race and ethnicity, deviance, demography, whatever your teaching and research actually cover — and then write the rubric that scores them. Tasks need to be unambiguous enough that a third-party educator or a model can apply the rubric and reach the same judgment you would. Expect to cite or paraphrase current literature, document why a criterion exists, and specify what distinguishes a strong response from a plausible-sounding weak one.
A second stream of work is review: reading other contributors' tasks, rubrics, and model-generated responses and giving specific, defensible feedback. This is where most contributors are separated from each other. Vague praise or line-editing is not useful; the project wants you to name the conceptual error, the misaligned Bloom's level, or the rubric criterion that can't actually be observed in a written answer.
What the screen looks for
- Verifiable teaching and publication history at the postsecondary level, with a PhD or ABD in sociology or an adjacent discipline
- Concrete evidence you have written rubrics and assessments in your own courses — not just used ones you were given
- Fluency with Bloom's taxonomy and at least one other assessment framework, applied rather than recited
- Ability to hold a sociological position under follow-up questioning, including where the evidence is contested
- Clear writing: the screen reads your prose as a work sample
No AI or machine learning background is expected. Familiarity with how models fail at social-scientific reasoning is a bonus, not a requirement.
Logistics
Contractor engagement, fully remote, asynchronous. Contributors typically commit 10–20 hours per week, though volume fluctuates with project phase and some cohorts are onboarded for short bursts. Deadlines are per-batch rather than per-day, so you set your own hours. Pay is hourly and reported by contributors in the $50–90 range; the specific rate is set at offer and is not guaranteed.