Marketing Specialist

$60–80/hrrate as listed

Senior marketing practitioners write and grade brand, growth, and performance marketing tasks used to train frontier language models. The role is a W-2 engagement through Cincinnatus LLC placed with a leading AI lab, with observed pay of $60–80/hr at roughly 35 hours per week.

Summary, eligibility guidance and screening preparation are prepared by Sidequest from the platform's posting. Check the source listing before applying.

What the work involves

You will spend most of your time on two activities: authoring marketing problems that a strong model should struggle with, and scoring model responses against structured rubrics. Task authoring means writing realistic prompts — a repositioning brief, a paid-social CAC problem, a portfolio architecture decision, a channel-mix reallocation under a fixed budget — along with a reference answer that shows your reasoning, not just your conclusion. Grading means reading model output closely and explaining, in writing, where the reasoning breaks: an invented benchmark, a growth tactic misapplied to a brand-building objective, a media plan that ignores frequency, a segmentation that sounds sophisticated but does not discriminate between buyers.

A second stream of work is rubric development. Marketing resists single correct answers, so much of the value you add is in defining what "good judgment" looks like in scoreable terms and calibrating with other SMEs so two reviewers grading the same response land in the same place. Expect written feedback on your own annotations early on and periodic calibration rounds throughout.

What the platform screens for

Depth over title. Eight-plus years at a recognized brand, agency, or holding company, with visible progression (Manager → Senior Manager → Director/VP). Screens probe for decisions you personally owned, including ones that did not work.
Prior rubric-based AI evaluation. This is stated as mandatory. Be ready to name the program or platform, describe the rubric dimensions, and explain a disagreement you had with a scoring guideline.
Written clarity. Feedback that a research team can act on is the deliverable; vague scoring notes are the most common reason candidates wash out.
Honest availability. Roughly 35 hours/week on weekday hours.

Logistics

Remote and largely asynchronous, though calibration sessions and SME syncs tend to land in US business hours. Cincinnatus LLC is the employer of record — W-2, payroll, benefits, and compliance — with placement inside the client lab's extended workforce. Pay in the $60–80/hr range reflects observed postings for this track and is not a guarantee; rates vary with seniority, specialization, and the specific workstream you are assigned.

What they look for

8+ years in brand, growth, or performance marketing at a top-tier brand, agency, or holding company
Hands-on experience evaluating LLM outputs against rubrics or structured scoring criteria
Demonstrable career progression into Senior Manager, Director, or VP-level marketing roles
Ability to write clear, defensible reference answers and written critique of model reasoning
Reliable weekday availability of ~35 hours/week
Comfort collaborating with other SMEs on rubric calibration and consistency

Before you apply

Would you pass this screen?

Drawn from what this listing actually requires. Answered in your browser — nothing is sent to us, and we do not store your answers.

Do you have 8 or more years of professional marketing experience (brand strategy, growth marketing, or performance marketing) at a recognized top-tier company such as P&G, Unilever, Nike, Ogilvy, WPP, Omnicom, or equivalent?
8+ years marketing at top-tier organization · required
Do you have prior hands-on experience evaluating LLM or AI model outputs against rubrics or structured scoring criteria?
Prior LLM/AI evaluation experience · required
Can you document a career progression in marketing (for example, from individual contributor to Manager, Manager to Senior Manager, Senior Manager to Director or VP)?
Demonstrable career progression · preferred
Are you able to commit to a minimum of 35 hours per week during US business weekdays?
35+ hours per week weekday availability · required

0 of 4 answered

Included with this listing

Interview prep — 11 questions

Matched to what this platform's screening actually measures. Answer each out loud in 60–90 seconds: claim → concrete example → implication.

What it tests: Whether the candidate has actually owned meaningful marketing work at a credible company, not just participated in one; whether they can articulate strategy and trade-offs, not just tactics or outputs.
A strong answer: The answer names a real campaign with a clear business outcome (revenue, market share, brand lift, growth rate—not vanity metrics), identifies a genuine strategic choice the candidate made or influenced, and explains the reasoning behind it and how it was validated.
Where people lose it: Claiming credit for campaigns they only supported or executed; describing campaigns at small or non-tier-one companies; talking only about execution ("I ran paid social") without the strategic framing or business impact.