The work
You are a task designer for a benchmark measuring whether advanced AI systems can do research-level electrical engineering with real tools. In practice that means writing original problems in Python: a fully specified setup, an oracle function that produces the ground-truth answer, and validators that accept correct solutions without leaking the path to them. Some problems are closed-form computation — extract S-parameters, de-embed a fixture, characterize a transmission line, run an operating point or AC sweep in ngspice and report a number. Others are interactive: the model must plan a sequence of measurements or simulations to recover circuit parameters that are never shown directly, reasoning from partial results toward a narrowed answer.
Every problem goes through a testing loop against current frontier models. If the model solves it on the first try, the problem is too shallow; if no approach works, it is probably underspecified or ambiguous. Most of the effort lands in that iteration — tightening assumptions, removing accidental shortcuts, and making sure the difficulty comes from engineering judgment rather than arithmetic volume.
What the screening looks for
- Tool-level specificity. Which scikit-rf or ngspice workflows you have actually run, what the libraries get wrong, and where numerical or convention issues (port ordering, reference impedance, renormalization, convergence settings) bite.
- Graduate-level depth under follow-up. Expect the interview to push past your first answer on S-parameter theory, noise, matching, stability, or SPICE model behavior.
- Python and evaluation instinct. You will be judged on whether you can write clean oracles and validators, and on whether you can articulate why a problem is genuinely hard rather than merely long.
- Honest availability. 15–20 hours per week minimum, sustained.
Logistics
Fully remote and asynchronous, with work done in Linux/terminal environments and remote compute sandboxes. Observed pay for this listing is $70–100/hr, typically set by demonstrated depth and assessment performance — rates are as reported by contributors, not guaranteed. A coding assessment is part of the application; plan for it to take real time.