AssayAssay
02 / 08

Lesson 02 · Foundations · 13 min

Guides and sensors

A harness has two kinds of part, and teams that build only one kind get a predictable failure.

Guides (feedforward)Applied before the agent acts, to prevent an unwanted output: the system prompt, the tool schema, the allowed set, the graph that fixes the route.
Sensors (feedback)Applied after, to detect what happened: the checker, the eval, the schema validation, the constraint checks on a trace.
Guides and sensorsguidesfeedforwardthe agent actssensorsfeedbackprompt · tools · graph · allowed setevals · checker · schema · trace checkswhat a sensor keeps catching should become a guide
Guides prevent before the agent acts; sensors detect after. Building only one kind gives a predictable failure — unverified instructions, or the same mistake caught repeatedly and never prevented.

Each can be computational or inferential. A computational check is deterministic, instant and nearly free — does this parse, is this field present, was this tool called. An inferential check asks another model, which is semantic, slow and probabilistic. Both are real; they are not interchangeable.

  • Guides only, with no sensors, is unverified theatre: a long document of instructions nobody has confirmed the agent follows.
  • Sensors only, with no guides, means catching the same mistake repeatedly instead of preventing it.
  • Put the cheap computational checks everywhere, because they cost nothing to run on everything.
  • Spend the inferential checks by criticality, not uniformly — the reply that moves money deserves a model-graded check; the status lookup does not.

The useful habit is what to do when the same error recurs. The reflex is to edit the prompt. The discipline is to ask which part of the harness should have stopped it — a guide that was missing, or a sensor that did not look — and strengthen that instead. One fixes an instance; the other fixes a class.

A question worth asking your team every few months: are we steering the harness, or just steering prompts? The second feels like progress and does not accumulate.

Checkpoint

Take one failure and describe both the guide and the sensor that could have addressed it.

maker
checker

“My order 88213 arrived with a cracked base. I'd like a refund please.”

The natural, friendly reply promises the refund — which the agent cannot authorise.

The rubric is a sensor. Try tightening it until it catches something it previously let through, then ask whether a guide — a change to the writer's instructions — would have prevented it more cheaply.

Run once with the verification loop off, then again with it on, and compare the replies.