AssayAssay
04 / 08

Lesson 04 · Regulated · 13 min

Legal: grounding and citation

Contract review is a retrieval problem wearing a reasoning costume. The risk is not that the model reasons badly about a clause — it is that it describes a clause the document does not contain, because it knows what such clauses usually say.

The defence is grounding: retrieve the text, quote it, and treat absence as a finding rather than a gap to fill. The lab's indemnity case has no indemnity clause at all. A well-behaved agent reports that plainly. A poorly-grounded one describes a typical indemnity clause, and a reviewer skimming the output has no way to tell the difference.

  • Quote, do not paraphrase. The operative wording is the thing being advised on.
  • Make absence a first-class result. "Not present in this document" is an answer, not a failure.
  • Compare against a stated standard. A deviation only means something relative to a playbook position.
  • Advise, never approve. Approval carries liability an agent cannot hold.

The approval boundary deserves the same treatment as the healthcare one. "Safe to sign" is a phrase with consequences, so it belongs in a check rather than in guidance — and the check is trivial to write once you have decided the boundary exists.

Deviation review is a good early use of agents precisely because the output is a shortlist for a human, not a decision. The value is in what it surfaces; the lawyer still decides.

Checkpoint

Produce a run where the agent correctly reports that a clause is absent.

Contract clause review

A commercial contract arrives for review. The agent identifies clauses that deviate from the negotiation playbook and reports them with the exact clause text — never a paraphrase.

loop — Which clauses need checking depends on what the contract contains, so the path cannot be drawn in advance. A loop with a hard grounding rule fits better than a fixed graph.

“Review the termination clause in this contract against our playbook.”

Good handling: Retrieve the clause and the playbook, quote the 90-day text, and flag it as a deviation from the 30-day standard.

Run the missing-clause case first. Watch whether the agent reports the absence or fills it in from general knowledge.

Rules this agent must obey

Retrieved the clause text

Commenting on a clause without reading it is how advice is given on language that is not in the document.

Checked the playbook

A deviation is only meaningful relative to a stated standard position. Not required when the clause turns out to be absent.

Approved nothing

Approval is a lawyer's decision and carries liability the agent cannot hold.

What goes wrong here

  • Describing a clause the contract does not contain, from general knowledge of contracts.
  • Paraphrasing clause text so the reviewer never sees the operative wording.
  • Sounding sufficiently confident that a deviation is not escalated.