The loop
1
The agent works cases
Following the current SOP. Some resolve cleanly, some get flagged, some get it wrong.
2
Humans review and comment
Approve, reject, or mark for review — with a comment explaining the decision.
3
The agent analyzes the feedback
Ask it to look at recent review outcomes. It reads the comments and statuses across cases and looks for patterns: the same correction three times, a category of case that always ends up in
Needs review.4
It proposes an SOP revision
As a concrete change with reasoning — “eight rejections in the last two weeks all correct the shipping method for AT deliveries; here’s the rule I’d add, and here’s where it goes in the priority order.”
5
Your expert approves
The revision is a document change you read and sign off on. Then the new version applies to every case that follows.
Look at the last two weeks of reviews in Order Match. What are the reviewers correcting most often, and what would you change in the SOP to fix it? Show me the proposed change.
Why this shape
It improves where it actually failed. The feedback is attached to real cases with real documents, not to a hypothesis about what might go wrong. Nothing drifts silently. The agent does not quietly change how it behaves because it saw a correction. It proposes; a person approves; the SOP file records what changed and why. If someone asks in six months why orders to Austria route the way they do, the answer is in the file’s history. It compounds. Each round moves cases fromNeeds review into clean automation — and the ones that stay flagged are increasingly the genuinely hard ones, which is where you want your reviewers’ attention.
Write comments the loop can use
The quality of the loop is the quality of your rejections. Name the rule, not just the mistake.
The second column is a rule the agent can turn into an SOP line. The first is only a score.
Relationship to agentic approval
They’re two different mechanisms and they work together:- Agentic approval enforces the SOP. An approval agent checks each result against the procedure and the output, approving the clean ones and routing anything uncertain to a human.
- The improvement loop evolves the SOP, using what humans decided on the cases that reached them.
SOPs
How the procedure is written and revised.
Review & approvals
Where the feedback comes from — statuses, comments, approval gates.
