What is a good AI approval workflow?

One queue, grouped by agent, showing the artefact, the evidence, the confidence and the cost. Three actions: approve, edit-then-approve, reject with a reason that feeds the next run.

An admin approves every new account by hand. Nothing is created until then. We reply by email; no newsletter, no sequence.

app.salescrew.io/inbox
The unified reply inbox with classified threads

The short answer

  • A good AI approval workflow is one queue, grouped by agent. Every item shows the artefact itself (the draft, the suggested action), the evidence behind it, a confidence score and the cost to produce it.
  • Three actions cover the real cases: approve as-is, edit then approve, and reject with a reason. The reason on a rejection matters as much as the rejection itself. It feeds the next run and reduces the same mistake happening again.
  • A named owner clears the queue daily. An approval workflow with no owner, or one checked weekly, defeats the purpose of holding actions for review. The delay itself becomes the cost.
  • The workflow only earns its keep if reviewing an item is faster than doing the task from scratch. If evidence is missing or scattered across screens, reviewers start rubber-stamping. That quietly turns review mode into auto mode without anyone deciding it.

Why one queue beats several

Teams that build agents one at a time often end up with one queue per agent almost by accident. The outreach agent gets a review tab. The inbox agent gets a separate one. A later agent gets its own screen entirely. This scatters review across the day. One queue can quietly go unchecked for a week while another gets daily attention. A single queue, with each item labeled by which agent produced it, solves this without losing the ability to filter by agent when a reviewer wants that.

The four pieces of information on each item, the artefact, the evidence, the confidence and the cost, answer the four questions a reviewer has. What is this asking me to approve? Why did the agent think this was right? How sure was it? Was it worth producing? Leave any one out and reviewers either dig for it elsewhere, which slows the queue down, or skip the check entirely, which defeats the point of review.

What each element does, and what happens without it

ElementWhyWhat happens without it
The artefact itselfShows exactly what will happen if approvedA reviewer approves the idea without seeing the actual output
Evidence (thread, score, source)Lets a reviewer judge whether the agent's reasoning was soundApprovals become a guess rather than a check
ConfidenceFlags items worth extra scrutiny before they are approved on autopilotLow-confidence drafts get the same quick glance as high-confidence ones
CostTies the queue to what each item cost to produce, useful for later cost analysisNo visibility into whether a feature's cost is proportionate to its value
Approve / edit-then-approve / reject with reasonCovers the three real outcomes without extra stepsReviewers either force everything through 'approve' or abandon the queue

Keeping the queue from becoming a rubber stamp

The biggest risk to an approval workflow is not that it gets ignored. It is that it gets approved on autopilot once a team trusts the agent. That is a reasonable thing to happen eventually for a specific action class. It should happen as a deliberate decision to move that class to automatic, not as reviewers quietly clicking approve without reading. A named owner who clears the queue daily, and who is expected to reject items that deserve it, keeps that distinction real.

Disclosure: SalesCrew is our product, and its approval queue is built to this shape. One queue grouped by agent. Each item shows the draft or action, the evidence (the thread, the score, the knowledge-base sources it drew from), a confidence figure and its cost. Approve, edit-then-approve and reject-with-reason are the three actions. Rejection reasons are meant to inform the next run, not only close the item.

If 95% of items are approved unchanged for two weeks, move that class to auto

Approval fatigue is a real failure mode. If a reviewer keeps approving one action class without edits, that class is ready to move to automatic. Keep reviewing the rest, but do not let the routine ones sit in a queue just because it exists.

Questions

Should every agent have its own approval queue?
No. One queue grouped by agent works better than separate queues per agent. A single queue is one place to check. Grouping still lets a reviewer see which agent produced which item without several different screens.
What should happen to a rejected item?
A rejection with a reason should feed back into the agent's next run, not only disappear. If a reviewer rejects a draft because it misread a contact's title, that pattern is worth catching earlier. A reason attached to the rejection is what makes that possible.
How much evidence is too much to show in a queue item?
Enough to judge the action without opening five other tabs, but not so much that a reviewer has to read a full record history for every item. The thread it replies to, the score behind it, and the source it drew from is usually the right amount.