What we measure and publish.
Every engagement has acceptance criteria tied to these metrics. We publish anonymized results after the measurement window closes.
- intervention rate
- How often a human had to step into a workflow the agent owns. Falling is good; zero is suspicious.
- correction rate
- How often a human changed what the agent produced at a checkpoint. The honest measure of output quality.
- escalation rate
- How often the agent handed a case to a human by design. Unlike interventions, escalations are the system working.
- hours removed
- Staff hours no longer spent on the workflow, measured against the audit baseline, not estimated.
- cost per successful outcome
- Everything divided by completed workflows: running costs, supervision minutes, rework. The number that decides whether the build was worth it.
- payback
- Months until the removed cost exceeds the build cost. Computed from measured numbers, not projections.
How the scoreboard is calculated
The formulas stay fixed across engagements. The workflow boundary, baseline, and acceptance criteria are written down before production measurement begins.
unplanned human interventions / workflows startedAn intervention means the agent could not complete a step it was expected to own.
checkpoint outputs changed / checkpoint outputs reviewedA correction counts only when a reviewer changes the output, not when they simply approve it.
(baseline staff minutes − production staff minutes) / 60Both sides agree on the baseline before the build starts. Production time comes from the same workflow boundary.
(run cost + supervision cost + rework cost) / successful outcomesA successful outcome must meet the acceptance criteria set during the audit.
build cost / measured monthly cost removedWe calculate payback after the acceptance window. A forecast is labeled as a forecast.
These are measurement definitions, not client results.
What a published result must show
A result belongs here only after the acceptance window closes and both sides agree on the numbers.
The starting cost of the workflow, measured during the audit and agreed by both sides.
What we built and where the workflow pauses for human judgment.
The change in each scoreboard metric during the acceptance window.
The build cost, actual running costs, supervision time, and measured payback.
We publish client results only after the measurement window closes. Projections do not count as results.
Bring us your worst workflow.
The audit takes two weeks and costs $4,500. You will know what the workflow costs now, what a calibrated version would cost, and whether it is worth building.
Book the Profitable Line Audit