Measuring a Team That Ships With Agents Introduction

Which of your numbers stopped meaning what they meant

Four metrics examined, four different ways they broke, what replaces each one — and the one judgment no number left can support.

Part of the leadership bundle · coming soon
You can read this introduction now. The 12 steps open when purchases do. Meanwhile, The Judgment Gap is free to read in full.
Part of the leadership bundle: $49.99
Every leadership volume, including new ones when they're released. One-time purchase, free updates. The Judgment Gap is free to read in full.
Decision Q&A

Four questions this volume answers

1Why does it matter to me?

Every number you report went up and none is computed wrongly. But most were stand-ins that used to move with what you care about, and that link broke. A misleading dashboard costs you a quarter of attention; a misleading judgment about a person costs far more.

Shown in step 1 · 2 · 6
2What should I ask?

Of each metric: does it still move with the thing you wanted? Did what it's counted over change shape? Can the record still say who did the work? Can it be moved without doing the thing it was meant to reward? And the number most teams don't compute: how much of what shipped had to be revisited, and within what window?

Shown in step 3 · 9
3How will I know it's going wrong?

Output and cycle time improving while failures reaching customers rise: the one result measure going the wrong way. Cycle time falling while work waits longer before anyone picks it up. A coverage-style number hitting its target because it sits on somebody's objectives.

Shown in step 5 · 7 · 12
4What do I decide?

Mark every line readable, readable with a caveat, or retired. Keep output counts for direction only, time from arrival rather than pickup, take coverage off objectives first and then retire it, and start computing rework with its window. In calibration bring described work, not numbers: there is no replacement. Retire metrics in a quarter where they look good.

Shown in step 8 · 9 · 10 · 11

Your metrics did not get worse. They started measuring something else.

Every number you report went up. None of them is computed wrongly. And most of them were never measurements of anything you cared about directly — they were things that were easy to count and that used to move when the thing you cared about moved.

That connection is what broke, and a broken connection does not make any gauge read zero. This volume names which of your numbers are affected, in which of four ways, and what to put in their place.

two guesses in a row, and the middle one came apart effort what it cost you the thing you count what you report value what you wanted snapped before all three move together, and the middle one is a fair stand-in after the outer two still move. They are simply no longer connected. nothing on any face reads zero. Nothing flashes. Both ends keep climbing at their own rates, and the chain in the middle is gone.
The spine of the volume: counting something easy in place of something you care about is a chain of two guesses, and the middle of it came apart.
What moves: three gauges rise together, then the link between the second and third becomes a broken dashed line while both outer gauges carry on rising.

Four metrics, four different failures

the metrichow it broke
counting outputthe stand-in stopped standing in for effort or for value
cycle timethe stretch being timed moved, and the queue moved outside it
individual recordswho did the work stopped being a decidable question
coverage and its relativesit was only ever meaningful because it was expensive

The four were chosen because each breaks differently, so the set generalizes. By the third step you should be able to apply them to a number this volume never mentions.

Every condemned number here comes with a replacement, or an explicit admission that there is not one. There is exactly one of the latter. It is about judging individual people, and it is the most important page in the volume.

What you can do afterward

Mark every line on your own dashboard as readable, readable-with-a-caveat, or retired. Compute the one number most teams do not, from records you already keep. Walk into a calibration meeting knowing which number cannot help you. And retire a metric upward without it sounding like an excuse.

The four failures, the replacements and the retirement script are on one page you can print.