Which of your numbers stopped meaning what they meant
Four metrics examined, four different ways they broke, what replaces each one — and the one judgment no number left can support.
Four questions this volume answers
Every number you report went up and none is computed wrongly. But most were stand-ins that used to move with what you care about, and that link broke. A misleading dashboard costs you a quarter of attention; a misleading judgment about a person costs far more.
Of each metric: does it still move with the thing you wanted? Did what it's counted over change shape? Can the record still say who did the work? Can it be moved without doing the thing it was meant to reward? And the number most teams don't compute: how much of what shipped had to be revisited, and within what window?
Output and cycle time improving while failures reaching customers rise: the one result measure going the wrong way. Cycle time falling while work waits longer before anyone picks it up. A coverage-style number hitting its target because it sits on somebody's objectives.
Mark every line readable, readable with a caveat, or retired. Keep output counts for direction only, time from arrival rather than pickup, take coverage off objectives first and then retire it, and start computing rework with its window. In calibration bring described work, not numbers: there is no replacement. Retire metrics in a quarter where they look good.
Your metrics did not get worse. They started measuring something else.
Every number you report went up. None of them is computed wrongly. And most of them were never measurements of anything you cared about directly — they were things that were easy to count and that used to move when the thing you cared about moved.
That connection is what broke, and a broken connection does not make any gauge read zero. This volume names which of your numbers are affected, in which of four ways, and what to put in their place.
Four metrics, four different failures
| the metric | how it broke |
|---|---|
| counting output | the stand-in stopped standing in for effort or for value |
| cycle time | the stretch being timed moved, and the queue moved outside it |
| individual records | who did the work stopped being a decidable question |
| coverage and its relatives | it was only ever meaningful because it was expensive |
The four were chosen because each breaks differently, so the set generalizes. By the third step you should be able to apply them to a number this volume never mentions.
Every condemned number here comes with a replacement, or an explicit admission that there is not one. There is exactly one of the latter. It is about judging individual people, and it is the most important page in the volume.
What you can do afterward
Mark every line on your own dashboard as readable, readable-with-a-caveat, or retired. Compute the one number most teams do not, from records you already keep. Walk into a calibration meeting knowing which number cannot help you. And retire a metric upward without it sounding like an excuse.
The four failures, the replacements and the retirement script are on one page you can print.