Gate 04 · Measurement · richardhenderson.io/playbook
Monitor the decision, and retire the model on purpose
Name ____________________ Date ____________ Owner ____________________
01Monitor the outcome the brief named
Which number says the decision is better?
02Watch inputs, scores and overrides too
What changes before the outcome does?
03Set the alert line and the retirement trigger now
At what point do we act, and how?
04Choose how often to look
How long can a decline run unnoticed?
05Check the metric itself
Would we notice if the number were being gamed?
06Retire on purpose
What happens the day the trigger fires?
Checklist
- The decision metric is monitored, not only accuracy
- Input, score and override drift are watched
- An alert line and a retirement trigger are written as numbers
- The review cadence matches the cadence of the decision
- A hand-reviewed sample guards against metric gaming
- Retirement has an owner and a procedure
Template by R.K. Henderson. The worked examples on the site use invented numbers.