Last time, Mio told Yui: "What a reviewer truly is, is detection." Today picks up there. Why is detection alone the lifeline? The answer lies in this: the two kinds of mistakes do not weigh the same. At a small desk in the review room, Yui feels that asymmetry in her body for the first time.
Two Sticky Notes
In the morning, Mio set two sticky notes on Yui's desk. One read "miss," the other "over-catch." In the work of reviewing materials—the promotional documents a drug company hands to doctors and pharmacists—there are only two ways to be wrong.
"A miss is letting a bad piece of material through with an 'this is fine.' An over-catch is stopping a genuinely good piece of material with a 'no good.'" Mio tapped the notes with her fingertip. "Yui, of these two—which one scares you?"
Yui thought for a moment and answered honestly. "A mistake is a mistake either way… so aren't they about equally bad?" Mio did not shake her head. She only said, "Then let's chase each one down."
Following Both Mistakes to the End
Mio drew two lines on the whiteboard. One was where over-catch leads; the other, where a miss leads.
"Start with over-catch. If you stop a good piece of material, what happens?" Yui answered. "The sales rep gets upset… it gets sent back, and you review it again." Mio nodded. "Right. More work. It eats time too. But that sheet of paper has stopped inside the review room. It hasn't taken a single step outside."
"Next, a miss. If you pass a bad piece of material—say, a document that overstates the effect—what then?" Yui's voice trailed off. Mio took up the rest. "The rep carries it out. A doctor reads it. And that doctor uses it to decide what drug to give the patient in front of them—on the premise that it works even better than it does. The paper is already outside the room. It reaches all the way to the patient."
The harm of over-catch is contained inside the room. The harm of a miss travels all the way to the patient. Even when it's the same single mistake, where it stops is entirely different.
The Same as Airport Security
Yui still looked unconvinced, so Mio offered an analogy. "You know airport security screening."
"Even if they confiscate too many water bottles, at worst a passenger complains and that's it. The line just gets longer. But miss a single dangerous item, and it reaches the cabin—and involves hundreds of people. That's why screeners fear a 'miss' on a scale entirely different from 'stopping too much.'" Mio paused for a beat on the words 'entirely different.' "By 'entirely different' I don't mean two or three times. I mean ten times, a hundred times the weight."
"Review is the same. Stopping a good piece of material is work inside the room. Passing a bad piece of material is a risk that reaches the patient's body. The moment you line these two up as 'both just mistakes,' you've already stopped looking through a reviewer's eyes."
The Trap of the Average
Here Mio voiced the crux that would matter for the later judgments. "That's why I don't measure a reviewer by their 'average score.'"
Yui asked back. "Someone who explains well, knows a lot, but misses one danger—wouldn't their total come out high?" Mio's answer was short. "It wouldn't. If anything, that's the most dangerous of all."
| Item | Over-catch (stopping too much) | Miss (passing too much) |
|---|---|---|
| Where the harm stops | Inside the review room | Reaches the patient |
| Main loss | Effort and time | Risk to health and safety |
| Recoverability | Just send it back | Hard once it has arrived |
"The average erases this vertical gap. Explanation 90, knowledge 90, detection 0. Add them and divide by three, you get 60. It looks like a pass. But detection of 0 means there's no one in the room who stops a miss. No matter how perfect the rest, that isn't a reviewer." Mio tapped the 'miss' note once more. "If this is zero, the total score means nothing."
Yui's Homework
On her way out, Mio added just one thing. "From here, I want you to watch three people. Higuchi, Minami, Wada." Yui heard names she had never met.
"One is silver-tongued, one is deeply learned, one is plain. Score them wrong, and you'll probably get the order backwards. Hold on to today's talk until then." Mio handed Yui the two sticky notes. The 'miss' note felt just a little heavier—though of course it couldn't be.
The Qualification Bar ── Map of all 10 episodes
- Vol. 2 (this episode): The Asymmetry of Harm ── A Miss Is Orders of Magnitude Heavier ── Why you must not draw the line with an average, part 1: a miss and a false alarm are not equal harms
- Vol. 3: The Compensation Trap ── Eloquence Hiding a Gap in Detection ── A reviewer who is brilliant at explaining and at getting along with people is weak at just one thing: spotting danger (risk detection). Average the scores and they pass. But someone who cannot spot danger yet talks well will push risky material through on charm alone. Why you must not decide pass or fail on an average — explained gently through real Case A.
- Vol. 4: Floor vs. Aggregate ── Non-Compensatory Gates and the Weighted Score ── Pass/fail is decided by minimum bars (floors); the total score is used only to rank. Fall below even one bar and a perfect score still fails. This is the unbreakable rule of the qualifying line.
- Vol. 5: The Highest Floor for Detection ── Why Risk Detection Exists ── Material review — the job of checking a drug company's promotional materials for doctors before they go out — exists to find the dangerous spots. So among eight abilities, the minimum bar for the power to spot danger (risk detection) is set highest. To pass as someone who can review alone (qualified) you need level L3, the second-highest rung, plus a real-world spotting range of 2 or more. A person who stops one rung lower, at L2, lets the most dangerous materials slip right through.
- Vol. 6: A Floor on Two Axes ── Not Letting Desktop Detection Pass ── The pass line for detection cannot be drawn with a single score. It needs two rulers: how well you can explain the danger, and whether you can catch it in the real material in front of you. A textbook-only spotter may look like L3 on paper but does not clear for solo work.
- Vol. 7: Calibration as a Gate to Independence ── Overconfidence Disqualifies ── A look at the gate (calibration gate G2) that asks: do you estimate your own seeing-power correctly? Working alone means no one checks behind you. A person who thinks their detection skill is higher than it really is (gap Δ of +2 or more) waves through danger without noticing their own blind spot. This gap (Δ) is not skill itself, but it decides whether someone may work alone.
- Vol. 8: The Four Gates G0–G4 ── The Logic of Early Rejection ── A reviewer's pass or fail is decided at four checkpoints in order. Anyone who fails an earlier checkpoint is not re-measured at a later one. A non-negotiable minimum line (a "floor") cannot be patched over by other strengths, and the total score never flips the result.
- Vol. 9: Three Profiles ── How One Line Sorts Them ── The eloquent talker, the textbook thinker, and the real deal — where one pass/fail line sends each
- Vol. 10 (final): The Responsibility of Drawing the Line ── Anchors First, Human Confirmation, Non-Punitive Growth ── The closing chapter that turns the pass line into something a workplace can actually use. Only when a shared book of agreed examples exists does the line become a common yardstick. The four verdict tiers are not a brand of failure but a signpost for what to grow next. AI gives a rough first reading; a human makes the final call.
The two mistakes share the name \"mistake,\" but they arrive at different destinations. Over-catch stops inside the room; a miss walks all the way to the patient. The two sticky notes in Yui's hand become the yardstick for how she will read the three people to come.
Next time, the first of them arrives in the review room—Higuchi, a master of explanation and persuasion. How will Yui score someone so silver-tongued?
- Key point Review mistakes come in two kinds. Over-catch (stopping good material) costs only effort inside the review room, but a miss (passing bad material) reaches the patient. Where the harm stops is fundamentally different.
- Key point The two harms differ by orders of magnitude—not two or three times, but ten or a hundred. So a reviewer whose detection is zero cannot stand as a reviewer, however high their explanation or knowledge.
- Key point The average erases this asymmetry. An evaluation that dilutes a detection score of 0 with other high scores to make it look like a pass is a dangerous way to measure—it hides the fact that no one in the room is stopping the misses.
- Green, D. M., & Swets, J. A. Signal Detection Theory and Psychophysics. Wiley, 1966. (Separating sensitivity from specificity; false negatives and false positives as independent costs.)
- Cizek, G. J., & Bunch, M. B. Standard Setting: A Guide to Establishing and Evaluating Performance Standards on Tests. Sage, 2007. (Drawing the pass line by standard setting rather than by an average.)
- Spencer, L. M., & Spencer, S. M. Competence at Work: Models for Superior Performance. Wiley, 1993. (The concept of threshold competency.)
- Messick, S. Validity. In Educational Measurement (3rd ed.). American Council on Education, 1989. (Validity and consequential validity — weighting the harm of misclassification.)