The Black Box When Your Game Crashes
Chapter 7 · The Road of Trials
The Black Box Series Iterate, Dominate, Disrupt
Failure is only expensive when the wreckage teaches nothing. Instrument the crash, close the Ego Gap, and make the next version harder to break.
Field Note · Fair Isle
The power failed before the storm reached the island.
By dusk the room was cold and the laptop showed twelve per cent. The wind was already working the walls, but the weather was not yet the problem. The problem was what the power cut revealed: which batteries were charged, which assumptions had been carrying the plan, which dependencies had no redundancy, and which part of the system existed only because the grid usually behaved.
Fair Isle, between Shetland and Orkney and 24 miles from the Shetland Mainland, is good at making invisible dependencies visible.1
So is failure.
The Asymmetric Equation
Failure + Telemetry + Honest Review = Inventory for the Next Version The crash is not the lesson. The corrected system is.Core Doctrine
Instrument the Failure
Before instrumentation, a crash is an emotional event. After instrumentation, it can become usable evidence.
Failure becomes useful only after it is instrumented.
Before instrumentation, a crash is an emotional event. It creates pain, blame, relief, embarrassment, adrenaline, and a powerful need to explain what happened quickly enough that identity remains intact.
That first explanation is usually efficient and usually wrong.
Flight-data and cockpit-voice recorders preserve evidence that investigators can combine with other sources; they are valuable precisely because recollection and interpretation are not the only record.15 The human version is less stable: outcome knowledge can alter what we remember believing. Outcome arrives, ego enters the cockpit, and the memory of what we knew, expected, and intended begins to change. Within hours, the original decision has been rewritten into a story that fits the result.
This is why the record has to exist before the wreckage.
Decision cards. Hand histories. Version control. Logs. Checklists. Behavioural measures. A stated hypothesis. A declared sample. These are not administrative accessories. They are protection against the most intelligent witness in the inquiry quietly altering the evidence.
Telemetry is what the system did. Ego is the cost of defending what you hoped the system was.
Diagnostic Instrument
The Ego Gap
The distance between telemetry and the preferred story predicts whether the lesson will be absorbed or repeated.
The distance between those two is the Ego Gap.
The operator can look at the evidence, update the model, and remain intact.
The evidence must be attacked, explained away, blamed on the field, or converted into a dramatic story in which the operator is either hero or victim.
The Crash Ledger
Audit Four Accounts
No single ledger can explain the crash. Systems usually fail through a chain.
The Cognitive Ledger
What was known? What was assumed? What was guessed and later remembered as known? Which base rate was ignored because the live story was more vivid? What disconfirming evidence arrived and failed to enter the decision?
The Emotional Ledger
What state placed the bet? Boredom. Entitlement. Fear of missing out. Revenge. The need to recover. The need to be seen as decisive. The novelty of a new system. The relief of avoiding a hard conversation.
The Strategic Ledger
Was the move part of a coherent range and process, or a one-off improvisation disguised as instinct? Were the stake, timing, and exit conditions consistent with the declared strategy? Did the decision protect the whole campaign or merely satisfy the moment?
The Variance Ledger
What portion of the result was outside control? What would a larger sample likely reveal? Are you punishing a sound decision for an ugly outcome, or rewarding a poor decision because the river was kind?
No single ledger can explain the crash. That is the point. Human beings prefer one cause because one cause produces one emotion and one villain. Systems usually fail through a chain.
The Asymmetric Question
Which failure are you still explaining because an explanation is less threatening than an examination?Field Note
Redundancy Is a Verb
The power cut did not create weakness. It revealed architecture.
On Fair Isle, redundancy is not a management concept. It is a daily form of respect for reality.
Distance changes the meaning of backup. Twenty-four miles from the Shetland Mainland, the second method is not inefficiency. It is the thing that allows the first method to fail without turning inconvenience into crisis.
The island teaches this without a presentation. Charge before the weather. Know where the torch is. Keep the alternative heat source. Do not allow the only route, device, person, or assumption to become a single point of failure merely because it behaved last week.
The power cut did not create weakness. It revealed architecture.
That is what a black box review should do. Not ask, Who failed? Ask, What did this event expose that normal operation was hiding?
A resilient system is not one that never breaks. It is one that breaks informatively, contains the consequence, and gives the next version something specific to improve.
The useful question after a crash is not How do we make sure this never happens again? That promise is usually impossible and therefore operationally empty.
The useful questions are narrower.
Failure Classification
Fire Versus Arson
Not every loss belongs in the same category.
Fire
The cost of the real game.
Fire is the damage that comes from participating in a real game: variance, weather, market change, another person's private decision, a card no process could control.
Arson
The damage added afterward.
Arson is the damage added after the first event: chasing, hiding, doubling the stake, changing the story, refusing the stop condition, taking one bad hand into the next ten.
You cannot eliminate fire. You can stop carrying petrol.
This distinction matters because shame confuses the two. It blames the operator for weather and excuses the operator's response as weather. The black box separates them. The first loss may be the cost of admission. The second is often a process leak.
Strategic Warning
Do Not Narrate the Wreckage Too Soon
A crash you narrate is a crash you are preparing to repeat.
Narrative has value later. It can teach, transfer, and give form to experience. But immediately after failure, story is often anaesthetic. It creates meaning before the evidence has finished speaking.
There are four common ways to waste wreckage.
The correct response is smaller and less cinematic: preserve the evidence, classify the failure, change one load-bearing variable, and run the next controlled test.
Field Exercise
The Four-Ledger Audit
Choose the most recent failure you are still explaining.
Create four headings: Cognitive, Emotional, Strategic, Variance.
Under each, write only observable facts first. Then write your interpretation in a second colour or separate paragraph. Do not allow the two to merge.
Finish with five decisions:
Then calculate the Ego Gap in one sentence:
The distance between those statements is the price of the lesson.
The Black Box Archive
Companion Field Notes
Two earlier Decision Science posts extend the chapter's argument from table memory, framing, mottos, and applied insight.
Decision Science · Companion Essay
Poker Doesn't Think, and the Cards Have No Memory
The cards do not preserve your preferred narrative. The operator supplies the framing, takes the action, and then has to separate what the deck did from what the decision process did.
Decision Science · Motto Archive
Edible Knowledge: Words to Chew On
A compact field archive of table mottos: commit fully, respect the game, treat mistakes as instruction, and keep the language of the next decision close enough to use under pressure.
- Fair Isle's community site describes the island as lying 24 miles from the Shetland Mainland and between Shetland and Orkney. Fair Isle Development Company: About the Isle.
- NTSB recorder reports treat cockpit-voice material as an investigation tool used with other evidence rather than as a sole source. NTSB Vehicle Recorder Specialist's Factual Report.
The Next Threshold
Diagnosis Is Not Repair
Flight-recorder evidence can clarify how an accident unfolded and still leave the next aircraft on the ground. A hand can be reviewed perfectly and never improve the next session. A manuscript can be outlined, structured, researched, and discussed for years without becoming an object another person can hold.
Eventually the beautifully diagnosed plan has to be executed by somebody, on a Tuesday.