mindjump
tool

How often is the alarm right?

An inspection, a filter or an alert can be accurate and still be wrong most of the time it goes off. It depends on how rare the real problem is. Move the sliders and watch it happen.

Try:illustrative numbers
real problem, flagged real problem, missed false alarm good, passed
–of alarms are real
–items flagged
–real problems missed
–of “all clear” results are right

How it works

The share of alarms that are real is the number of real problems caught divided by all alarms: p·s / (p·s + (1 − p)·f), where p is how common the problem is, s the share caught and f the share of good items flagged by mistake. When p is small, even a small f applied to the many good items produces more false alarms than real ones.

Runs entirely in your browser. Nothing you enter is sent anywhere.

mindjump · small thinking tools, written down so I actually use them.