Statistics · Testing · Medium
Which discoveries are real
A research group tests a large number of signals, of which one in ten has a real effect. The test flags a signal that has a real effect 80% of the time, and flags a signal that has no effect 5% of the time. What fraction of the flagged signals have no real effect?
a fraction, an expression or a decimal to two significant figures · 5/8 · ln 2 · pi · inf
Answer and solution
Answer
9/25 ≈ 0.36
Solution
When few of the hypotheses tested are true, false positives from the many empty ones are a large share of what is flagged.
Per 1,000 signals: 0.8 × 100 = 80 true flags and 0.05 × 900 = 45 false flags. Share false = 45 / 125 = 0.36.
Testing comes up in 5 firms' roundsD. E. Shaw · Two Sigma · Tower Research · +2
These 6 rounds ask this kind of problem live, with follow-ups. Every round on every track is in Premium.