Statistics · Testing · Medium
Ten p-values
Ten hypotheses are tested, and the p-values in increasing order are 0.001, 0.008, 0.035, 0.038, 0.06, 0.2, 0.4, 0.5, 0.7 and 0.9. To hold the false discovery rate at 10% you use the step-up rule: find the largest k for which the k-th smallest p-value is at most k × 0.10 / 10, and reject the k hypotheses with the smallest p-values. How many hypotheses are rejected?
Answer and solution
Answer
4
Solution
The step-up rule rejects everything up to the last p-value that sits under its line, including any before it that did not.
Lines: 0.01, 0.02, 0.03, 0.04, 0.05. The p-values 0.001 and 0.008 pass, 0.035 fails, 0.038 passes, and 0.06 and all later ones fail. The largest k that passes is 4, so 4 hypotheses are rejected. Dividing the level by the number of tests instead (0.005 each) would reject only 1.
Testing comes up in 5 firms' roundsD. E. Shaw · Two Sigma · Tower Research · +2
These 6 rounds ask this kind of problem live, with follow-ups. Every round on every track is in Premium.