21. What does a p-value tell you, and what does it not tell you?
EasyStatistics & inference
Technical
Show model answer
Under a specified statistical model, it describes how unusual the observed result or more extreme results would be under the tested null assumptions. It is not the probability that the hypothesis is true.
Interpret it with the design, effect estimate, uncertainty and assumptions. A small p-value does not establish practical importance, eliminate bias or prove a mechanism, and a large one does not automatically show that two conditions are equivalent.
What interviewers listen for
- Interpret conditionally on assumptions
- Not probability of hypothesis truth
- Consider effect and design