Skip to interview prep
Apexed

21. What does a p-value tell you, and what does it not tell you?

EasyStatistics & inference

Technical
Show model answer

Under a specified statistical model, it describes how unusual the observed result or more extreme results would be under the tested null assumptions. It is not the probability that the hypothesis is true.

Interpret it with the design, effect estimate, uncertainty and assumptions. A small p-value does not establish practical importance, eliminate bias or prove a mechanism, and a large one does not automatically show that two conditions are equivalent.

What interviewers listen for

  • Interpret conditionally on assumptions
  • Not probability of hypothesis truth
  • Consider effect and design
What does a p-value tell you, and what does it not tell you — Science & research interview question — Apexed