Calibration of p values for testing precise null hypotheses

Journal Article (Journal Article)

P values are the most commonly used tool to measure evidence against a hypothesis or hypothesized model. Unfortunately, they are often incorrectly viewed as an error probability for rejection of the hypothesis or, even worse, as the posterior probability that the hypothesis is true. The fact that these interpretations can be completely misleading when testing precise hypotheses is first reviewed, through consideration of two revealing simulations. Then two calibrations of a p value are developed, the first being interpretable as odds and the second as either a (conditional) frequentist error probability or as the posterior probability of the hypothesis.

Full Text

Duke Authors

Cited Authors

  • Sellke, T; Bayarri, MJ; Berger, JO

Published Date

  • February 1, 2001

Published In

Volume / Issue

  • 55 / 1

Start / End Page

  • 62 - 71

International Standard Serial Number (ISSN)

  • 0003-1305

Digital Object Identifier (DOI)

  • 10.1198/000313001300339950

Citation Source

  • Scopus