Skip to main content
Journal cover image

Rethinking observed power: Concept, practice and implications.

Publication ,  Journal Article
Sun, S; Pan, W; Wang, L
Published in: Methodology: European Journal of Research Methods for the Behavioral and Social Sciences
January 2011

Observed power analysis is recommended by many scholarly journal editors and reviewers, especially for studies with statistically nonsignificant test results. However, researchers may not fully realize that blind observance of this recommendation could lead to an unfruitful effort, despite the repeated warnings from methodologists. Through both a review of 14 published empirical studies and a Monte Carlo simulation study, the present study demonstrates that observed power is usually not as informative or helpful as we think because (a) observed power for a nonsignificant test is generally low and, therefore, does not provide additional information to the test; and (b) a low observed power does not always indicate that the test is underpowered. Implications and suggestions of statistical power analysis for quantitative researchers are discussed.

Duke Scholars

Altmetric Attention Stats
Dimensions Citation Stats

Published In

Methodology: European Journal of Research Methods for the Behavioral and Social Sciences

DOI

ISSN

1614-1881

Publication Date

January 2011

Volume

7

Issue

3

Start / End Page

81 / 87

Related Subject Headings

  • Social Sciences Methods
 

Citation

APA
Chicago
ICMJE
MLA
NLM
Sun, S., Pan, W., & Wang, L. (2011). Rethinking observed power: Concept, practice and implications. Methodology: European Journal of Research Methods for the Behavioral and Social Sciences, 7(3), 81–87. https://doi.org/10.1027/1614-2241/a000025
Sun, S., W. Pan, and L. Wang. “Rethinking observed power: Concept, practice and implications.Methodology: European Journal of Research Methods for the Behavioral and Social Sciences 7, no. 3 (January 2011): 81–87. https://doi.org/10.1027/1614-2241/a000025.
Sun S, Pan W, Wang L. Rethinking observed power: Concept, practice and implications. Methodology: European Journal of Research Methods for the Behavioral and Social Sciences. 2011 Jan;7(3):81–7.
Sun, S., et al. “Rethinking observed power: Concept, practice and implications.Methodology: European Journal of Research Methods for the Behavioral and Social Sciences, vol. 7, no. 3, Jan. 2011, pp. 81–87. Manual, doi:10.1027/1614-2241/a000025.
Sun S, Pan W, Wang L. Rethinking observed power: Concept, practice and implications. Methodology: European Journal of Research Methods for the Behavioral and Social Sciences. 2011 Jan;7(3):81–87.
Journal cover image

Published In

Methodology: European Journal of Research Methods for the Behavioral and Social Sciences

DOI

ISSN

1614-1881

Publication Date

January 2011

Volume

7

Issue

3

Start / End Page

81 / 87

Related Subject Headings

  • Social Sciences Methods