Skip to main content

Reproducibility in the Social Sciences.

Publication ,  Journal Article
Moody, JW; Keister, LA; Ramos, MC
Published in: Annual review of sociology
July 2022

Concern over social scientists' inability to reproduce empirical research has spawned a vast and rapidly growing literature. The size and growth of this literature make it difficult for newly interested academics to come up to speed. Here, we provide a formal text modeling approach to characterize the entirety of the field, which allows us to summarize the breadth of this literature and identify core themes. We construct and analyze text networks built from 1,947 articles to reveal differences across social science disciplines within the body of reproducibility publications and to discuss the diversity of subtopics addressed in the literature. This field-wide view suggests that reproducibility is a heterogeneous problem with multiple sources for errors and strategies for solutions, a finding that is somewhat at odds with calls for largely passive remedies reliant on open science. We propose an alternative rigor and reproducibility model that takes an active approach to rigor prior to publication, which may overcome some of the shortfalls of the postpublication model.

Duke Scholars

Altmetric Attention Stats
Dimensions Citation Stats

Published In

Annual review of sociology

DOI

ISSN

0360-0572

Publication Date

July 2022

Volume

48

Issue

1

Start / End Page

65 / 85

Related Subject Headings

  • Sociology
  • 4410 Sociology
  • 1608 Sociology
  • 1505 Marketing
 

Citation

APA
Chicago
ICMJE
MLA
NLM
Moody, J. W., Keister, L. A., & Ramos, M. C. (2022). Reproducibility in the Social Sciences. Annual Review of Sociology, 48(1), 65–85. https://doi.org/10.1146/annurev-soc-090221-035954
Moody, James W., Lisa A. Keister, and Maria C. Ramos. “Reproducibility in the Social Sciences.Annual Review of Sociology 48, no. 1 (July 2022): 65–85. https://doi.org/10.1146/annurev-soc-090221-035954.
Moody JW, Keister LA, Ramos MC. Reproducibility in the Social Sciences. Annual review of sociology. 2022 Jul;48(1):65–85.
Moody, James W., et al. “Reproducibility in the Social Sciences.Annual Review of Sociology, vol. 48, no. 1, July 2022, pp. 65–85. Epmc, doi:10.1146/annurev-soc-090221-035954.
Moody JW, Keister LA, Ramos MC. Reproducibility in the Social Sciences. Annual review of sociology. 2022 Jul;48(1):65–85.

Published In

Annual review of sociology

DOI

ISSN

0360-0572

Publication Date

July 2022

Volume

48

Issue

1

Start / End Page

65 / 85

Related Subject Headings

  • Sociology
  • 4410 Sociology
  • 1608 Sociology
  • 1505 Marketing