Reproducibility in the Social Sciences

Journal Article (Review)

Concern over social scientists’ inability to reproduce empirical research has spawned a vast and rapidly growing literature. The size and growth of this literature make it difficult for newly interested academics to come up to speed. Here, we provide a formal text modeling approach to characterize the entirety of the field, which allows us to summarize the breadth of this literature and identify core themes. We construct and analyze text networks built from 1,947 articles to reveal differences across social science disciplines within the body of reproducibility publications and to discuss the diversity of subtopics addressed in the literature. This field-wide view suggests that reproducibility is a heterogeneous problem with multiple sources for errors and strategies for solutions, a finding that is somewhat at odds with calls for largely passive remedies reliant on open science. We propose an alternative rigor and reproducibility model that takes an active approach to rigor prior to publication, which may overcome some of the shortfalls of the postpublication model.

Full Text

Duke Authors

Cited Authors

  • Moody, JW; Keister, LA; Ramos, MC

Published Date

  • January 1, 2022

Published In

Volume / Issue

  • 48 /

International Standard Serial Number (ISSN)

  • 0360-0572

Digital Object Identifier (DOI)

  • 10.1146/annurev-soc-090221-035954

Citation Source

  • Scopus