Skip to main content
construction release_alert
Scholars@Duke will be undergoing maintenance April 11-15. Some features may be unavailable during this time.
cancel
Journal cover image

What Is the Test-Retest Reliability of Common Task-Functional MRI Measures? New Empirical Evidence and a Meta-Analysis.

Publication ,  Journal Article
Elliott, ML; Knodt, AR; Ireland, D; Morris, ML; Poulton, R; Ramrakha, S; Sison, ML; Moffitt, TE; Caspi, A; Hariri, AR
Published in: Psychological science
July 2020

Identifying brain biomarkers of disease risk is a growing priority in neuroscience. The ability to identify meaningful biomarkers is limited by measurement reliability; unreliable measures are unsuitable for predicting clinical outcomes. Measuring brain activity using task functional MRI (fMRI) is a major focus of biomarker development; however, the reliability of task fMRI has not been systematically evaluated. We present converging evidence demonstrating poor reliability of task-fMRI measures. First, a meta-analysis of 90 experiments (N = 1,008) revealed poor overall reliability-mean intraclass correlation coefficient (ICC) = .397. Second, the test-retest reliabilities of activity in a priori regions of interest across 11 common fMRI tasks collected by the Human Connectome Project (N = 45) and the Dunedin Study (N = 20) were poor (ICCs = .067-.485). Collectively, these findings demonstrate that common task-fMRI measures are not currently suitable for brain biomarker discovery or for individual-differences research. We review how this state of affairs came to be and highlight avenues for improving task-fMRI reliability.

Duke Scholars

Altmetric Attention Stats
Dimensions Citation Stats

Published In

Psychological science

DOI

EISSN

1467-9280

ISSN

0956-7976

Publication Date

July 2020

Volume

31

Issue

7

Start / End Page

792 / 806

Related Subject Headings

  • Reproducibility of Results
  • Magnetic Resonance Imaging
  • Individuality
  • Humans
  • Experimental Psychology
  • Connectome
  • Cognition
  • Brain
  • 52 Psychology
  • 1702 Cognitive Sciences
 

Citation

APA
Chicago
ICMJE
MLA
NLM
Elliott, M. L., Knodt, A. R., Ireland, D., Morris, M. L., Poulton, R., Ramrakha, S., … Hariri, A. R. (2020). What Is the Test-Retest Reliability of Common Task-Functional MRI Measures? New Empirical Evidence and a Meta-Analysis. Psychological Science, 31(7), 792–806. https://doi.org/10.1177/0956797620916786
Elliott, Maxwell L., Annchen R. Knodt, David Ireland, Meriwether L. Morris, Richie Poulton, Sandhya Ramrakha, Maria L. Sison, Terrie E. Moffitt, Avshalom Caspi, and Ahmad R. Hariri. “What Is the Test-Retest Reliability of Common Task-Functional MRI Measures? New Empirical Evidence and a Meta-Analysis.Psychological Science 31, no. 7 (July 2020): 792–806. https://doi.org/10.1177/0956797620916786.
Elliott ML, Knodt AR, Ireland D, Morris ML, Poulton R, Ramrakha S, et al. What Is the Test-Retest Reliability of Common Task-Functional MRI Measures? New Empirical Evidence and a Meta-Analysis. Psychological science. 2020 Jul;31(7):792–806.
Elliott, Maxwell L., et al. “What Is the Test-Retest Reliability of Common Task-Functional MRI Measures? New Empirical Evidence and a Meta-Analysis.Psychological Science, vol. 31, no. 7, July 2020, pp. 792–806. Epmc, doi:10.1177/0956797620916786.
Elliott ML, Knodt AR, Ireland D, Morris ML, Poulton R, Ramrakha S, Sison ML, Moffitt TE, Caspi A, Hariri AR. What Is the Test-Retest Reliability of Common Task-Functional MRI Measures? New Empirical Evidence and a Meta-Analysis. Psychological science. 2020 Jul;31(7):792–806.
Journal cover image

Published In

Psychological science

DOI

EISSN

1467-9280

ISSN

0956-7976

Publication Date

July 2020

Volume

31

Issue

7

Start / End Page

792 / 806

Related Subject Headings

  • Reproducibility of Results
  • Magnetic Resonance Imaging
  • Individuality
  • Humans
  • Experimental Psychology
  • Connectome
  • Cognition
  • Brain
  • 52 Psychology
  • 1702 Cognitive Sciences