Skip to main content
construction release_alert
Scholars@Duke will be undergoing maintenance April 11-15. Some features may be unavailable during this time.
cancel

What is the test-retest reliability of common task-fMRI measures? New empirical evidence and a meta-analysis

Publication ,  Journal Article
Elliott, M; Knodt, A; Ireland, D; Morris, M; Poulton, R; Ramrakha, S; Sison, M; Moffitt, T; Caspi, A; Hariri, A
2019

Identifying brain biomarkers of disease risk is a growing priority in neuroscience. The ability to identify meaningful biomarkers is limited by measurement reliability; unreliable measures are unsuitable for predicting clinical outcomes. Measuring brain activity using task-fMRI is a major focus of biomarker development; however, the reliability of task-fMRI has not been systematically evaluated. We present converging evidence demonstrating poor reliability of task-fMRI measures. First, a meta-analysis of 90 experiments (N=1,008) revealed poor overall reliability (mean ICC=.397). Second, the test-retest reliabilities of activity in a priori regions of interest across 11 common fMRI tasks collected in the context of the Human Connectome Project (N=45) and the Dunedin Study (N=20) were poor (ICCs=.067-.485). Collectively, these findings demonstrate that common task-fMRI measures are not currently suitable for brain biomarker discovery or individual differences research. We review how this state of affairs came to be and highlight avenues for improving task-fMRI reliability.

Duke Scholars

Altmetric Attention Stats
Dimensions Citation Stats

DOI

Publication Date

2019

Related Subject Headings

  • Psychiatry
  • 52 Psychology
  • 32 Biomedical and clinical sciences
  • 31 Biological sciences
  • 17 Psychology and Cognitive Sciences
  • 11 Medical and Health Sciences
  • 06 Biological Sciences
 

Citation

APA
Chicago
ICMJE
MLA
NLM
Elliott, M., Knodt, A., Ireland, D., Morris, M., Poulton, R., Ramrakha, S., … Hariri, A. (2019). What is the test-retest reliability of common task-fMRI measures? New empirical evidence and a meta-analysis. https://doi.org/10.1101/681700
Elliott, Maxwell, Annchen Knodt, David Ireland, Meriwether Morris, Richie Poulton, Sandhya Ramrakha, Maria Sison, Terrie Moffitt, Avshalom Caspi, and Ahmad Hariri. “What is the test-retest reliability of common task-fMRI measures? New empirical evidence and a meta-analysis,” 2019. https://doi.org/10.1101/681700.
Elliott M, Knodt A, Ireland D, Morris M, Poulton R, Ramrakha S, et al. What is the test-retest reliability of common task-fMRI measures? New empirical evidence and a meta-analysis. 2019;
Elliott M, Knodt A, Ireland D, Morris M, Poulton R, Ramrakha S, Sison M, Moffitt T, Caspi A, Hariri A. What is the test-retest reliability of common task-fMRI measures? New empirical evidence and a meta-analysis. 2019;

DOI

Publication Date

2019

Related Subject Headings

  • Psychiatry
  • 52 Psychology
  • 32 Biomedical and clinical sciences
  • 31 Biological sciences
  • 17 Psychology and Cognitive Sciences
  • 11 Medical and Health Sciences
  • 06 Biological Sciences