Multisite reliability of cognitive BOLD data.


Journal Article

Investigators perform multi-site functional magnetic resonance imaging studies to increase statistical power, to enhance generalizability, and to improve the likelihood of sampling relevant subgroups. Yet undesired site variation in imaging methods could off-set these potential advantages. We used variance components analysis to investigate sources of variation in the blood oxygen level-dependent (BOLD) signal across four 3-T magnets in voxelwise and region-of-interest (ROI) analyses. Eighteen participants traveled to four magnet sites to complete eight runs of a working memory task involving emotional or neutral distraction. Person variance was more than 10 times larger than site variance for five of six ROIs studied. Person-by-site interactions, however, contributed sizable unwanted variance to the total. Averaging over runs increased between-site reliability, with many voxels showing good to excellent between-site reliability when eight runs were averaged and regions of interest showing fair to good reliability. Between-site reliability depended on the specific functional contrast analyzed in addition to the number of runs averaged. Although median effect size was correlated with between-site reliability, dissociations were observed for many voxels. Brain regions where the pooled effect size was large but between-site reliability was poor were associated with reduced individual differences. Brain regions where the pooled effect size was small but between-site reliability was excellent were associated with a balance of participants who displayed consistently positive or consistently negative BOLD responses. Although between-site reliability of BOLD data can be good to excellent, acquiring highly reliable data requires robust activation paradigms, ongoing quality assurance, and careful experimental control.

Full Text

Duke Authors

Cited Authors

  • Brown, GG; Mathalon, DH; Stern, H; Ford, J; Mueller, B; Greve, DN; McCarthy, G; Voyvodic, J; Glover, G; Diaz, M; Yetter, E; Ozyurt, IB; Jorgensen, KW; Wible, CG; Turner, JA; Thompson, WK; Potkin, SG; Function Biomedical Informatics Research Network,

Published Date

  • February 1, 2011

Published In

Volume / Issue

  • 54 / 3

Start / End Page

  • 2163 - 2175

PubMed ID

  • 20932915

Pubmed Central ID

  • 20932915

Electronic International Standard Serial Number (EISSN)

  • 1095-9572

Digital Object Identifier (DOI)

  • 10.1016/j.neuroimage.2010.09.076


  • eng

Conference Location

  • United States