OBJECTIVE: Multisite and longitudinal neuroimaging studies are important in uncovering trajectories of recovery and neurodegeneration following traumatic brain injury (TBI) and concussion through the use of diffusion tensor imaging (DTI) and other imaging modalities. This study assessed differences in anisotropic diffusion measurement across four scanners using a human and a novel phantom developed in conjunction with the Chronic Effects of Neurotrauma Consortium. METHOD: Human scans provided measurement within biological tissue, and the novel physical phantom provided measures of anisotropic intra-tubular diffusion to serve as a model for intra-axonal water diffusion. Intra- and inter-scanner measurement variances were compared, and the impact on effect size was calculated. RESULTS: Intra-scanner test-retest reliability estimates for fractional anisotropy (FA) demonstrated relative stability over testing intervals. The human tissue and phantom showed similar FA ranges, high linearity and large within-device effect sizes. However, inter-scanner measures of FA indicated substantial differences, some of which exceeded typical DTI effect sizes in mild TBI. CONCLUSION: The diffusion phantom may be used to better elucidate inter-scanner variability in DTI-based measurement and provides an opportunity to better calibrate results obtained from scanners used in multisite and longitudinal studies. Novel solutions are being evaluated to understand and potentially overcome these differences.