Skip to main content
Journal cover image

Prior test experience confounds longitudinal tracking of adolescent cognitive and motor development.

Publication ,  Journal Article
Sullivan, EV; Thompson, WK; Brumback, T; Prouty, D; Tapert, SF; Brown, SA; De Bellis, MD; Nooner, KB; Baker, FC; Colrain, IM; Clark, DB ...
Published in: BMC Med Res Methodol
June 24, 2022

BACKGROUND: Accurate measurement of trajectories in longitudinal studies, considered the gold standard method for tracking functional growth during adolescence, decline in aging, and change after head injury, is subject to confounding by testing experience. METHODS: We measured change in cognitive and motor abilities over four test sessions (baseline and three annual assessments) in 154 male and 165 female participants (baseline age 12-21 years) from the National Consortium on Alcohol and NeuroDevelopment in Adolescence (NCANDA) study. At each of the four test sessions, these participants were given a test battery using computerized administration and traditional pencil and paper tests that yielded accuracy and speed measures for multiple component cognitive (Abstraction, Attention, Emotion, Episodic memory, Working memory, and General Ability) and motor (Ataxia and Speed) functions. The analysis aim was to dissociate neurodevelopment from testing experience by using an adaptation of the twice-minus-once tested method, which calculated the difference between longitudinal change (comprising developmental plus practice effects) and practice-free initial cross-sectional performance for each consecutive pairs of test sessions. Accordingly, the first set of analyses quantified the effects of learning (i.e., prior test experience) on accuracy and after speed domain scores. Then developmental effects were  determined for each domain for accuracy and speed having removed the measured learning effects. RESULTS: The greatest gains in performance occurred between the first and second sessions, especially in younger participants, regardless of sex, but practice gains continued to accrue thereafter for several functions. For all 8 accuracy composite scores, the developmental effect after accounting for learning was significant across age and was adequately described by linear fits. The learning-adjusted developmental effects for speed were adequately described by linear fits for Abstraction, Emotion, Episodic Memory, General Ability, and Motor scores, although a nonlinear fit was better for Attention, Working Memory, and Average Speed scores. CONCLUSION: Thus, what appeared as accelerated cognitive and motor development was, in most cases, attributable to learning. Recognition of the substantial influence of prior testing experience is critical for accurate characterization of normal development and for developing norms for clinical neuropsychological investigations of conditions affecting the brain.

Duke Scholars

Altmetric Attention Stats
Dimensions Citation Stats

Published In

BMC Med Res Methodol

DOI

EISSN

1471-2288

Publication Date

June 24, 2022

Volume

22

Issue

1

Start / End Page

177

Location

England

Related Subject Headings

  • Young Adult
  • Neuropsychological Tests
  • Male
  • Longitudinal Studies
  • Humans
  • General & Internal Medicine
  • Female
  • Emotions
  • Cross-Sectional Studies
  • Cognition
 

Citation

APA
Chicago
ICMJE
MLA
NLM
Sullivan, E. V., Thompson, W. K., Brumback, T., Prouty, D., Tapert, S. F., Brown, S. A., … Pfefferbaum, A. (2022). Prior test experience confounds longitudinal tracking of adolescent cognitive and motor development. BMC Med Res Methodol, 22(1), 177. https://doi.org/10.1186/s12874-022-01606-9
Sullivan, Edith V., Wesley K. Thompson, Ty Brumback, Devin Prouty, Susan F. Tapert, Sandra A. Brown, Michael D. De Bellis, et al. “Prior test experience confounds longitudinal tracking of adolescent cognitive and motor development.BMC Med Res Methodol 22, no. 1 (June 24, 2022): 177. https://doi.org/10.1186/s12874-022-01606-9.
Sullivan EV, Thompson WK, Brumback T, Prouty D, Tapert SF, Brown SA, et al. Prior test experience confounds longitudinal tracking of adolescent cognitive and motor development. BMC Med Res Methodol. 2022 Jun 24;22(1):177.
Sullivan, Edith V., et al. “Prior test experience confounds longitudinal tracking of adolescent cognitive and motor development.BMC Med Res Methodol, vol. 22, no. 1, June 2022, p. 177. Pubmed, doi:10.1186/s12874-022-01606-9.
Sullivan EV, Thompson WK, Brumback T, Prouty D, Tapert SF, Brown SA, De Bellis MD, Nooner KB, Baker FC, Colrain IM, Clark DB, Nagel BJ, Pohl KM, Pfefferbaum A. Prior test experience confounds longitudinal tracking of adolescent cognitive and motor development. BMC Med Res Methodol. 2022 Jun 24;22(1):177.
Journal cover image

Published In

BMC Med Res Methodol

DOI

EISSN

1471-2288

Publication Date

June 24, 2022

Volume

22

Issue

1

Start / End Page

177

Location

England

Related Subject Headings

  • Young Adult
  • Neuropsychological Tests
  • Male
  • Longitudinal Studies
  • Humans
  • General & Internal Medicine
  • Female
  • Emotions
  • Cross-Sectional Studies
  • Cognition