Skip to main content
Journal cover image

Comparing ability and norm-referenced scores as clinical trial outcomes for neurodevelopmental disabilities: a simulation study.

Publication ,  Journal Article
Farmer, C; Thurm, A; Troy, JD; Kaat, AJ
Published in: J Neurodev Disord
January 17, 2023

BACKGROUND: For genetic conditions associated with neurodevelopmental disorder (GCAND), developmental domains such as motor ability, thinking and learning, social abilities, and communication are potential intervention targets. Performance on measures of developmental concepts can be expressed using several types of scores. Norm-referenced scores are intended for the diagnostic context, allowing for the identification of impairment relative to age-based expectations, and can exhibit dramatic floor effects when used in individuals with more significant limitations. Person ability scores, which are derived via Rasch analysis or item response theory, are available on many standardized tests and are intended to measure within-person change. However, they have not been used or evaluated as primary endpoints in GCAND clinical trials. In this study, we simulated a series of parallel-arm clinical trials under several chronological age and impairment conditions, to compare empirically the power and type I error rate of operationalizing test performance using ability scores rather than norm-referenced scores. RESULTS: Using the Vineland Adaptive Behavior Scales as the example, we demonstrated an advantage in statistical power of ability scores over norm-referenced scores at extreme levels of impairment. This advantage was at least partially driven by floor effects in norm-referenced scores. For simulated conditions where impairment was less severe, ability scores outperformed norm-referenced scores, but they were more similar. The type I error rate closely approximated the nominal type I error rate of 5% for both scores. CONCLUSION: The results of this simulation demonstrate a substantial power and interpretative advantage of ability scores over norm-referenced scores for studies of GCAND that will enroll participants with high levels of impairment. These results are expected to generalize to studies of developmental concepts, regardless of the etiology or specific test. However, the relative advantage of ability scores is expected to be even greater for tests with a higher floor than the Vineland.

Duke Scholars

Altmetric Attention Stats
Dimensions Citation Stats

Published In

J Neurodev Disord

DOI

EISSN

1866-1955

Publication Date

January 17, 2023

Volume

15

Issue

1

Start / End Page

4

Location

England

Related Subject Headings

  • Patient Simulation
  • Neurodevelopmental Disorders
  • Learning
  • Humans
  • Communication
  • 3209 Neurosciences
  • 1701 Psychology
  • 1109 Neurosciences
 

Citation

APA
Chicago
ICMJE
MLA
NLM
Farmer, C., Thurm, A., Troy, J. D., & Kaat, A. J. (2023). Comparing ability and norm-referenced scores as clinical trial outcomes for neurodevelopmental disabilities: a simulation study. J Neurodev Disord, 15(1), 4. https://doi.org/10.1186/s11689-022-09474-6
Farmer, Cristan, Audrey Thurm, Jesse D. Troy, and Aaron J. Kaat. “Comparing ability and norm-referenced scores as clinical trial outcomes for neurodevelopmental disabilities: a simulation study.J Neurodev Disord 15, no. 1 (January 17, 2023): 4. https://doi.org/10.1186/s11689-022-09474-6.
Farmer, Cristan, et al. “Comparing ability and norm-referenced scores as clinical trial outcomes for neurodevelopmental disabilities: a simulation study.J Neurodev Disord, vol. 15, no. 1, Jan. 2023, p. 4. Pubmed, doi:10.1186/s11689-022-09474-6.
Journal cover image

Published In

J Neurodev Disord

DOI

EISSN

1866-1955

Publication Date

January 17, 2023

Volume

15

Issue

1

Start / End Page

4

Location

England

Related Subject Headings

  • Patient Simulation
  • Neurodevelopmental Disorders
  • Learning
  • Humans
  • Communication
  • 3209 Neurosciences
  • 1701 Psychology
  • 1109 Neurosciences