Skip to main content

Three recommendations based on a comparison of the reliability and validity of the predominant models used in research on the empirical structure of psychopathology.

Publication ,  Journal Article
Forbes, MK; Greene, AL; Levin-Aspenson, HF; Watts, AL; Hallquist, M; Lahey, BB; Markon, KE; Patrick, CJ; Tackett, JL; Waldman, ID; Wright, AGC ...
Published in: Journal of abnormal psychology
April 2021

The present study compared the primary models used in research on the structure of psychopathology (i.e., correlated factor, higher-order, and bifactor models) in terms of structural validity (model fit and factor reliability), longitudinal measurement invariance, concurrent and prospective predictive validity in relation to important outcomes, and longitudinal consistency in individuals' factor score profiles. Two simpler operationalizations of a general factor of psychopathology were also examined-a single-factor model and a count of diagnoses. Models were estimated based on structured clinical interview diagnoses in two longitudinal waves of nationally representative data from the United States (n = 43,093 and n = 34,653). Models that included narrower factors (fear, distress, and externalizing) were needed to capture the observed multidimensionality of the data. In the correlated factor and higher-order models these narrower factors were reliable, largely invariant over time, had consistent associations with indicators of adaptive functioning, and had moderate stability within individuals over time. By contrast, the fear- and distress-specific factors in the bifactor model did not show good reliability or validity throughout the analyses. Notably, the general factor of psychopathology (p factor) performed similarly well across tests of reliability and validity regardless of whether the higher-order or bifactor model was used; the simplest (single factor) model was also comparable across most tests, with the exception of model fit. Given the limitations of categorical diagnoses, it will be important to repeat these analyses using dimensional measures. We conclude that when aiming to understand the structure and correlates of psychopathology it is important to (a) look beyond model fit indices to choose between different models, (b) examine the reliability of latent variables directly, and (c) be cautious when isolating and interpreting the unique effects of specific psychopathology factors, regardless of which model is used. (PsycInfo Database Record (c) 2021 APA, all rights reserved).

Duke Scholars

Altmetric Attention Stats
Dimensions Citation Stats

Published In

Journal of abnormal psychology

DOI

EISSN

1939-1846

ISSN

0021-843X

Publication Date

April 2021

Volume

130

Issue

3

Start / End Page

297 / 317

Related Subject Headings

  • Research
  • Reproducibility of Results
  • Prospective Studies
  • Models, Psychological
  • Mental Disorders
  • Male
  • Humans
  • Female
  • Fear
  • Factor Analysis, Statistical
 

Citation

APA
Chicago
ICMJE
MLA
NLM
Forbes, M. K., Greene, A. L., Levin-Aspenson, H. F., Watts, A. L., Hallquist, M., Lahey, B. B., … Krueger, R. F. (2021). Three recommendations based on a comparison of the reliability and validity of the predominant models used in research on the empirical structure of psychopathology. Journal of Abnormal Psychology, 130(3), 297–317. https://doi.org/10.1037/abn0000533
Forbes, Miriam K., Ashley L. Greene, Holly F. Levin-Aspenson, Ashley L. Watts, Michael Hallquist, Benjamin B. Lahey, Kristian E. Markon, et al. “Three recommendations based on a comparison of the reliability and validity of the predominant models used in research on the empirical structure of psychopathology.Journal of Abnormal Psychology 130, no. 3 (April 2021): 297–317. https://doi.org/10.1037/abn0000533.
Forbes MK, Greene AL, Levin-Aspenson HF, Watts AL, Hallquist M, Lahey BB, et al. Three recommendations based on a comparison of the reliability and validity of the predominant models used in research on the empirical structure of psychopathology. Journal of abnormal psychology. 2021 Apr;130(3):297–317.
Forbes, Miriam K., et al. “Three recommendations based on a comparison of the reliability and validity of the predominant models used in research on the empirical structure of psychopathology.Journal of Abnormal Psychology, vol. 130, no. 3, Apr. 2021, pp. 297–317. Epmc, doi:10.1037/abn0000533.
Forbes MK, Greene AL, Levin-Aspenson HF, Watts AL, Hallquist M, Lahey BB, Markon KE, Patrick CJ, Tackett JL, Waldman ID, Wright AGC, Caspi A, Ivanova M, Kotov R, Samuel DB, Eaton NR, Krueger RF. Three recommendations based on a comparison of the reliability and validity of the predominant models used in research on the empirical structure of psychopathology. Journal of abnormal psychology. 2021 Apr;130(3):297–317.

Published In

Journal of abnormal psychology

DOI

EISSN

1939-1846

ISSN

0021-843X

Publication Date

April 2021

Volume

130

Issue

3

Start / End Page

297 / 317

Related Subject Headings

  • Research
  • Reproducibility of Results
  • Prospective Studies
  • Models, Psychological
  • Mental Disorders
  • Male
  • Humans
  • Female
  • Fear
  • Factor Analysis, Statistical