Skip to main content
Journal cover image

The Internal Validity of Discrete Choice Experiment Data: A Testing Tool for Quantitative Assessments.

Publication ,  Journal Article
Johnson, FR; Yang, J-C; Reed, SD
Published in: Value Health
February 2019

OBJECTIVES: To develop a tool for testing internal validity of discrete choice experiment (DCE) data, deploy the program, and collect summary test results from a sample of active health researchers to demonstrate the practical utility of the tool in a wide range of health applications. METHODS: A previously developed Gauss program had been in use for testing internal validity. The program was translated to MATLAB and adapted, compiled, and deployed. Sixty-seven authors who had coauthored one or more published DCE studies between 2013 and 2016 were contacted by email; provided access to the tool, instructions, and an example data file; and invited to submit test summaries for tabulation. RESULTS: Twenty-one researchers from 10 countries contributed test results from a total of 55 DCE data sets. Fifty-one studies included at least two out of a possible six tests. Attribute dominance was the most common test, and stability had the highest failure incidence. Only three summaries included a transitivity test, and no failures were detected. CONCLUSIONS: It was possible to evaluate multiple internal validity checks for most data sets even when the experimental design did not explicitly include tests. Nevertheless, internal validity is rarely reported. Free availability of the tool for testing data quality could improve both reporting and more careful design of DCE studies to help validate and interpret stated preference data.

Duke Scholars

Altmetric Attention Stats
Dimensions Citation Stats

Published In

Value Health

DOI

EISSN

1524-4733

Publication Date

February 2019

Volume

22

Issue

2

Start / End Page

157 / 160

Location

United States

Related Subject Headings

  • Reproducibility of Results
  • Patient Preference
  • Internationality
  • Humans
  • Health Policy & Services
  • Data Collection
  • Choice Behavior
  • 4407 Policy and administration
  • 4203 Health services and systems
  • 3801 Applied economics
 

Citation

APA
Chicago
ICMJE
MLA
NLM
Johnson, F. R., Yang, J.-C., & Reed, S. D. (2019). The Internal Validity of Discrete Choice Experiment Data: A Testing Tool for Quantitative Assessments. Value Health, 22(2), 157–160. https://doi.org/10.1016/j.jval.2018.07.876
Johnson, F Reed, Jui-Chen Yang, and Shelby D. Reed. “The Internal Validity of Discrete Choice Experiment Data: A Testing Tool for Quantitative Assessments.Value Health 22, no. 2 (February 2019): 157–60. https://doi.org/10.1016/j.jval.2018.07.876.
Johnson FR, Yang J-C, Reed SD. The Internal Validity of Discrete Choice Experiment Data: A Testing Tool for Quantitative Assessments. Value Health. 2019 Feb;22(2):157–60.
Johnson, F. Reed, et al. “The Internal Validity of Discrete Choice Experiment Data: A Testing Tool for Quantitative Assessments.Value Health, vol. 22, no. 2, Feb. 2019, pp. 157–60. Pubmed, doi:10.1016/j.jval.2018.07.876.
Johnson FR, Yang J-C, Reed SD. The Internal Validity of Discrete Choice Experiment Data: A Testing Tool for Quantitative Assessments. Value Health. 2019 Feb;22(2):157–160.
Journal cover image

Published In

Value Health

DOI

EISSN

1524-4733

Publication Date

February 2019

Volume

22

Issue

2

Start / End Page

157 / 160

Location

United States

Related Subject Headings

  • Reproducibility of Results
  • Patient Preference
  • Internationality
  • Humans
  • Health Policy & Services
  • Data Collection
  • Choice Behavior
  • 4407 Policy and administration
  • 4203 Health services and systems
  • 3801 Applied economics