The Internal Validity of Discrete Choice Experiment Data: A Testing Tool for Quantitative Assessments.
OBJECTIVES: To develop a tool for testing internal validity of discrete choice experiment (DCE) data, deploy the program, and collect summary test results from a sample of active health researchers to demonstrate the practical utility of the tool in a wide range of health applications. METHODS: A previously developed Gauss program had been in use for testing internal validity. The program was translated to MATLAB and adapted, compiled, and deployed. Sixty-seven authors who had coauthored one or more published DCE studies between 2013 and 2016 were contacted by email; provided access to the tool, instructions, and an example data file; and invited to submit test summaries for tabulation. RESULTS: Twenty-one researchers from 10 countries contributed test results from a total of 55 DCE data sets. Fifty-one studies included at least two out of a possible six tests. Attribute dominance was the most common test, and stability had the highest failure incidence. Only three summaries included a transitivity test, and no failures were detected. CONCLUSIONS: It was possible to evaluate multiple internal validity checks for most data sets even when the experimental design did not explicitly include tests. Nevertheless, internal validity is rarely reported. Free availability of the tool for testing data quality could improve both reporting and more careful design of DCE studies to help validate and interpret stated preference data.
Duke Scholars
Altmetric Attention Stats
Dimensions Citation Stats
Published In
DOI
EISSN
Publication Date
Volume
Issue
Start / End Page
Location
Related Subject Headings
- Reproducibility of Results
- Patient Preference
- Internationality
- Humans
- Health Policy & Services
- Data Collection
- Choice Behavior
- 4407 Policy and administration
- 4203 Health services and systems
- 3801 Applied economics
Citation
Published In
DOI
EISSN
Publication Date
Volume
Issue
Start / End Page
Location
Related Subject Headings
- Reproducibility of Results
- Patient Preference
- Internationality
- Humans
- Health Policy & Services
- Data Collection
- Choice Behavior
- 4407 Policy and administration
- 4203 Health services and systems
- 3801 Applied economics