Evaluation criteria for human-automation performance metrics
Publication
, Conference
Donmez, B; Pina, PE; Cummings, ML
Published in: Performance Metrics for Intelligent Systems (PerMIS) Workshop
December 1, 2008
Previous research has identified broad metric classes for human-automation performance to facilitate metric selection, as well as understanding and comparison of research results. However, there is still lack of an objective method for selecting the most efficient set of metrics. This research identifies and presents a list of evaluation criteria that can help determine the quality of a metric in terms of experimental constraints, comprehensive understanding, construct validity, statistical efficiency, and measurement technique efficiency. Future research will build on these evaluation criteria and existing generic metric classes to develop a cost-benefit analysis approach that can be used for metric selection. © 2010 ACM.
Duke Scholars
Published In
Performance Metrics for Intelligent Systems (PerMIS) Workshop
DOI
ISBN
9781605582931
Publication Date
December 1, 2008
Start / End Page
77 / 82
Citation
APA
Chicago
ICMJE
MLA
NLM
Donmez, B., Pina, P. E., & Cummings, M. L. (2008). Evaluation criteria for human-automation performance metrics. In Performance Metrics for Intelligent Systems (PerMIS) Workshop (pp. 77–82). https://doi.org/10.1145/1774674.1774687
Donmez, B., P. E. Pina, and M. L. Cummings. “Evaluation criteria for human-automation performance metrics.” In Performance Metrics for Intelligent Systems (PerMIS) Workshop, 77–82, 2008. https://doi.org/10.1145/1774674.1774687.
Donmez B, Pina PE, Cummings ML. Evaluation criteria for human-automation performance metrics. In: Performance Metrics for Intelligent Systems (PerMIS) Workshop. 2008. p. 77–82.
Donmez, B., et al. “Evaluation criteria for human-automation performance metrics.” Performance Metrics for Intelligent Systems (PerMIS) Workshop, 2008, pp. 77–82. Scopus, doi:10.1145/1774674.1774687.
Donmez B, Pina PE, Cummings ML. Evaluation criteria for human-automation performance metrics. Performance Metrics for Intelligent Systems (PerMIS) Workshop. 2008. p. 77–82.
Published In
Performance Metrics for Intelligent Systems (PerMIS) Workshop
DOI
ISBN
9781605582931
Publication Date
December 1, 2008
Start / End Page
77 / 82