Skip to main content

Effect of case selection on the performance of computer-aided detection schemes.

Publication ,  Journal Article
Nishikawa, RM; Giger, ML; Doi, K; Metz, CE; Yin, FF; Vyborny, CJ; Schmidt, RA
Published in: Med Phys
February 1994

The choice of clinical cases used to train and test a computer-aided diagnosis (CAD) scheme can affect the test results (i.e., error rate). In this study, we deliberately modified the components of our testing database to study the effects of this modification on measured performance. Using a computerized scheme for the automated detection of breast masses from mammograms, it was found that the sensitivity of the scheme ranged between 26% and 100% (at a false positive rate of 1.0 per image) depending on the cases used to test the scheme. Even a 20% change in the cases comprising the database can reduce the measured sensitivity by 15%-25%. Because of the strong dependence of measured performance on the testing database, it is difficult to estimate reliably the accuracy of a CAD scheme. Furthermore, it is questionable to compare different CAD schemes when different cases are used for testing. Sharing databases, creating a common database, or using a quantitative measure to characterize databases are possible solutions to this problem. However, none of these solutions exists or is practiced at present. Therefore, as a short-term solution, it is recommended that the method used for selecting cases, and histograms or mean and standard deviations of relevant image features be reported whenever performance data are presented.

Duke Scholars

Altmetric Attention Stats
Dimensions Citation Stats

Published In

Med Phys

DOI

ISSN

0094-2405

Publication Date

February 1994

Volume

21

Issue

2

Start / End Page

265 / 269

Location

United States

Related Subject Headings

  • Nuclear Medicine & Medical Imaging
  • Mammography
  • Humans
  • Female
  • Diagnosis, Computer-Assisted
  • Case-Control Studies
  • Breast Neoplasms
  • 5105 Medical and biological physics
  • 4003 Biomedical engineering
  • 1112 Oncology and Carcinogenesis
 

Citation

APA
Chicago
ICMJE
MLA
NLM
Nishikawa, R. M., Giger, M. L., Doi, K., Metz, C. E., Yin, F. F., Vyborny, C. J., & Schmidt, R. A. (1994). Effect of case selection on the performance of computer-aided detection schemes. Med Phys, 21(2), 265–269. https://doi.org/10.1118/1.597287
Nishikawa, R. M., M. L. Giger, K. Doi, C. E. Metz, F. F. Yin, C. J. Vyborny, and R. A. Schmidt. “Effect of case selection on the performance of computer-aided detection schemes.Med Phys 21, no. 2 (February 1994): 265–69. https://doi.org/10.1118/1.597287.
Nishikawa RM, Giger ML, Doi K, Metz CE, Yin FF, Vyborny CJ, et al. Effect of case selection on the performance of computer-aided detection schemes. Med Phys. 1994 Feb;21(2):265–9.
Nishikawa, R. M., et al. “Effect of case selection on the performance of computer-aided detection schemes.Med Phys, vol. 21, no. 2, Feb. 1994, pp. 265–69. Pubmed, doi:10.1118/1.597287.
Nishikawa RM, Giger ML, Doi K, Metz CE, Yin FF, Vyborny CJ, Schmidt RA. Effect of case selection on the performance of computer-aided detection schemes. Med Phys. 1994 Feb;21(2):265–269.

Published In

Med Phys

DOI

ISSN

0094-2405

Publication Date

February 1994

Volume

21

Issue

2

Start / End Page

265 / 269

Location

United States

Related Subject Headings

  • Nuclear Medicine & Medical Imaging
  • Mammography
  • Humans
  • Female
  • Diagnosis, Computer-Assisted
  • Case-Control Studies
  • Breast Neoplasms
  • 5105 Medical and biological physics
  • 4003 Biomedical engineering
  • 1112 Oncology and Carcinogenesis