Skip to main content
Journal cover image

A comparison of knowledge, synthesis, and clinical judgment. Multiple-choice questions in the assessment of physician competence.

Publication ,  Journal Article
Norcini, JJ; Swanson, DB; Grosso, LJ; Shea, JA; Webster, GD
Published in: Eval Health Prof
December 1984

This study compares the reliability, validity, and efficiency of three multiple-choice question (MCQs) ability scales with patient management problems (PMPs). Data are from the 1980, 1981, and 1982 American Board of Internal Medicine Certifying Examinations. The MCQ ability scales were constructed by classifying the one best answer and multiple-true/false questions in each examination as measuring predominantly clinical judgment, synthesis, or knowledge. Clinical judgment items require prioritizing or weighing management decisions; synthesis items require the integration of findings into a diagnostic decision; and knowledge items stress recall of factual information. Analyses indicate that the MCQ ability scales are more reliable and valid per unit of testing time than are PMPs and that clinical judgment and synthesis scales are slightly more correlated with PMPs than is the knowledge scale. Additionally, all MCQ ability scales seem to be measuring the same aspects of competence as PMPs.

Duke Scholars

Published In

Eval Health Prof

DOI

ISSN

0163-2787

Publication Date

December 1984

Volume

7

Issue

4

Start / End Page

485 / 499

Location

United States

Related Subject Headings

  • United States
  • Public Health
  • Internal Medicine
  • Evaluation Studies as Topic
  • Educational Measurement
  • Clinical Competence
  • 4206 Public health
  • 1117 Public Health and Health Services
 

Citation

APA
Chicago
ICMJE
MLA
NLM
Norcini, J. J., Swanson, D. B., Grosso, L. J., Shea, J. A., & Webster, G. D. (1984). A comparison of knowledge, synthesis, and clinical judgment. Multiple-choice questions in the assessment of physician competence. Eval Health Prof, 7(4), 485–499. https://doi.org/10.1177/016327878400700409
Norcini, J. J., D. B. Swanson, L. J. Grosso, J. A. Shea, and G. D. Webster. “A comparison of knowledge, synthesis, and clinical judgment. Multiple-choice questions in the assessment of physician competence.Eval Health Prof 7, no. 4 (December 1984): 485–99. https://doi.org/10.1177/016327878400700409.
Norcini JJ, Swanson DB, Grosso LJ, Shea JA, Webster GD. A comparison of knowledge, synthesis, and clinical judgment. Multiple-choice questions in the assessment of physician competence. Eval Health Prof. 1984 Dec;7(4):485–99.
Norcini, J. J., et al. “A comparison of knowledge, synthesis, and clinical judgment. Multiple-choice questions in the assessment of physician competence.Eval Health Prof, vol. 7, no. 4, Dec. 1984, pp. 485–99. Pubmed, doi:10.1177/016327878400700409.
Norcini JJ, Swanson DB, Grosso LJ, Shea JA, Webster GD. A comparison of knowledge, synthesis, and clinical judgment. Multiple-choice questions in the assessment of physician competence. Eval Health Prof. 1984 Dec;7(4):485–499.
Journal cover image

Published In

Eval Health Prof

DOI

ISSN

0163-2787

Publication Date

December 1984

Volume

7

Issue

4

Start / End Page

485 / 499

Location

United States

Related Subject Headings

  • United States
  • Public Health
  • Internal Medicine
  • Evaluation Studies as Topic
  • Educational Measurement
  • Clinical Competence
  • 4206 Public health
  • 1117 Public Health and Health Services