Skip to main content

Facilitating Institutional Oversight and Program Improvement Through Educational Competency Committees.

Publication ,  Journal Article
Andolsek, KM; Fortune, RF; Nagler, A; Stancil, C; Kuhn, C; McNeill, D
Published in: J Grad Med Educ
July 2016

BACKGROUND: The Accreditation Council for Graduate Medical Education (ACGME) requires programs to engage annually in program evaluation and improvement. OBJECTIVE: We assessed the value of creating educational competency committees (ECCs) that use successful elements of 2 established processes-institutional special reviews and institutional oversight of annual program evaluations. METHODS: The ECCs used a template to review programs' annual program evaluations. Results were aggregated into an institutional dashboard. We calculated the costs, sensitivity, specificity, and predictive value by comparing programs required to have a special review with those that had ACGME citations, requests for a progress report, or a data-prompted site visit. We assessed the value for professional development through a participant survey. RESULTS: Thirty-two ECCs involving more than 100 individuals reviewed 237 annual program evaluations over a 3-year period. The ECCs required less time than internal reviews. The ECCs rated 2 to 8 programs (2.4%-9.8%) as "noncompliant." One to 13 programs (1.2%-14.6%) had opportunities for improvement identified. Institutional improvements were recognized using the dashboard. Zero to 13 programs (0%-16%) were required to have special reviews. The sensitivity of the decision to have a special review was 83% to 100%; specificity was 89% to 93%; and negative predictive value was 99% to 100%. The total cost was $280 per program. Of the ECC members, 86% to 95% reported their participation enhanced their professional development, and 60% to 95% believed the ECC benefited their program. CONCLUSIONS: Educational competency committees facilitated the identification of institution-wide needs, highlighted innovation and best practices, and enhanced professional development. The cost, sensitivity, specificity, and predictive value indicated good value.

Duke Scholars

Altmetric Attention Stats
Dimensions Citation Stats

Published In

J Grad Med Educ

DOI

EISSN

1949-8357

Publication Date

July 2016

Volume

8

Issue

3

Start / End Page

384 / 389

Location

United States

Related Subject Headings

  • Program Evaluation
  • North Carolina
  • Internship and Residency
  • Hospitals, University
  • Education, Medical, Graduate
  • Accreditation
  • 3901 Curriculum and pedagogy
  • 1302 Curriculum and Pedagogy
 

Citation

APA
Chicago
ICMJE
MLA
NLM
Andolsek, K. M., Fortune, R. F., Nagler, A., Stancil, C., Kuhn, C., & McNeill, D. (2016). Facilitating Institutional Oversight and Program Improvement Through Educational Competency Committees. J Grad Med Educ, 8(3), 384–389. https://doi.org/10.4300/JGME-D-15-00307.1
Andolsek, Kathryn M., Rhea F. Fortune, Alisa Nagler, Chrystal Stancil, Catherine Kuhn, and Diana McNeill. “Facilitating Institutional Oversight and Program Improvement Through Educational Competency Committees.J Grad Med Educ 8, no. 3 (July 2016): 384–89. https://doi.org/10.4300/JGME-D-15-00307.1.
Andolsek KM, Fortune RF, Nagler A, Stancil C, Kuhn C, McNeill D. Facilitating Institutional Oversight and Program Improvement Through Educational Competency Committees. J Grad Med Educ. 2016 Jul;8(3):384–9.
Andolsek, Kathryn M., et al. “Facilitating Institutional Oversight and Program Improvement Through Educational Competency Committees.J Grad Med Educ, vol. 8, no. 3, July 2016, pp. 384–89. Pubmed, doi:10.4300/JGME-D-15-00307.1.
Andolsek KM, Fortune RF, Nagler A, Stancil C, Kuhn C, McNeill D. Facilitating Institutional Oversight and Program Improvement Through Educational Competency Committees. J Grad Med Educ. 2016 Jul;8(3):384–389.

Published In

J Grad Med Educ

DOI

EISSN

1949-8357

Publication Date

July 2016

Volume

8

Issue

3

Start / End Page

384 / 389

Location

United States

Related Subject Headings

  • Program Evaluation
  • North Carolina
  • Internship and Residency
  • Hospitals, University
  • Education, Medical, Graduate
  • Accreditation
  • 3901 Curriculum and pedagogy
  • 1302 Curriculum and Pedagogy