Skip to main content

Validity of Level of Supervision Scales for Assessing Pediatric Fellows on the Common Pediatric Subspecialty Entrustable Professional Activities.

Publication ,  Journal Article
Mink, RB; Schwartz, A; Herman, BE; Turner, DA; Curran, ML; Myers, A; Hsu, DC; Kesselheim, JC; Carraccio, CL ...
Published in: Acad Med
February 2018

PURPOSE: Entrustable professional activities (EPAs) represent the routine and essential activities that physicians perform in practice. Although some level of supervision scales have been proposed, they have not been validated. In this study, the investigators created level of supervision scales for EPAs common to the pediatric subspecialties and then examined their validity in a study conducted by the Subspecialty Pediatrics Investigator Network (SPIN). METHOD: SPIN Steering Committee members used a modified Delphi process to develop unique scales for six of the seven common EPAs. The investigators sought validity evidence in a multisubspecialty study in which pediatric fellowship program directors and Clinical Competency Committees used the scales to evaluate fellows in fall 2014 and spring 2015. RESULTS: Separate scales for the six EPAs, each with five levels of progressive entrustment, were created. In both fall and spring, more than 300 fellows in each year of training from over 200 programs were assessed. In both periods and for each EPA, there was a progressive increase in entrustment levels, with second-year fellows rated higher than first-year fellows (P < .001) and third-year fellows rated higher than second-year fellows (P < .001). For each EPA, spring ratings were higher (P < .001) than those in the fall. Interrater reliability was high (Janson and Olsson's iota = 0.73). CONCLUSIONS: The supervision scales developed for these six common pediatric subspecialty EPAs demonstrated strong validity evidence for use in EPA-based assessment of pediatric fellows. They may also inform the development of scales in other specialties.

Duke Scholars

Altmetric Attention Stats
Dimensions Citation Stats

Published In

Acad Med

DOI

EISSN

1938-808X

Publication Date

February 2018

Volume

93

Issue

2

Start / End Page

283 / 291

Location

United States

Related Subject Headings

  • Reproducibility of Results
  • Professional Competence
  • Pediatrics
  • Humans
  • General & Internal Medicine
  • Fellowships and Scholarships
  • Education, Medical, Graduate
  • Delphi Technique
  • Clinical Competence
  • 4203 Health services and systems
 

Citation

APA
Chicago
ICMJE
MLA
NLM
Mink, R. B., Schwartz, A., Herman, B. E., Turner, D. A., Curran, M. L., Myers, A., … Steering Committee of the Subspecialty Pediatrics Investigator Network (SPIN), . (2018). Validity of Level of Supervision Scales for Assessing Pediatric Fellows on the Common Pediatric Subspecialty Entrustable Professional Activities. Acad Med, 93(2), 283–291. https://doi.org/10.1097/ACM.0000000000001820
Mink, Richard B., Alan Schwartz, Bruce E. Herman, David A. Turner, Megan L. Curran, Angela Myers, Deborah C. Hsu, Jennifer C. Kesselheim, Carol L. Carraccio, and Carol L. Steering Committee of the Subspecialty Pediatrics Investigator Network (SPIN). “Validity of Level of Supervision Scales for Assessing Pediatric Fellows on the Common Pediatric Subspecialty Entrustable Professional Activities.Acad Med 93, no. 2 (February 2018): 283–91. https://doi.org/10.1097/ACM.0000000000001820.
Mink RB, Schwartz A, Herman BE, Turner DA, Curran ML, Myers A, et al. Validity of Level of Supervision Scales for Assessing Pediatric Fellows on the Common Pediatric Subspecialty Entrustable Professional Activities. Acad Med. 2018 Feb;93(2):283–91.
Mink, Richard B., et al. “Validity of Level of Supervision Scales for Assessing Pediatric Fellows on the Common Pediatric Subspecialty Entrustable Professional Activities.Acad Med, vol. 93, no. 2, Feb. 2018, pp. 283–91. Pubmed, doi:10.1097/ACM.0000000000001820.
Mink RB, Schwartz A, Herman BE, Turner DA, Curran ML, Myers A, Hsu DC, Kesselheim JC, Carraccio CL, Steering Committee of the Subspecialty Pediatrics Investigator Network (SPIN). Validity of Level of Supervision Scales for Assessing Pediatric Fellows on the Common Pediatric Subspecialty Entrustable Professional Activities. Acad Med. 2018 Feb;93(2):283–291.

Published In

Acad Med

DOI

EISSN

1938-808X

Publication Date

February 2018

Volume

93

Issue

2

Start / End Page

283 / 291

Location

United States

Related Subject Headings

  • Reproducibility of Results
  • Professional Competence
  • Pediatrics
  • Humans
  • General & Internal Medicine
  • Fellowships and Scholarships
  • Education, Medical, Graduate
  • Delphi Technique
  • Clinical Competence
  • 4203 Health services and systems