Skip to main content
Journal cover image

AI-Generated Graduate Medical Education Content for Total Joint Arthroplasty: Comparing ChatGPT Against Orthopaedic Fellows.

Publication ,  Journal Article
DeCook, R; Muffly, BT; Mahmood, S; Holland, CT; Ayeni, AM; Ast, MP; Bolognese, MP; Guild, GN; Sheth, NP; Pean, CA; Premkumar, A
Published in: Arthroplast Today
June 2024

BACKGROUND: Artificial intelligence (AI) in medicine has primarily focused on diagnosing and treating diseases and assisting in the development of academic scholarly work. This study aimed to evaluate a new use of AI in orthopaedics: content generation for professional medical education. Quality, accuracy, and time were compared between content created by ChatGPT and orthopaedic surgery clinical fellows. METHODS: ChatGPT and 3 orthopaedic adult reconstruction fellows were tasked with creating educational summaries of 5 total joint arthroplasty-related topics. Responses were evaluated across 5 domains by 4 blinded reviewers from different institutions who are all current or former total joint arthroplasty fellowship directors or national arthroplasty board review course directors. RESULTS: ChatGPT created better orthopaedic content than fellows when mean aggregate scores for all 5 topics and domains were compared (P ≤ .001). The only domain in which fellows outperformed ChatGPT was the integration of key points and references (P = .006). ChatGPT outperformed the fellows in response time, averaging 16.6 seconds vs the fellows' 94 minutes per prompt (P = .002). CONCLUSIONS: With its efficient and accurate content generation, the current findings underscore ChatGPT's potential as an adjunctive tool to enhance orthopaedic arthroplasty graduate medical education. Future studies are warranted to explore AI's role further and optimize its utility in augmenting the educational development of arthroplasty trainees.

Duke Scholars

Altmetric Attention Stats
Dimensions Citation Stats

Published In

Arthroplast Today

DOI

ISSN

2352-3441

Publication Date

June 2024

Volume

27

Start / End Page

101412

Location

United States
 

Citation

APA
Chicago
ICMJE
MLA
NLM
DeCook, R., Muffly, B. T., Mahmood, S., Holland, C. T., Ayeni, A. M., Ast, M. P., … Premkumar, A. (2024). AI-Generated Graduate Medical Education Content for Total Joint Arthroplasty: Comparing ChatGPT Against Orthopaedic Fellows. Arthroplast Today, 27, 101412. https://doi.org/10.1016/j.artd.2024.101412
DeCook, Ryan, Brian T. Muffly, Sania Mahmood, Christopher T. Holland, Ayomide M. Ayeni, Michael P. Ast, Michael P. Bolognese, et al. “AI-Generated Graduate Medical Education Content for Total Joint Arthroplasty: Comparing ChatGPT Against Orthopaedic Fellows.Arthroplast Today 27 (June 2024): 101412. https://doi.org/10.1016/j.artd.2024.101412.
DeCook R, Muffly BT, Mahmood S, Holland CT, Ayeni AM, Ast MP, et al. AI-Generated Graduate Medical Education Content for Total Joint Arthroplasty: Comparing ChatGPT Against Orthopaedic Fellows. Arthroplast Today. 2024 Jun;27:101412.
DeCook, Ryan, et al. “AI-Generated Graduate Medical Education Content for Total Joint Arthroplasty: Comparing ChatGPT Against Orthopaedic Fellows.Arthroplast Today, vol. 27, June 2024, p. 101412. Pubmed, doi:10.1016/j.artd.2024.101412.
DeCook R, Muffly BT, Mahmood S, Holland CT, Ayeni AM, Ast MP, Bolognese MP, Guild GN, Sheth NP, Pean CA, Premkumar A. AI-Generated Graduate Medical Education Content for Total Joint Arthroplasty: Comparing ChatGPT Against Orthopaedic Fellows. Arthroplast Today. 2024 Jun;27:101412.
Journal cover image

Published In

Arthroplast Today

DOI

ISSN

2352-3441

Publication Date

June 2024

Volume

27

Start / End Page

101412

Location

United States