Skip to main content

Integrating Al Algorithms into the Clinical Workflow.

Publication ,  Journal Article
Juluru, K; Shih, H-H; Keshava Murthy, KN; Elnajjar, P; El-Rowmeim, A; Roth, C; Genereaux, B; Fox, J; Siegel, E; Rubin, DL
Published in: Radiol Artif Intell
November 2021

Integration of artificial intelligence (AI) applications within clinical workflows is an important step for leveraging developed AI algorithms. In this report, generalizable components for deploying AI systems into clinical practice are described that were implemented in a clinical pilot study using lymphoscintigraphy examinations as a prospective use case (July 1, 2019-October 31, 2020). Deployment of the AI algorithm consisted of seven software components, as follows: (a) image delivery, (b) quality control, (c) a results database, (d) results processing, (e) results presentation and delivery, (f) error correction, and (g) a dashboard for performance monitoring. A total of 14 users used the system (faculty radiologists and trainees) to assess the degree of satisfaction with the components and overall workflow. Analyses included the assessment of the number of examinations processed, error rates, and corrections. The AI system processed 1748 lymphoscintigraphy examinations. The system enabled radiologists to correct 146 AI results, generating real-time corrections to the radiology report. All AI results and corrections were successfully stored in a database for downstream use by the various integration components. A dashboard allowed monitoring of the AI system performance in real time. All 14 survey respondents "somewhat agreed" or "strongly agreed" that the AI system was well integrated into the clinical workflow. In all, a framework of processes and components for integrating AI algorithms into clinical workflows was developed. The implementation described could be helpful for assessing and monitoring AI performance in clinical practice. Keywords: PACS, Computer Applications-General (Informatics), Diagnosis © RSNA, 2021.

Duke Scholars

Altmetric Attention Stats
Dimensions Citation Stats

Published In

Radiol Artif Intell

DOI

EISSN

2638-6100

Publication Date

November 2021

Volume

3

Issue

6

Start / End Page

e210013

Location

United States
 

Citation

APA
Chicago
ICMJE
MLA
NLM
Juluru, K., Shih, H.-H., Keshava Murthy, K. N., Elnajjar, P., El-Rowmeim, A., Roth, C., … Rubin, D. L. (2021). Integrating Al Algorithms into the Clinical Workflow. Radiol Artif Intell, 3(6), e210013. https://doi.org/10.1148/ryai.2021210013
Juluru, Krishna, Hao-Hsin Shih, Krishna Nand Keshava Murthy, Pierre Elnajjar, Amin El-Rowmeim, Christopher Roth, Brad Genereaux, Josef Fox, Eliot Siegel, and Daniel L. Rubin. “Integrating Al Algorithms into the Clinical Workflow.Radiol Artif Intell 3, no. 6 (November 2021): e210013. https://doi.org/10.1148/ryai.2021210013.
Juluru K, Shih H-H, Keshava Murthy KN, Elnajjar P, El-Rowmeim A, Roth C, et al. Integrating Al Algorithms into the Clinical Workflow. Radiol Artif Intell. 2021 Nov;3(6):e210013.
Juluru, Krishna, et al. “Integrating Al Algorithms into the Clinical Workflow.Radiol Artif Intell, vol. 3, no. 6, Nov. 2021, p. e210013. Pubmed, doi:10.1148/ryai.2021210013.
Juluru K, Shih H-H, Keshava Murthy KN, Elnajjar P, El-Rowmeim A, Roth C, Genereaux B, Fox J, Siegel E, Rubin DL. Integrating Al Algorithms into the Clinical Workflow. Radiol Artif Intell. 2021 Nov;3(6):e210013.

Published In

Radiol Artif Intell

DOI

EISSN

2638-6100

Publication Date

November 2021

Volume

3

Issue

6

Start / End Page

e210013

Location

United States