Offline testing of the ATHENA Hypertension decision support system knowledge base to improve the accuracy of recommendations.

Published

Journal Article

ATHENA-HTN is a clinical decision support system (CDSS) that delivers guideline-based patient-specific recommendations about hypertension management at the time of clinical decision-making. The ATHENA-HTN knowledge is stored in a knowledge-base (KB). Changes in best-practice recommendations require updates to the KB. We describe a method of offline testing to evaluate the accuracy of recommendations generated from the KB. A physician reviewed 100 test cases and made drug recommendations based on guidelines and the "Rules" (descriptions of encoded knowledge). These drug recommendations were compared to those generated by ATHENA-HTN. Nineteen drug-recommendation discrepancies were identified: ATHENA-HTN was more complete in generating recommendations (15); ambiguities in the Rules misled the physician (3); and content in the Rules was not encoded (1). Three new boundaries were identified. Three updates were made to the KB based on the results. The offline testing method was successful in identifying areas for KB improvement and led to improved accuracy of guideline-based recommendations.

Full Text

Duke Authors

Cited Authors

  • Martins, SB; Lai, S; Tu, S; Shankar, R; Hastings, SN; Hoffman, BB; Dipilla, N; Goldstein, MK

Published Date

  • 2006

Published In

Start / End Page

  • 539 - 543

PubMed ID

  • 17238399

Pubmed Central ID

  • 17238399

Electronic International Standard Serial Number (EISSN)

  • 1942-597X

Language

  • eng

Conference Location

  • United States