rss
JAMIA 1998;5:305-314 doi:10.1136/jamia.1998.0050305
  • Original Investigation
  • Research Paper

Identifying Adverse Drug Events

Development of a Computer-based Monitor and Comparison with Chart Review and Stimulated Voluntary Report

  1. Ashish K Jha,
  2. Gilad J Kuperman,
  3. Jonathan M Teich,
  4. Lucian Leape,
  5. Brian Shea,
  6. Eve Rittenberg,
  7. Elisabeth Burdick,
  8. Diane Lew Seger,
  9. Martha Vander Vliet,
  10. David W Bates
  1. Affiliations of the authors: Brigham and Women's Hospital (AKJ, GJK, JMT, BS, ER, DLS, MVV, DWB) and Harvard School of Public Health (LL, EB), Boston, Massachusetts
  1. Correspondence and reprints: David W. Bates, MD, MSc, Division of General Medicine, Department of Medicine, Brigham and Women's Hospital, 75 Francis Street, Boston, MA 02115. e-mail: 〈dwbates{at}bics.harvard.edu
  • Received 18 August 1997
  • Accepted 21 January 1998

Abstract

Background Adverse drug events (ADEs) are both common and costly. Most hospitals identify ADEs using spontaneous reporting, but this approach lacks sensitivity; chart review identifies more events but is expensive. Computer-based approaches to ADE identification appear promising, but they have not been directly compared with chart review and they are not widely used.

Objectives To develop a computer-based ADE monitor, and to compare the rate and type of ADEs found with the monitor with those discovered by chart review and by stimulated voluntary report.

Design Prospective cohort study in one tertiary-care hospital.

Participants All patients admitted to nine medical and surgical units in a tertiary-care hospital over an eight-month period.

Main Outcome Measure Adverse drug events identified by the computer-based monitor, by chart review, and by stimulated voluntary report.

Methods A computer-based monitoring program identified alerts, which were situations suggesting that an ADE might be present (e.g., an order for an antidote such as naloxone). A trained reviewer then examined patients' hospital records to determine whether an ADE had occurred. The results of the computer-based monitoring strategy were compared with two other ADE detection strategies: intensive chart review and stimulated voluntary report by nurses and pharmacists. The monitor and the chart review strategies were independent, and the reviewers were blinded.

Results The computer monitoring strategy identified 2,620 alerts, of which 275 were determined to be ADEs. The chart review found 398 ADEs, whereas voluntary report detected 23. Of the 617 ADEs detected by at least one method, 76 ADEs were detected by both computer monitor and chart review. The computer monitor identified 45 percent; chart review, 65 percent; and voluntary report, 4 percent. The ADEs identified by computer monitor were more likely to be classified as “severe” than were those identified by chart review (51 versus 42 percent, p =.04). The positive predictive value of computer-generated alerts was 16 percent during the first eight weeks of the study; rule modifications increased this to 23 percent in the final eight weeks. The computer strategy required 11 person-hours per week to execute, whereas chart review required 55 person-hours per week and voluntary report strategy required 5.

Conclusions The computer-based monitor identified fewer ADEs than did chart review but many more ADEs than did stimulated voluntary report. The overlap among the ADEs identified using different methods was small, suggesting that the incidence of ADEs may be higher than previously reported and that different detection methods capture different events. The computer-based monitoring system represents an efficient approach for measuring ADE frequency and gauging the effectiveness of ADE prevention programs.

Footnotes

  • This work was supported by research grant R01-HS07107-01 from the Agency for Health Care Policy and Research, by a grant from the Harvard Risk Management Foundation, and by the Carl W. Walter Fund of Harvard Medical School.

  • * Nephrotoxins were aminoglycosides, angiotensin converting enzyme (ACE) inhibitors, acyclovir, amphotericin B, carboplatin, cisplatin, cyclosporine, foscarnet, ifosfamide, nonsteroidal anti-inflammatory agents, pentamidine, and vancomycin.

Access policy for JAMIA

All content published in JAMIA is deposited with PubMedCentral by the publisher but with varying embargo times. Authors/funders may pay an Unlocked fee of $2,000 to make the article free on the JAMIA website and PMC immediately on publication. Research funded by government and other recognised agencies is deposited with a 12 month embargo. All other content is deposited with a 36 month embargo.

The Journal of the American Medical Informatics Association is published for the American Medical Informatics Association by BMJ Publishing Group Ltd.