Monitoring Device Safety in Interventional Cardiology
- Affiliations of the authors: Decision Systems Group, Department of Radiology, Harvard Medical School, Boston, MA (MEM, LOM, FSR), Harvard-MIT Division of Health Sciences & Technology, Massachusetts Institute of Technology, Cambridge, MA (MEM, LOM, FSR)
- Correspondence and reprints: Frederic S. Resnic, MD, MS, Brigham & Women's Hospital, 75 Francis Street, Boston, MA 02115; e-mail: <fresnic{at}partners.org>, Michael E. Matheny, MD; e-mail: <mmatheny{at}dsg.harvard.edu>
- Received 7 July 2005
- Accepted 16 October 2005
Abstract
Objective A variety of postmarketing surveillance strategies to monitor the safety of medical devices have been supported by the U.S. Food and Drug Administration, but there are few systems to automate surveillance. Our objective was to develop a system to perform real-time monitoring of safety data using a variety of process control techniques.
Design The Web-based Data Extraction and Longitudinal Time Analysis (DELTA) system imports clinical data in real-time from an electronic database and generates alerts for potentially unsafe devices or procedures. The statistical techniques used are statistical process control (SPC), logistic regression (LR), and Bayesian updating statistics (BUS).
Measurements We selected in-patient mortality following implantation of the Cypher drug-eluting coronary stent to evaluate our system. Data from the University of Michigan Consortium Bare-Metal Stent Study was used to calculate the event rate alerting boundaries. Data analysis was performed on local catheterization data from Brigham and Women's Hospital from July 1, 2003, shortly after the Cypher release, to December 31, 2004, including 2,270 cases with 27 observed deaths.
Results The single-stratum SPC had alerts in months 4 and 10. The multistrata SPC had alerts in months 5, 10, and 18 in the moderate-risk stratum, and months 1, 4, 7, and 10 in the high-risk stratum. The only cumulative alerts were in the first month for the high-risk stratum of the multistrata SPC. The LR method showed no monthly or cumulative alerts. The BUS method showed an alert in the first month for the high-risk stratum.
Conclusion The system performed adequately within the Brigham and Women's Hospital Intranet environment based on the design goals. All three cumulative methods agreed that the overall observed event rates were not significantly higher for the new medical device than for a closely related medical device and were consistent with the observation that the initial concerns about this device dissipated as more data accumulated.
Footnotes
-
This research was supported in part by grants 1-T15-LM-07092 and R01-LM08142-01 from the National Library of Medicine of the National Institutes of Health.
-
The authors thank Richard Cope and Barry Coflan for their excellent programming work on the project, Dr. Robert Greenes for editing assistance, and Anne Fladger and her staff for literature procurement assistance.
The authors have no conflict of interests to disclose.
