Ambulatory prescribing errors among community-based providers in two states
- Erika L Abramson1,2,3,
- David W Bates4,5,6,
- Chelsea Jenter4,
- Lynn A Volk6,
- Yolanda Barrón2,
- Jill Quaresimo7,
- Andrew C Seger4,
- Elisabeth Burdick4,
- Steven Simon4,5,8,
- Rainu Kaushal1,2,3,9
- 1Department of Pediatrics, Weill Medical College of Cornell University, New York, New York, USA
- 2Department of Public Health, Weill Medical College of Cornell University, New York, New York, USA
- 3New York Presbyterian Hospital, New York, USA
- 4Division of General Internal Medicine, Brigham and Women's Hospital, Boston, Massachusetts, USA
- 5Harvard Medical School, Boston, Massachusetts, USA
- 6Information Systems, Partners Healthcare System, Boston, Massachusetts, USA
- 7Taconic IPA, Fishkill, New York, New York, USA
- 8VA Boston Healthcare System, Boston, Massachusetts, USA
- 9Department of Medicine, Weill Medical College of Cornell University, New York, New York, USA
- Correspondence to Dr Erika Abramson, Departments of Pediatrics and Public Health, Weill Medical College of Cornell University, 525 East 68th Street, Room-M-610, New York, NY 10065, USA;
- Received 2 May 2011
- Accepted 27 October 2011
- Published Online First 1 December 2011
Objective Little is known about the frequency and types of prescribing errors in the ambulatory setting among community-based, primary care providers. Therefore, the rates and types of prescribing errors were assessed among community-based, primary care providers in two states.
Material and Methods A non-randomized cross-sectional study was conducted of 48 providers in New York and 30 providers in Massachusetts, all of whom used paper prescriptions, from September 2005 to November 2006. Using standardized methodology, prescriptions and medical records were reviewed to identify errors.
Results 9385 prescriptions were analyzed from 5955 patients. The overall prescribing error rate, excluding illegibility errors, was 36.7 per 100 prescriptions (95% CI 30.7 to 44.0) and did not vary significantly between providers from each state (p=0.39). One or more non-illegibility errors were found in 28% of prescriptions. Rates of illegibility errors were very high (175.0 per 100 prescriptions, 95% CI 169.1 to 181.3). Inappropriate abbreviation and direction errors also occurred frequently (13.4 and 4.2 errors per 100 prescriptions, respectively). Reviewers determined that the vast majority of errors could have been eliminated through the use of e-prescribing with clinical decision support.
Discussion Prescribing errors appear to occur at very high rates among community-based primary care providers, especially when compared with studies of academic-affiliated providers that have found nearly threefold lower error rates. Illegibility errors are particularly problematical.
Conclusions Further characterizing prescribing errors of community-based providers may inform strategies to improve ambulatory medication safety, especially e-prescribing.
- data exchange
- decision support
- electronic health records
- health information technology
- inappropriate prescribing
- medication error
- measuring/improving patient safety and reducing medical errors
- patient safety
- primary care
- quality of care
Medication errors occur frequently, may be harmful, and result in considerable costs. A study of adult inpatients found 5.3 prescribing errors per 100 paper orders, with 6.6% having potential for harm and 0.9% resulting in actual harm.1 One estimate of national costs for preventable adverse drug events (ADE) affecting inpatients was US$2 billion annually.2
In contrast to the inpatient setting, much less is known about prescribing errors in the outpatient setting. A study of four adult academic-affiliated primary care practices in Boston, Massachusetts, found errors in one in 13 prescriptions (7.6%), with nearly half having potential for harm. The error rate among the providers using hand-written prescriptions was 11%.3 Other studies have found even higher prescribing error rates among paper-based prescribers, although few studies have focused on community-based providers who do the majority of ambulatory prescription writing.4–7
Detecting prescribing errors in the outpatient setting is challenging because patients frequently have multiple providers and pharmacies, and copies of prescriptions are generally unavailable for review. Despite these challenges, understanding the frequency and types of outpatient prescribing errors is critical because an estimated 2.6 billion medications are provided, prescribed, or continued at ambulatory visits annually.8 Furthermore, rates of preventable ADE in the ambulatory setting are high and many patients experience sequelae requiring medical care.9–12
Improving healthcare safety is a goal of major national policy forces such as the American Reinvestment and Recovery Act, which aims to increase the adoption of health information technology, including e-prescribing, by offering billions of dollars of incentives to providers who demonstrate meaningful use of electronic health records (EHR).13 Core measures of the meaningful use criteria include computer entry of medication orders, implementation of specific clinical decision support (CDS) to assist in medication ordering, and electronic transmission of prescriptions to pharmacies. Therefore, better understanding the rates and types of prescribing errors made by providers may inform the design and CDS strategies for e-prescribing systems, which are expected to be increasingly adopted by providers so that they can be eligible for incentives.
We therefore conducted this study to determine the rates and types of prescribing errors among paper-based, primary care prescribers in solo and small group practices in two communities, and to determine the potential impact of e-prescribing on these errors.
We conducted this cross-sectional study of 78 ambulatory care providers in the Hudson Valley Region of New York and Brockton, Massachusetts, from September 2005 to November 2006. We analyzed carbon copies of all prescriptions written by participating providers during a 2-week period for the presence of prescribing errors, ensuring that we obtained at least 75 prescriptions on 25 patients per provider and extending data collection if necessary to achieve these numbers. We limited prescription review to three randomly selected prescriptions per patient to minimize clustering of errors. Non-duplicate prescription pads were removed during study periods to maximize compliance with duplicate prescription pad use. The study received approval from the Kingston Institutional Review Board in the Hudson Valley and the Caritas Good Samaritan Medical Center Institutional Review Board in Brockton.
We focused on errors that occurred during the prescription writing process and classified errors in accordance with definitions from the Institute of Medicine.2 Classification included rule violations, prescribing errors with low potential to cause harm, (referred to as ‘prescribing errors’), near misses, and ADE. The least harmful type of error was rule violations, which were departures from strict standards of prescribing that were unlikely to result in harm. An example was failure to write ‘po’ for a medication only taken orally. Rule violations were not included in error counts. An example of a prescribing error with low potential to cause harm was prescribing an anti-hypertensive medication but omitting the quantity to be dispensed. Near misses were errors with high potential for harm that were either intercepted or reached the patient but did not result in harm. One example was prescribing penicillin to a patient with a known allergy who took the medication but did not have a reaction. Actual ADE were injuries from a medication, some of which were associated with an error and therefore considered preventable.
The Hudson Valley is a predominantly rural and suburban area north of New York City. Brockton is the sixth largest city in Massachusetts located 25 miles south of Boston. Most of the 78 providers worked in practices ranging in size from one to seven providers and none of the practices was affiliated with an academic medical center.
The New York providers were all members of the not-for-profit Taconic Independent Practice Association (Taconic IPA). A letter was sent to members in May 2005 detailing incentives for adopting e-prescribing systems and inviting providers to participate in a research study. Providers were given additional discounts on EHR licenses as an incentive for participation in the research study.
The Massachusetts providers were identified with the help of the Massachusetts eHealth Collaborative (MAeHC), which is a coalition formed in 2004 of the state's major healthcare stakeholders to pursue community-wide EHR implementation.14 The principal investigator and study staff approached individual physicians in Brockton, one of the MAeHC target communities, for participation. No monetary incentives were offered to participate in the research study, although providers were given free EHR by the MAeHC to encourage adoption.
One physician (RK) trained a research nurse and research pharmacist in an identical manner using well-utilized, standardized methodology.3 ,15–18 Training included review of error definitions, assessment of legibility, and review of test and actual cases. A prescription was deemed illegible if it could be easily misinterpreted or was indecipherable. Reviews were initially conducted in pairs, after which the research nurse reviewed the Hudson Valley prescriptions and the pharmacist reviewed the Brockton prescriptions. Rule violations, prescribing errors, near misses, and ADE were all classified.15 We determined interrater reliability by having the pharmacist and nurse evaluate the same random sample of 2% of the data. The κ score for agreement between the research nurse and pharmacist was 0.81, indicating very good to excellent agreement. For all suspected near misses and ADE, the research nurse or pharmacist performed a review of the patient's outpatient medical record to determine any sequelae.
Physician event review and classification
We conducted physician reviews for all suspected near misses and ADE. Confirmed ADE were rated on preventability using a five-point Likert scale and on attribution (ie, the certainty with which the medication was the explanation for the observed adverse event) using the Naranjo algorithm, which uses factors such as known medication side-effect profiles, timing of patient-reported symptoms, and documented use of antidotes to assess attribution.19 ADE were also classified on the level of severity as significant, serious, life-threatening, or fatal. For the New York providers, two physicians reviewed events independently. The κ score for interrater agreement for the presence of near misses was 0.95 (p<0.001), demonstrating excellent agreement. For the Massachusetts providers, a separate group of physicians conducted reviews jointly to reach consensus.
Finally, we examined each individual error to determine whether using e-prescribing with either basic or advanced CDS could have prevented the error. Consistent with other studies, we defined basic CDS as CDS that ensured completeness in prescribing fields and eliminated illegibility errors; all other CDS features, such as prescribing alerts, were defined as advanced.3 ,7 ,20 We did not count errors preventable with basic CDS as also preventable with advanced CDS.
We calculated overall error rates per 100 prescriptions and compared error rates for providers in the two communities using mixed-effects Poisson regression, to adjust for clustering at the provider level. We assumed an independent correlation structure for all Poisson models. We calculated 95% Poisson CI with cluster-robust standard errors for the rates. We also compared the presence of any error per prescription using logistic mixed-effects models, adjusting for clustering with provider as the unit of analysis. The only available provider characteristics were age, sex and year since graduation and they were not included in the Poisson or logistic mixed models as covariates. We used SAS for PC V.9.1 to estimate κ statistics, χ2, Fisher's exact, and t tests and Stata V.11, to estimate mixed-effects Poisson and logistic models, and to calculate 95% Poisson and logistic CI with clustered robust standard errors.
Forty-eight providers were from New York and 30 were from Massachusetts (table 1). There was no significant difference between the groups of providers in gender, degree, or years since graduation.
We reviewed a total of 5873 prescriptions from 3808 unique patients seen by the New York providers and 3512 prescriptions from 2147 unique patients seen by the Massachusetts providers (table 2). The patients seen by New York providers were significantly older than those seen by Massachusetts providers (mean age 54 vs 51 years, p<0.001). There was no significant difference in patient gender.
Both groups of providers had high error rates (table 3). Rule violations occurred at a rate of 54.4 per 100 prescriptions. Prescribing errors, including illegibility errors, occurred at a rate of 212.6 per 100 prescriptions. Providers in Massachusetts had a higher error rate than providers in New York (p=0.01). However, when illegibility errors were excluded, the prescribing error rate was 36.7 per 100 prescriptions and there was no statistically significant difference in rates between provider groups (p=0.39). Excluding illegibility errors, 27.8% of prescriptions had at least one prescribing error.
We found an overall near miss rate of 1.5 per 100 prescriptions. We did not find a difference in rates between provider groups (p=0.55). Excluding illegibility errors from near miss counts, the near miss rate was 1.1 per 100 prescriptions. The overall rate of preventable ADE we detected was low (0.15 per 100 prescriptions).
Types of errors
The most common types of prescribing errors among providers at both sites were illegibility errors, use of inappropriate abbreviations, direction errors and strength errors (table 4). Among near misses, illegibility errors and dose errors occurred most frequently. The most common illegible fields were strength or strength unit, medication name and frequency. Examples of errors are provided in box 1.
Examples of prescribing errors and near misses
Ketoconazole 2% antifungal cream is prescribed without directions for use.
Lortisone cream (betamethasone and clotrimazole cream) is ordered with length of treatment omitted.
Rhinocort Aqua nasal spray (budesonide nasal spray) is prescribed with frequency illegible.
Amoxicillin 500 mg is prescribed with length of treatment omitted.
Imitrex 100 mg (sumatriptan) is ordered with frequency for use omitted.
Vicodin 7.5–750 mg (hydrocodone and acetaminophen) is ordered for ‘1 tablet every 4 h’, which exceeds maximum daily dose of acetaminophen.
Lasix (furosemide) is ordered with strength omitted.
Ortho Evra contraceptive patch (ethinyl estradiol and norelgestromin transdermal system) instructions incorrectly written as ‘apply one patch monthly’.
*Including illegibility errors, excluding rule violations.
Prescribing errors by drug category
Prescribing errors most frequently involved antibiotics (n=1516, 16.4%), followed by cholesterol medications (n=530, 5.7%), narcotic analgesics (n=500, 5.4%) and anti-hypertensive drugs (n=468, 5.1%).
Potential impact of e-prescribing
In addition to preventing all illegibility errors, reviewers determined that e-prescribing with basic CDS may have prevented 1092 of the remaining 3443 prescribing errors (32%), and advanced CDS may have prevented another 1966 of the remaining prescribing errors (57%) (tables 5 and 6). Errors judged preventable by basic CDS, aside from illegibility errors, were omission errors. Most frequently, these were strength or dose errors, such as omitting strength or dose units. All other errors were judged preventable by advanced CDS. The most frequent types were inappropriate abbreviation errors and direction errors, such as directions for use incorrect or discrepant. For the near misses we detected, basic CDS would have prevented all 38 illegibility errors and may have prevented 44 of the remaining 104 near misses (42%), while advanced CDS may have prevented an additional 38 (36%). There was no significant difference between the two groups of providers in the rates of errors preventable with basic and advanced CDS.
We found that approximately one in four prescriptions written by community-based providers in two states had at least one error, even without counting illegibility errors. Illegibility errors occurred on average more than once per prescription. The use of an e-prescribing system has the potential to reduce error rates markedly. E-prescribing systems linked with advanced CDS may have an even bigger impact, especially on errors with higher potential for harm.
Our study is one of only a few to characterize prescribing errors in ambulatory care settings and we are not aware of other multistate studies that have been performed. In comparing the providers from New York and Massachusetts, there was no significant difference in prescribing error rates for non-illegibility errors. Our observed rate of errors seems generally similar to that of other studies, although methodologies vary between studies and rates may differ between academic and community settings.3 ,5 ,6 For example, despite the use of the same methodology and pharmacist reviewer, the percentage of hand-written prescriptions containing at least one error in a study of four academic-affiliated primary care clinics in Boston was 11% compared with our rate of 27.8%.3 Community-based providers may have different prescribing patterns and fewer support systems than academic-affiliated providers, leading to higher error rates.
Although the majority of errors we detected were unlikely to result in serious patient harm, some might. Furthermore, even the less serious errors are important to study for their potential impact on efficiency as well as patient safety. Illegible prescriptions or those with missing information can lead to pharmacy filling errors or callbacks for clarification. Substantial time may be wasted for patients, prescribers, and pharmacists given the high frequency with which prescribing errors appear to occur. Callbacks probably also have important clinical implications. For example, a study evaluating pharmacy callbacks to 22 primary care practices to clarify prescriptions found that callbacks were common and problems for ‘acute’ medications, defined as medications in which administration delays could lead to worsening of a medical condition or cause prolonged pain, were not resolved on the same day 34% of the time.21
In addition, although our methods were not designed to capture near misses or preventable ADE, we still detected a near miss rate of 1.5 per 100 prescriptions and there were likely to be additional near misses and preventable ADE that occurred but were not detected. A previous study showed that 4% of ambulatory patients with prescription errors experienced a preventable ADE.3 Further studies should be conducted in the community setting with methods specifically suited to detecting near misses and preventable ADE.
Understanding the epidemiology of prescribing errors in the outpatient setting can inform strategies for reducing their frequency and severity. This includes the use of e-prescribing, which has significant potential for improving patient safety.7 ,22 We found an overall rate of 175.1 illegibility errors per 100 prescriptions, all of which would be eliminated by even the most basic e-prescribing system. However, advanced CDS appears important to achieve even greater safety gains.
By characterizing ambulatory prescribing errors, CDS can be designed so that it targets the most frequent types of errors. For example, the two most common types of errors we found that were judged to be preventable with advanced CDS were inappropriate abbreviation errors and direction errors. CDS that automatically converted inappropriate abbreviations into acceptable abbreviations would eliminate this type of error. Pre-populated direction fields with clear and complete instructions for certain drugs might eliminate many direction errors. Future studies should be conducted to determine the actual impact of various e-prescribing systems with CDS on ambulatory prescribing errors, as few such studies have been conducted.3 ,4 ,22–25 This is particularly important given the expected increase in use of e-prescribing as a result of the federal stimulus package and meaningful use criteria.13
Our study has several limitations. We had only one reviewer for each prescription, although joint review of a subset of prescriptions revealed excellent agreement. This may account for differences in rates of prescribing errors between the New York and Massachusetts providers when illegibility errors were included, as ultimately the determination of legibility is subjective. We focused on prescribing errors and were limited by our methods to comment on near misses and ADE. In addition, the providers in our study were not blinded to the study's purpose. Our error rates might, therefore, be underestimates if physicians attempted to be particularly careful while writing prescriptions during the study period. The practices that elected to participate might not be representative of all practices, and might have lower rates than practices at large.
Few studies have characterized the rates and types of prescribing errors made by community-based providers in the ambulatory setting. Our findings suggest that these errors occur in one in four prescriptions, even without counting illegibility issues, which occur at a rate of more than one per prescription. Therefore, handwritten prescriptions are simply not safe. Many of these errors may be preventable through the use of e-prescribing systems, especially when linked with advanced CDS. By evaluating the rates and types of ambulatory prescribing errors made by community-based providers, findings from this study can inform current policies aimed at improving outpatient medication safety.
The authors thank A John Blair, III, MD, President of the Taconic IPA and CEO of MedAllies, Dianne Koval, MHSA, RHIA, CPEHR, Vice President of Provider Services for MedAllies, Micky Tripathi, PhD, CEO of the MAeHC, and Linda Rudolph, Senior Pilot Executive for the MAeHC for their assistance in provider enrollment. In addition, the authors would like to acknowledge the work of research assistants Madeline McCarthy, Alexis Tumolo and Elizabeth McGlinchey.
Funding This study was funded by grant number 1UC1HS015397 from the Agency for Healthcare Research and Quality. The Massachusetts study was also co-funded by the Massachusetts eHealth Collaborative and the Hudson Valley study by the Taconic Independent Practice Association. The content is solely the responsibility of the authors and does not necessarily represent the official views of the Agency for Healthcare Research and Quality or that of the Massachusetts e-Health Collaborative or the Taconic Independent Practice Association.
Competing interests None.
Ethics approval The study received approval from the Kingston Institutional Review Board in the Hudson Valley and the Caritas Good Samaritan Medical Center Institutional Review Board in Brockton.
Provenance and peer review Not commissioned; externally peer reviewed.