Impact of Clinical Reminder Redesign on Learnability, Efficiency, Usability, and Workload for Ambulatory Clinic Nurses
- Jason J Saleem,
- Emily S Patterson,
- Laura Militello,
- Shilo Anders,
- Mercedes Falciglia,
- Jennifer A Wissman,
- Emilie M Roth,
- Steven M Asch
- Affiliations of the authors: Veterans Association Getting at Patient Safety (GAPS) Center, VAMC (JJS, ESP, MF, JAW), Cincinnati, OH; Veterans Association HSR&D Center on Implementing Evidencebased Practice, Roudebush VAMC (JJS), Indianapolis, IN; Department of Electrical and Computer Engineering, IUPUI (JJS), Indianapolis, IN; Institute for Ergonomics (ESP), Cognitive Systems Engineering Laboratory (SA), The Ohio State University, Columbus, OH; University of Dayton Research Institute (LM), Dayton, OH; Department of Internal Medicine, University of Cincinnati (MF), Cincinnati, OH; Roth Cognitive Engineering (EMR), Brookline, MA; Health Services Research, VA Greater Los Angeles Healthcare System (SMA), Los Angeles, CA; Associate Professor of Medicine at the David Geffen School of Medicine (SMA) UCLA, Los Angeles, CA
- Correspondence and reprints: Jason J. Saleem, PhD, VA HSR&D Center of Excellence on Implementing Evidenced-Based Practice (CIEBP), Richard L. Roudebush VA Medical Center (11-H), 1481 West Tenth Street, Indianapolis, IN 46202; ; e-mail: <jsaleem{at}iupui.edu>
- Received 28 May 2006
- Accepted 11 June 2007
Abstract
Objective Computerized clinical reminders (CRs) were designed to reduce clinicians’ reliance on their memory and to present evidence-based guidelines at point of care. However, the literature indicates that CR adoption and effectiveness has been variable. We examined the impact of four design modifications to CR software on learnability, efficiency, usability, and workload for intake nursing personnel in an outpatient clinic setting. These modifications were included in a redesign primarily to address barriers to effective CR use identified during a previous field study.
Design In a simulation experiment, 16 nurses used prototypes of the current and redesigned system in a within-subject comparison for five simulated patient encounters. Prior to the experimental session, participants completed an exploration session, where “learnability” of the current and redesigned systems was assessed.
Measurements Time, performance, and survey data were analyzed in conjunction with semi-structured debrief interview data.
Results The redesign was found to significantly increase learnability for first-time users as measured by time to complete the first CR, efficiency as measured by task completion time for two of five patient scenarios, usability as determined by all three groupings of questions taken from a commonly used survey instrument, and two of six workload subscales of the NASA Task Load Index (TLX) survey: mental workload and frustration.
Conclusion Modest design modifications to existing CR software positively impacted variables that likely would increase the willingness for first-time nursing personnel to adopt and consistently use CRs.
Footnotes
-
Supported by the Department of Veterans Affairs, Veterans Health Administration, Health Services Research and Development Service (TRX 02-216). A VA HSR&D Advanced Career Development Award supported Dr. Asch and a VA HSR&D Merit Review Entry Program Award supported Dr. Patterson.
-
The views expressed in this article are those of the authors and do not necessarily represent the view of the Department of Veterans Affairs.
