Factors affecting home care patients' acceptance of a web-based interactive self-management technology
- Calvin K L Or1,
- Ben-Tzion Karsh2,
- Dolores J Severtson3,
- Laura J Burke4,
- Roger L Brown3,
- Patricia Flatley Brennan2,3
- 1Department of Industrial and Manufacturing Systems Engineering, The University of Hong Kong, Pokfulam, Hong Kong
- 2Department of Industrial and Systems Engineering, University of Wisconsin-Madison, Madison, Wisconsin, USA
- 3School of Nursing, University of Wisconsin-Madison, Madison, Wisconsin, USA
- 4System Nursing Research and Scientific Support, Aurora Health Care, Milwaukee, Wisconsin, USA
- Correspondence to Calvin K L Or, Room 8-07, Haking Wong Building, Department of Industrial and Manufacturing Systems Engineering, The University of Hong Kong, Pokfulam, Hong Kong;
- Received 10 July 2010
- Accepted 3 November 2010
- Published Online First 3 December 2010
Objective With the advent of personal health records and other patient-focused health technologies, there is a growing need to better understand factors that contribute to acceptance and use of such innovations. In this study, we employed the Unified Theory of Acceptance and Use of Technology as the basis for determining what predicts patients' acceptance (measured by behavioral intention) and perceived effective use of a web-based, interactive self-management innovation among home care patients.
Design Cross-sectional secondary analysis of data from a randomized field study evaluating a technology-assisted home care nursing practice with adults with chronic cardiac disease.
Measurement and analysis A questionnaire was designed based on validated measurement scales from prior research and was completed by 101 participants for measuring the acceptance constructs as part of the parent study protocol. Latent variable modeling with item parceling guided assessment of patients' acceptance.
Results Perceived usefulness accounted for 53.9% of the variability in behavioral intention, the measure of acceptance. Together, perceived usefulness, health care knowledge, and behavioral intention accounted for 68.5% of the variance in perceived effective use. Perceived ease of use and subjective norm indirectly influenced behavioral intention, through perceived usefulness. Perceived ease of use and subjective norm explained 48% of the total variance in perceived usefulness.
Conclusion The study demonstrates that perceived usefulness, perceived ease of use, subjective norm, and healthcare knowledge together predict most of the variance in patients' acceptance and self-reported use of the web-based self-management technology.
Recent advances in consumer health information technologies (CHITs), which have increasingly gained popularity over the past decade, have complemented traditional healthcare delivery and expanded support for patient self-care. In this study, CHITs refer to patient-focused interactive web- or technology-mediated applications that are designed to improve information access and exchange, enhance decision making, provide social and emotional support, and facilitate behavior changes that promote health and well being1; examples include CHESS2 and ComputerLink.3 CHITs are frequently developed to be used at home by patients for self-care, home care support, or teleconsultation. Such technologies benefit patients by providing them with prompt access to various education, communication, and decision support materials and tools. These readily available resources at the time of need can facilitate the care delivery process, which in turn can lead to better patient health outcomes, well-being, and quality of life, as well as lower hospital readmission rates and mortality rates.4–10 However, patients do not always accept and use the technologies.11–16 Lack of CHIT acceptance and subsequent use is a significant concern for patients and healthcare organizations; patients who do not accept or use CHITs will not realize the full benefits of them, and non-acceptance or non-use means a loss of return on investment for the organizations. This makes the study of patient technology acceptance a national priority.
In fact, the U.S. Agency for Healthcare Research and Quality sponsored an Evidence Report to identify drivers and barriers related to successful use of CHITs among the elderly and underserved.17 The qualitative review of the literature found that: (1) use of CHITs among the elderly, chronically ill, and underserved varied widely and was difficult to assess; (2) ease of use and usefulness of the CHITs were important determinants of use of the technologies; (3) the most frequent barriers were lack of perceived benefit, lack of convenience, and cumbersome data entry; and (4) the most frequent driver of use was the patient's perception of a health benefit. One of the other conclusions was that “in most cases our evidence for usability, barriers, and drivers came from studies where these issues were not a key part of the study design, but rather qualitative evidence that accompanied an outcomes study” (p 54).17
In another literature review of factors affecting patients' CHIT acceptance, Or and Karsh18 found that most studies focused on patient-related predictors, such as socio-demographic and health variables. Most of the reviewed studies did not test relevant and reliable predictors of acceptance, such as ease of use and usefulness of CHITs and social influence. The review also found that only a few studies19–23 were grounded in a theory that could explain technology acceptance, suggesting that model misspecification could be a significant limitation of previous research. The significant lack of theoretically driven empirical models is a concern because it leaves designers and decision makers without clear guidance of what to do to promote patient acceptance of CHIT. This study is an attempt to fill that gap by positing a patient technology acceptance model that draws upon variable categories from an established theory of technology acceptance—the Unified Theory of Acceptance and Use of Technology (UTAUT).24 The UTAUT is a recent extension of the most widely studied theory of technology acceptance, the Technology Acceptance Model,25 26 which has been used in over a dozen studies modeling healthcare providers' acceptance of health information technology,27 but rarely to model patient acceptance of CHIT. Our purpose in using the UTAUT was to have a principled set of variables from which to predict CHIT acceptance and use. We do not suggest that these variables are the only possible predictors, or that our model is a ‘correct’ model. Rather, we view this as a theoretically supported starting point.
This present study examined acceptance after only 4 weeks of patient use because early stage acceptance has strong bearing on later stage use.28 This study also measured and tested variables outside of the UTAUT that may be especially important for the study population of interest—a home care patient population that includes mostly elderly patients. This study then analyzed the relationships among the variables of the model using data from a larger study29 (hereafter referred to as the HeartCare II study) that examined technology-enhanced nursing practice in home care. While the HeartCare II study focused on a new model of home care nursing practice that capitalized on a web-based technology to support patient self-care and disease management, this present study investigated patients' acceptance of the web technology itself.
Theoretical background and research hypotheses
The patient technology acceptance model that was tested is presented in figure 1. The model relies substantially on the UTAUT, as well as the findings of other related studies.23 25 30 The UTAUT is a well-established model and has been successfully used for analyzing acceptance of computer technologies among healthy individuals, such as general internet users as well as healthcare professionals. Evidence has shown that the UTAUT demonstrated a substantial improvement over the other acceptance models and explained 69% of the variance in behavioral intention,24 which is the most common indicator of acceptance. We therefore measure patient acceptance of CHIT by self-reported behavioral intention. Other extensions of the Technology Acceptance Model have had good success predicting acceptance among healthcare professionals as well.27 Based on the UTAUT, our model posited that four core determinants were associated with acceptance and perceived effective use; they were performance expectancy, effort expectancy, social influence, and facilitating conditions. Figure 1 shows the variables that were used to measure each of those core determinants. Behavioral intention is the measure of acceptance in this present study, and the reasons are as follows: (1) the variable has been widely used to measure individuals' acceptance of (health) technology23 24 26 30–34; (2) individuals' formation of an intention to perform a behavior may mean that the individual has accepted the behavior; and (3) behavioral intention considerably predicts actual behavior, such as using a technology.24 30 35 36 Because behavioral intention is believed to predict use behavior, we further measured perceived effective use. Also, we complemented the UTAUT with four patient-centered factors addressing psychomotor, visual, and cognitive aspects, including perceived upper extremity functional ability, perceived visual functional status, health information seeking preference, and healthcare knowledge.
Perceived usefulness pertains to performance expectancy in the UTAUT. Based on the original definition by Davis,25 perceived usefulness in this study refers to “the degree to which the participant believes that using the self-management technology would improve his or her ability and enhance the effectiveness in managing his or her disease.” Studies outside and within the consumer health informatics discipline have consistently found that perceived usefulness of a technology is associated with the acceptance of the technology.17 19 21 23 24 27 37 38 This suggests that patients will be more likely to accept the technology if they believe that the technology is useful as it can convey health benefits or facilitate self-management.
Perceived ease of use
Perceived ease of use pertains to effort expectancy in the UTAUT. Based on Davis,25 perceived ease of use in this study refers to “the degree to which a participant believes that using the self-management technology would be free of effort.” CHIT acceptance studies supported that perceived ease of use positively predicted acceptance19 21–23; the effect was also found to be mediated by perceived usefulness. This suggests that patients are more likely to accept a CHIT and perceive the technology as useful if they feel that the technology is easy to use.
Subjective norm has been frequently used to capture the essence of social influence and refers to one's appraisal of how important others feel about the target behavior.39 In the context of this present study, subjective norm refers to the participant's perceptions that people who are important to him or her think he or she should use the self-management technology. Although the impacts of subjective norm on acceptance are not always consistent, evidence has shown that the factor has been a significant determinant of acceptance within the information systems literature30 40 41 as well as in research studying acceptance among healthcare providers, such as physicians.27 We are not aware of any previous studies of patient CHIT acceptance that have examined subjective norm; however, there is merit in exploring the possible effect of subjective norm in this present study.
Perceived behavioral control
Perceived behavioral control, a construct that pertains to facilitating conditions in the UTAUT, reflects individuals' perceptions of internal (ie, self-confidence in his or her ability to perform a given behavior) and external (ie, the availability of resources, such as technical support, needed to perform the behavior) constraints on the behavior of interest, such as CHIT use.24 30 39 We are unaware of any previous studies that have examined the impact of perceived behavioral control on patient CHIT acceptance. However, studies of healthcare professionals and studies outside of healthcare have shown that perceived behavioral control significantly predicts acceptance and use of information technology.30 42
Perceived visual functional status and perceived upper extremity functional ability
Perceived visual functional status and perceived upper extremity functional ability were examined. The CHIT involved in this study was an interactive web-based technology and our participants were home care patients with chronic cardiac disease who were mostly elderly. Due to chronic disabling conditions and ageing, the visual and upper extremity functioning of many elderly patients and patients with chronic cardiac disease is reduced, which leads to their inability to see well and/or to easily manipulate computers.43 Having difficulty seeing text and graphics on a computer screen, using a keyboard, or manipulating a mouse can in turn lead to non-acceptance of technology.44–46 Psychomotor and visual capacity, therefore, should be components of any user acceptance model, and they are especially important in models attempting to explain technology acceptance of lay people.
Health information seeking preference
Health information seeking preference, which refers to “the degree to which the participant believes that he or she should be told the information about his or her health and the care for the disease,” was included based on Wilson and Lankton.23 Using CHITs is one way to receive health information since the technologies offer an alternative mechanism for getting prompt lab test results and up-to-date health and treatment knowledge. Therefore, patients who want to receive more information about their condition or treatments may be more likely to accept the technology.
Healthcare knowledge, which refers to “the amount of knowledge participants feel they have regarding their health condition and care for their disease,” was also examined based on Wilson and Lankton.23 Patients who think that they have little knowledge about caring for their health problems may be more likely to accept the health technology. This may occur because the participants wish to obtain more relevant health information and supportive resources from the technology to better manage their symptoms and activities.47 48
Behavioral intention refers to the strength of an individual's intention to perform a behavior.36 It is the most common measure of acceptance, and is the one used in this present study. Previous studies have shown that behavioral intention predicted usage behavior, such as using a technology.24 26 30 34 Moreover, behavioral intention typically fully mediated the effects of individuals' beliefs and perceptions about a technology, such as perceived ease of use and usefulness, on usage behavior.24 26 28 40
Study design and sample
We conducted a secondary analysis of data collected from the HeartCare II study, a randomized field study involving home care patients with chronic cardiac disease, to test the research model and hypotheses. For the HeartCare II study, five offices of a multi-site home healthcare agency in a midwestern state were randomly assigned to the experimental or control condition. The nurses who worked for offices in the control group provided care as usual to their home care patient participants. Nurses who worked for offices in the experimental group provided their patient participants with technology-enhanced care.29 Consenting participants in this group either used their own computers or were provided with free computers and internet connection so that they (or their nurses) could access our specially designed web site for self-management (or nursing practice). The technology acceptance survey questionnaire examining patient participants' perceptions of using the web site for self-management was administered only to the experimental group's participants since those in the control group were not exposed to the technology. To ensure the participants used a consistent referent (ie, using the technology for self-management), they were instructed that the questions were used to ask about “your feeling of using the web site in doing the self-management” before they answered the questions.
Participant inclusion criteria were as follows: (1) admitted for home care registered nursing service by the home care agency; (2) any diagnosis of chronic cardiac disease related to coronary artery disease and/or congestive heart failure; (3) normal vision with corrective lenses; (4) non-cognitively impaired; (5) able to read and write in English; and (6) home dwelling within the service area of the participating home care agency offices. Eligible participants had to have sufficient network connectivity (phone line or cable network) in their home. Exclusion criteria included significant sensory or motor disabilities, mental incapacity, or requiring in-home continuous professional care. Those people were excluded because they were likely to be unable to use the technology intervention. In the parent study, 146 eligible participants were enrolled in the experimental group. This technology acceptance study began data collection about 7 months after the parent study had begun enrollment. At that time, 22 participants had either withdrawn from or completed part or all of the time points of the parent study, and, therefore, only 124 of the 146 experimental participants were involved in this acceptance study. The HeartCare II research and this acceptance study received institutional review board approval and obtained participant informed consent.
Following enrollment in the study, participants in the experimental-designated offices were either permitted to use their home computers or provided with a computer terminal and a modem for accessing the technology at no cost if they did not have their own computer. During the first or second week after the technology implementation, participants received training from their visiting nurses on how to use the technology to improve their self-management of their heart condition(s). Participants were also provided with a written manual and a pocket guide illustrating access and use of the system and its features.
All participants completed an assessment for demographic data during a home visit by a research registered nurse at baseline. At the participants' request, data were collected either via telephone or mail survey. For the telephone survey, a trained research assistant administered the survey to participants over the phone. Although CHIT acceptance survey data were collected at 1, 4, 8, 12, and 24 weeks post-implementation, in this paper we examined only cross-sectional data collected at week 4 to examine predictors of early acceptance and use.
The HeartCare web site
The technology used to test acceptance in this study was an interactive web-based health information system (henceforth called the HeartCare web site). The HeartCare web site allowed home care patients with chronic cardiac disease access to the resources for self-care in their homes. The web site was created with a graphical user interface. Participant users needed to use the mouse and keyboard to interact with the system. They were also required to login by typing their user name and password before navigating the web site. The web site offered resources to support three key functions for self-care: health information access, communication, and disease self-monitoring and self-management.
We carefully reviewed the literature and chose validated measurement scales to operationalize the theoretical constructs. All measurement items were adjusted to reflect the specific target behavior of interest in this study. Study variables were measured through subscales that were conceptually or semantically congruent. Both intact scales and modifications of existing scales were employed. Modifications, which were based on two rounds of cognitive interviews with senior citizens, included eliminating irrelevant items or rewording existing items for better acceptability to the target population.49 A total of 31 items were used to measure the 10 constructs tested in the conceptual model. Items for all constructs, except the perceived upper extremity functional ability and perceived visual functional status, were rated on 7-point Likert-type scales, ranging from “not at all” (0) to “a great deal” (6). Perceived upper extremity function was assessed with four items from the upper extremity subscale of the 32-item Late-Life Function and Disability Instrument.50–52 The items were phrased, “how much difficulty do you have doing a particular physical activity?” were answered on a 5-point scale with response options of “cannot do” (1), “quite a lot” (2), “some” (3), “a little” (4), and “none” (5).50–52 Perceived visual functional status was measured using the three-item near vision subscale of the 25-item National Eye Institute Visual Function Questionnaire.53 The items were rated on a 5-point scale, ranging from “no difficulty at all” (1) to “stopped doing this because of your (the participant's) eyesight” (5).53 The overall composite visual scores were calculated based on the standard algorithm.54 The scores range from 0 to 100 where a higher score represents less difficulty with near vision activities. The four-item usefulness and four-item ease of use scales from Davis et al26 were adapted to assess perceived usefulness and ease of use, respectively. Adapted from Venkatesh et al24 and Taylor and Todd,30 subjective norm and perceived behavioral control were measured with the three- and four-item scale, respectively. Health information seeking preference and healthcare knowledge were assessed based on the four- and two-item scales, respectively, developed by Wilson and Lankton.23
Behavioral intention, our measure of acceptance, was assessed with two items drawn from Venkatesh et al.24 Perceived effective use, our measure of use, was measured with one item developed within this study, “To what extent do you use the HeartCare web site as much as you should use it?” Most CHIT studies measure subjective use with frequency measures or simple yes/no measures. However, neither frequency nor duration of use is necessarily relevant to self-care or meaningful. A patient might use a health web site very infrequently and for short durations of time, but get exactly what they need from that web site. Another patient might spend hours searching for information, only to quit disappointed. Subjective measures of frequency or duration would correctly find the later patient used the web site more; but as demonstrated, that may not be the most relevant outcome. Because of such concerns, we used a new ‘effective use’ measure. Even though all measures except for perceived effective use were derived from previously validated scales, all items were still subjected to expert review by two engineering and four nursing researchers as well as two rounds of pilot testing with senior citizens using cognitive interview techniques. Cronbach's α was used to assess the internal consistency of the items for each construct.
Latent variable modeling with item parceling55–57 was used to determine the significant predictors of CHIT acceptance, starting with the proposed model (figure 1) and to examine the multivariate relationships among the variables using MPlus v 5.58 Maximum likelihood estimation was used for model fitting and parameter estimation. Measurement errors were computed for each latent variable and were included in model estimation. As suggested by Bollen59 (also see Coffman and MacCallum55), measurement errors were set to equal (1−α)×σ2, where α is the reliability estimate (Cronbach's α coefficient) of the items and σ2 is the variance of the mean scores of the latent construct. Model modification was done using a ‘backward search’ followed by a ‘forward search’ approach.60 The backward search continued until no further non-significant path was detected.60 61 Following that, the forward search identified paths that could be added (ie, reducing constraints) based on the MPlus modification indices.58 We intended to only add paths that were theoretically meaningful,60 61 however no additional paths were suggested for improved fit. Five commonly used goodness-of-fit indices were employed to assess the overall model fit; good fit was indicated by the ratio of χ2 to degrees of freedom (χ2/df<3), the comparative fit index (CFI≥0.90), the Tucker–Lewis index (TLI≥0.90), root mean square error of approximation (RMSEA<0.06; although RMSEA values as high as 0.08 are considered acceptable), and standardized root mean square residual (SRMR<0.08).62–67
Descriptive statistics of the sample
Of the 124 acceptance study's participants, 101 (81%) completed the acceptance survey at week 4. Of the 23 participants who did not complete the survey at week 4, seven were hospitalized, seven did not return the mail survey, six withdrew from the study, one was too ill to complete the survey, one was lost to follow-up, and one refused to complete the survey for personal reasons. Forty-eight of the 101 surveys were through phone interview and 53 were via mail. Participants' ages ranged from 28 to 90 years with a mean of 62.5 (SD 12.3). The sample had 61 males and 40 females. Their education ranged from 3 to 28 years with a mean of 14.1 (SD 3.6). The majority (79.2%) of the participants were Caucasian. Self-rated computer experience was none, beginner, competent, and expert in 14.9%, 32.7%, 40.6%, and 11.9% of the participants, respectively. Slightly more than half (57%) of the sample used their own computers versus computers provided by our project. Cronbach's α's, means, and SDs for the variables, and correlations between the acceptance constructs and behavioral intention and perceived effective use are shown in table 1.
The significant predictors are presented in figure 2. All five goodness-of-fit indices indicated that this reduced model fit the data well: χ2/df=1.42; CFI=0.99; TLI=0.98; RMSEA (90% CI)=0.064 (0.00–0.15); and SRMR=0.034. Perceived usefulness accounted for 53.9% of the variability in behavioral intention. The amount of variance in perceived effective use accounted for by perceived usefulness, healthcare knowledge, and behavioral intention was 68.5%. Perceived ease of use and subjective norm explained 48% of the total variance in perceived usefulness.
In the model, perceived usefulness significantly predicted behavioral intention. There was a significant un-hypothesized finding which emerged; it was found that perceived usefulness significantly directly influenced perceived effective use. Moreover, perceived usefulness had an indirect effect on perceived effective use through behavioral intention (indirect effect=0.34, p<0.001). The direct effect of perceived ease of use on behavioral intention was not significant, but perceived ease of use had an indirect influence on behavioral intention through perceived usefulness (indirect effect=0.41, p<0.001). Subjective norm had no direct effect on behavioral intention. However, subjective norm exerted an indirect influence on behavioral intention through perceived usefulness (indirect effect=0.20, p<0.05). Perceived behavioral control had no significant influence on behavioral intention or perceived effective use. Perceived upper extremity functional ability, perceived visual functional status, health information seeking preference, and healthcare knowledge were not associated with behavioral intention. However, healthcare knowledge significantly predicted perceived effective use. As expected, behavioral intention significantly predicted perceived effective use.
This study used the UTAUT as a theoretical basis and integrated variables related to health to examine the acceptance of a web-based, interactive self-management technology among home care patients. The model with significant paths fit the data well and showed the enduring predictive power of the core UTAUT variables—subjective norm, perceived ease of use, perceived usefulness—on acceptance (measured as behavioral intention) and self-reported use (measured as effective use). Consistent with previous CHIT acceptance studies,20 21 23 38 perceived usefulness was the most important factor that explained a significant proportion of the variance in behavioral intention. Patients had stronger intention to use a health technology if they believed that using the technology would enhance their ability and effectiveness in managing their disease. This study also found that perceived usefulness significantly influenced self-reported use, consistent with previous research.37 Patients who felt that the health technology was useful for their disease reported a higher usage of the technology.
Contrary to what was expected, perceived ease of use had no significant direct effect on behavioral intention. Davis et al26 noted that, over time, as users learn to use a technology, ease of use of the technology becomes less salient; thus, the effect of ease of use diminishes. In this study, we examined acceptance 4 weeks post-implementation. Ease of use may not have been a concern as patients may have learned to use the technology during that time; and thus, the effect of ease of use was not found. However, additional research is needed to understand any temporal relationships among ease of use, acceptance, and use with CHITs. Our results, like those of others,23 25 showed that patients' perceptions of usefulness, which strongly influenced their intention to use the technology, depended in part on the ease of use of the technology. This demonstrates ease of use is still an important variable for influencing acceptance of CHIT.
Studies on information technology acceptance have shown various results for the relationship between subjective norm and behavioral intention. However, this was the first study examining the relationship within a patient population. Our results match the findings of previous studies, demonstrating that subjective norm has no direct effect on behavioral intention.40 68 Nevertheless, subjective norm was still an important factor for patients' CHIT acceptance since our result showed that the factor indirectly influenced behavioral intention through perceived usefulness, consistent with other studies.40 69 This indicated that the influences of people who were important to the patients were essential in the development of patients' beliefs about the usefulness of the technology for managing their disease.
Healthcare knowledge had no significant impact on behavioral intention, but it positively predicted perceived effective use. Patients who felt that they were less knowledgeable regarding care for their disease were less likely to use the technology. Perhaps the issue is that low healthcare knowledge lowers patients' self-efficacy for using technology to obtain health information and to manage their health, and therefore lowers their use of the technology. In contrast, patients who have higher healthcare knowledge may benefit more readily from CHIT because they already understand health and can benefit from further information. However, the causal mechanism can only be speculated upon, and additional work is needed to examine the assertion.
Perceived behavioral control was hypothesized to exert direct effects on both behavioral intention and perceived effective use. However, perceived behavioral control had no effect on the variables. Moreover, contrary to what was expected, perceived visual functional status, perceived upper extremity functional ability, and health information seeking preference had no significant influence on behavioral intention. However, the findings should be interpreted with caution. Our data indicated that there was low variability in the responses for those variables (ie, a substantial number of participants responded having good visual ability, high upper extremity functional status, and high preference for health information seeking). This may have occurred because the overall study design excluded those people with significant limitations to their sensory or motor abilities. Also, it is possible that patients who had a high preference for health information seeking were more willing to agree to participate in the overall study. The low variability in these data elements could limit the possibility of finding significant effects for these variables. More research on these variables is needed.
There are a number of limitations in this study. First, the sample size was small. This current study represents a rare attempt to model patient technology acceptance using a theoretically grounded model. However, this study is exploratory. We only studied one group of patients and had a sample size of only 101. We note, however, that Or and Karsh's review of 52 previously published studies of patient acceptance of CHIT only had large samples when the CHIT under study was a health internet web site. On the other hand, the six previous studies of CHIT similar to ours had sample sizes of 12,44 32,21 35,22 38,45 100,70 107,19 and 163,23 making our sample not unusually small. To address this limitation, we had to restrict the number of a priori parameters to estimate in order to maintain a minimum of 5:1 subject-to-parameter ratio.71 Because of that, potential confounders, which also might have served as moderators, were not included in the model. These variables include age, gender, education, computer experience, and computer ownership. No other studies of CHIT acceptance have assessed those moderators18 and it is unfortunate our sample size precluded us from doing so. The sample size may also call into question the null results; perhaps with larger samples some of those might have been significant. Nevertheless, the model fit the data well, perceived usefulness accounted for over 50% of the variation in acceptance, and perceived usefulness, healthcare knowledge, and behavioral intention accounted for 68% of the variance in perceived effective use. The UTAUT likely holds promise in explaining significant variation in acceptance and use of CHIT. Second, this study evaluated technology usage behavior using a perceived effective use measure as opposed to objective measures. Objective measures may result in more accurate estimates. However, most previous CHIT acceptance studies have employed self-reported measures,18 and ample research exists demonstrating that that self-reported measures correlate well with objective measures.30 40 Third, the generalizability of this study should be evaluated in light of the fact that it was conducted on a sample of home care patients with chronic cardiac disease. Fourth, several variables that might help further explain acceptance and use were not explored in this study. Those factors, including computer affect, intrinsic motivation, satisfaction with medical care, computer self-efficacy, and internet skill training,18 72 73 may have the potential to determine CHIT acceptance among chronically ill patients and merit future exploration.
Future research in this area should focus on several areas. First, larger samples will be needed to add the variables we could not test, but also to further develop the left side of the model. That is, it will be important to model the determinants of usefulness and ease of use more precisely as those determinants can translate directly into design. Second, moderator analyses will be necessary to tease out the details of how disability, age, gender, and other variables might affect the model. Third, longitudinal models should be explored to determine whether and how the model changes with time.
To conclude, CHITs are expected to bring benefits to their users, such as patients. Evidence shows that CHITs can improve patients' quality of life and well-being, increase medication adherence, facilitate the healthcare delivery process, and support home care patient self-management.4–6 74 75 However, those benefits will only accrue to patients if the technology is accepted and used. There are many ways in which CHITs can fail to gain users' acceptance. Current patient users of health technology will be less likely to accept the technology when they perceive it as disadvantageous or functionally incompatible with their needs, existing values, or past experiences (ie, systems are not useful).12 13 Our results suggest that, first and foremost, in order to increase the likelihood that patients will experience the potential benefits of CHITs, the technology must be designed such that system applications are in consonance with patients' needs. This is of course easier said than done, but the results have design and development implications. Based on the items measuring usefulness, the data have suggested that CHITs that are designed to support disease management must improve patients' ability to manage their disease, save them time managing their disease, and make them more effective at managing their disease. Achieving these goals will likely require cognitive analyses, such as cognitive work and task analyses,15 76–78 followed by careful attention to human factors engineering79 and cognitive engineering principles for designing automation to support cognitive work (eg, managing a disease).80–84 Moreover, experiences within and outside of healthcare have advocated active involvement of intended target users in the process of technology design and development (ie, user participation) as one of the principal methodologies for technology designers or health informatics practitioners to address actual user needs and preferences for a new system.68 85–87 Such analyses and user involvement can ensure that necessary and desired content and functions are present to support disease management. As Demiris et al pointed out, “The targeted users of the system can provide useful feedback… They can point out features they perceived as undesirable for such a system and redirect the design efforts” (p 470).87 Applying usability principles is necessary but not sufficient to achieve useful CHIT; cognitive analyses and user involvement provide the ‘what’ to design; usability principles and principles of data representation for problem solving88 can provide the ‘how.’
Our study also showed that subjective norm and patients' perception of ease of use significantly determined the perception of usefulness. The subjective norm measure asked the patients the extent to which their nurses and other people important to them wanted them to use the web site. This highlights the need for caregivers and important others, perhaps family members, to be champions of the technology to help increase perceptions of usefulness. The perceived ease of use measure was comprised of items measuring ease of learning as well as ease of manipulating the web site, both of which can be addressed through attention to methods and principles of usability89 90 and application of scientific principles of training.91 92 The literature has emphasized the importance of training for elderly patients for using computer or web-based health technology.87 93–95 A series of operational and computer/internet skills training sessions may be necessary to improve (elderly) patients' skills and level of confidence in their ability to use technical innovations, which may improve the feelings of ease of use. Proactively considering the issues should help create acceptance for the technology, which in turn should increase the likelihood of technology implementation success.18 96 97 We believe these factors are especially important for the population we studied, a patient population that includes mostly frail elderly patients, because of their unique design requirements.87 98 As has been pointed out, “elderly patients may have difficulty reading electronic sources because of the small size of the font, irrelevant or excessive use of information and graphical representations… Challenges can also arise if the technology is not made with a user-friendly design” (p 205).93 This is especially important for those health informatics practitioners who want to achieve higher usability and accessibility for technology designed for elderly patients. Using a poorly designed web system (eg, overwhelming interface or inadequate feedback) can be a challenge for healthy users. The challenge becomes even larger when a non-user-friendly system is pushed onto the elderly patient users who have functional decline and disability. Designing a system for elderly patient users should aim to improve its interface usability as well as functional and physical accessibility, which can be achieved by applying a specific set of design guidelines and recommendations.87 93 98–102
The authors thank all of the nurses and patient participants who were involved in the study. The authors also thank Pascale Carayon, Gail Casper, and Marge Sebern for their assistance on the study and helpful comments on the manuscript.
Funding This study was funded by a grant from the National Library of Medicine (R01-LM6249, ‘HeartCare II-Custom Support for Home Care’).
Competing interests None.
Ethics approval This study was conducted with the approval of the institutional review board of the University of Wisconsin-Madison and Aurora Health Care.
Provenance and peer review Not commissioned; externally peer reviewed.