A Randomized Trial Comparing Telemedicine Case Management with Usual Care in Older, Ethnically Diverse, Medically Underserved Patients with Diabetes Mellitus
- Steven Shea,
- Ruth S Weinstock,
- Justin Starren,
- Jeanne Teresi,
- Walter Palmas,
- Lesley Field,
- Philip Morin,
- Robin Goland,
- Roberto E Izquierdo,
- L Thomas Wolff,
- Mohammed Ashraf,
- Charlyn Hilliman,
- Stephanie Silver,
- Suzanne Meyer,
- Douglas Holmes,
- Eva Petkova,
- Linnea Capps,
- Rafael A Lantigua for the IDEATel Consortium
- Affiliations of the authors: Departments of Medicine (SSh, WP, LF, RG, RAL), Biomedical Informatics (SSh, JS, MA, CH), and Radiology (JS) and Naomi Berrie Diabetes Center (RG), Columbia University, New York, NY; Departments of Epidemiology (SSh) and Biostatistics (EP), Joseph Mailman School of Public Health, Columbia University, New York, NY; Joslin Diabetes Center and Division of Endocrinology, Diabetes and Metabolism, SUNY Upstate Medical University, Syracuse, NY (RSW, REI, SM); Department of Veterans Affairs, VA Medical Center, Syracuse, NY (RSW); Research Division of the Hebrew Home for the Aged at Riverdale, Bronx, NY (JT, SSi, DH); Stroud Center, Columbia University, and New York State Psychiatric Institute, New York, NY (JT); Department of Family Medicine, SUNY Upstate Medical University, Syracuse, NY (LTW); Department of Medicine, Harlem Hospital Center, New York, NY (LC)
- Correspondence and reprints: Steven Shea, MD, Division of General Medicine, 630 W. 168th Street, New York, NY 10032; e-mail: < >
- Received 22 July 2005
- Accepted 21 September 2005
Background Telemedicine is a promising but largely unproven technology for providing case management services to patients with chronic conditions who experience barriers to access to care or a high burden of illness.
Methods The authors conducted a randomized, controlled trial comparing telemedicine case management to usual care, with blinding of those obtaining outcome data, in 1,665 Medicare recipients with diabetes, aged 55 years or greater, and living in federally designated medically underserved areas of New York State. The primary endpoints were HgbA1c, blood pressure, and low-density lipoprotein (LDL) cholesterol levels.
Results In the intervention group (n = 844), mean HgbA1c improved over one year from 7.35% to 6.97% and from 8.35% to 7.42% in the subgroup with baseline HgbA1c ≥7% (n = 353). In the usual care group (n = 821) mean HgbA1c improved over one year from 7.42% to 7.17%. Adjusted net reductions (one-year minus baseline mean values in each group, compared between groups) favoring the intervention were as follows: HgbA1c, 0.18% (p = 0.006), systolic and diastolic blood pressure, 3.4 (p = 0.001) and 1.9 mm Hg (p < 0.001), and LDL cholesterol, 9.5 mg/dL (p < 0.001). In the subgroup with baseline HgbA1c ≥7%, net adjusted reduction in HgbA1c favoring the intervention group was 0.32% (p = 0.002). Mean LDL cholesterol level in the intervention group at one year was 95.7 mg/dL. The intervention effects were similar in magnitude in the subgroups living in New York City and upstate New York.
Conclusion Telemedicine case management improved glycemic control, blood pressure levels, and total and LDL cholesterol levels at one year of follow-up.
The past decade has seen an explosion of interest in informatics resources that can be used directly by patients and consumers.1 A wide variety of systems has been fielded. Patients have been given access to hospital-based electronic medical records (EMRs).2 3 4 Personal health records have been developed for use directly by patients5 6; synchronous videoconferencing has been used for patient education, monitoring, and motivation7 8 9 10; and remote monitoring has been used to capture disease-specific measurements electronically, such as blood glucose or vital signs.11 12 13 14 15 16 17 With the advent of the World Wide Web, Web sites have been developed to provide disease-specific education,18 19 and e-mail has been used increasingly for interactions between patients and providers.20 21 22 More recently, Web-based messaging has been viewed as a way to circumvent some of the limitations of traditional e-mails.23 24 25
Despite the number and variety of technical approaches that have been developed, several authors have noted the relative scarcity of rigorous evaluations.26 27 28 The relative lack of substantive telemedicine evaluation data is related to multiple issues, including the underlying difficulty and cost of conducting robust evaluation, lack of studies using randomized designs with concurrent controls, small sample sizes, short-term follow-up, and lack of multidisciplinary evaluation teams. Thus, despite the obvious promise of this technology, the clinical effectiveness of telemedicine, both in general and in specific clinical contexts, remains poorly documented. The Informatics for Diabetes Education and Telemedicine project (IDEATel)29 30 was therefore undertaken as a prospectively randomized clinical trial of health services delivered electronically directly to patients with diabetes in their homes.
Diabetes was selected as the target clinical domain for IDEATel for a number of reasons. An estimated 18 million adults in the United States have diabetes,31 with the prevalence increasing as the population ages and obesity increases.32 33 Type 2 diabetes accounts for 90% to 95% of diagnosed cases in adults, increases markedly with age and obesity, and is more common in African-Americans and Hispanics compared to non-Hispanic whites.31 34 The costs of diabetes in 2002 exceeded $132 billion including $92 billion in direct medical costs.31 Those over 65 years of age account for two thirds of all costs.35 The chronic complications of diabetes are responsible for most of the morbidity, mortality, and cost, with most diabetes-related mortality due to macrovascular disease, specifically coronary artery and cerebrovascular disease.36 Treatment of hypertension and dyslipidemia in patients with diabetes decreases these complications and is cost-effective.37 38 39 40 41 42 43 The microvascular complications of diabetes, including neuropathy, nephropathy, and retinopathy and blindness, can be reduced by improving control of glycemia and blood pressure.37 44 45 46 47 48 Thus, extensive evidence supports the benefit of improving management in type 2 diabetes for preventing morbidity and mortality from both macro- and microvascular disease.
Diabetes is frequently selected as the target condition for evaluations of telemedicine and remote monitoring because of the need for ongoing educational, motivational, and monitoring activities.11 12 13 17 49 50 Access to in-person case management for diabetes may be impeded by a number of factors. In rural areas, these include geographic distance, weather, lack of public transportation, and provider shortages. In urban inner cities with predominantly minority populations, obstacles include language, culture, low educational attainment, disempowerment, lack of social reinforcement for health-related behaviors and activities, and provider shortages. Telemedicine supports patient-provider interactions that are both distant and asynchronous51 and thereby offers the potential to improve access, the process of care, and clinical outcomes. The Centers for Medicare and Medicaid Services (CMS), the federal agency responsible for administering the Medicare program, provides only limited reimbursement for electronically delivered health care services, because of lack of data demonstrating effectiveness.26 27 28
In many ways, the IDEATel project combines features traditionally associated with telemedicine (videoconferencing and remote monitoring) with those traditionally associated with informatics (Web-based tools and integration with EMRs). The details of the IDEATel technical implementation have been described previously30 52 53 and are reviewed briefly in the Methods section. Other articles, either published or in preparation, address various aspects including the implementation process,54 cognitive design issues,55 56 clinician perceptions, and patient perceptions. This article focuses on the impact of the IDEATel intervention on clinical outcomes. Specific hypotheses were that the intervention would improve hemoglobin A1c, blood pressure, and lipid levels compared to usual care.
Eligibility and Exclusions
Criteria for inclusion were age 55 years or older; being a current Medicare beneficiary; having diabetes mellitus defined by a physician's diagnosis and being on treatment with diet, an oral hypoglycemic agent, or insulin; residence in a federally designated medically underserved area (either of two federal designations, medically underserved area [MUA] or health professional shortage area [HPSA]) in New York State; and oral fluency in either English or Spanish. Exclusions were moderate or severe cognitive, visual, or physical impairment or the presence of severe comorbid disease. It is important to note that neither literacy nor any prior computer experience as required of subjects. In addition, no specific threshold level of HbA1c was required.
Subjects were enrolled through primary care practices in New York City, with the enrollment hub at Columbia University Medical Center, and in upstate New York, where the enrollment hub was at State University of New York (SUNY) Upstate Medical University at Syracuse. Recruitment in the upstate area spanned a geographic area of approximately 30,000 square miles. Systematic review of patient panels was conducted at participating practices in order to identify potentially eligible patients. A total of 9,597 potential participants were identified in this fashion (Fig. 1). Eligibility was screened by telephone prior to the baseline examination and again at the baseline examination. Potentially eligible subjects were contacted by mail and telephone and invited to attend the baseline examination, where consent was obtained. Randomization to telemedicine case management or to usual care was assigned in a 1:1 ratio by the study coordinating center (Research Division of the Hebrew Home for the Aged at Riverdale) immediately upon completion of the baseline examination. Randomization began in December 2000, and was completed in October 2002. Subjects were randomized within clusters defined by primary care provider patient panels. For subjects assigned to intervention, an appointment was made by telephone for installation of the home telemedicine unit within two weeks. A follow-up examination was conducted one year after the baseline examination. Personnel conducting these examinations were blinded to intervention status and were not involved in supporting the technical aspects of the intervention or in delivering diabetes case management services. Written informed consent was obtained from all subjects. The study was approved by the Institutional Review Boards at Columbia University Medical Center, SUNY Upstate Medical University at Syracuse, and all participating hospitals and health care provider organizations.
Participants randomized to the intervention group received a home telemedicine unit (HTU) developed specifically for IDEATel (American Telecare, Inc.; Eden Prairie, MN). The HTU consisting of a Web-enabled computer with modem connection to an existing telephone line. The HTU provided four major functions: (i) videoconferencing over plain old telephone service (POTS) connections at eight to 15 frames per second allowing patients to interact with nurse case managers at the Berrie Diabetes Center at Columbia University or the Joslin Diabetes Center at SUNY Upstate Medical University; (ii) remote monitoring of glucose (One Touch Sure Step; LifeScan, Inc.; Milpitas, CA) and blood pressure (UA-767 Blood Pressure Monitor; A&D Medical; Milpitas, CA) with electronic upload and integration with the Columbia EMR57; (iii) dial-up Internet service provider access to a Web portal providing access to patients' own clinical data and secure Web-based messaging with nurse case mangers; and (iv) access to an educational Web site created for the project by the American Diabetes Association in English and Spanish and in regular and low-literacy versions in each language.30 A major goal of the technical implementation was the tight integration of the project-specific telemedicine systems with existing clinical systems through the use of well-established standards, in particular Health Level 7 (HL7).30 52 Figure 1 summarizes the servers and data flows. Three separate methods for uploading monitoring data were provided (1,3,7 in Fig. 1). Patients can upload data directly over an SSL tunnel (3 in Fig. 1). During video visits, nurse case managers can capture data from devices connected to the HTU (1>2>5 in Fig. 1). Last, patients can log into the Web portal to manually enter results (7 in Fig. 1). All results are converted to HL7 and stored in the New York Presbyterian Data Repository. A combination of strategies provided security.53 Project servers were placed in a firewalled subnet. Data transfers on the public Internet were encrypted. All Web access used secure socket layer encryption. Patient HTUs were secured via encrypted public key infrastructure tokens on the HTUs. Clinician access was secured through Lightweight Directory Access Protocol authentication for on-campus access and time-based cryptographic tokens (RSA Security, Bedford, MA) for remote access. A security policy server (Netegrity, Computer Associates, Islandia, NY) allowed for multiple authentication schemes based on user class.
Nurse case managers were trained in diabetes management and in the use of computer-based case management tools to facilitate interactions through videoconferencing with patients. Some subjects also received glucose test strips for the specific glucose monitor provided by the study. Subjects were trained in the use of the HTU at the time of installation and were selectively retrained during the study based on the assessment of the nurse case manager. Intervention subjects were assigned to a project case manager under supervision of diabetologists at the Joslin or Berrie Diabetes Centers (upstate and New York City subjects, respectively). Case managers interacted with patients using the HTU and case management software. We used Version 2.2b (updated May 2000) of the Veterans Health Administration Clinical Practice Guidelines for the Management of Diabetes Mellitus in the Primary Care Setting.58 These guidelines are flexible, annotated, evidence based, and algorithmic in format. The primary care physicians of intervention patients retained full responsibility and control over their patients' care. The case managers' notes were reviewed by the supervising diabetologist, and when a change in management was suggested, the primary care physician was contacted by e-mail, fax, letter, or phone.
Patients in the usual care group remained under the care of their primary care providers. These primary care providers cared for patients in both the intervention and usual care groups, following the design whereby randomization was clustered within clinical practice. The primary care providers received a mailing with current guidelines for the care of patients with diabetes. The clinical care that patients in the usual care group received was delivered by their primary care providers, without other guidance or direction from study personnel.
Prespecified endpoints were hemoglobin A1c, blood pressure, and low-density-lipoprotein (LDL) cholesterol levels. Subjects were instructed to come to the baseline and follow-up examinations fasting and having held their glycemic control medications. For New York City subjects, all examination data were collected at Columbia University Medical Center. For Upstate subjects who could conveniently travel to Syracuse, these data were collected at the SUNY Upstate Medical University, while for those living too distant, examinations were performed in regional medical centers and medical offices. For subjects unable to travel, home visits were made by trained nurses who carried with them phlebotomy equipment, a cooler for transport of blood and urine specimens, a blood pressure device with various-size cuffs, and a scale, a stadiometer, and a measuring tape. Specimens collected in the field were spun and frozen at regional sites. Blood pressure measurements and blood and urine samples were obtained in the fasting state in the morning. After breakfast, questionnaire data were collected. Specimens were processed and frozen at the data collection sites and analyzed at Medstar Laboratory (Washington, DC). Hemoglobin A1c was analyzed by boronate affinity chromatography with the Primus CLC 385 (Primus, Kansas City, MO). Total cholesterol, triglyceride, and high-density lipoprotein (HDL) cholesterol were measured using enzymatic colorimetric methods (Vitros, Johnson & Johnson, New Brunswick, NJ). LDL cholesterol was calculated using the Friedewald equation59 for subjects with triglyceride level < 400 mg/dL and measured directly using a homogeneous assay (Polymedco, Cortlandt Manor, NY) for those with triglyceride level ≥400 mg/dL. Resting blood pressure was measured using a Dinamap Monitor Pro 100 (Critikon, Tampa, FL) automated oscillometric device. Three measurements were obtained following 5 minutes of rest using a standardized protocol.60 The average of the second and third measurements was recorded as the resting blood pressure. Demographic and other questionnaire data were collected by interviewers at the baseline examination. Blood pressure values were communicated to participants at the time of the examination. Hemoglobin A1c and lipid levels at the baseline and follow-up examinations were communicated by mail to participants and their primary care providers for both the intervention and control groups. Data collection for the follow-up examination was completed on October 31, 2003.
Sample Size and Power Calculations
The planned sample size was 1,500, with 750 allocated to each arm of the study, based on power calculations using analysis of covariance and longitudinal random effects models for hemoglobin A1c and blood pressure. Power calculations were based on the following assumptions: overall attrition estimates of 20%, reliability of the outcome variables of 0.90, cluster intercorrelations ranging from 0.05 to 0.2, α = 0.05, and two-tailed test for each of the primary outcomes. Based on calculations performed assuming different scenarios regarding variances and effect sizes, power was at least 0.80 for detection of clinically meaningful changes in the outcomes. The sample size was increased during the recruitment phase of the study to compensate for differential early dropout in the intervention group.
Analysis of covariance was used to adjust for baseline values of the outcomes and the design feature of clustering, with each primary care provider treated as a random effect. Additionally, the group heterogeneity in cluster and residual variances was modeled in order to satisfy model assumptions and improve model fit, using SAS PROC MIXED.61 Examination of skew and kurtosis indicated that variable transformations were not required. Significance tests were two tailed, and no adjustment of p-values for multiple outcomes was applied.
Recruitment, enrollment, randomization, and completion of the follow-up examination are shown in Figure 2. The one-year follow-up examination was not completed by 248 of the 1,665 randomized subjects (14.9%), of whom 144 were assigned to intervention and 104 to usual care.
The intervention and usual care groups did not differ with respect to baseline demographic and clinical characteristics (Table 1). Mean age was approximately 71 years (median, 70) in both groups. Subjects living in the New York City region were younger, more likely to be Hispanic and African American, have lower educational attainment and annual household income, to be eligible for Medicaid, to live alone, and to respond “no” to the question “Do you know how to use a computer?” compared to subjects living in the Upstate region (Table 2).
At one year of follow-up, mean hemoglobin A1c level decreased in the intervention group from 7.35% to 6.97% (Table 3, panel A). The net adjusted reduction in hemoglobin A1c in the intervention group compared to the usual care group was 0.18% (p = 0.006), despite a reduction in the control group from 7.42% to 7.17% over this time (Table 3, panel A). In the intervention subgroup with hemoglobin A1c ≥7% at baseline (n = 353), mean A1c level decreased from 8.35% to 7.42%, with net adjusted reduction of 0.32% (p = 0.002). For the study sample as a whole, mean systolic and diastolic blood pressure level decreased in the intervention group from 142/71 mm Hg to 137/68 mm Hg. The net adjusted reductions for systolic and diastolic blood pressure were 3.4 mm Hg (p = 0.001) and 1.9 mm Hg (p < 0.001). For total and LDL cholesterol these net adjusted differences were 11.06 mg/dL and 9.5 mg/dL (p < 0.001 for both). Changes over one year in the control group in blood pressure and lipid levels were small. Mean LDL cholesterol level in the intervention group at one year was 95.7 mg/dL.
Subjects who did not complete the one-year follow-up examination did not differ from those who did at the p ≥ 0.05 level with respect to age, sex, race/ethnicity, and baseline levels of hemoglobin A1c, blood pressure, and LDL cholesterol. Findings from analyses in which the baseline values of subjects who did not complete the one-year follow-up examination were carried forward as the one-year follow-up value, and with the same statistical adjustments as in the main analysis, were consistent with the main findings (Table 3, panel B).
One-year follow-up results were also analyzed separately in the Upstate New York and New York City regions because of the baseline differences in subjects recruited in the two areas and also because of the potential for heterogeneity in the intervention, which was delivered to each of these two groups of subjects from a single diabetes center in Syracuse or New York City, respectively. The intervention effect was similar in magnitude in the two regions for each of the clinical outcomes (Table 4, panels A and B). Intervention subjects made extensive use of the home telemedicine system (Table 5). All aspects of the system received greater utilization by subjects in the Upstate region compared to those in New York City.
The cost to the project of the home telemedicine unit was $3,425 per unit ($3,000 for the patient station, $225 for the blood pressure cuff, $75 for cables, and $125 for the cart). The home glucometers were provided to the project at no cost by LifeScan, Inc. The quoted cost for the glucometer and cable was $110.
We found that diabetes case management delivered using telemedicine improved hemoglobin A1c, blood pressure, and LDL cholesterol levels in older patients with diabetes mellitus at one year of follow-up compared to usual care. Intervention effects of approximately the same magnitude were observed in both urban and rural subgroups. The intervention effect on diabetes control was greater in the subgroup with hemoglobin A1c ≥7% at baseline, with an absolute change from 8.35% to 7.42% and a difference net of change in the usual care group of 0.32%. Entry into the study required residence in federally designated medically underserved geographic areas. Because of the high concentration of people with low income living in these areas, the study group had high proportions of subjects with Medicaid eligibility, of Hispanic and African American race/ethnicity, and with low levels of educational attainment and computer familiarity. Nonetheless, the computer-dependent intervention strategy met with a high level of acceptance, was used, and had favorable effects on the main outcomes.
Diabetes control in the usual care group, as measured by mean hemoglobin A1c level, improved over the one year of follow-up by 0.25%, from 7.42% to 7.17%. In the subgroup with hemoglobin A1c ≥7.0% at baseline, this change was 0.74%, from 8.52% to 7.78%. These improvements in the usual care group are consistent with secular trends in improved diabetes care nationally,62 spill-over effects of the intervention, or both. Secular trends in diabetes care may have resulted from national educational and quality improvement programs,63 64 publication of standards of care,65 and recent availability of new classes of drugs.66 Spill-over effects may have occurred because all participating physicians received educational materials on diabetes management as well as communications from the study case managers regarding management of specific intervention patients. The study design randomized subjects within physician practices. Although the average cluster size was small (mean, 3; median, 1), many participating physicians managed patients in both the intervention and control groups. Reporting of baseline hemoglobin A1c to participants and their physicians may also have contributed to improved glycemic control in both groups. These contexts may explain the relatively smaller clinical impact of the intervention, net of changes in the control group, on hemoglobin A1c.
The follow-up examination was not completed by 248 of the 1,665 randomized subjects, of whom 144 were randomized to intervention and 104 to usual care. Information obtained by study staff from intervention subjects who dropped out suggests that the differential loss to follow-up was due largely to factors related to the HTU, including its physical size and difficulties subjects experienced in learning how to use it. The dropout rate for the intervention subjects cannot be directly compared with most other telemedicine or remote monitoring studies for several reasons. First, very few other telemedicine intervention studies continued for one year or more. Second, few used an intention-to-treat analysis.67 In particular, in our study, patients who were randomized to the intervention group but never had HTUs installed due to poor telephone line quality were counted among the intervention dropout group.
Very few subjects in our study who were able to use the device effectively dropped out, and the dropout rate was greater among those in the intervention group who experienced difficulty using the home telemedicine device. Thus, loss to follow-up was not random. We attempted to address the issue of loss to follow-up by performing an analysis with the baseline value carried forward.68 The results of this analysis showed that the intervention effects remained significant, assuming that those who dropped out did not experience worsening of mean hemoglobin A1c, blood pressure, and lipid levels over the year following randomization.
We compared diabetes case management delivered using telemedicine to usual care, which for most patients did not incorporate case management. Comparison of telemedicine versus in-person delivery of diabetes case management would not have been feasible across the geographic span of the State of New York, nor would such a design have addressed the question whether telemedicine is an effective strategy for improving diabetes care compared to currently available patterns of care. Another feature of our design was that all medication changes were made by the primary care physicians rather than directly by the nurse case managers, so that the diabetes case management was embedded within the primary care process. Although primary care physicians were offered secure Web-based messaging, most preferred to interact with nurse case managers through traditional communication media, telephone, and fax. Not all recommendations for medication changes from the intervention team were implemented by the primary care practitioners. We did not compare diabetes case management and primary care for patients with diabetes.
Our findings are generally consistent with those of smaller studies of telemedicine as a means of providing care for patients with diabetes that reported patient acceptance, improved glycemic control, or both.13 67 69 70 71 72 The IDEATel project, however, differs from prior studies in a number of ways. The most obvious difference is scale. The IDEATel results indicate that the benefits described in smaller studies can be delivered to large numbers of patients across broad geographic expanses and substantial sociodemographic diversity. To our knowledge, it is the first telemedicine study to report simultaneous improvements in HbA1c, blood pressure, and lipids. The study is also unusual in that the recruitment process did not target patients with poor glycemic control, nor did it require computer experience or computer literacy for eligibility. As such, we believe it may be more representative of the population at large. Previous telemedicine studies have been based in individual clinical practices or small groups of practices.13 16 17 49 67 72 73 Unlike most other studies, IDEATel included large numbers of medically underserved and ethnic minority subjects. The IDEATel intervention spanned hundreds of independent practices. Most prior studies have used stand-alone systems. The IDEATel system demonstrates the feasibility of tight, standards-based integration between a remote case management system and a large EMR. It also demonstrates the feasibility of data capture directly from home monitoring devices into a longitudinal, comprehensive EMR. From an informatics research standpoint, this study demonstrates that large-scale, prospectively randomized clinical trials of informatics interventions are possible.
A number of obstacles remain to be overcome before the full potential of telemedicine can be brought to bear on the health care delivery system. Foremost among these is the cost of technology and personnel for effective case management. The cost to the project of the home telemedicine devices was $3,425. In addition, Medicare claims were greater in the intervention group compared to the usual care group during the one year of follow-up, a finding consistent with the fact that enrollment occurred only in federally designated medically underserved areas and with the inference that the intervention contacts increased needed use of health care services. A full analysis of Medicare claims and project-related intervention costs will be reported separately. Other obstacles to the use of telemedicine and the Internet in health care include lack of data system resources for providers to capture and respond to uploaded data, reimbursement models, and state medical licensing regulations that require telemedicine-based providers to be in the same state as patients.74 75 Some of these barriers are being addressed in part by rapidly evolving technical solutions that are smaller, portable, less expensive, more familiar, and easier to use. The IDEATel study provides evidence that medical informatics and telemedicine technology can help to translate advances in treatment of chronic diseases into effective health care. Our study also provides evidence that the “digital divide”76 is an addressable rather than an insurmountable obstacle to use of computer-based technology to improve care for chronic conditions for many patients with limitations in access. The implication is that telemedicine has the potential to be an effective means of providing case management for older persons with diabetes and possibly for other groups as well.
Supported by Cooperative Agreement 95-C-90998 from the Centers for Medicare and Medicaid Services.
We acknowledge the contributions of Dr. Paul D. Clayton to the conceptualization of this project and to the creation of the clinical medical informatics infrastructure at Columbia University Medical Center and of Drs. Edward Shortliffe and George Hripcsak in providing support for that infrastructure. This paper is dedicated to the memory of Catherine Tuck, MD.
The IDEATel Research Consortium includes the following: Columbia University and New York-Presbyterian Hospital (New York, NY): Steven Shea, MD, MS, Justin Starren, MSD, PhD, Walter Palmas, MD, Lesley Field, RN, MSN, Robin Goland, MD, Catherine Tuck, MD (deceased), Rafael Lantigua, MD, Soumitra Sengupta, PhD, David Kaufman, PhD, Vimla Patel, PhD, Mohammed Ashraf, Charlyn Hilliman, MPA, Sean Mota, Patricia Kringas, RN, Jessica Rivera, RN, Rene Bachmann, RN, CDN, CDE, David Baorto, MD, PhD, Dimitri Borovtsov, Yao Huang, Rajhunathan Kamasmudram, PhD, Khalid Qureshi, Yuri Vayman; Harlem Hospital Center (New York, NY): Linnea Capps, MD; St. Luke's-Roosevelt Hospital Center (New York, NY): Alejandro Prigollini, MD; Research Division of the Hebrew Home for the Aged at Riverdale (Bronx, NY): Douglas Holmes, PhD, Jeanne Teresi, EdD, PhD, Stephanie Silver, MPH, Jian Kong, MS, Eva Petkova, PhD, Joseph P. Eimicke, MS, Onie Manzano, BS; SUNY Upstate Medical University at Syracuse (Syracuse, NY): Ruth Weinstock, MD, PhD, Philip Morin, MS, Roberto Izquierdo, MD, L. Thomas Wolff, MD, Suzanne Meyer, RN, CDE, Paul Knudson, MD, Suzan M. Carusone, RN, CCRC, Fraser G. Tudiver, MD (currently at East Tennessee State University, Johnson City, TN), Teresa J. Wagner, MS, Carina Lagua, MA, RD, CDE, Susan Fox, RN, Susan West, RN, MSN, CDE, JoAnn Shupe, AOS, Donald R. Roller, BS, Joseph Ziemba, MBA, David P. Thomson, MD, Kelly Duncan BSW, CCRC, Sarah Doolittle, BS, CCRC, Joanne Kearns, MA, RD, CDE, Deborah Bowerman, RN, CDE, Phyllis T. Bazen, MSN, ACNP-C, Pamela Suddaby, RN, BS, Kristine M. Brindak, RN; A. L. Lee Memorial Hospital, Inc. (Fulton, NY): Shirley Seabury, MHA; Arnot-Ogden Medical Center (Elmira, NY): John F. Carroll, MD, MBA, Frederic P. Skinner, MD, PhD, Terri L. Ennis, RN. Bassett Healthcare (Cooperstown, NY): Kathleen Sellers, RN, PhD, Barbara Leo, BA, BS, RN, Elsie Haus, MEd, FNP, Catherine Cooney, BS, MA, RN; Delaware Valley Hospital (Walton, NY): Michael J. Freeman, DO, MPH; Family Health Network of Central New York, Inc. (Cortland, NY): Susan Ulrich, MS, RN, CPNP; Guthrie Healthcare System (Sayre, PA): Brian D. Cassetta, MD; Hudson Headwaters Health Network (Glens Falls, NY): Patricia Auer, MSN, FNP, W. Emily Hammond, AAS, RN, Cairenn L. Young, MSW, Mary M. Beadnell, LPN; Lourdes Hospital (Binghamton, NY): Timothy C. Howland, MD; Olean General Hospital (Olean, NY): Robert Catalano, MD, Galvin Anderson, MD, Terri N. Kolasinski, RN; Samaritan Medical Center (Watertown, NY): Anil Shah, MD, Kate R. Fraczek, RN, Terry Flynt, BSN, RN; State University of New York at Buffalo (Buffalo, NY): John Taylor, MBA, Lurene R. Tumiel, PhD, Marc Shilling, MA, MPA, Chester Fox, MD; United Health Services (Binghamton, NY): David Kwiatkowski, MD; American Telecare, Inc. (Eden Prairie, MN): Randall S. Moore, MD, MBA, C. R. Abbruscato, MSEE, Karen Boril.