Psychometric Properties of Patient-Facing eHealth Evaluation Measures: Systematic Review and Analysis.

BACKGROUND: Significant resources are being invested into eHealth technology to improve health care. Few resources have focused on evaluating the impact of use on patient outcomes A standardized set of metrics used across health systems and research will enable aggregation of data to inform improved implementation, clinical practice, and ultimately health outcomes associated with use of patient-facing eHealth technologies. OBJECTIVE: The objective of this project was to conduct a systematic review to (1) identify existing instruments for eHealth research and implementation evaluation from the patient's point of view, (2) characterize measurement components, and (3) assess psychometrics. METHODS: Concepts from existing models and published studies of technology use and adoption were identified and used to inform a search strategy. Search terms were broadly categorized as platforms (eg, email), measurement (eg, survey), function/information use (eg, self-management), health care occupations (eg, nurse), and eHealth/telemedicine (eg, mHealth). A computerized database search was conducted through June 2014. Included articles (1) described development of an instrument, or (2) used an instrument that could be traced back to its original publication, or (3) modified an instrument, and (4) with full text in English language, and (5) focused on the patient perspective on technology, including patient preferences and satisfaction, engagement with technology, usability, competency and fluency with technology, computer literacy, and trust in and acceptance of technology. The review was limited to instruments that reported at least one psychometric property. Excluded were investigator-developed measures, disease-specific assessments delivered via technology or telephone (eg, a cancer-coping measure delivered via computer survey), and measures focused primarily on clinician use (eg, the electronic health record). RESULTS: The search strategy yielded 47,320 articles. Following elimination of duplicates and non-English language publications (n=14,550) and books (n=27), another 31,647 articles were excluded through review of titles. Following a review of the abstracts of the remaining 1096 articles, 68 were retained for full-text review. Of these, 16 described an instrument and six used an instrument; one instrument was drawn from the GEM database, resulting in 23 articles for inclusion. None included a complete psychometric evaluation. The most frequently assessed property was internal consistency (21/23, 91%). Testing for aspects of validity ranged from 48% (11/23) to 78% (18/23). Approximately half (13/23, 57%) reported how to score the instrument. Only six (26%) assessed the readability of the instrument for end users, although all the measures rely on self-report. CONCLUSIONS: Although most measures identified in this review were published after the year 2000, rapidly changing technology makes instrument development challenging. Platform-agnostic measures need to be developed that focus on concepts important for use of any type of eHealth innovation. At present, there are important gaps in the availability of psychometrically sound measures to evaluate eHealth technologies.

Implementing smoking cessation guidelines for hospitalized Veterans: Cessation results from the VA-BEST trial.

PURPOSE: To examine the impact of a nurse-initiated tobacco cessation intervention focused on providing guideline-recommended care to hospitalized smokers. DESIGN: Pre-post quasi-experimental trial. SETTING: General medical units of four US Department of Veterans Affairs hospitals. SUBJECTS: 898 adult Veteran smokers (503 and 395 were enrolled in the baseline and intervention periods, respectively). INTERVENTION: The intervention included academic detailing, adaptation of the computerized medical record, patient self-management support, and organizational support and feedback. MEASURES: The primary outcome was self-reported 7-day point prevalence abstinence at six months. ANALYSIS: Tobacco use was compared for the pre-intervention and intervention periods with multivariable logistic regression using generalized estimating equations to account for clustering at the nurse level. Predictors of abstinence at six months were investigated with best subsets regression. RESULTS: Seven-day point prevalence abstinence during the intervention period did not differ significantly from the pre-intervention period at either three (adjusted odds ratio (AOR) and 95% confidence interval (CI95)=0.78 [0.51-1.18]) or six months (AOR=0.92; CI95=0.62-1.37). Predictors of abstinence included baseline self-efficacy for refraining from smoking when experiencing negative affect (p=0.0004) and perceived likelihood of staying off cigarettes following discharge (p<0.0001). CONCLUSIONS: Tobacco use interventions in the VA inpatient setting likely require more substantial changes in clinician behavior and enhanced post-discharge follow-up to improve cessation outcomes.

Implementation of smoking cessation guidelines in the emergency department: a qualitative study of staff perceptions.

BACKGROUND: The US Public Health Service smoking cessation practice guideline specifically recommends that physicians and nurses strongly advise their patients who use tobacco to quit, but the best approach for attaining this goal in the emergency department (ED) remains unknown. The aim of this study was to characterize emergency physicians' (EPs) and nurses' (ENs) perceptions of cessation counseling and to identify barriers and facilitators to implementation of the 5 A's framework (Ask-Advise-Assess-Assist-Arrange) in the ED. METHODS: We conducted semi-structured, face-to-face interviews of 11 EPs and 19 ENs following a pre-post implementation trial of smoking cessation guidelines in two study EDs. We used purposeful sampling to target EPs and ENs with different attitudes toward cessation counseling, based on their responses to a written survey (Decisional Balance Questionnaire). Conventional content analysis was used to inductively characterize the issues raised by study participants and to construct a coding structure, which was then applied to study transcripts. RESULTS: The main findings of this study converged upon three overarching domains: 1) reactions to the intervention; 2) perceptions of patients' receptivity to cessation counseling; and 3) perspectives on ED cessation counseling and preventive care. ED staff expressed ambivalence toward the implementation of smoking cessation guidelines. Both ENs and EPs agreed that the delivery of smoking cessation counseling is important, but that it is not always practical in the ED on account of time constraints, the competing demands of acute care, and resistance from patients. Participants also called attention to the need for improved role clarity and teamwork when implementing the 5 A's in the ED. CONCLUSIONS: There are numerous challenges to the implementation of smoking cessation guidelines in the ED. ENs are generally willing to take the lead in offering brief cessation counseling, but their efforts need to be reinforced by EPs. ED systems need to address workflow, teamwork, and practice policies that facilitate prescription of smoking cessation medication, referral for cessation counseling, and follow-up in primary care. The results of this qualitative evaluation can be used to guide the design of future ED intervention studies. TRIAL REGISTRATION: ClinicalTrials.gov registration number NCT00756704.

Implementing Best Evidence in Smoking Cessation Treatment for Hospitalized Veterans: Results from the VA-BEST Trial.

BACKGROUND: Although the US Department of Veterans Affairs (VA) has promoted adherence to smoking cessation guidelines since 1997, hospitalized smokers do not consistently receive assistance in quitting. METHODS: In a pre-post guideline implementation trial on the inpatient medicine units of four VA hospitals, the effectiveness of a multimodal intervention (enhanced academic detailing, modification of the nursing admission template, patient education materials and quitline referral, practice facilitation and staff feedback) changing practice behavior was evaluated. Peridischarge interviews were conducted with 824 patients to assess receipt of nurses' and physicians' delivery of the 5A's (Ask, Advise, Assess, Assist, Arrange) in hospitalized smokers. RESULTS: Subjects were significantly more likely to have received each of the 5A's from a nurse during the postimplementation period (except for "advise to quit"). More patients were assisted in quitting (75% versus 56%, adjusted odds ratio [OR] = 2.3, 95% confidence interval [CI] = 1.6, 3.1) and had follow-up arranged (23% versus 18%, adjusted OR = 1.5, 95% CI = 1.0, 2.2) by a nurse during the postimplementation period. However, unadjusted results showed no improvement in seven-day point prevalence abstinence at six-month follow-up (13.5% versus 13.9%). Nurses' self-efficacy in cessation counseling, as measured in a survey of 166 unit nurses, improved following guideline implementation. DISCUSSION: A multifaceted intervention including enhanced academic detailing is an effective strategy for improving the delivery of smoking cessation services in medical inpatients. To promote long-term cessation, more intensive interventions are needed to ensure that motivated smokers receive guideline-recommended treatment (including pharmacotherapy and referral to outpatient cessation counseling).

Nursing interventions in a telemonitoring program.

BACKGROUND: The use of telemonitoring of patients with chronic illness in their homes is growing. Current literature does not describe what types of patient problems are addressed by nurses in these programs and what actions are taken in response to identified problems. This study defined and analyzed patient problems and nursing actions delivered in a telemonitoring program focused on chronic disease management. SUBJECTS AND METHODS: Data were drawn from a clinical trial that evaluated telemonitoring in patients with comorbid diabetes and hypertension. Using study patient records, patient problems and nursing actions were coded using an inductive approach. RESULTS: In total, 2,336 actions were coded for 68 and 65 participants in two intervention groups. The most frequent reasons for contact were reporting information to the primary care provider and lifestyle information related to diabetes and hypertension (e.g., diet, smoking cessation, foot care, and social contacts). The most frequent mode of contact was the study sending a letter to a participant. CONCLUSIONS: Detailed descriptions of interventions delivered facilitate analysis of the unique contributions of nurses in the expanding market of telemonitoring, enable identification of the appropriate number and combination of interventions needed to improve outcomes, and make possible more systematic translation of findings to practice. Furthermore, this information can inform calculation of appropriate panel sizes for care managers and the competencies needed to provide this care.

The emergency department action in smoking cessation (EDASC) trial: impact on cessation outcomes.

INTRODUCTION: The focus on acute care, time pressure, and lack of resources hamper the implementation of smoking cessation guidelines in the emergency department (ED). The purpose of this study was to determine whether an emergency nurse- initiated intervention based on the 5A's (Ask-Advise-Assess-Assist-Arrange) framework improves quit rates. METHODS: We conducted a pre-post implementation trial in 789 adult smokers who presented to two EDs in Iowa between August 13, 2008 and August 4, 2010. The intervention focused on improving delivery of the 5A's by ED nurses and physicians using academic detailing, charting/reminder tools, and group feedback. Performance of ED cessation counseling was measured using a 5A's composite score (ranging from 0 to 5). Smoking status was assessed by telephone interview at 3- and 6-month follow-up (with biochemical confirmation in those participants who reported abstinence at 6-month follow-up). RESULTS: Based on data from 650 smokers who completed the post-ED interview, there was a significant improvement in the mean 5A's composite score for emergency nurses during the intervention period at both hospitals combined (1.51 vs. 0.88, difference = 0.63, 95% confidence interval [CI] [0.41, 0.85]). At 6-month follow-up, 7-day point prevalence abstinence (PPA) was 6.8 and 5.1% in intervention and preintervention periods, respectively (adjusted odds ratio [OR] = 1.7, 95% CI [0.99, 2.9]). CONCLUSIONS: It is feasible to improve the delivery of brief smoking cessation counseling by ED staff. The observed improvements in performance of cessation counseling, however, did not translate into statistically significant improvements in cessation rates. Further improvements in the effectiveness of ED cessation interventions are needed.

Outcomes of a home telehealth intervention for patients with diabetes and hypertension.

BACKGROUND: Home telehealth programs often focus on a single disease, yet many patients who need monitoring have multiple conditions. This study evaluated secondary outcomes from a clinical trial evaluating the efficacy of home telehealth to improve outcomes of patients with co-morbid diabetes and hypertension. SUBJECTS AND METHODS: A single-center randomized controlled clinical trial compared two remote monitoring intensity levels (low and high) and usual care in patients with type 2 diabetes and hypertension being treated in primary care. Secondary outcomes assessed were knowledge (diabetes, hypertension, medications), self-efficacy, adherence (diabetes, medications), and patient perceptions of the intervention mode. RESULTS: Knowledge scores improved in the high-intensity intervention group participants, but upon further analysis, we found the intervention effect was not mediated by gain in knowledge. No significant differences were found across the groups in self-efficacy, adherence, or patient perceptions of the intervention mode. CONCLUSIONS: Home telehealth can enhance detection of key clinical symptoms that occur between regular physician visits. While our intervention improved glycemic and blood pressure control, the mechanism of the effect for this improvement was not clear.

Effectiveness of home telehealth in comorbid diabetes and hypertension: a randomized, controlled trial.

BACKGROUND: Increased emphasis is being placed on the critical need to control hypertension (HTN) in patients with diabetes. OBJECTIVE: The objective of this study was to evaluate the efficacy of a nurse-managed home telehealth intervention to improve outcomes in veterans with comorbid diabetes and HTN. DESIGN: A single-center, randomized, controlled clinical trial design comparing two remote monitoring intensity levels and usual care in patients with type 2 diabetes and HTN being treated in primary care was used. MEASUREMENTS: Primary outcomes were hemoglobin A1c and systolic blood pressure (SBP); secondary outcome was adherence. RESULTS: Intervention subjects experienced decreased A1c during the 6-month intervention period compared with the control group, but 6 months after the intervention was withdrawn, the intervention groups were comparable with the control group. For SBP, the high-intensity subjects had a significant decrease in SBP compared with the other groups at 6 months and this pattern was maintained at 12 months. Adherence improved over time for all groups, but there were no differences among the three groups. LIMITATIONS: Subjects had relatively good baseline control for A1c and SBP; minorities and women were underrepresented. CONCLUSIONS: Home telehealth provides an innovative and pragmatic approach to enhance earlier detection of key clinical symptoms requiring intervention. Transmission of education and advice to the patient on an ongoing basis with close surveillance by nurses can improve clinical outcomes in patients with comorbid chronic illness.

Patient perceptions of a remote monitoring intervention for chronic disease management.

Use of telecommunications technology to provide remote monitoring for people with chronic disease is becoming increasingly accepted as a means to improve patient outcomes and reduce resource use. The purpose of this project was to evaluate patient perceptions of a nurse-managed remote monitoring intervention to improve outcomes in veterans with comorbid diabetes and hypertension. Postintervention evaluation data were collected using a 12-item questionnaire and an open-ended question. Participants rated the program as generally positive on the questionnaire, but responses to the open-ended question revealed criticisms and suggestions for improvement not captured on the questionnaire. Interviewing participants in these programs may offer richer data for identifying areas for program improvement.

Postadmission dehydration: risk factors, indicators, and outcomes.

Detecting and treating dehydration in hospitalized patients is critical because of the adverse outcomes associated with this condition. Using a case-control design, this study estimated the incidence, risk factors, and outcomes of dehydration in hospitalized adults. The overall incidence rate for developing one of three ICD-9 codes for dehydration during a hospital stay was 3.5%. Cases and controls differed significantly on a number of clinical variables on admission; a large percentage of patients may have had dehydration on admission to the hospital. Mortality rates at 30 and 180 days postdischarge were significantly higher when dehydration was present. Patients may be discharged to rehabilitation settings in a dehydrated state, which prolongs recovery. Despite the increased risk for dehydration and higher rates of hospitalization in older populations, little systematic research has addressed the risk factors for and indicators of dehydration in hospitalized patients.

Outcomes of a home telehealth intervention for patients with heart failure.

We evaluated the efficacy of two telehealth applications, delivered by telephone and videophone, for improving outcomes of patients following hospital discharge for an acute exacerbation of heart failure. The outcomes measured were patient self-efficacy, satisfaction with care and knowledge of and compliance with prescribed medications. At hospital discharge, patients were randomly assigned to either control (usual care), telephone or videophone groups. Study nurses contacted the intervention patients each week for 90 days after discharge. A total of 148 patients were enrolled: 49 were randomized to usual care, 52 to the videophone intervention and 47 to the telephone intervention. At 90 days, 126 patients (85%) had completed follow-up; at 180 days, 109 patients (74%) had completed follow-up. There were no significant differences between the groups in medication compliance, self-efficacy or satisfaction with care. The intervention group patients were more likely to have had their medications adjusted during the 90-day intervention period. Knowledge scores improved in the intervention group patients, although these scores were lower at enrolment compared to the control group. It is possible that routine monitoring of symptoms by the study nurses led to medication adjustments and accounted for the intervention patients' significantly delayed time to readmission relative to the control patients.

Risk factors and outcomes associated with hospital admission for dehydration.

The hospital admission rate for dehydration is one of the Agency for Healthcare Research and Quality Prevention's Quality Indicators, which are considered screening tools for potential quality issues. Thus, admission for dehydration may reflect the quality of care provided in community settings. Using a case-control design, this study estimated the incidence, risk factors, and outcomes of dehydration in adults admitted to the hospital. The overall prevalence rate for three International Classification of Diseases codes for dehydration at admission was 0.55%. Cases and controls differed significantly on a number of clinical variables at admission, including weight, body mass index, pulse, blood pressure, use of bulk-forming laxatives, serum sodium and chloride, and presence of generalized weakness or hemiplegia, edema, diarrhea, vomiting, and having nothing by mouth before admission. Mortality rates at 30 and 180 days after discharge were not significantly different between the two groups. Dehydration in community-dwelling adults may delay rehabilitation or result in hospital admission. Prevention, monitoring, and management are critical to preventing dehydration-associated problems.

Evaluation of home telehealth following hospitalization for heart failure: a randomized trial.

Previous studies have found that home-based intervention programs reduce readmission rates for patients with heart failure. Only one previous trial has compared telephone and videophone to traditional care to deliver a home-based heart failure intervention program. The objective of this study was to evaluate the efficacy of a telehealth-facilitated postdischarge support program in reducing resource use in patients with heart failure. Patients at a Midwestern Department of Veterans Affairs Medical Center were randomized to telephone, videophone, or usual care for follow-up care after hospitalization for heart failure exacerbation. Outcome measures included readmission rates; time to first readmission; urgent care clinic visits; survival; and quality of life. The intervention resulted in a significantly longer time to readmission but had no effect on readmission rates or mortality. There were no differences in hospital days or urgent care clinic use. All subjects reported higher disease-specific quality of life scores at 1 year. There was evidence of the value of telephone follow-up, but there was no evidence to support the benefit of videophone care over telephone care. Rigorous evaluation is needed to determine which patients may benefit most from specific telehealth applications and which technologies are most cost-effective.

User perceptions of in-home medication dispensing devices.

The purpose of this study was to characterize patient and clinician perceptions of programmable medication devices (dispensers and timers) being marketed to consumers to improve medication adherence. Using principles of usability testing, 33 volunteer staff and clinic patients rated seven devices. Raters scored devices on cueing and alarms, storage and dispensing, machine characteristics, potential to improve adherence, and cost. Medication dispensers ranked highest overall. However, even if the Department of Veterans Affairs paid for them, patient participants would be unlikely to use them. No significant differences were found across the devices in the perceived likelihood that the device would improve medication adherence. In this article, we provide a set of criteria for patients who might choose such a device and clinicians who may recommend these kinds of devices. More work is needed in the design and deployment of these devices if they are to be part of a successful medication adherence plan.

Nurse and patient communication profiles in a home-based telehealth intervention for heart failure management.

OBJECTIVE: This study compared differences in nurse and patient communication profiles between two telehealth modes: telephone and videophone, and evaluated longitudinal changes in communication, nurse perceptions, and patient satisfaction. METHODS: Subjects were enrolled in a randomized controlled clinical trial evaluating a 90-day home-based intervention for heart failure. Telephone (n=14) and videophone (n=14) interactions were audio taped and analyzed using the Roter Interaction Analysis System. RESULTS: Nurses were more likely to use open-ended questions, back-channel responses, friendly jokes, and checks for understanding on the telephone compared to videophone. Compliments given and partnership were more common on the videophone. Patients were more likely to give lifestyle information and approval comments on the telephone, and used more closed-ended questions on the videophone. Nurses perceptions of the interactions were not different between the telephone and videophone, nor did their perceptions change significantly over the course of the intervention. There were no significant differences in patient satisfaction between the telephone and videophone. CONCLUSIONS: The results of this study did not support use of a videophone over the telephone. PRACTICE IMPLICATIONS: It is critical to match technologies to patient needs and use the least complex technology possible. When considering use a videophone, health care providers should critically examine the trade-offs between additional complexities with the added value of the visual interaction.

Functional trajectories associated with hospitalization in older adults.

For older adults, acute-care hospital stays can result in functional decline that leads to increased risk of hospitalization, nursing home admission, or mortality. This study describes functional trajectories in hospitalized older adults and identifies risk factors associated with those trajectories. Respondents (N = 45) exhibited five of six possible functional trajectory patterns. The largest change in functional status was a decline in activities of daily living (ADL) from baseline at 2 weeks before admission to the time of admission; ADL did not return to baseline during the first 4 days in the hospital. Depression scores were significantly higher in respondents who reported experiencing ADL decline before admission. Respondents whose ADL scores declined during hospitalization (regardless of baseline status) were more likely than others to die within 3 months of discharge. Functional trajectory in hospitalized elderly patients is an important and underappreciated prognostic concept requiring further attention.

Nurse and patient communication via low- and high-bandwidth home telecare systems.

We examined nurse-patient communication on two videoconferencing systems: a video-phone (PSTN video) and a PC-based system (IP video). The former used data transmission via a modem at 33.6 kbit/s and the latter via a local-area network at up to 512 kbit/s. Twenty-six nurses and 18 volunteers (simulated patients) participated. On each video system nurse-patient dyads completed scripted interactions; they then completed questionnaires to assess communication. Of the participants, 84% (n=37) preferred IP video and 14% (n=6) preferred PSTN video (one expressed no preference). IP video was rated significantly higher in all communication quality areas except self-consciousness/embarrassment. Although participants' overall ratings were higher for the IP video system, two important advantages of the PSTN video system were identified by both nurses and patients: first, it provided superior visualization of the medication bottle, insulin syringe and the patient's skin; and second, it was easier to use. Video quality and audio quality are important determinants of patient and provider perceptions, but ease of use, clinical appropriateness, and the need for training and support must not be forgotten.