The Impact of Participant Characteristics on Use and Satisfaction of a Web-Based Computer-Tailored Chronic Obstructive Pulmonary Disease Self-Management Intervention: A Process Evaluation.

BACKGROUND: A randomized controlled trial (RCT) showed that a Web-based computer-tailored self-management intervention for people with or at risk for chronic obstructive pulmonary disease (COPD) did not have a significant treatment effect. Process evaluation measures such as application use and satisfaction with the intervention can help understand these results. OBJECTIVES: The aim of this paper is to uncover reasons for suboptimal application use, evaluate satisfaction with the intervention, and investigate which participant characteristics predict application use and user satisfaction. METHODS: Participants were recruited through 2 different channels: an online panel and general practice. The intervention group received the intervention, which consisted of 2 modules (smoking cessation and physical activity). The control group received no intervention. The study employed a mixed methods design. Quantitative and qualitative data were gathered assessing participant characteristics, application use, reasons for not using the application, and satisfaction with the intervention. RESULTS: The RCT included 1325 participants. The proportion of individuals who participated was significantly higher in the online group (4072/6844, 59.5%) compared to the general practice group (43/335, 12.8%) (P<.001). Application use was low. Of all participants in the intervention group, 52.9% (348/658) initiated use of one or both modules, 36.0% (237/658) completed an intervention component (prolonged use), and 16.6% (109/658) revisited one of the modules after completing an intervention component (sustained use). Older age, established diagnosis of COPD, or experiencing breathlessness predicted sustained use. Participant satisfaction with the 2 modules was 6.7 (SD 1.6) on a scale from 0 to 10. The interviews revealed that a computer application was believed not to be sufficient and the help of a health care professional was necessary. Participants with a greater intention to change were more satisfied with the application. CONCLUSIONS: The application was not used sufficiently. Study materials should be further tailored to younger individuals, those at risk for COPD, and those who do not experience breathlessness in order to increase sustained use among them. Involvement of a health care professional could improve satisfaction with the intervention and potentially increase engagement with the intervention materials. However, to make this possible, recruitment in general practice needs to be improved. Recommendations are made for improving the study design, strengthening the intervention (eg, practice facilitation), and linking the computer application to interaction with a health care provider.

Impact of Educational Level on Study Attrition and Evaluation of Web-Based Computer-Tailored Interventions: Results From Seven Randomized Controlled Trials.

BACKGROUND: Web-based computer-tailored interventions have shown to be effective in improving health behavior; however, high dropout attrition is a major issue in these interventions. OBJECTIVE: The aim of this study is to assess whether people with a lower educational level drop out from studies more frequently compared to people with a higher educational level and to what extent this depends on evaluation of these interventions. METHODS: Data from 7 randomized controlled trials of Web-based computer-tailored interventions were used to investigate dropout rates among participants with different educational levels. To be able to compare higher and lower educated participants, intervention evaluation was assessed by pooling data from these studies. Logistic regression analysis was used to assess whether intervention evaluation predicted dropout at follow-up measurements. RESULTS: In 3 studies, we found a higher study dropout attrition rate among participants with a lower educational level, whereas in 2 studies we found that middle educated participants had a higher dropout attrition rate compared to highly educated participants. In 4 studies, no such significant difference was found. Three of 7 studies showed that participants with a lower or middle educational level evaluated the interventions significantly better than highly educated participants ("Alcohol-Everything within the Limit": F2,376=5.97, P=.003; "My Healthy Behavior": F2,359=5.52, P=.004; "Master Your Breath": F2,317=3.17, P=.04). One study found lower intervention evaluation by lower educated participants compared to participants with a middle educational level ("Weight in Balance": F2,37=3.17, P=.05). Low evaluation of the interventions was not a significant predictor of dropout at a later follow-up measurement in any of the studies. CONCLUSIONS: Dropout attrition rates were higher among participants with a lower or middle educational level compared with highly educated participants. Although lower educated participants evaluated the interventions better in approximately half of the studies, evaluation did not predict dropout attrition. Further research is needed to find other explanations for high dropout rates among lower educated participants.

A randomized controlled trial evaluating the effectiveness of a web-based, computer-tailored self-management intervention for people with or at risk for COPD.

INTRODUCTION: COPD is a leading cause of morbidity and mortality. Self-management interventions are considered important in order to limit the progression of the disease. Computer-tailored interventions could be an effective tool to facilitate self-management. METHODS: This randomized controlled trial tested the effectiveness of a web-based, computer-tailored COPD self-management intervention on physical activity and smoking behavior. Participants were recruited from an online panel and through primary care practices. Those at risk for or diagnosed with COPD, between 40 and 70 years of age, proficient in Dutch, with access to the Internet, and with basic computer skills (n=1,325), were randomly assigned to either the intervention group (n=662) or control group (n=663). The intervention group received the web-based self-management application, while the control group received no intervention. Participants were not blinded to group assignment. After 6 months, the effect of the intervention was assessed for the primary outcomes, smoking cessation and physical activity, by self-reported 7-day point prevalence abstinence and the International Physical Activity Questionnaire - Short Form. RESULTS: Of the 1,325 participants, 1,071 (80.8%) completed the 6-month follow-up questionnaire. No significant treatment effect was found on either outcome. The application however, was used by only 36% of the participants in the experimental group. CONCLUSION: A possible explanation for the nonsignificant effect on the primary outcomes, smoking cessation and physical activity, could be the low exposure to the application as engagement with the program has been shown to be crucial for the effectiveness of computer-tailored interventions. (Netherlands Trial Registry number: NTR3421.).

Metadata Correction: Impact of Educational Level on Study Attrition and Evaluation of Web-Based Computer-Tailored Interventions: Results From Seven Randomized Controlled Trials.

[This corrects the article DOI: .].

Integrating a tailored e-health self-management application for chronic obstructive pulmonary disease patients into primary care: a pilot study.

BACKGROUND: Changes in reimbursement have been compelling for Dutch primary care practices to apply a disease management approach for patients with chronic obstructive pulmonary disease (COPD). This approach includes individual patient consultations with a practice nurse, who coaches patients in COPD management. The aim of this study was to gauge the feasibility of adding a web-based patient self-management support application, by assessing patients' self-management, patients' health status, the impact on the organization of care, and the level of application use and appreciation. METHODS: The study employed a mixed methods design. Six practice nurses recruited COPD patients during a consultation. The e-Health application included a questionnaire that captured information on demographics, self-management related behaviors (smoking cessation, physical activity and medication adherence) and their determinants, and nurse recommendations. The application provided tailored feedback messages to patients and provided the nurse with reports. Data were collected through questionnaires and medical record abstractions at baseline and one year later. Semi-structured interviews with patients and nurses were conducted. Descriptive statistics were calculated for quantitative data and content analysis was used to analyze the qualitative data. RESULTS: Eleven patients, recruited by three nurses, used the application 1 to 7 times (median 4). Most patients thought that the application supported self-management, but their interest diminished after multiple uses. Impact on patients' health could not be determined due to the small sample size. Nurses reported benefits for the organization of care and made suggestions to optimize the use of the reports. CONCLUSION: Results suggest that it is possible to integrate a web-based COPD self-management application into the current primary care disease management process. The pilot study also revealed opportunities to improve the application and reports, in order to increase technology use and appreciation.

A randomised controlled trial testing a web-based, computer-tailored self-management intervention for people with or at risk for chronic obstructive pulmonary disease: a study protocol.

BACKGROUND: Chronic Obstructive Pulmonary Disease (COPD) is a major cause of morbidity and mortality. Effective self-management support interventions are needed to improve the health and functional status of people with COPD or at risk for COPD. Computer-tailored technology could be an effective way to provide this support. METHODS/DESIGN: This paper presents the protocol of a randomised controlled trial testing the effectiveness of a web-based, computer-tailored self-management intervention to change health behaviours of people with or at risk for COPD. An intervention group will be compared to a usual care control group, in which the intervention group will receive a web-based, computer-tailored self-management intervention. Participants will be recruited from an online panel and through general practices. Outcomes will be measured at baseline and at 6 months. The primary outcomes will be smoking behaviour, measuring the 7-day point prevalence abstinence and physical activity, measured in minutes. Secondary outcomes will include dyspnoea score, quality of life, stages of change, intention to change behaviour and alternative smoking behaviour measures, including current smoking behaviour, 24-hour point prevalence abstinence, prolonged abstinence, continued abstinence and number of quit attempts. DISCUSSION: To the best of our knowledge, this will be the first randomised controlled trial to test the effectiveness of a web-based, computer-tailored self-management intervention for people with or at risk for COPD. The results will be important to explore the possible benefits of computer-tailored interventions for the self-management of people with or at risk for COPD and potentially other chronic health conditions. DUTCH TRIAL REGISTER: NTR3421.

Usability evaluation of an online, tailored self-management intervention for chronic obstructive pulmonary disease patients incorporating behavior change techniques.

BACKGROUND: An eHealth intervention using computer tailored technology including several behavior change techniques was developed to support the self-management of chronic obstructive pulmonary disease patients. OBJECTIVE: The goal of this study was to evaluate and improve the usability of the eHealth intervention. METHODS: We conducted a usability evaluation with 8 chronic obstructive pulmonary disease patients, with a mixed methods design. We improved the usability through iterative cycles of evaluation and adaptation. Participants were asked to think aloud during the evaluation sessions. Participants then completed a semi-structured interview. The sessions were observed and recorded. Descriptive statistics and content analysis were used to uncover usability issues. RESULTS: Areas for improvement were layout, navigation, and content. Most issues could be solved within 3 iterations of improvement. Overall, participants found the program easy to use. The length of the program urged us to further analyze the appreciation of behavior change techniques. Some were perceived as helpful and easy to use, while others evoked frustration. CONCLUSIONS: The usability study identified several issues for improvement, confirming the need for usability evaluation during the development of eHealth interventions. The uncovered strengths and limitations of behavior change techniques may lead to optimization of eHealth interventions, but further insight is needed.