Correction: Key Variables for Effective eHealth Designs for Individuals With and Without Mental Health Disorders: 212-4 Fractional Factorial Experiment.

[This corrects the article DOI: 10.2196/23137.].

Key Variables for Effective eHealth Designs for Individuals With and Without Mental Health Disorders: 212-4 Fractional Factorial Experiment.

BACKGROUND: eHealth applications not only offer the potential to increase service convenience and responsiveness but also expand the ability to tailor services to improve relevance, engagement, and use. To achieve these goals, it is critical that the designs are intuitive. Limited research exists on designs that work for those with a severe mental illness (SMI), many of whom have difficulty traveling for treatments, reject or infrequently seek treatment, and tend to discontinue treatments for significant periods. OBJECTIVE: This study aims to evaluate the influence of 12 design variables (eg, navigational depth, reading level, and use of navigational lists) on the usability of eHealth application websites for those with and without SMI. METHODS: A 212-4 fractional factorial experiment was used to specify the designs of 256 eHealth websites. This approach systematically varied the 12 design variables. The final destination contents of all websites were identical, and only the designs of the navigational pages varied. The 12 design elements were manipulated systematically to allow the assessment of combinations of design elements rather than only one element at a time. Of the 256 websites, participants (n=222) sought the same information on 8 randomly selected websites. Mixed effect regressions, which accounted for the dependency of the 8 observations within participants, were used to test for main effects and interactions on the ability and time to find information. Classification and regression tree analyses were used to identify effects among the 12 variables on participants' abilities to locate information, for the sample overall and each of the 3 diagnostic groups of participants (schizophrenia spectrum disorder [SSD], other mental illnesses, and no mental illness). RESULTS: The best and worst designs were identified for each of these 4 groups. The depth of a website's navigation, that is, the number of screens users needed to navigate to find the desired content, had the greatest influence on usability (ability to find information) and efficiency (time to find information). The worst performing designs for those with SSD had a 9% success rate, and the best had a 51% success rate: the navigational designs made a 42% difference in usability. For the group with other mental illnesses, the design made a 50% difference, and for those with no mental illness, a 55% difference was observed. The designs with the highest usability had several key design similarities, as did those with the poorest usability. CONCLUSIONS: It is possible to identify evidence-based strategies for designing eHealth applications that result in significantly better performance. These improvements in design benefit all users. For those with SSD or other SMIs, there are designs that are highly effective. Both the best and worst designs have key similarities but vary in some characteristics.

Web-based collaborative care intervention to manage cancer-related symptoms in the palliative care setting.

BACKGROUND: The aim of this study was to examine the efficacy of a collaborative care intervention in reducing depression, pain, and fatigue and improve quality of life. METHODS: A total of 261 patients with advanced cancer and 179 family caregivers were randomized to a web-based collaborative care intervention or enhanced usual care. The intervention included the following: 1) a web site with written and audiovisual self-management strategies, a bulletin board, and other resources; 2) visits with a care coordinator during a physician's appointment every 2 months; and 3) telephone follow-up every 2 weeks. Primary patient outcomes included measures of depression, pain, fatigue, and health-related quality of life. Secondary outcomes included Interleukin (IL)-1α, IL-1ß, IL-6, and IL-8 levels, Natural Killer (NK) cell numbers, and caregiver stress and depression. RESULTS: At the baseline, 51% of the patients reported 1 or more symptoms in the clinical range. For patients who presented with clinical levels of symptoms and were randomized to the intervention, reductions in depression (Cohen's d = 0.71), pain (Cohen's d = 0.62), and fatigue (Cohen's d = 0.26) and improvements in quality of life (Cohen's d = 0.99) were observed when compared to those in the enhanced usual car arm at 6 months. Reductions in IL-6 (φ = 0.18), IL-1ß (φ = 0.35), IL-1α (φ = 0.19), and IL-8 (φ = 0.15) and increases in NK cell numbers (φ = 0.23) were observed in comparison with enhanced usual care arm at 6 months. Reductions in caregiver stress (Cohen's d = 0.75) and depression (Cohen's d = 0.37) were observed at 6 months for caregivers whose loved ones were randomized to the intervention arm. CONCLUSIONS: The integration of screening and symptom management into cancer care is recommended.

Advances in the assessment of cognitive skills using computer-based measurement.

The impact of technology in the field of intellectual assessment has, for the most part, been limited to computerized administration and scoring. Anderson's (2001) theory of intelligence suggests that performance on traditional IQ measures is acquired via two main routes, thinking and dedicated processing systems known as modules. Empirical data used to support this relationship between the speed of basic processing and intellectual functioning have been evidenced primarily by correlations between measures of general intelligence and measures of inspection time (IT). These IT measures allow individuals to make a forced choice discrimination task without a motor component. Because only the time used to cognitively solve the problem is recorded, these responses typically occur in milliseconds. Many theorists (e.g., Burns & Nettelbeck, 2002; Deary, 2000; Jensen, 2006) consider IT to be a more "pure" measure of intelligence, because the influences of verbal skills, memory, and socialization are minimized and results are therefore considered to be more culture-fair. Until relatively recently, IT measurement was restricted to complex and expensive specialized laboratory equipment. This article describes the theoretical background and developmental process of a computer-based IT measure that is easily adaptable to accommodate the needs of the researcher.

Effects of the WRITE Symptoms Interventions on Symptoms and Quality of Life Among Patients With Recurrent Ovarian Cancers: An NRG Oncology/GOG Study (GOG-0259).

PURPOSE: GOG-259 was a 3-arm randomized controlled trial of two web-based symptom management interventions for patients with recurrent ovarian cancer. Primary aims were to compare the efficacy of the nurse-guided (Nurse-WRITE) and self-directed (SD-WRITE) interventions to Enhanced Usual Care (EUC) in improving symptoms (burden and controllability) and quality of life (QOL). METHODS: Patients with recurrent or persistent ovarian, fallopian, or primary peritoneal cancer with 3+ symptoms were eligible for the study. Participants completed baseline (BL) surveys (symptom burden and controllability and QOL) before random assignment. WRITE interventions lasted 8 weeks to develop symptom management plans for three target symptoms. All women received EUC: monthly online symptom assessment with provider reports; online resources; and every 2-week e-mails. Outcomes were evaluated at 8 and 12 weeks after BL. Repeated-measures modeling with linear contrasts evaluated group by time effects on symptom burden, controllability, and QOL, controlling for key covariates. RESULTS: Participants (N = 497) reported mean age of 59.3 ± 9.2 years. At BL, 84% were receiving chemotherapy and reported a mean of 14.2 ± 4.9 concurrent symptoms, most commonly fatigue, constipation, and peripheral neuropathy. Symptom burden and QOL improved significantly over time (P < .001) for all three groups. A group by time interaction (P < .001) for symptom controllability was noted whereby both WRITE intervention groups had similar improvements from BL to 8 and 12 weeks, whereas EUC did not improve over time. CONCLUSION: Both WRITE Intervention groups showed significantly greater improvements in symptom controllability from BL to 8 and BL to 12 weeks compared with EUC. There were no significant differences between Nurse-WRITE and SD-WRITE. SD-WRITE has potential as a scalable intervention for a future implementation study.

Randomized controlled trial of a collaborative care intervention to manage cancer-related symptoms: lessons learned.

BACKGROUND: Collaborative care interventions to treat depression have begun to be tested in settings outside of primary care. However, few studies have expanded the collaborative care model to other settings and targeted comorbid physical symptoms of depression. PURPOSE: The aims of this report were to: (1) describe the design and methods of a trial testing the efficacy of a stepped collaborative care intervention designed to manage cancer-related symptoms and improve overall quality of life in patients diagnosed with hepatobiliary carcinoma; and (2) share the lessons learned during the design, implementation, and evaluation of the trial. METHODS: The trial was a phase III randomized controlled trial testing the efficacy of a stepped collaborative care intervention to reduce depression, pain, and fatigue in patients diagnosed with advanced cancer. The intervention was compared to an enhanced usual care arm. The primary outcomes included the Center for Epidemiological Studies-Depression scale, Brief Pain Inventory, and Functional Assessment of Cancer Therapy (FACT)-Fatigue, and the FACT-Hepatobiliary. Sociodemographic and disease-specific characteristics were recorded from the medical record; Natural Killer cells and cytokines that are associated with these symptoms and with disease progression were assayed from serum. RESULTS: and Discussion The issues addressed include: (1) development of collaborative care in the context of oncology (e.g., timing of the intervention, tailoring of the intervention, ethical issues regarding randomization of patients, and changes in medical treatment over the course of the study); (2) use of a website by chronically ill populations (e.g., design and access to the website, development of the website and intervention, ethical issues associated with website development, website usage, and unanticipated costs associated with website development); (3) evaluation of the efficacy of intervention (e.g., patient preferences, proxy raters, changes in medical treatment, and inclusion of biomarkers as endpoints); and (4) analyses and interpretation of the intervention (e.g., confounding factors, dose and active ingredients, and risks and benefits of collaborative care interventions in chronically ill patients). LIMITATIONS: The limitations to the study, although not fully realized at this time as the trial is ongoing, include: (1) heterogeneity of the diagnoses and treatments of participants; and (2) inclusion of caregivers as proxy raters but not as participants in the intervention. CONCLUSIONS: Collaborative care interventions to manage multiple symptoms in a tertiary cancer center are feasible. However, researchers designing and implementing interventions that are web-based, target multiple symptoms, and for oncology patients may benefit from previous experiences.

The next generation of collaborative care: The design of a novel web-based stepped collaborative care intervention delivered via telemedicine for people diagnosed with cancer.

BACKGROUND: The NIH consensus statement on cancer-related symptoms concluded the most common and debilitating were depression, pain and fatigue [1-6]. Although the comorbidity of these symptoms is well known and may have similar underlying biological mechanisms no intervention has been developed to reduce these symptoms concurrently. The novel web-based stepped collaborative care intervention delivered by telemedicine is the first to be tested in people diagnosed with cancer. METHODS: We plan to test a web-based stepped collaborative care intervention with 450 cancer patients and 200 caregivers in the context of a randomized controlled trial. The primary endpoint is quality of life with other primary outcomes including patient-reported depression, pain, fatigue. Secondary outcomes include patient serum levels of pro-inflammatory cytokines and disease progression. We also will assess informal caregiver stress, depression, and metabolic abnormalities to determine if improvements in patients' symptoms also relate to improvement in caregiver outcomes. RESULTS: The trial is ongoing and a total of 382 patients have been randomized. Preliminary analyses of the screening tools used for study entry suggest that Center for Epidemiological Studies-Depression (CESD) scale has good sensitivity and specificity (0.81 and 0.813) whereas the scale used to assess pain (0.47 and 0.91) and fatigue (0.11 and 0.91) had poor sensitivity but excellent specificity. Using the AUROC, the best cut point for the CES-D was 19, for pain was 4.5; and for fatigue was 2.5. Outcomes not originally proposed included health care utilization and healthcare charges. The first 100 patients who have been followed a year post-treatment, and who were less than 75 years and randomized to the web-based stepped collaborative care intervention, had lower rates of complications after surgery [χ2 = 5.45, p = 0.02]. For patients who survived 6 months or less and were randomized to the web-based stepped collaborative care intervention, had lower rates of 90-day readmissions when compared to patients randomized to the screening and referral arm [χ2 = 4.0, p = 0.046]. Patients randomized to the collaborative care intervention arm had lower overall health care activity-based costs of $16,758 per patient per year when compared to the screening and referral arm. DISCUSSION: This novel web-based stepped stepped collaborative care intervention, delivered via telemedicine, is expected to provide a new strategy to improve the quality of life in those diagnosed with cancer and their caregivers. TRIAL REGISTRATION: ClinicalTrials.govNCT02939755.

Effectiveness of Online Collaborative Care for Treating Mood and Anxiety Disorders in Primary Care: A Randomized Clinical Trial.

Importance: Collaborative care for depression and anxiety is superior to usual care from primary care physicians for these conditions; however, challenges limit its provision in routine practice and at scale. Advances in technology may overcome these barriers but have yet to be tested. Objective: To examine the effectiveness of combining an internet support group (ISG) with an online computerized cognitive behavioral therapy (CCBT) provided via a collaborative care program for treating depression and anxiety vs CCBT alone and whether providing CCBT in this manner is more effective than usual care. Design, Setting, and Participants: In this 3-arm randomized clinical trial with blinded outcome assessments, primary care physicians from 26 primary care practices in Pittsburgh, Pennsylvania, referred 2884 patients aged 18 to 75 years in response to an electronic medical record prompt from August 2012 to September 2014. Overall, 704 patients (24.4%) met all eligibility criteria and were randomized to CCBT alone (n = 301), CCBT+ISG (n = 302), or usual care (n = 101). Intent-to-treat analyses were conducted November 2015 to January 2017. Interventions: Six months of guided access to an 8-session CCBT program provided by care managers who informed primary care physicians of their patients' progress and promoted patient engagement with our online programs. Main Outcomes and Measures: Mental health-related quality of life (12-Item Short-Form Health Survey Mental Health Composite Scale) and depression and anxiety symptoms (Patient-Reported Outcomes Measurement Information System) at 6-month follow-up, with treatment durability assessed 6 months later. Results: Of the 704 randomized patients, 562 patients (79.8%) were female, and the mean (SD) age was 42.7 (14.3) years. A total of 604 patients (85.8%) completed our primary 6-month outcome assessment. At 6-month assessment, 254 of 301 patients (84.4%) receiving CCBT alone started the program (mean [SD] sessions completed, 5.4 [2.8]), and 228 of 302 patients (75.5%) in the CCBT+ISG cohort logged into the ISG at least once, of whom 141 (61.8%) provided 1 or more comments or posts (mean, 10.5; median [range], 3 [1-306]). Patients receiving CCBT+ISG reported similar 6-month improvements in mental health-related quality of life, mood, and anxiety symptoms compared with patients receiving CCBT alone. However, compared with patients receiving usual care, patients in the CCBT alone cohort reported significant 6-month effect size improvements in mood (effect size, 0.31; 95% CI, 0.09-0.53) and anxiety (effect size, 0.26; 95% CI, 0.05-0.48) that persisted 6 months later, and completing more CCBT sessions produced greater effect size improvements in mental health-related quality of life and symptoms. Conclusions and Relevance: While providing moderated access to an ISG provided no additional benefit over guided CCBT at improving mental health-related quality of life, mood, and anxiety symptoms, guided CCBT alone is more effective than usual care for these conditions. Trial Registration: clinicaltrials.gov Identifier: NCT01482806.

Designing eHealth Applications to Reduce Cognitive Effort for Persons With Severe Mental Illness: Page Complexity, Navigation Simplicity, and Comprehensibility.

BACKGROUND: eHealth technologies offer great potential for improving the use and effectiveness of treatments for those with severe mental illness (SMI), including schizophrenia and schizoaffective disorder. This potential can be muted by poor design. There is limited research on designing eHealth technologies for those with SMI, others with cognitive impairments, and those who are not technology savvy. We previously tested a design model, the Flat Explicit Design Model (FEDM), to create eHealth interventions for individuals with SMI. Subsequently, we developed the design concept page complexity, defined via the design variables we created of distinct topic areas, distinct navigation areas, and number of columns used to organize contents and the variables of text reading level, text reading ease (a newly added variable to the FEDM), and the number of hyperlinks and number of words on a page. OBJECTIVE: The objective of our study was to report the influence that the 19 variables of the FEDM have on the ability of individuals with SMI to use a website, ratings of a website's ease of use, and performance on a novel usability task we created termed as content disclosure (a measure of the influence of a homepage's design on the understanding user's gain of a website). Finally, we assessed the performance of 3 groups or dimensions we developed that organize the 19 variables of the FEDM, termed as page complexity, navigational simplicity, and comprehensibility. METHODS: We measured 4 website usability outcomes: ability to find information, time to find information, ease of use, and a user's ability to accurately judge a website's contents. A total of 38 persons with SMI (chart diagnosis of schizophrenia or schizoaffective disorder) and 5 mental health websites were used to evaluate the importance of the new design concepts, as well as the other variables in the FEDM. RESULTS: We found that 11 of the FEDM's 19 variables were significantly associated with all 4 usability outcomes. Most other variables were significantly related to 2 or 3 of these usability outcomes. With the 5 tested websites, 7 of the 19 variables of the FEDM overlapped with other variables, resulting in 12 distinct variable groups. The 3 design dimensions had acceptable coefficient alphas. Both navigational simplicity and comprehensibility were significantly related to correctly identifying whether information was available on a website. Page complexity and navigational simplicity were significantly associated with the ability and time to find information and ease-of-use ratings. CONCLUSIONS: The 19 variables and 3 dimensions (page complexity, navigational simplicity, and comprehensibility) of the FEDM offer evidence-based design guidance intended to reduce the cognitive effort required to effectively use eHealth applications, particularly for persons with SMI, and potentially others, including those with cognitive impairments and limited skills or experience with technology. The new variables we examined (topic areas, navigational areas, columns) offer additional and very simple ways to improve simplicity.

Critical design elements of e-health applications for users with severe mental illness: singular focus, simple architecture, prominent contents, explicit navigation, and inclusive hyperlinks.

OBJECTIVE: E-health applications are becoming integral components of general medical care delivery models and emerging for mental health care. Few exist for treatment of those with severe mental illness (SMI). In part, this is due to a lack of models to design such technologies for persons with cognitive impairments and lower technology experience. This study evaluated the effectiveness of an e-health design model for persons with SMI termed the Flat Explicit Design Model (FEDM). METHODS: Persons with schizophrenia (n = 38) performed tasks to evaluate the effectiveness of 5 Web site designs: 4 were prominent public Web sites, and 1 was designed according to the FEDM. Linear mixed-effects regression models were used to examine differences in usability between the Web sites. Omnibus tests of between-site differences were conducted, followed by post hoc pairwise comparisons of means to examine specific Web site differences when omnibus tests reached statistical significance. RESULTS: The Web site designed using the FEDM required less time to find information, had a higher success rate, and was rated easier to use and less frustrating than the other Web sites. The home page design of one of the other Web sites provided the best indication to users about a Web site's contents. The results are consistent with and were used to expand the FEDM. CONCLUSIONS: The FEDM provides evidence-based guidelines to design e-health applications for person with SMI, including: minimize an application's layers or hierarchy, use explicit text, employ navigational memory aids, group hyperlinks in 1 area, and minimize the number of disparate subjects an application addresses.

Web-based psychoeducational intervention for persons with schizophrenia and their supporters: one-year outcomes.

OBJECTIVE: This study examined the use of a uniquely designed Web site and home computers to deliver online multifamily psychoeducational therapy to persons with schizophrenia and their informal supports (family and friends). Web site usage and outcome benefits are reported. METHODS: Thirty-one persons with schizophrenia or schizoaffective disorder and 24 support persons were randomly assigned to the online intervention (telehealth) or treatment as usual (usual care) condition. At three, six, and 12 months, interviewer-administered assessments were conducted with participants. Intention-to-treat analyses compared persons with schizophrenia in the two study conditions on severity of positive symptoms and knowledge of schizophrenia. Support persons in the two study conditions were compared on knowledge of schizophrenia. Each participant's usage of the Web site was logged. RESULTS: Persons with schizophrenia in the telehealth condition had a large and significant reduction in positive symptoms (p=.042, d=-.88) and a large and significant increase in knowledge of schizophrenia compared with their counterparts in the usual care condition. Support persons in the telehealth condition showed a large and significant increase in knowledge about prognosis compared with those in the usual care condition (p=.036, d=1.94). Persons with schizophrenia used the Web site to a much greater extent (pages viewed and time spent) than support persons. CONCLUSIONS: These findings suggest that online delivery of psychotherapeutic treatment and educational resources to consumers' homes has considerable potential to improve consumer well-being and offers several advantages over standard clinic-based delivery models.

Designing websites for persons with cognitive deficits: Design and usability of a psychoeducational intervention for persons with severe mental illness.

The purpose of this study was to develop an understanding of the design elements that influence the ability of persons with severe mental illness (SMI) and cognitive deficits to use a website, and to use this knowledge to design a web-based telehealth application to deliver a psychoeducation program to persons with schizophrenia and their families. Usability testing was conducted with 98 persons with SMI. First, individual website design elements were tested. Based on these results, theoretical website design models were used to create several alternative websites. These designs were tested for their ability to facilitate use by persons with SMI. The final website design is presented. The results indicate that commonly prescribed design models and guidelines produce websites that are poorly suited and confusing to persons with SMI. Our findings suggest an alternative model that should be considered when designing websites and other telehealth interventions for this population. Implications for future studies addressing the characteristics of accessible designs for persons with SMI and cognitive deficits are discussed.

An interactive Web-based intervention for persons with TBI and their families: use and evaluation by female significant others.

OBJECTIVE: To assess the feasibility of providing in-home adjunctive and supportive services to persons with traumatic brain injury (TBI) and their families via a Web site. DESIGN: Nineteen families were provided with access to the Web site intervention for 6 months. Those who needed it were provided with a computer and Internet service in their homes. PARTICIPANTS: Adult women who were the significant others of adult males with moderate-to-severe TBI. MAIN OUTCOME MEASURE: Value and ease of use of the Web site. Each participant's usage of the Web site was automatically tracked including each page visited, time of day, and time spent on the page. RESULTS: Female significant others found the Web site to be valuable and easy to use, and used it throughout the 6-month period. The on-line support group was the most used and valued module. CONCLUSIONS: Family caregivers will use Web-based interventions to help meet their needs for social support, information, and guidance following the return home of persons with TBI.