Development and Usability Testing of a System to Detect Adverse Events and Medical Mistakes.

Many inpatient hospital visits result in adverse events, and a disproportionate number of adverse events are thought to occur among vulnerable populations. The personal and financial costs of these events are significant at the individual, care team, and system levels. Existing methods for identifying adverse events, such as the Institute for Healthcare Improvement Global Trigger Tool, typically involve retroactive chart review to identify risks or triggers and then detailed review to determine whether and what type of harm occurred. These methods are limited in scalability and ability to prospectively identify triggers to enable intervention before an adverse event occurs. The purpose of this study was to gather usability feedback on a prototype of an informatics intervention based on the IHI method. The prototype electronic Global Trigger Tool collects and presents risk factors for adverse events. Six health professionals identified as potential users in clinical, quality improvement, and research roles were interviewed. Interviewees universally described insufficiencies of current methods for tracking adverse events and offered important information on desired future user interface features. A key next step will be to refine and integrate an electronic Global Trigger Tool system into standards-compliant electronic health record systems as a patient safety module.

Usability and acceptability of the electronic self-assessment and care (eSAC) program in advanced ovarian cancer: A mixed methods study.

OBJECTIVE: To determine usability and acceptability of the electronic self-assessment and care (eSAC) web-based, patient reported outcome (PRO) program for people with advanced ovarian cancer. METHODS: Patient participants recruited from a single ambulatory site were prompted by email to answer symptom/quality of life items prior to each clinic visit. Patient participant acceptability was measured with the Acceptability E-Scale Score (AES). Usability was measured among a subset of patient participants using semi-structured interviews. Clinician participant acceptability and usability were measured via survey and semi-structured interviews. Quantitative data were analyzed with descriptive statistics. Qualitative data were analyzed using thematic content analysis. A mixed methods analysis was performed. RESULTS: Of 163 eligible patients approached, 143 (87.7%) provided written consent. Patient participants (n = 71) who created an eSAC report prior to at least 3 clinic visits, rated eSAC as acceptable with a mean AES score of 26.19 ± 3.36 (out of 30). Interview data from patient participants (n = 33) revealed that eSAC was easy to use and important to the clinic visit conversation. Data from clinician surveys (n = 8) and focus groups (n = 3) revealed that the eSAC program was acceptable and useful for clinicians. Qualitative analysis suggested process improvements from patients and clinicians for effectiveness in the advanced ovarian cancer setting. Mixed methods analysis demonstrated no major discrepancies between quantitative and qualitative findings, with the qualitative data broadening understanding of quantitative ratings. CONCLUSION: eSAC was useful and acceptable in this setting. This PRO is a promising strategy for enhancing patient-centered care for people with advanced ovarian cancer.

Assigning value to preparation for prostate cancer decision making: a willingness to pay analysis.

BACKGROUND: The Personal Patient Profile-Prostate (P3P) is a web-based decision support system for men newly diagnosed with localized prostate cancer that has demonstrated efficacy in reducing decisional conflict. Our objective was to estimate willingness-to-pay (WTP) for men's decisional preparation activities. METHODS: In a multicenter, randomized trial of P3P, usual care group participants received typical preparation for decision making plus referral to publicly-available, educational websites. Intervention group participants received the same, plus online P3P educational media specific to the user's personal preferences and values, and a communication coaching component tailored to race\ethnicity, age and language. WTP data were collected one week after physician consultation. An iterative bidding direct contingent valuation survey format was used, randomly assigning participants to high or low starting values (SV). Tobit models were used to explore associations between SV-adjusted WTP and age, education, marital and work-status, insurance, decision-control preference and decision-making stage. RESULTS: Of 392 participants enrolled, 141 P3P and 107 usual care (UC) provided a WTP value. Men were willing to pay a median $25 (IQR $10-100) for P3P in addition to usual care preparation materials. In the final multivariable tobit regression model, SV, marital status, stage of decision making and income were significantly associated with WTP for P3P. Decision control preference was considered marginally significant (p = 0.11). Men were WTP a median $30 (IQR $10-$200) for usual care material alone. In the final multivariable model, SV, education, and stage of decision making were significantly associated with WTP in usual care. CONCLUSION: WTP was similar for UC and for the addition of P3P to UC decision preparation. The WTP values were associated with demographic and preference variables. Findings can help focus decision support on future patients who would benefit most: those without strong support systems, at earlier stages of decision making, and open to a shared-decision style. TRIAL REGISTRATION: NCT NCT01844999 . Registered May 3, 2013.

Decision Support with the Personal Patient Profile-Prostate: A Multicenter Randomized Trial.

PURPOSE: We evaluated the efficacy of the web based P3P (Personal Patient Profile-Prostate) decision aid vs usual care with regard to decisional conflict in men with localized prostate cancer. MATERIALS AND METHODS: A randomized (1:1), controlled, parallel group, nonblinded trial was performed in 4 regions of the United States. Eligible men had clinically localized prostate cancer and an upcoming consultation, and they spoke and read English or Spanish. Participants answered questionnaires to report decision making stage, personal characteristics, concerns and preferences plus baseline symptoms and decisional conflict. A randomization algorithm allocated participants to receive tailored education and communication coaching, generic teaching sheets and external websites plus a 1-page summary to clinicians (intervention) or the links plus materials provided in clinic (usual care). Conflict outcomes and the number of consultations were measured at 1 month. Univariate and multivariable models were used to analyze outcomes. RESULTS: A total of 392 men were randomized, including 198 to intervention and 194 to usual care, of whom 152 and 153, respectively, returned 1-month outcomes. The mean ± SD 1-month decisional conflict scale (score range 0 to 100) was 10.9 ± 16.7 for intervention and 9.9 ± 18.0 for usual care. The multivariable model revealed significantly reduced conflict in the intervention group (-5.00, 95% CI -9.40--0.59). Other predictors of conflict included income, marital or partner status, decision status, number of consultations, clinical site and D'Amico risk classification. CONCLUSIONS: In this multicenter trial the decision aid significantly reduced decisional conflict. Other variables impacted conflict and modified the effect of the decision aid, notably risk classification, consultations and resources. P3P is an effective adjunct for shared decision making in men with localized prostate cancer.

High Altitude Illness: Knowledge, Practice, and Attitudes of Porters in Nepal.

INTRODUCTION: Porters working at high altitude face a number of preventable health risks ranging from frostbite to potentially fatal high-altitude pulmonary and cerebral edema. Porters are often recruited from impoverished low-altitude areas, poorly equipped in terms of protective clothing, and tasked with carrying loads that equal or exceed their body mass to high elevations. Despite a large population of porters working throughout mountainous parts of the world, there is little documentation regarding knowledge levels, attitudes, and practices related to the prevention of altitude illness in this population. Much of the literature focuses on biomechanics of load carrying for porters or altitude issues for trekkers. METHODS: A cross-sectional survey was developed using a modified Delphi technique. The survey was administered to a convenience sample of porters (n=146) from diverse cultural groups between Lukla (2774 m) and Everest Base Camp (5361 m). RESULTS: Many of the porters started at a young age, carried heavy loads, and had difficulty identifying symptoms of high altitude illness, and less than 20% correctly identified preventive measures for high-altitude illness. CONCLUSIONS: Porters in the Khumbu region continue to face hazards in their working environment. Future research and health education campaigns should address knowledge deficits and help with the design of tailored interventions.

Addressing low health literacy with "Talking Pill Bottles": A pilot study in a community pharmacy setting.

OBJECTIVES: To test the effect of "Talking Pill Bottles" on medication self-efficacy, knowledge, adherence, and blood pressure readings among hypertensive patients with low health literacy and to assess patients' acceptance of this innovation. DESIGN: Longitudinal nonblinded randomized trial with standard treatment and intervention arms. SETTING AND PARTICIPANTS: Two community pharmacies serving an ethnically diverse population in the Pacific Northwest. Participants were consented patients with antihypertension prescriptions who screened positive for low health literacy based on the Test of Functional Health Literacy Short Form. Participants in the intervention arm received antihypertensive medications and recordings of pharmacists' counseling in Talking Pill Bottles at baseline. Control arm participants received antihypertensive medications and usual care instructions. MAIN OUTCOME MEASURES: Comparison and score changes between baseline and day 90 for medication knowledge test, Self-Efficacy for Appropriate Medication Use Scale (SEAMS), Morisky Medication Adherence Scale (MMAS-8), blood pressure, and responses to semistructured exit interviews and Technology Acceptance Model surveys. RESULTS: Of 871 patients screened for health literacy, 134 eligible participants were enrolled in the trial. The sample was elderly, ethnically diverse, of low income, and experienced regarding hypertension and medication history. In both arms, we found high baseline scores in medication knowledge test, SEAMS, and MMAS-8 and minimal changes in these measures over the 90-day study period. Blood pressure decreased significantly in the intervention arm. Acceptability scores for the Talking Pill Bottle technology were high. CONCLUSION: Our results suggest that providing audio-assisted medication instructions in Talking Pill Bottles positively affected blood pressure control and was well accepted by patients with low health literacy. Further research involving newly diagnosed patients is needed to mitigate possible ceiling effects that we observed in an experienced population.

Information Needs of Men with Localized Prostate Cancer During Radiation Therapy.

The purpose of this study was to describe how patient information needs change over the course of receiving radiation therapy for prostate cancer. Convenience sampling was utilized to recruit men with stage I-III prostate cancer. A longitudinal repeated measures design was implemented for this pilot study. Patients were presented with 36 paired comparisons, each asking the participant to choose the most important information topic(s) for today. Following completion of the survey instruments, the clinic nurse delivered the four top-ranked information topic handouts to each patient with brief instruction on how to use the handouts. Over the course of 6 months, we were able to recruit 35 men. The four highest priority topics across all four sessions were prognosis, stage of disease, treatment options, and side effects. Our results suggest trends in the information priorities that men hold over the course of radiation treatment. The information priorities do appear to shift over time, notably prognosis concerns and risk for family members continued to rise over time, while side effect information declined. These findings will extend an already strong foundation of evidence for preparatory information in radiation therapy. Furthermore, these findings will strengthen current evidence that computerized assessment of patient self-report information is feasible and an important adjunct to clinical practice.

Usability Testing the "Personal Patient Profile-Prostate" in a Sample of African American and Hispanic Men.

Shared treatment decision making in a cancer setting requires a patient's understanding of the potential benefits and risks of each treatment option. Graphical display of risk information is one approach to improving understanding. Little is known about how patients engage with infographics in the context of health education materials and whether interactions vary with health literacy levels. We conducted an observational study, using an eye tracker device, of how men with newly diagnosed localized prostate cancer visually engaged with an on-screen infographic depicting risk information in the Personal Patient Profile-Prostate. Health literacy was measured with the Short Assessment of Health Literacy-English. Gaze patterns on an exemplar screens containing infographics about survival were analyzed and explored with respect to sociodemographic and health literacy data. Acceptability of Personal Patient Profile-Prostate was measured with the Acceptability E-scale. Twenty-six English-speaking men participated, and eye tracking data were collected for 12 men on the exemplar page of risk information that we analyzed. We found preliminary evidence of visual scanning and of participants with lower literacy focusing sooner on infographics versus text. Acceptability for Personal Patient Profile-Prostate was high. These findings suggest that infographics may be of higher relative value to participants with low health literacy. Eye trackers may provide valuable information on how people visually engage with infographics and may inform development of health education materials, although care must be taken to minimize data loss.

The electronic self report assessment and intervention for cancer: promoting patient verbal reporting of symptom and quality of life issues in a randomized controlled trial.

BACKGROUND: The electronic self report assessment - cancer (ESRA-C), has been shown to reduce symptom distress during cancer therapy The purpose of this analysis was to evaluate aspects of how the ESRA-C intervention may have resulted in lower symptom distress (SD). METHODS: Patients at two cancer centers were randomized to ESRA-C assessment only (control) or the Web-based ESRA-C intervention delivered to patients' homes or to a tablet in clinic. The intervention allowed patients to self-monitor symptom and quality of life (SxQOL) between visits, receive self-care education and coaching to report SxQOL to clinicians. Summaries of assessments were delivered to clinicians in both groups. Audio-recordings of clinic visits made 6 weeks after treatment initiation were coded for discussions of 26 SxQOL issues, focusing on patients'/caregivers' coached verbal reports of SxQOL severity, pattern, alleviating/aggravating factors and requests for help. Among issues identified as problematic, two measures were defined for each patient: the percent SxQOL reported that included a coached statement, and an index of verbalized coached statements per SxQOL. The Wilcoxon rank test was used to compare measures between groups. Clinician responses to problematic SxQOL were compared. A mediation analysis was conducted, exploring the effect of verbal reports on SD outcomes. RESULTS: 517 (256 intervention) clinic visits were audio-recorded. General discussion of problematic SxQOL was similar in both groups. Control group patients reported a median 75% of problematic SxQOL using any specific coached statement compared to a median 85% in the intervention group (p = .0009). The median report index of coached statements was 0.25 for the control group and 0.31 for the intervention group (p = 0.008). Fatigue, pain and physical function issues were reported significantly more often in the intervention group (all p < .05). Clinicians' verbalized responses did not differ between groups. Patients' verbal reports did not mediate final SD outcomes (p = .41). CONCLUSIONS: Adding electronically-delivered, self-care instructions and communication coaching to ESRA-C promoted specific patient descriptions of problematic SxQOL issues compared with ESRA-C assessment alone. However, clinician verbal responses were no different and subsequent symptom distress group differences were not mediated by the patients' reports. TRIAL REGISTRATION: NCT00852852; 26 Feb 2009.

Effects of automated prompts for logging symptom and exercise data on mobile devices in patients with chronic obstructive pulmonary disease.

Traditional approaches to patient-reported outcomes diaries have been largely paper based. However, paper-based approaches have inherent inefficiencies such as an inability to communicate the entries in real time to the healthcare team, issues related to transport and mobility, and no tailored output related to what is entered. Traditional paper-based approaches also lack the ability to prompt users at regular intervals to record data. This lack of prompting may lead to delays in entering symptoms and exercises (diary hoarding). Electronic mobile devices have addressed some of these limitations. However, until recently these electronic devices have not been able to deliver the data in real time, thus limiting the ability of the care team to interact and respond. With the emergence of wireless mobile devices, which provide real-time linkages between the patient and the researchers, these limitations are largely eliminated. Yet, it is unclear (whether diary hoarding still occurs and) whether prompts are effective in reducing hoarding over the course of many months. The purpose of this analysis was to conduct a summative evaluation of 7474 automated prompts sent to participants with chronic obstructive pulmonary disease (n = 19). These participants were provided with mobile devices for logging exercise and symptom data over a 6-month period as part of a clinical trial. We found a marginal association between length in the study and delay in submission of exercise and symptom data in response to electronic prompts. Factors associated with delayed response to the prompts included older age, limited computer skills, and reports of no exercise. We recommend that future investigators who are using mobile devices in their research pay careful attention to usability issues as well as strategies that might keep patients engaged and motivated.

Effects of automated prompts for logging symptom and exercise data on mobile devices in patients with chronic obstructive pulmonary disease.

Traditional approaches to patient-reported outcomes diaries have been largely paper based. However, paper-based approaches have inherent inefficiencies such as an inability to communicate the entries in real time to the healthcare team, issues related to transport and mobility, and no tailored output related to what is entered. Traditional paper-based approaches also lack the ability to prompt users at regular intervals to record data. This lack of prompting may lead to delays in entering symptoms and exercises (diary hoarding). Electronic mobile devices have addressed some of these limitations. However, until recently these electronic devices have not been able to deliver the data in real time, thus limiting the ability of the care team to interact and respond. With the emergence of wireless mobile devices, which provide real-time linkages between the patient and the researchers, these limitations are largely eliminated. Yet, it is unclear (whether diary hoarding still occurs and) whether prompts are effective in reducing hoarding over the course of many months. The purpose of this analysis was to conduct a summative evaluation of 7474 automated prompts sent to participants with chronic obstructive pulmonary disease (n = 19). These participants were provided with mobile devices for logging exercise and symptom data over a 6-month period as part of a clinical trial. We found a marginal association between length in the study and delay in submission of exercise and symptom data in response to electronic prompts. Factors associated with delayed response to the prompts included older age, limited computer skills, and reports of no exercise. We recommend that future investigators who are using mobile devices in their research pay careful attention to usability issues as well as strategies that might keep patients engaged and motivated.

Validation and testing of the Acceptability E-scale for web-based patient-reported outcomes in cancer care.

The performance of the Acceptability E-scale was tested in a sample of 627 adult and older adult patients from various oncology clinics who completed an electronic symptoms survey. The revised Acceptability E-scale has strong psychometric properties and can be useful in assessing the acceptability and usability of computerized health-related programs in oncology and other health population.

Decision regret, adverse outcomes, and treatment choice in men with localized prostate cancer: Results from a multi-site randomized trial.

INTRODUCTION: Men diagnosed with localized prostate cancer must navigate a highly preference-sensitive decision between treatment options with varying adverse outcome profiles. We evaluated whether use of a decision support tool previously shown to decrease decisional conflict also impacted the secondary outcome of post-treatment decision regret. METHODS: Participants were randomized to receive personalized decision support via the Personal Patient Profile-Prostate or usual care prior to a final treatment decision. Symptoms were measured just before randomization and 6 months later; decision regret was measured at 6 months along with records review to ascertain treatment choices. Regression modeling explored associations between baseline variables including race and D`Amico risk, study group, and 6-month variables regret, choice, and symptoms. RESULTS: At 6 months, 287 of 392 (73%) men returned questionnaires of which 257 (89%) had made a treatment choice. Of that group, 201 of 257 (78%) completely answered the regret scale. Regret was not significantly different between participants randomized to the P3P intervention compared to the control group (P = 0.360). In univariate analyses, we found that Black men, men with hormonal symptoms, and men with bowel symptoms reported significantly higher decision regret (all P < 0.01). Significant interactions were detected between race and study group (intervention vs. usual care) in the multivariable model; use of the Personal Patient Profile-Prostate was associated with significantly decreased decisional regret among Black men (P = 0.037). Interactions between regret, symptoms and treatment revealed that (1) men choosing definitive treatment and reporting no hormonal symptoms reported lower regret compared to all others; and (2) men choosing active surveillance and reporting bowel symptoms had higher regret compared to all others. CONCLUSION: The Personal Patient Profile-Prostate decision support tool may be most beneficial in minimizing decisional regret for Black men considering treatment options for newly-diagnosed prostate cancer. TRIAL REGISTRATION: NCT01844999.

Development and evaluation of the personal patient profile-prostate (P3P), a Web-based decision support system for men newly diagnosed with localized prostate cancer.

BACKGROUND: Given that no other disease with the high incidence of localized prostate cancer (LPC) has so many treatments with so few certainties related to outcomes, many men are faced with assuming some responsibility for the treatment decision along with guidance from clinicians. Men strongly consider their own personal characteristics and other personal factors as important and influential to the decision. Clinical researchers have not developed or comprehensively investigated interventions to facilitate the insight and prioritizing of personal factors along with medical factors that are required of a man in preparation for the treatment decision. OBJECTIVES: The purpose of this pilot study was to develop and evaluate the feasibility and usability of a Web-based decision support technology, the Personal Patient Profile-Prostate (P3P), in men newly diagnosed with LPC. METHODS: Use cases were developed followed by infrastructure and content application. The program was provided on a personal desktop computer with a touch screen monitor. Participant responses to the query component of P3P determined the content of the multimedia educational and coaching intervention. The intervention was tailored to race, age, and personal factors reported as influencing the decision. Prepilot usability testing was conducted using a "think aloud" interview to identify navigation and content challenges. These issues were addressed prior to deployment in the clinic. A clinical pilot was conducted in an academic medical center where men sought consultation and treatment for LPC. Completion time, missing data, and acceptability were measured. RESULTS: Prepilot testing included 4 men with a past diagnosis of LPC who had completed therapy. Technical navigation issues were documented along with confusing content language. A total of 30 additional men with a recent diagnosis of LPC completed the P3P program in clinic prior to consulting with a urologist regarding treatment options. In a mean time of 46 minutes (SD 13 minutes), participants completed the P3P query and intervention components. Of a possible 4560 items for 30 participants, 22 (0.5%) were missing. Acceptability was reported as high overall. The sections of the intervention reported as most useful were the statistics graphs, priority information topics, and annotated external website links. CONCLUSIONS: The P3P intervention is a feasible and usable program to facilitate treatment decision making by men with newly diagnosed LPC. Testing in a multisite randomized trial with a diverse sample is warranted.

Usability evaluation of the interactive Personal Patient Profile-Prostate decision support system with African American men.

BACKGROUND: The Personal Patient Profile-Prostate (P4) program is an interactive Web-based decision support system that provides men with localized prostate cancer customized education and coaching with which to make the best personal treatment decision. This study assessed functionality and usability of the P4 program and identified problems in user-computer interaction in a sample of African American men. METHODS: Usability testing was conducted with 12 community-dwelling African American adult men. The health status of participants was not known or collected by the research team. Each participant worked with the P4 program and provided simultaneous feedback using the "think aloud" technique. Handwritten field notes were collated and assigned to 3 standard coded categories. Aspects of P4 program usability was made based on common issues in the assigned categories. Summary statistics were derived for types and frequency of usability issues noted in the coded data. RESULTS: Twelve participants reported a total of 122 usability comments, with a mean of 9 usability comments. The most common usability issue by participant was completeness of information content, which comprised 53 (43%) of the total issues. Comprehensibility of text and graphics was second, comprising 51 (42%) of the total issues. CONCLUSION: This study provided initial inventory of usability issues for community African American men that may potentially interfere with application of the P4 system in the community setting and overall system usability, confirming the need for usability testing of a culturally appropriate Internet-based decision support system before community application.

Improving health literacy: a Web application for evaluating text-to-speech engines.

The Internet is increasingly used as a medium for gathering and exchanging health information exchange. Healthcare professionals and organizations need to consider barriers that may exist within their patient-oriented Web applications. One approach to making the Web more accessible for those with lower health literacy may be to supplement textual content with audio annotation using text-to-speech engines, allowing for the creation of a virtual surrogate reader. One challenge is that with numerous text-to-speech engines on the market, objective measures of quality are difficult to obtain. To facilitate comparisons of text-to-speech engines, we developed an open-source Web application that measures user reaction times, subjective quality ratings, and accuracy in completing tasks across different audio files created by text-to-speech engines. Our research endeavor was successful in building and piloting this Web application; significant differences were found for subjective ratings of quality across three text-to-speech engines priced at different levels. However, no significant differences were found with reaction times or accuracy between these text-to-speech engines. Future avenues of research include exploring more complex tasks, usability issues related to implementing text-to-speech features, and applied health promotion and education opportunities among vulnerable populations.

Depression screening using the Patient Health Questionnaire-9 administered on a touch screen computer.

OBJECTIVE: To (1) evaluate the feasibility of touch screen depression screening in cancer patients using the Patient Health Questionnaire-9 (PHQ-9), (2) evaluate the construct validity of the PHQ-9 using the touch screen modality, and (3) examine the prevalence and severity of depression using this screening modality. METHODS: The PHQ-9 was placed in a web-based survey within a study of the clinical impact of computerized symptom and quality of life screening. Patients in medical oncology, radiation oncology, and hematopoietic stem cell transplantation (HSCT) clinics used the program on a touch screen computer in waiting rooms prior to therapy (T1) and during therapy (T2). Responses of depressed mood or anhedonia (PHQ-2 cardinal depression symptoms) triggered additional items. PHQ-9 scores were provided to the oncology team in real time. RESULTS: Among 342 patients enrolled, 33 (9.6%) at T1 and 69 (20.2%) at T2 triggered the full PHQ-9 by endorsing at least one cardinal symptom. Feasibility was high, with at least 97% completing the PHQ-2 and at least 96% completing the PHQ-9 when triggered and a mean completion time of about 2 min. The PHQ-9 had good construct validity. Medical oncology patients had the highest percent of positive screens (12.9%) at T1, while HSCT patients had the highest percent (30.5%) at T2. Using this method, 21 (6.1%) at T1 and 54 (15.8%) at T2 of the total sample had moderate to severe depression. CONCLUSIONS: The PHQ-9 administered on a touch screen computer is feasible and provides valid depression data in a diverse cancer population.

Designing and testing a web-based interface for self-monitoring of exercise and symptoms for older adults with chronic obstructive pulmonary disease.

The use of information and communication technologies to support collaborative management of chronic obstructive pulmonary disease and associated symptoms is particularly appealing since most people with chronic obstructive pulmonary disease continue to experience dyspnea despite optimal medical therapy and therefore must engage in the long-term tasks of self-management. Exercise is an effective therapy to reduce dyspnea in patients with chronic obstructive pulmonary disease. The purpose of this article was to describe our process of developing a set of integrated tools to support collaborative symptom and exercise monitoring for patients with chronic obstructive pulmonary disease. This process could be followed by other researchers and clinicians interested in developing collaborative management tools for other chronic conditions. User-centered design principles guided the 4-phase development process of a set of integrated tools for self-symptom management. The usability challenges uncovered during the field testing were mostly minor and were easily corrected. Patients had a strong preference for a calendar-like display of completed exercise coupled with simultaneous goal viewing. Field usability testing showed that the integrated set of tools was relatively easy to learn, efficient to use, and with minimal errors and has a high level of user satisfaction. An iterative, multimodal process is essential to successful development of acceptable Web-based tools for self-management in chronic obstructive pulmonary disease.

Development of a user-centered health information service system for depressive symptom management.

A user-centered, Web-based depressive symptoms management system might be particularly useful in Korea, where those who seek mental health care face stigmatizing and where personal computers and the Internet have reached saturation levels. The purpose of this article is to describe the development process of a Web-based system for depressive symptom management through user-centered design principles. Our design process included four distinct phases: a needs assessment, analysis, design/development/testing, and the application release. The final revised website was released with the URL address, "http://www.baejy.com/smiles/". In the 3 years since the site was made available publicly, it is notable that 161,604 Koreans have accessed this website, either for educational purposes or for managing their depressive symptoms. A Web-based depressive symptom management system with a high degree of usability was developed. This website can be used to assess depressive symptoms and to serve as an intervention strategy to improve mental health.