Designing comprehensible healthcare public reports: An investigation of the use of narratives and tests of quality metrics to support healthcare public report sensemaking.

A key challenge for designers of healthcare public reports is the development of a presentation format that accurately communicates the variability in the quality of care among healthcare systems. This study conducted in the United States explored whether presenting public report information within narratives and with tests of healthcare quality metrics supported the public report sensemaking process. The study involved 200 participants and employed a 2 (public report information presented in the standard format, presented within a narrative) * 2 (no tests of quality metrics added to standard report, metrics tests added) between-subjects experimental design. The participants viewed the scenario of a patient looking for dialysis facility-related information. They were then asked which dialysis facility they would choose for their care and their level of confidence in their choice. Subsequently, a knowledge quiz evaluating how the participants interpreted the information presented to them, the NASA-TLX workload survey, and a usability questionnaire were administered. The results showed that the probability of choosing the better facility from the perspective of the quality measures included in the report changed from 0.69 to 0.89 when information was presented within a narrative rather than with the standard public report format. The results also found a significantly higher comprehension score (M = 54.58, SD = 18.51) when information was presented within the narrative than when presented in the standard public report format (M = 44.57, SD = 25.13). When information was presented to the participants within a narrative, the narrative may have enabled the participants to visualize themselves as the person depicted in the narrative and this may have increased the perceived relevance of the quality measures. Total workload, mental demand and perceived usability were higher when information was presented within the narrative than when presented in the standard format. The high workload and mental demand may be due to the stress placed on the information processing channels while reading a narrative and the effort expended to relate it to the quality measures. They may also be markers of more deliberative decision making facilitated by the narratives. No significant effect of tests of quality metrics was found on the dependent variables of choice of the better healthcare facility, comprehension, and usability. There was also no significant effect of quality metrics tests on overall workload. However, the effect of quality metrics tests on the mental demand subscale of NASA-TLX was significant. Mental demand was higher without quality metrics tests than with quality metrics tests. No significant interaction was found between the two independent variables on the dependent variables of choice of the better healthcare facility, comprehension, workload, and usability. It is recommended that narratives be used to present public report information to support informed healthcare decisions.

Assessing operating room turnover time via the use of mobile application.

BACKGROUND: Improving operating room (OR) utilization is crucial to hospitals. This study examines the effectiveness of a mobile application co-developed with hospital staff to track OR turnover time (TOT). METHODS: An Android-based app, named ORTimer, was used by staff in two OR units (GI-Lab and D-Core) of Greenville Memorial Hospital (GMH) in South Carolina. The staff used the app to record milestones and note delay reasons (if applicable). A total of 1,782 turnover observations from the GI-Lab and 694 turnover observations from the D-Core were collected for the study. Using data collected from the app and additional information from GMH's electronic medical record system, a two-sample proportionality test was conducted to test the hypothesis that the use of the app improved OR turnover performance (i.e., the TOT is equal to or less than the allotted time). RESULTS: The result of the hypothesis test indicates that a higher percentage of observations in the GI-Lab and D-Core met their turnover target time when the ORTimer app was used. Additionally, multiple regression analysis was used to identify significant factors that contribute to prolonged OR TOT and to estimate their impacts. CONCLUSIONS: The app serves as both a visual management tool as well as a TOT data collection tool. By identifying barriers to the on-time completion of the turnaround, the app allows for continuous improvement of the turnover process.

An investigation of the effect of anecdotal information on the choice of a healthcare facility.

This article includes two studies investigating the impact of anecdotal healthcare information from the Internet on healthcare decisions. The availability of anecdotal information on the Internet through social media and peer support groups has increased the risk of the dissemination of misleading information. The first study investigated the effect of demographics, quality of life, health status and public reports usage on the use of anecdotal healthcare information from the Internet. The second employed a 2 (anecdotal information presented as videos supporting and contradicting public report information) * 2 (phase of introduction of anecdotal information: early, late) between-subjects experimental design to investigate the consumer's choice between two health facilities, the level of confidence in the decision, the knowledge acquired and the workload experienced. The results from the first study found that age, gender, educational level, health status and public report usage were significant predictors of consumer use of anecdotal information on the Internet. The results from the second suggest that the probability of making the optimal choice was reduced by more than half when contradicting rather than supporting anecdotal information was presented first. The data from anecdotal information became the anchor points for developing an understanding of the healthcare situation, meaning initial perceptions did not change after the presentation of the more reliable public reports. Because of comprehension issues related to public reports, consumers may give more weight to anecdotal information found online. Thus, new approaches are needed to ensure the former is engaging for a wide range of healthcare consumers.

An investigation of the efficacy of collaborative virtual reality systems for moderated remote usability testing.

Collaborative virtual reality-based systems have integrated high fidelity voice-based communication, immersive audio and screen-sharing tools into virtual environments. Such three-dimensional collaborative virtual environments can mirror the collaboration among usability test participants and facilitators when they are physically collocated, potentially enabling moderated usability tests to be conducted effectively when the facilitator and participant are located in different places. We developed a virtual collaborative three-dimensional remote moderated usability testing laboratory and employed it in a controlled study to evaluate the effectiveness of moderated usability testing in a collaborative virtual reality-based environment with two other moderated usability testing methods: the traditional lab approach and Cisco WebEx, a web-based conferencing and screen sharing approach. Using a mixed methods experimental design, 36 test participants and 12 test facilitators were asked to complete representative tasks on a simulated online shopping website. The dependent variables included the time taken to complete the tasks; the usability defects identified and their severity; and the subjective ratings on the workload index, presence and satisfaction questionnaires. Remote moderated usability testing methodology using a collaborative virtual reality system performed similarly in terms of the total number of defects identified, the number of high severity defects identified and the time taken to complete the tasks with the other two methodologies. The overall workload experienced by the test participants and facilitators was the least with the traditional lab condition. No significant differences were identified for the workload experienced with the virtual reality and the WebEx conditions. However, test participants experienced greater involvement and a more immersive experience in the virtual environment than in the WebEx condition. The ratings for the virtual environment condition were not significantly different from those for the traditional lab condition. The results of this study suggest that participants were productive and enjoyed the virtual lab condition, indicating the potential of a virtual world based approach as an alternative to conventional approaches for synchronous usability testing.

Healthcare information on YouTube: A systematic review.

This article reviews the peer-reviewed literature addressing the healthcare information available on YouTube. Inclusion and exclusion criteria were determined, and the online databases PubMed and Web of Knowledge were searched using the search phrases: (1) YouTube* AND Health* and (2) YouTube* AND Healthcare*. In all, 18 articles were reviewed, with the results suggesting that (1) YouTube is increasingly being used as a platform for disseminating health information; (2) content and frame analysis were the primary techniques employed by researchers to analyze the characteristics of this information; (3) YouTube contains misleading information, primarily anecdotal, that contradicts the reference standards and the probability of a lay user finding such content is relatively high; (4) the retrieval of relevant videos is dependent on the search term used; and (5) videos from government organizations and professional associations contained trustworthy and high-quality information. YouTube is used as a medium for promoting unscientific therapies and drugs that are yet to be approved by the appropriate agencies and has the potential to change the beliefs of patients concerning controversial topics such as vaccinations. This review recognizes the need to design interventions to enable consumers to critically assimilate the information posted on YouTube with more authoritative information sources to make effective healthcare decisions.

An investigation of the efficacy of electronic consenting interfaces of research permissions management system in a hospital setting.

PURPOSE: Ethical and legal requirements for healthcare providers in the United States, stipulate that patients sign a consent form prior to undergoing medical treatment or participating in a research study. Currently, the majority of the hospitals obtain these consents using paper-based forms, which makes patient preference data cumbersome to store, search and retrieve. To address these issues, Health Sciences of South Carolina (HSSC), a collaborative of academic medical institutions and research universities in South Carolina, is developing an electronic consenting system, the Research Permissions Management System (RPMS). This article reports the findings of a study conducted to investigate the efficacy of the two proposed interfaces for this system - an iPad-based and touchscreen-based by comparing them to the paper-based and Topaz-based systems currently in use. METHODS: This study involved 50 participants: 10 hospital admission staff and 40 patients. The four systems were compared with respect to the time taken to complete the consenting process, the number of errors made by the patients, the workload experienced by the hospital staff and the subjective ratings of both patients and staff on post-test questionnaires. RESULTS: The results from the empirical study indicated no significant differences in the time taken to complete the tasks. More importantly, the participants found the new systems more usable than the conventional methods with the registration staff experiencing the least workload in the iPad and touchscreen-based conditions and the patients experiencing more privacy and control during the consenting process with the proposed electronic systems. In addition, they indicated better comprehension and awareness of what they were signing using the new interfaces. DISCUSSION: The results indicate the two methods proposed for capturing patient consents are at least as effective as the conventional methods, and superior in several important respects. While more research is needed, these findings suggest the viability of cautious adoption of electronic consenting systems, especially because these new systems appear to address the challenge of identifying the participants required for the complex research being conducted as the result of advances in the biomedical sciences.