Roles, Users, Benefits, and Limitations of Chatbots in Health Care: Rapid Review.

BACKGROUND: Chatbots, or conversational agents, have emerged as significant tools in health care, driven by advancements in artificial intelligence and digital technology. These programs are designed to simulate human conversations, addressing various health care needs. However, no comprehensive synthesis of health care chatbots' roles, users, benefits, and limitations is available to inform future research and application in the field. OBJECTIVE: This review aims to describe health care chatbots' characteristics, focusing on their diverse roles in the health care pathway, user groups, benefits, and limitations. METHODS: A rapid review of published literature from 2017 to 2023 was performed with a search strategy developed in collaboration with a health sciences librarian and implemented in the MEDLINE and Embase databases. Primary research studies reporting on chatbot roles or benefits in health care were included. Two reviewers dual-screened the search results. Extracted data on chatbot roles, users, benefits, and limitations were subjected to content analysis. RESULTS: The review categorized chatbot roles into 2 themes: delivery of remote health services, including patient support, care management, education, skills building, and health behavior promotion, and provision of administrative assistance to health care providers. User groups spanned across patients with chronic conditions as well as patients with cancer; individuals focused on lifestyle improvements; and various demographic groups such as women, families, and older adults. Professionals and students in health care also emerged as significant users, alongside groups seeking mental health support, behavioral change, and educational enhancement. The benefits of health care chatbots were also classified into 2 themes: improvement of health care quality and efficiency and cost-effectiveness in health care delivery. The identified limitations encompassed ethical challenges, medicolegal and safety concerns, technical difficulties, user experience issues, and societal and economic impacts. CONCLUSIONS: Health care chatbots offer a wide spectrum of applications, potentially impacting various aspects of health care. While they are promising tools for improving health care efficiency and quality, their integration into the health care system must be approached with consideration of their limitations to ensure optimal, safe, and equitable use.

Therapeutic Approaches for the Prevention of Upper Limb Repetitive Strain Injuries in Work-Related Computer Use: A Scoping Review.

PURPOSE: To explore and describe therapeutic approaches for the prevention of upper limb (UL) repetitive strain injuries (RSI) amongst computer users in the twenty-first century. METHODS: A scoping review was conducted using the method described by Arksey and O'Malley, further enhanced by Levac et al. to ensure rigor, validity and reliability during analysis. Key concepts pertaining to the research question have been mapped, following comprehensive searches of relevant electronic databases namely EBSCOHost (Academic Search Premier, CINAHL, eBook Collection, E-Journals, Health Source-Consumer Edition, Health Sources-Nursing/Academic Edition and MEDLINE), PUBMED and Google Scholar. The identified studies have been presented in a descriptive numerical summary to address the research aim. RESULTS: From the 577 studies initially identified, 58 studies were eligible for inclusion in the scoping review after abstract and full text screening. Strategies for the prevention of UL RSIs in computer users were categorised into overarching types of intervention as well as the factors which contribute towards sustained implementation of prevention strategies. Using ergonomic equipment was the most prevalent approach during intervention, breaks and rest periods were found to be the less common intervention offered to prevent RSIs. The majority of the studies noted personal worksite adjustments, including adjustments of the chair, back rest, lumbar support, handles or any arm support to the individual as a strategy to prevent UL RSIs. In high income countries the use of ergonomic equipment was the most common type of approach during intervention, in middle income countries stretches were the most common therapeutic intervention strategy and in low-income countries there was an even distribution between a number of different therapeutic interventions aimed at preventing RSIs. CONCLUSIONS: The review provides an overview of approaches and a comprehensive baseline for identifying further research required to generate prevention approaches. The information within the review may be used to impact company practice, policy and decision making in terms of developing prevention strategies.

Development and refinement of a novel end-of-life planning website for patients with advanced cancer: a mixed methods approach.

PURPOSE: Despite known benefits of planning for end-of-life, no digital tool exists to help patients with advanced cancer and their loved ones plan for death comprehensively. To address this unmet need, we developed a preliminary version of an innovative website to help patients with advanced cancer prepare for end-of-life tasks. METHODS: Guided by the Obesity-Related Behavioral Intervention Trials (ORBIT) model for behavioral intervention development, patients with advanced cancer (n = 10) and their caregivers (n = 10) participated in a "Think Aloud" exercise and usability protocols to optimize the end-of-life planning website. The website was iteratively refined throughout the study in collaboration with the partnering company, Peacefully, Inc. Participants also completed the Acceptability E-Scale and System Usability Scale, with a priori benchmarks established for acceptability (scores of ≥ 24 on the Acceptability E-Scale) and usability (scores of ≥ 68 on the System Usability Scale). RESULTS: Patients (N = 10) and caregivers (N = 10) completed usability testing. Patients were majority female (80%), White (100%), and had a mean age of 58 years. Caregivers (N = 10) were majority male (60%), spouse/partner (90%), White (90%), and had a mean age of 59 years. For patients, a priori hypotheses were met for both acceptability (mean score of 24.7, SD = 4.35) and usability (mean score of 73.8, SD = 6.15). For caregivers, acceptability was just below the cutoff (mean score of 22.9, SD = 4.07) and usability exceeded the cutoff (mean score of 70.0, SD = 8.42). Overall, patients and caregivers reported high levels of satisfaction and found the website helpful, with specific suggestions for changes (e.g., add more information about information security, improve text legibility). CONCLUSIONS: The findings from this study will inform modifications to optimize an innovative website to support patients with advanced cancer to prepare holistically for end-of-life tasks.

Postmenopausal women's cognitive function and performance of virtual reality tasks.

OBJECTIVE: This study aimed to assess whether prior knowledge of computer use determines performance of virtual reality tasks by postmenopausal women and whether menopausal symptoms, sociodemographic factors, lifestyle and cognition modify or interfere with their performance. METHOD: This cross-sectional study included 152 postmenopausal women divided into two groups: computer users and non-users. Age, ethnicity, time of menopause, menopausal symptoms, female health status, level of physical activity and cognitive function were considered. The participants played a virtual reality game and were assessed for hits, errors, omissions and game time. The Mann-Whitney, chi-square and Fisher exact tests and multivariate linear regression analysis were used. RESULTS: Postmenopausal computer users play virtual reality games (p = 0.005) better than postmenopausal non-users of computers. Vasomotor symptoms were high in women who used computers compared to those who did not (p = 0.006). Multivariate linear regression analysis found that the best-fitting predictors for the number of hits - that is, age (p = 0.039), Mini-Mental State Examination score (p = 0.006) and the headache symptom (p = 0.021) - influence the performance of virtual reality tasks. CONCLUSION: Computer users performed virtual reality tasks better than non-users. Headache and age but not vasomotor symptoms negatively affected the postmenopausal women's performance.

Developing a Technical-Oriented Taxonomy to Define Archetypes of Conversational Agents in Health Care: Literature Review and Cluster Analysis.

BACKGROUND: The evolution of artificial intelligence and natural language processing generates new opportunities for conversational agents (CAs) that communicate and interact with individuals. In the health domain, CAs became popular as they allow for simulating the real-life experience in a health care setting, which is the conversation with a physician. However, it is still unclear which technical archetypes of health CAs can be distinguished. Such technical archetypes are required, among other things, for harmonizing evaluation metrics or describing the landscape of health CAs. OBJECTIVE: The objective of this work was to develop a technical-oriented taxonomy for health CAs and characterize archetypes of health CAs based on their technical characteristics. METHODS: We developed a taxonomy of technical characteristics for health CAs based on scientific literature and empirical data and by applying a taxonomy development framework. To demonstrate the applicability of the taxonomy, we analyzed the landscape of health CAs of the last years based on a literature review. To form technical design archetypes of health CAs, we applied a k-means clustering method. RESULTS: Our taxonomy comprises 18 unique dimensions corresponding to 4 perspectives of technical characteristics (setting, data processing, interaction, and agent appearance). Each dimension consists of 2 to 5 characteristics. The taxonomy was validated based on 173 unique health CAs that were identified out of 1671 initially retrieved publications. The 173 CAs were clustered into 4 distinctive archetypes: a text-based ad hoc supporter; a multilingual, hybrid ad hoc supporter; a hybrid, single-language temporary advisor; and, finally, an embodied temporary advisor, rule based with hybrid input and output options. CONCLUSIONS: From the cluster analysis, we learned that the time dimension is important from a technical perspective to distinguish health CA archetypes. Moreover, we were able to identify additional distinctive, dominant characteristics that are relevant when evaluating health-related CAs (eg, input and output options or the complexity of the CA personality). Our archetypes reflect the current landscape of health CAs, which is characterized by rule based, simple systems in terms of CA personality and interaction. With an increase in research interest in this field, we expect that more complex systems will arise. The archetype-building process should be repeated after some time to check whether new design archetypes emerge.

Development of an Open-Source Injection Mold Monitoring System.

In the highly competitive injection molding industry, the ability to effectively collect information from various sensors installed in molds and machines is of the utmost relevance, enabling the development of data-based Industry 4.0 algorithms. In this work, an alternative to commercially available monitoring systems used in the industry was developed and tested in the scope of the TOOLING 4G project. The novelty of this system is its affordability, simplicity, real-time data acquisition and display in an intuitive Graphical User Interface (GUI), while being open-source firmware and software-based. These characteristics, and their combinations have been present in previous works, but, to the authors' knowledge, not all of them simultaneously. The system used an Arduino microcontroller-based data acquisition module that can be connected to any computer via a USB port. Software was developed, including a GUI, prepared to receive data from both the Arduino module and a second module. In the current state of development, data corresponding to a maximum of six sensors can be visualized, at a rate of 10 Hz, and recorded for later usage. These capabilities were verified under real-world conditions for monitoring an injection mold with the objective of creating the basis of a platform to deploy predictive maintenance. Mold temperature, cavity pressure, 3-axis acceleration, and extraction force data showed the system can successfully monitor the mold and allowed the clear distinction between normal and abnormal operating patterns.

Use of interventions involving virtual reality tasks during the climacteric: a systematic review.

Technological advances have been impacting health care worldwide. Our study aimed to research the literature systematically to determine the impact of technological treatments versus conventional treatments on the quality of life of climacteric women. The study was registered on PROSPERO (CRD42021241638). We searched seven databases, including PRISMA, using mesh terms. After screening for eligibility, we selected five clinical trials, and applying the snowball technique we were able to include four more articles, totaling nine articles that used technology-based interventions (virtual reality games) during the climacteric. The total study population consisted of 298 climacteric women. Two studies evaluated a technology-based treatment for pelvic floor, one for urinary incontinence symptoms, three for postural balance, one for cardiorespiratory capacity, one for osteoporosis and one study for lower back pain. The studies showed that the technological treatments improved pelvic floor strength, balance, cardiorespiratory fitness and bone mineral density when compared to conventional treatments. Improvement was linked to adherence to training and a high level of satisfaction during the training sessions. Technology-based treatments appear to be a viable alternative to conventional treatments in improving the quality of health, with benefits for the cardiovascular, genitourinary and skeletal systems, and ultimately for the overall quality of life.

Comparison of usability evaluation methods for a health information system: heuristic evaluation versus cognitive walkthrough method.

BACKGROUND: There are differences of opinion regarding the selection of the most practical usability evaluation method among different methods. The present study aimed to compare two expert-based evaluation methods in order to assess a nursing module as the most widely used module of a Hospital Information System (HIS). METHODS: Five independent evaluators used the Heuristic Evaluation (HE) and Cognitive Walkthrough (CW) methods to evaluate the nursing module of Shafa HIS. In this regard, the number and severity of the recognized problems according to the usability attributes were compared using two evaluation methods. RESULTS: The HE and CW evaluation methods resulted in the identification of 104 and 24 unique problems, respectively, of which 33.3% of recognized problems in the CW evaluation method overlapped with the HE method. The average severity of the recognized problems was considered to be minor (2.34) in the HE method and major (2.77) in the CW evaluation method. There was a significant difference in terms of the total number and average severity of the recognized problems by these methods (P < 0.001). Based on the usability attribute, the HE method identified a larger number of problems concerning all usability attributes, and a significant difference was observed in terms of the number of recognized problems in both methods for all attributes except 'memorability'. Also, there was a significant difference between the two methods based on the average severity of recognized problems only in terms of 'learnability'. CONCLUSION: The HE method identified more problems with lower average severity while the CW was able to recognize fewer problems with higher average severity. Regarding the evaluation goal, the HE method was able to be used to improve the effectiveness and satisfaction of the HIS. Furthermore, the CW evaluation method is recommended to identify usability problems with the highest average severity, especially in terms of 'learnability'.

DQAgui: a graphical user interface for the MIRACUM data quality assessment tool.

BACKGROUND: With the growing impact of observational research studies, there is also a growing focus on data quality (DQ). As opposed to experimental study designs, observational research studies are performed using data mostly collected in a non-research context (secondary use). Depending on the number of data elements to be analyzed, DQ reports of data stored within research networks can grow very large. They might be cumbersome to read and important information could be overseen quickly. To address this issue, a DQ assessment (DQA) tool with a graphical user interface (GUI) was developed and provided as a web application. METHODS: The aim was to provide an easy-to-use interface for users without prior programming knowledge to carry out DQ checks and to present the results in a clearly structured way. This interface serves as a starting point for a more detailed investigation of possible DQ irregularities. A user-centered development process ensured the practical feasibility of the interactive GUI. The interface was implemented in the R programming language and aligned to Kahn et al.'s DQ categories conformance, completeness and plausibility. RESULTS: With DQAgui, an R package with a web-app frontend for DQ assessment was developed. The GUI allows users to perform DQ analyses of tabular data sets and to systematically evaluate the results. During the development of the GUI, additional features were implemented, such as analyzing a subset of the data by defining time periods and restricting the analyses to certain data elements. CONCLUSIONS: As part of the MIRACUM project, DQAgui is now being used at ten German university hospitals for DQ assessment and to provide a central overview of the availability of important data elements in a datamap over 2 years. Future development efforts should focus on design optimization and include a usability evaluation.

A virtual research showcase and judging platform created from a patchwork of workplace applications.

Background: Despite the challenges the COVID-19 pandemic placed on libraries' existing workflows and operations, many librarians developed and debuted new services that addressed novel needs that emerged during the pandemic. This report describes how two electronic resource librarians at regional hospitals within a healthcare corporation used exhibition platforms to showcase resident research in an online format as a complement to in-person resident research programming. Case Presentation: Over the course of the pandemic, two exhibition platform variants were implemented, one year apart. This case report describes how each platform was developed. The first online event was conducted using a virtual exhibit platform to minimize in-person contact. The second online event, held the following year, blended a traditional live event with virtual elements using the online exhibit platform. To ensure completion of tasks, project management techniques were adopted throughout the event planning process. Conclusions: The pandemic created opportunities for hospitals to explore transforming meetings from primarily live and onsite into hybrid and fully virtual events. While many corporate hospitals have transitioned back to primarily in-person programming, newly adopted online practices such as online judging platforms and automation of continuing medical education tasks will likely remain. As in-person restrictions within healthcare settings are lifted or eased at uneven rates, organizations may continue to explore the value of in-person meetings versus the video conference experience of the same meeting.

Current state of dental informatics in the field of health information systems: a scoping review.

BACKGROUND: Over the past 50 years, dental informatics has developed significantly in the field of health information systems. Accordingly, several studies have been conducted on standardized clinical coding systems, data capture, and clinical data reuse in dentistry. METHODS: Based on the definition of health information systems, the literature search was divided into three specific sub-searches: "standardized clinical coding systems," "data capture," and "reuse of routine patient care data." PubMed and Web of Science were searched for peer-reviewed articles. The review was conducted following the PRISMA-ScR protocol. RESULTS: A total of 44 articles were identified for inclusion in the review. Of these, 15 were related to "standardized clinical coding systems," 15 to "data capture," and 14 to "reuse of routine patient care data." Articles related to standardized clinical coding systems focused on the design and/or development of proposed systems, on their evaluation and validation, on their adoption in academic settings, and on user perception. Articles related to data capture addressed the issue of data completeness, evaluated user interfaces and workflow integration, and proposed technical solutions. Finally, articles related to reuse of routine patient care data focused on clinical decision support systems centered on patient care, institutional or population-based health monitoring support systems, and clinical research. CONCLUSIONS: While the development of health information systems, and especially standardized clinical coding systems, has led to significant progress in research and quality measures, most reviewed articles were published in the US. Clinical decision support systems that reuse EDR data have been little studied. Likewise, few studies have examined the working environment of dental practitioners or the pedagogical value of using health information systems in dentistry.

Grateful Med: Direct access to MEDLINE for health professionals with personal computers.

Donald A.B. Lindberg M.D. arrived as Director, U.S. National Library of Medicine (NLM) in late 1984 with the intention of implementing a physician-friendly interface to MEDLINE, a prime example of his interest in making NLM information services more directly useful in medical care. By early 1986, NLM's Grateful Med, an inexpensive PC search interface to MEDLINE useful for health professionals, had joined the group of end-user systems for searching MEDLINE that emerged in the 1980s. This chapter recounts Grateful Med's rapid iterative development and the subsequent campaign to bring it to attention of health professionals. It emphasizes Lindberg's role, the challenges faced by those introducing and using the interface in a pre-Internet world, and some longer-term effects of the effort to expand health professionals' use of MEDLINE during the decade from 1986 to 1996.

Hippocampal and striatal volumes correlate with spatial memory impairment in Huntington's disease.

Spatial memory impairments are observed in people with Huntington's disease (HD), however, the domain of spatial memory has received little focus when characterizing the cognitive phenotype of HD. Spatial memory is traditionally thought to be a hippocampal-dependent function, while the neuropathology of HD centers on the striatum. Alongside spatial memory deficits in HD, recent neurocognitive theories suggest that a larger brain network is involved, including the striatum. We examined the relationship between hippocampal and striatal volumes and spatial memory in 36 HD gene expansion carriers, including premanifest (n = 24) and early manifest HD (n = 12), and 32 matched healthy controls. We assessed spatial memory with Paired Associates Learning, Rey-Osterrieth Complex Figure Test, and the Virtual House task, which assesses three components of spatial memory: navigation, object location, and plan drawing. Caudate nucleus, putamen, and hippocampal volumes were manually segmented on T1-weighted MR images. As expected, caudate nucleus and putamen volumes were significantly smaller in the HD group compared to controls, with manifest HD having more severe atrophy than the premanifest HD group. Hippocampal volumes did not differ significantly between HD and control groups. Nonetheless, on average, the HD group performed significantly worse than controls across all spatial memory tasks. The spatial memory components of object location and recall of figural and topographical drawings were associated with striatal and hippocampal volumes in the HD cohort. We provide a case to include spatial memory impairments in the cognitive phenotype of HD, and extend the neurocognitive picture of HD beyond its primary pathology within the striatum.

Using patients' own knowledge of early sensations and symptoms to develop an interactive, individualized e-questionnaire to facilitate early diagnosis of lung cancer.

BACKGROUND: One reason for the often late diagnosis of lung cancer (LC) may be that potentially-indicative sensations and symptoms are often diffuse, and may not be considered serious or urgent, making their interpretation complicated. However, with only a few exceptions, efforts to use people's own in-depth knowledge about prodromal bodily experiences has been a missing link in efforts to facilitate early LC diagnosis. In this study, we describe and discuss facilitators and challenges in our process of developing and initial testing an interactive, self-completion e-questionnaire based on patient descriptions of experienced prodromal sensations and symptoms, to support early identification of lung cancer (LC). METHODS: E-questionnaire items were derived from in-depth, detailed explorative interviews with individuals undergoing investigation for suspected LC. The descriptors of sensations/symptoms and the background items obtained were the basis for developing an interactive, individualized instrument, PEX-LC, which was refined for usability through think-aloud and other interviews with patients, members of the public, and clinical staff. RESULTS: Major challenges in the process of developing PEX-LC related to collaboration among many actors, and design/user interface problems including technical issues. Most problems identified through the think-aloud interviews related to design/user interface problems and technical issues rather than content, for example we re-ordered questions to be in line with patients' chronological, rather than retrospective, descriptions of their experiences. PEX-LC was developed into a final e-questionnaire on a touch-screen smart tablet with one background module covering sociodemographic characteristics, 10 interactive, individualized modules covering early sensations and symptoms, and a 12th assessing current symptoms. CONCLUSIONS: Close collaboration with patients throughout the process was intrinsic for developing PEX-LC. Similarly, we recognized the extent to which clinicians and technical experts were also important in this process. Similar endeavors should assure all necessary competence is included in the core research team, to facilitate timely progress. Our experiences developing PEX-LC combined with new empirical research suggest that this individualized, interactive e-questionnaire, developed through systematizing patients' own formulations of their prodromal symptom experiences, is both feasible for use and has potential value in the intended group.

Effects of Information Architecture on the Effectiveness and User Experience of Web-Based Patient Education in Middle-Aged and Older Adults: Online Randomized Experiment.

BACKGROUND: Web-based patient education is increasingly offered to improve patients' ability to learn, remember, and apply health information. Efficient organization, display, and structural design, that is, information architecture (IA), can support patients' ability to independently use web-based patient education. However, the role of IA in the context of web-based patient education has not been examined systematically. OBJECTIVE: To support intervention designers in making informed choices that enhance patients' learning, this paper describes a randomized experiment on the effects of IA on the effectiveness, use, and user experience of a patient education website and examines the theoretical mechanisms that explain these effects. METHODS: Middle-aged and older adults with self-reported hip or knee joint complaints were recruited to use and evaluate 1 of 3 patient education websites containing information on total joint replacement surgery. Each website contained the same textual content based on an existing leaflet but differed in the employed IA design (tunnel, hierarchical, or matrix design). Participants rated the websites on satisfaction, engagement, control, relevance, trust, and novelty and completed an objective knowledge test. Analyses of variance and structural equation modeling were used to examine the effects of IA and construct a theoretical model. RESULTS: We included 215 participants in our analysis. IA did not affect knowledge gain (P=.36) or overall satisfaction (P=.07) directly. However, tunnel (mean 3.22, SD 0.67) and matrix (mean 3.17, SD 0.69) architectures were found to provide more emotional support compared with hierarchical architectures (mean 2.86, SD 0.60; P=.002). Furthermore, increased perceptions of personal relevance in the tunnel IA (ß=.18) were found to improve satisfaction (ß=.17) indirectly. Increased perceptions of active control in the matrix IA (ß=.11) also improved satisfaction (ß=.27) indirectly. The final model of the IA effects explained 74.3% of the variance in satisfaction and 6.8% of the variance in knowledge and achieved excellent fit (χ217,215=14.7; P=.62; root mean square error of approximation=0.000; 95% CI [0.000-0.053]; comparative fit index=1.00; standardized root mean square residual=0.044). CONCLUSIONS: IA has small but notable effects on users' experiences with web-based health education interventions. Web-based patient education designers can employ tunnel IA designs to guide users through sequentially ordered content or matrix IA to offer users more control over navigation. Both improve user satisfaction by increasing user perceptions of relevance (tunnel) and active control (matrix). Although additional research is needed, hierarchical IA designs are currently not recommended, as hierarchical content is perceived as less supportive, engaging, and relevant, which may diminish the use and, in turn, the effect of the educational intervention.

A Qualitative Analysis of the Needs and Experiences of Hospital-based Clinicians when Accessing Medical Imaging.

As digital imaging is now a common and essential tool in the clinical workflow, it is important to understand the experiences of clinicians with medical imaging systems in order to guide future development. The objective of this paper was to explore health professionals' experiences, practices and preferences when using Picture Archiving and Communications Systems (PACS), to identify shortcomings in the existing technology and inform future developments. Semi-structured interviews are reported with 35 hospital-based healthcare professionals (3 interns, 11 senior health officers, 6 specialist registrars, 6 consultants, 2 clinical specialists, 5 radiographers, 1 sonographer, 1 radiation safety officer). Data collection took place between February 2019 and December 2020 and all data are analyzed thematically. A majority of clinicians report using PACS frequently (6+ times per day), both through dedicated PACS workstations, and through general-purpose desktop computers. Most clinicians report using basic features of PACS to view imaging and reports, and also to compare current with previous imaging, noting that they rarely use more advanced features, such as measuring. Usability is seen as a problem, including issues related to data privacy. More sustained training would help clinicians gain more value from PACS, particularly less experienced users. While the majority of clinicians report being unconcerned about sterility when accessing digital imaging, clinicians were open to the possibility of touchless operation using voice, and the ability to execute multiple commands with a single voice command would be welcomed.

Alternative PACS interface devices are well-accepted and may reduce radiologist's musculoskeletal discomfort as compared to keyboard-mouse-recording device.

OBJECTIVE: To evaluate the use of two alternative picture archiving and communication systems (PACS) interface devices (a graphics tablet and a handheld controller) in clinical practice and on task-oriented exercises. MATERIAL AND METHODS: Eleven senior radiologists were prospectively evaluated. The participants used the two tested interface devices for 10 working periods each and answered a questionnaire to evaluate the ergonomics of this experience. The prevalence of work-related musculoskeletal discomfort with the standard PACS interface set (mouse-keyboard-recording device) and these two devices was assessed. Exercises evaluating image scrolling and selection, image zooming and panning, image windowing, performing measurements, and reporting were performed with the standard PACS interface set and with the two tested devices. The sitting posture and hand position were evaluated. RESULTS: The general appreciation of the two alternative interface devices was considered to be similar to that of the standard interface set. The ergonomics of the handheld controller was considered to be slightly better than that of the standard interface set. The prevalence of musculoskeletal discomfort was 81%, 45%, and 18% for the standard interface set, graphics tablet, and handheld controller, respectively. With the graphics tablet and the handheld controller in 45% and 60%, respectively, there was a working posture change with respect to the standard interface set. The mean total exercise completion times of both tested devices were 27% higher than that of the standard interface set. CONCLUSION: Despite the increase in completion time of the task-oriented exercises, the tested devices were well accepted and considered to be more comfortable than the standard set. KEY POINTS: • Alternative PACS interface devices can be used as a substitute for the standard mouse-keyboard-recording device set with a potential improvement in work ergonomics and a reduction in work-related musculoskeletal discomfort.

Use of a Low-Cost Portable 3D Virtual Reality Gesture-Mediated Simulator for Training and Learning Basic Psychomotor Skills in Minimally Invasive Surgery: Development and Content Validity Study.

BACKGROUND: Simulation in virtual environments has become a new paradigm for surgeon training in minimally invasive surgery (MIS). However, this technology is expensive and difficult to access. OBJECTIVE: This study aims first to describe the development of a new gesture-based simulator for learning skills in MIS and, second, to establish its fidelity to the criterion and sources of content-related validity evidence. METHODS: For the development of the gesture-mediated simulator for MIS using virtual reality (SIMISGEST-VR), a design-based research (DBR) paradigm was adopted. For the second objective, 30 participants completed a questionnaire, with responses scored on a 5-point Likert scale. A literature review on the validity of the MIS training-VR (MIST-VR) was conducted. The study of fidelity to the criterion was rated using a 10-item questionnaire, while the sources of content-related validity evidence were assessed using 10 questions about the simulator training capacity and 6 questions about MIS tasks, and an iterative process of instrument pilot testing was performed. RESULTS: A good enough prototype of a gesture-based simulator was developed with metrics and feedback for learning psychomotor skills in MIS. As per the survey conducted to assess the fidelity to the criterion, all 30 participants felt that most aspects of the simulator were adequately realistic and that it could be used as a tool for teaching basic psychomotor skills in laparoscopic surgery (Likert score: 4.07-4.73). The sources of content-related validity evidence showed that this study's simulator is a reliable training tool and that the exercises enable learning of the basic psychomotor skills required in MIS (Likert score: 4.28-4.67). CONCLUSIONS: The development of gesture-based 3D virtual environments for training and learning basic psychomotor skills in MIS opens up a new approach to low-cost, portable simulation that allows ubiquitous learning and preoperative warm-up. Fidelity to the criterion was duly evaluated, which allowed a good enough prototype to be achieved. Content-related validity evidence for SIMISGEST-VR was also obtained.

A qualitative research framework for the design of user-centered displays of explanations for machine learning model predictions in healthcare.

BACKGROUND: There is an increasing interest in clinical prediction tools that can achieve high prediction accuracy and provide explanations of the factors leading to increased risk of adverse outcomes. However, approaches to explaining complex machine learning (ML) models are rarely informed by end-user needs and user evaluations of model interpretability are lacking in the healthcare domain. We used extended revisions of previously-published theoretical frameworks to propose a framework for the design of user-centered displays of explanations. This new framework served as the basis for qualitative inquiries and design review sessions with critical care nurses and physicians that informed the design of a user-centered explanation display for an ML-based prediction tool. METHODS: We used our framework to propose explanation displays for predictions from a pediatric intensive care unit (PICU) in-hospital mortality risk model. Proposed displays were based on a model-agnostic, instance-level explanation approach based on feature influence, as determined by Shapley values. Focus group sessions solicited critical care provider feedback on the proposed displays, which were then revised accordingly. RESULTS: The proposed displays were perceived as useful tools in assessing model predictions. However, specific explanation goals and information needs varied by clinical role and level of predictive modeling knowledge. Providers preferred explanation displays that required less information processing effort and could support the information needs of a variety of users. Providing supporting information to assist in interpretation was seen as critical for fostering provider understanding and acceptance of the predictions and explanations. The user-centered explanation display for the PICU in-hospital mortality risk model incorporated elements from the initial displays along with enhancements suggested by providers. CONCLUSIONS: We proposed a framework for the design of user-centered displays of explanations for ML models. We used the proposed framework to motivate the design of a user-centered display of an explanation for predictions from a PICU in-hospital mortality risk model. Positive feedback from focus group participants provides preliminary support for the use of model-agnostic, instance-level explanations of feature influence as an approach to understand ML model predictions in healthcare and advances the discussion on how to effectively communicate ML model information to healthcare providers.

Communicating laboratory results to patients and families.

People are increasingly able to access their laboratory results via patient portals. The potential benefits provided by such access, such as reductions in patient burden and improvements in patient satisfaction, disease management, and medical decision making, also come with potentially valid concerns about such results causing confusion or anxiety among patients. However, it is possible to clearly convey the meaning of results and, when needed, indicate required action by designing systems to present laboratory results adapted to the people who will use them. Systems should support people in converting the potentially meaningless data of results into meaningful information and actionable knowledge. We offer 10 recommendations toward this goal: (1) whenever possible, provide a clear takeaway message for each result. (2) Signal whether differences are meaningful or not. (3) When feasible, provide thresholds for concern and action. (4) Individualize the frame of reference by allowing custom reference ranges. (5) Ensure the system is accessible. (6) Provide conversion tools along with results. (7) Design in collaboration with users. (8) Design for both new and experienced users. (9) Make it easy for people use the data as they wish. (10) Collaborate with experts from relevant fields. Using these 10 methods and strategies renders access to laboratory results into meaningful and actionable communication. In this way, laboratories and medical systems can support patients and families in understanding and using their laboratory results to manage their health.