Modern Image-Guided Surgery: A Narrative Review of Medical Image Processing and Visualization.

Medical image analysis forms the basis of image-guided surgery (IGS) and many of its fundamental tasks. Driven by the growing number of medical imaging modalities, the research community of medical imaging has developed methods and achieved functionality breakthroughs. However, with the overwhelming pool of information in the literature, it has become increasingly challenging for researchers to extract context-relevant information for specific applications, especially when many widely used methods exist in a variety of versions optimized for their respective application domains. By being further equipped with sophisticated three-dimensional (3D) medical image visualization and digital reality technology, medical experts could enhance their performance capabilities in IGS by multiple folds. The goal of this narrative review is to organize the key components of IGS in the aspects of medical image processing and visualization with a new perspective and insights. The literature search was conducted using mainstream academic search engines with a combination of keywords relevant to the field up until mid-2022. This survey systemically summarizes the basic, mainstream, and state-of-the-art medical image processing methods as well as how visualization technology like augmented/mixed/virtual reality (AR/MR/VR) are enhancing performance in IGS. Further, we hope that this survey will shed some light on the future of IGS in the face of challenges and opportunities for the research directions of medical image processing and visualization.

On Building and Evaluating a Medical Records Exploration Interface Using Text Mining Techniques.

Medical records contain many terms that are difficult to process. Our aim in this study is to allow visual exploration of the information in medical databases where texts present a large number of syntactic variations and abbreviations by using an interface that facilitates content identification, navigation, and information retrieval. We propose the use of multi-term tag clouds as content representation tools and as assistants for browsing and querying tasks. The tag cloud generation is achieved by using a novelty mathematical method that allows related terms to remain grouped together within the tags. To evaluate this proposal, we have carried out a survey over a spanish database with 24,481 records. For this purpose, 23 expert users in the medical field were tasked to test the interface and answer some questions in order to evaluate the generated tag clouds properties. In addition, we obtained a precision of 0.990, a recall of 0.870, and a F1-score of 0.904 in the evaluation of the tag cloud as an information retrieval tool. The main contribution of this approach is that we automatically generate a visual interface over the text capable of capturing the semantics of the information and facilitating access to medical records, obtaining a high degree of satisfaction in the evaluation survey.

A spatial neighborhood methodology for computing and analyzing lymph node carcinoma similarity in precision medicine.

Precision medicine seeks to tailor therapy to the individual patient, based on statistical correlates from patients who are similar to the one under consideration. These correlates can and should go beyond genetics, and in general, beyond tabular or array data that can be easily represented computationally and compared. For example, in many types of cancer, cancer treatment and toxicity depend in large measure on the spatial disease spread-e.g., metastasizes to regional lymph nodes in head and neck cancer. However, there is currently a lack of methodology for integrating spatial information when considering patient similarity. We present a novel modeling methodology for the comparison of cancer patients within a cohort, based on the spatial spread of the lymph nodes affected in each patient. The method uses a topological map, bigrams, and hierarchical clustering to group patients based on their similarity. We compare this approach against a nonspatial (categorical) similarity approach where patients are binned solely by their affected nodes. We present similarity results on a 582 head and neck cancer patient cohort, along with two visual abstractions for analysis of the results, and we present clinician feedback. Our novel methodology partitions a patient cohort into clinically meaningful groups more susceptible to treatment side-effects. Such spatially-aware similarity approaches can help maximize the effectiveness of each patient's treatment.

Effects of Task Difficulty and Display Format on Automation Usage Strategy: A Workload Capacity Analysis.

Objective An experiment used workload capacity analysis to quantify automation usage strategy across different task difficulty and display format types in a speeded task. Background Workload capacity measures the efficiency of concurrent information processing and can serve as a gauge of automation usage strategy in speeded decision tasks. The present study used workload capacity analysis to investigate automation usage strategy while information display format and task difficulty were manipulated. Method Subjects performed a speeded judgment task assisted by an automated aid that issued decision cues at varying onset times. Response time distributions were converted to measures of workload capacity. Results Two variants of a workload capacity measure, CzOR and CzAND, gave evidence that operators moderated their own decision times both in anticipation of and following the arrival of the aid's diagnosis under difficult task conditions regardless of display format. Conclusion Assistance from an automated decision aid may cause operators to delay their own responses in a speeded decision task, producing joint response time distributions that are slower than optimal. Application Even when it renders its own judgments quickly and with high accuracy, an automated decision aid may slow responses from a user. Automation designers should consider the relative costs and benefits of response accuracy and time when choosing whether and how to implement an automated decision aid.

Solvent flashcards: a visualisation tool for sustainable chemistry.

Selecting greener solvents during experiment design is imperative for greener chemistry. While many solvent selection guides are currently used in the pharmaceutical industry, these are often paper-based guides which can make it difficult to identify and compare specific solvents. This work presents a stand-alone version of the solvent flashcards that were developed as part of the AI4Green electronic laboratory notebook. The functionality is an intuitive and interactive interface for the visualisation of data from CHEM21, a pharmaceutical solvent selection guide that categorises solvents according to "greenness". This open-source software is written in Python, JavaScript, HTML and CSS and allows users to directly contrast and compare specific solvents by generating colour-coded flashcards. It can be installed locally using pip, or alternatively the source code is available on GitHub: https://github.com/AI4Green/solvent_flashcards . The documentation can also be found on GitHub or on the corresponding Python Package Index webpage: https://pypi.org/project/solvent-guide/ . SCIENTIFIC CONTRIBUTION: This simple and easy-to-use digital tool provides a visualisation of solvent greenness data through a novel intuitive interface and encourages green chemistry. It offers numerous advantages over traditional solvent selection guides, allowing users to directly customise the solvent list and generate side-by-side comparisons of only the most important solvents. The release as a standalone package will maximise the benefit of this software.

Yum-Me: A Personalized Nutrient-Based Meal Recommender System.

Nutrient-based meal recommendations have the potential to help individuals prevent or manage conditions such as diabetes and obesity. However, learning people's food preferences and making recommendations that simultaneously appeal to their palate and satisfy nutritional expectations are challenging. Existing approaches either only learn high-level preferences or require a prolonged learning period. We propose Yum-me, a personalized nutrient-based meal recommender system designed to meet individuals' nutritional expectations, dietary restrictions, and fine-grained food preferences. Yum-me enables a simple and accurate food preference profiling procedure via a visual quiz-based user interface and projects the learned profile into the domain of nutritionally appropriate food options to find ones that will appeal to the user. We present the design and implementation of Yum-me and further describe and evaluate two innovative contributions. The first contriution is an open source state-of-the-art food image analysis model, named FoodDist. We demonstrate FoodDist's superior performance through careful benchmarking and discuss its applicability across a wide array of dietary applications. The second contribution is a novel online learning framework that learns food preference from itemwise and pairwise image comparisons. We evaluate the framework in a field study of 227 anonymous users and demonstrate that it outperforms other baselines by a significant margin. We further conducted an end-to-end validation of the feasibility and effectiveness of Yum-me through a 60-person user study, in which Yum-me improves the recommendation acceptance rate by 42.63%.

Desarrollo de una Interfaz Visual del Metabolismo de Glucosa Basada en Modelos Matemáticos Compartimentales / Development of a Visual Interface of Glucose Metabolism Based on Compartment Mathematical Models

RESUMEN La diabetes es una pandemia mundial cuya incidencia ha aumentado en las últimas décadas. Por tal motivo, es prioritario proponer estrategias para su diagnóstico, tratamiento y seguimiento. Uno de los enfoques recientes en el tratamiento de la diabetes es el monitoreo continuo, el cual permite tener suficiente información sobre el estado metabólico del paciente a lo largo del día. Esta información puede servir para simular pacientes virtuales que sean herramientas para proponer estrategias de tratamiento. Por tanto, el objetivo de esta investigación es proponer una interfaz visual que simule pacientes virtuales, a partir de un conjunto de modelos matemáticos compartimentales que permiten ingresar parámetros del metabolismo y modificaciones en el tratamiento. El desarrollo de la interfaz se realizó en MATLAB® y simula tres tipos de pacientes (sano, diabético tipo I y diabético tipo II). Los resultados muestran una interfaz que presenta de manera ilustrativa el funcionamiento de los modelos matemáticos y permite una visualización del estado metabólico del paciente; así como el manejo de medicamentos e ingesta. Una limitante de esta investigación es la validación de la interfaz con datos experimentales de los tres tipos de pacientes. Una vez validada, esta herramienta aportaría en el desarrollo de tecnología in silico para la generación de pacientes virtuales.

ABSTRACT Diabetes is a pandemic disease whose incident rate has been rising in the last decades. Therefore, it is important to propose strategies for its diagnosis, treatment and monitoring. One of the recent approaches on diabetes treatment is the continuous monitoring, which provides enough information about the metabolic state of the patient throughout the day. This information can be used to simulate virtual patients which are useful tools in treatment strategies. Thus, the objective of this research is to propose a visual interface to simulate virtual patients, this is based on compartmental mathematical models considering changes in metabolic parameters and treatment modifications. The interface was made in MATLAB® and simulates three kinds of patients (healthy, type I diabetic, type II diabetic). The results show an interface that presents the functionality of the mathematical models in an illustrative way and it allows the visualization of the metabolic state of the patient; as well as the medication usage and meal intake. A limitation of this approach is the validation of the interface with experimental data of the three kinds of patients. Once it was validated, this tool could contribute to the development of in silico technology to generate virtual patients.