MDF-Net for abnormality detection by fusing X-rays with clinical data.

This study investigates the effects of including patients' clinical information on the performance of deep learning (DL) classifiers for disease location in chest X-ray images. Although current classifiers achieve high performance using chest X-ray images alone, consultations with practicing radiologists indicate that clinical data is highly informative and essential for interpreting medical images and making proper diagnoses. In this work, we propose a novel architecture consisting of two fusion methods that enable the model to simultaneously process patients' clinical data (structured data) and chest X-rays (image data). Since these data modalities are in different dimensional spaces, we propose a spatial arrangement strategy, spatialization, to facilitate the multimodal learning process in a Mask R-CNN model. We performed an extensive experimental evaluation using MIMIC-Eye, a dataset comprising different modalities: MIMIC-CXR (chest X-ray images), MIMIC IV-ED (patients' clinical data), and REFLACX (annotations of disease locations in chest X-rays). Results show that incorporating patients' clinical data in a DL model together with the proposed fusion methods improves the disease localization in chest X-rays by 12% in terms of Average Precision compared to a standard Mask R-CNN using chest X-rays alone. Further ablation studies also emphasize the importance of multimodal DL architectures and the incorporation of patients' clinical data in disease localization. In the interest of fostering scientific reproducibility, the architecture proposed within this investigation has been made publicly accessible( https://github.com/ChihchengHsieh/multimodal-abnormalities-detection ).

Exploring technologies to better link physical evidence and digital information for disaster victim identification.

Disaster victim identification (DVI) entails a protracted process of evidence collection and data matching to reconcile physical remains with victim identity. Technology is critical to DVI by enabling the linkage of physical evidence to information. However, labelling physical remains and collecting data at the scene are dominated by low-technology paper-based practices. We ask, how can technology help us tag and track the victims of disaster? Our response to this question has two parts. First, we conducted a human-computer interaction led investigation into the systematic factors impacting DVI tagging and tracking processes. Through interviews with Australian DVI practitioners, we explored how technologies to improve linkage might fit with prevailing work practices and preferences; practical and social considerations; and existing systems and processes. We focused on tagging and tracking activities throughout the DVI process. Using insights from these interviews and relevant literature, we identified four critical themes: protocols and training; stress and stressors; the plurality of information capture and management systems; and practicalities and constraints. Second, these findings were iteratively discussed by the authors, who have combined expertise across electronics, data science, cybersecurity, human-computer interaction and forensic pathology. We applied the themes identified in the first part of the investigation to critically review technologies that could support DVI practitioners by enhancing DVI processes that link physical evidence to information. This resulted in an overview of candidate technologies matched with consideration of their key attributes. This study recognises the importance of considering human factors that can affect technology adoption into existing practices. Consequently, we provide a searchable table (as Supplementary information) that relates technologies to the key considerations and attributes relevant to DVI practice, for readers to apply to their own context. While this research directly contributes to DVI, it also has applications to other domains in which a physical/digital linkage is required, and particularly within high stress environments with little room for error.Key points:Disaster victim identification (DVI) processes require us to link physical evidence and digital information. While technology could improve this linkage, experience shows that technological "solutions" are not always adopted in practice.Our study of the practices, preferences and contexts of Australian DVI practitioners suggests 10 critical considerations for these technologies.We review and evaluate 44 candidate technologies against these considerations and highlight the role of human factors in adoption.

Collaborative Sense-Making in Genomic Research: The Role of Visualisation.

Genomic research emerges from collaborative work within and across different scientific disciplines. A diverse range of visualisation techniques has been employed to aid this research, yet relatively little is known as to how these techniques facilitate collaboration. We conducted a case study of collaborative research within a biomedical institute to learn more about the role visualisation plays in genomic mapping. Interviews were conducted with molecular biologists (N = 5) and bioinformaticians (N = 6). We found that genomic research comprises a variety of distinct disciplines engaged in complex analytic tasks that each resist simplification, and their complexity influences how visualisations were used. Visualisation use was impacted by group-specific interactions and temporal work patterns. Visualisations were also crucial to the scientific workflow, used for both question formation and confirmation of hypotheses, and acted as an anchor for the communication of ideas and discussion. In the latter case, two approaches were taken: providing collaborators with either interactive or static imagery representing a viewpoint. The use of generic software for simplified visualisations, and quick production and curation was also noted. We discuss these findings with reference to group-specific interactions and present recommendations for improving collaborative practices through visual analytics.

HealthMap: a cluster randomised trial of interactive health plans and self-management support to prevent coronary heart disease in people with HIV.

BACKGROUND: The leading causes of morbidity and mortality for people in high-income countries living with HIV are now non-AIDS malignancies, cardiovascular disease and other non-communicable diseases associated with ageing. This protocol describes the trial of HealthMap, a model of care for people with HIV (PWHIV) that includes use of an interactive shared health record and self-management support. The aims of the HealthMap trial are to evaluate engagement of PWHIV and healthcare providers with the model, and its effectiveness for reducing coronary heart disease risk, enhancing self-management, and improving mental health and quality of life of PWHIV. METHODS/DESIGN: The study is a two-arm cluster randomised trial involving HIV clinical sites in several states in Australia. Doctors will be randomised to the HealthMap model (immediate arm) or to proceed with usual care (deferred arm). People with HIV whose doctors are randomised to the immediate arm receive 1) new opportunities to discuss their health status and goals with their HIV doctor using a HealthMap shared health record; 2) access to their own health record from home; 3) access to health coaching delivered by telephone and online; and 4) access to a peer moderated online group chat programme. Data will be collected from participating PWHIV (n = 710) at baseline, 6 months, and 12 months and from participating doctors (n = 60) at baseline and 12 months. The control arm will be offered the HealthMap intervention at the end of the trial. The primary study outcomes, measured at 12 months, are 1) 10-year risk of non-fatal acute myocardial infarction or coronary heart disease death as estimated by a Framingham Heart Study risk equation; and 2) Positive and Active Engagement in Life Scale from the Health Education Impact Questionnaire (heiQ). DISCUSSION: The study will determine the viability and utility of a novel technology-supported model of care for maintaining the health and wellbeing of people with HIV. If shown to be effective, the HealthMap model may provide a generalisable, scalable and sustainable system for supporting the care needs of people with HIV, addressing issues of equity of access. TRIAL REGISTRATION: Universal Trial Number (UTN) U111111506489; ClinicalTrial.gov Id NCT02178930 submitted 29 June 2014.