Digital Otoscopy With Computer-Aided Composite Image Generation: Impact on the Correct Diagnosis, Confidence, and Time.

OBJECTIVE: This study investigated the comparative performance of ear, nose, and throat (ENT) physicians in correctly detecting ear abnormalities when reviewing digital otoscopy imaging using 3 different visualization methods, including computer-assisted composite images called "SelectStitch," single video frame "Still" images, and video clips. The study also explored clinicians' diagnostic confidence levels and the time to make a diagnosis. STUDY DESIGN: Clinician diagnostic reader study. SETTING: Online diagnostic survey of ENT physicians. METHODS: Nine ENT physicians reviewed digital otoscopy examinations from 86 ears with various diagnoses (normal, perforation, retraction, middle ear effusion, tympanosclerosis). Otoscopy examinations used artificial-intelligence (AI)-based computer-aided composite image generation from a video clip (SelectStitch), manually selected best still frame from a video clip (Still), or the entire video clip. Statistical analyses included comparisons of ability to detect correct diagnosis, confidence levels, and diagnosis times. RESULTS: The ENT physicians' ability to detect ear abnormalities (33.2%-68.7%) varied depending on the pathologies. SelectStitch and Still images were not statistically different in detecting abnormalities (P > .50), but both were different from Video (P < .01). However, the performance improvement observed with Videos came at the cost of significantly longer time to determining the diagnosis. The level of confidence in the diagnosis was positively associated with correct diagnoses, but varied by particular pathology. CONCLUSION: This study explores the potential of computer-assisted techniques like SelectStitch in enhancing otoscopic diagnoses and time-saving, which could benefit telemedicine settings. Comparable performance between computer-generated and manually selected images suggests the potential of AI algorithms for otoscopy applications.

A global rise in alluvial mining increases sediment load in tropical rivers.

Increasing gold and mineral mining activity in rivers across the global tropics has degraded ecosystems and threatened human health1,2. Such river mineral mining involves intensive excavation and sediment processing in river corridors, altering river form and releasing excess sediment downstream2. Increased suspended sediment loads can reduce water clarity and cause siltation to levels that may result in disease and mortality in fish3,4, poor water quality5 and damage to human infrastructure6. Although river mining has been investigated at local scales, no global synthesis of its physical footprint and impacts on hydrologic systems exists, leaving its full environmental consequences unknown. We assemble and analyse a 37-year satellite database showing pervasive, increasing river mineral mining worldwide. We identify 396 mining districts in 49 countries, concentrated in tropical waterways that are almost universally altered by mining-derived sediment. Of 173 mining-affected rivers, 80% have suspended sediment concentrations (SSCs) more than double pre-mining levels. In 30 countries in which mining affects large (>50 m wide) rivers, 23 ± 19% of large river length is altered by mining-derived sediment, a globe-spanning effect representing 35,000 river kilometres, 6% (±1% s.e.) of all large tropical river reaches. Our findings highlight the ubiquity and intensity of mining-associated degradation in tropical river systems.

Convolutional Neural Network-Based Clinical Predictors of Oral Dysplasia: Class Activation Map Analysis of Deep Learning Results.

Oral cancer/oral squamous cell carcinoma is among the top ten most common cancers globally, with over 500,000 new cases and 350,000 associated deaths every year worldwide. There is a critical need for objective, novel technologies that facilitate early, accurate diagnosis. For this purpose, we have developed a method to classify images as "suspicious" and "normal" by performing transfer learning on Inception-ResNet-V2 and generated automated heat maps to highlight the region of the images most likely to be involved in decision making. We have tested the developed method's feasibility on two independent datasets of clinical photographic images of 30 and 24 patients from the UK and Brazil, respectively. Both 10-fold cross-validation and leave-one-patient-out validation methods were performed to test the system, achieving accuracies of 73.6% (±19%) and 90.9% (±12%), F1-scores of 97.9% and 87.2%, and precision values of 95.4% and 99.3% at recall values of 100.0% and 81.1% on these two respective cohorts. This study presents several novel findings and approaches, namely the development and validation of our methods on two datasets collected in different countries showing that using patches instead of the whole lesion image leads to better performance and analyzing which regions of the images are predictive of the classes using class activation map analysis.

Molecular Imaging of Inflammatory Disease.

Inflammatory diseases include a wide variety of highly prevalent conditions with high mortality rates in severe cases ranging from cardiovascular disease, to rheumatoid arthritis, to chronic obstructive pulmonary disease, to graft vs. host disease, to a number of gastrointestinal disorders. Many diseases that are not considered inflammatory per se are associated with varying levels of inflammation. Imaging of the immune system and inflammatory response is of interest as it can give insight into disease progression and severity. Clinical imaging technologies such as computed tomography (CT) and magnetic resonance imaging (MRI) are traditionally limited to the visualization of anatomical information; then, the presence or absence of an inflammatory state must be inferred from the structural abnormalities. Improvement in available contrast agents has made it possible to obtain functional information as well as anatomical. In vivo imaging of inflammation ultimately facilitates an improved accuracy of diagnostics and monitoring of patients to allow for better patient care. Highly specific molecular imaging of inflammatory biomarkers allows for earlier diagnosis to prevent irreversible damage. Advancements in imaging instruments, targeted tracers, and contrast agents represent a rapidly growing area of preclinical research with the hopes of quick translation to the clinic.

OtoMatch: Content-based eardrum image retrieval using deep learning.

Acute infections of the middle ear are the most commonly treated childhood diseases. Because complications affect children's language learning and cognitive processes, it is essential to diagnose these diseases in a timely and accurate manner. The prevailing literature suggests that it is difficult to accurately diagnose these infections, even for experienced ear, nose, and throat (ENT) physicians. Advanced care practitioners (e.g., nurse practitioners, physician assistants) serve as first-line providers in many primary care settings and may benefit from additional guidance to appropriately determine the diagnosis and treatment of ear diseases. For this purpose, we designed a content-based image retrieval (CBIR) system (called OtoMatch) for normal, middle ear effusion, and tympanostomy tube conditions, operating on eardrum images captured with a digital otoscope. We present a method that enables the conversion of any convolutional neural network (trained for classification) into an image retrieval model. As a proof of concept, we converted a pre-trained deep learning model into an image retrieval system. We accomplished this by changing the fully connected layers into lookup tables. A database of 454 labeled eardrum images (179 normal, 179 effusion, and 96 tube cases) was used to train and test the system. On a 10-fold cross validation, the proposed method resulted in an average accuracy of 80.58% (SD 5.37%), and maximum F1 score of 0.90 while retrieving the most similar image from the database. These are promising results for the first study to demonstrate the feasibility of developing a CBIR system for eardrum images using the newly proposed methodology.