Evaluation of the Use of Combined Artificial Intelligence and Pathologist Assessment to Review and Grade Prostate Biopsies.

Importance: Expert-level artificial intelligence (AI) algorithms for prostate biopsy grading have recently been developed. However, the potential impact of integrating such algorithms into pathologist workflows remains largely unexplored. Objective: To evaluate an expert-level AI-based assistive tool when used by pathologists for the grading of prostate biopsies. Design, Setting, and Participants: This diagnostic study used a fully crossed multiple-reader, multiple-case design to evaluate an AI-based assistive tool for prostate biopsy grading. Retrospective grading of prostate core needle biopsies from 2 independent medical laboratories in the US was performed between October 2019 and January 2020. A total of 20 general pathologists reviewed 240 prostate core needle biopsies from 240 patients. Each pathologist was randomized to 1 of 2 study cohorts. The 2 cohorts reviewed every case in the opposite modality (with AI assistance vs without AI assistance) to each other, with the modality switching after every 10 cases. After a minimum 4-week washout period for each batch, the pathologists reviewed the cases for a second time using the opposite modality. The pathologist-provided grade group for each biopsy was compared with the majority opinion of urologic pathology subspecialists. Exposure: An AI-based assistive tool for Gleason grading of prostate biopsies. Main Outcomes and Measures: Agreement between pathologists and subspecialists with and without the use of an AI-based assistive tool for the grading of all prostate biopsies and Gleason grade group 1 biopsies. Results: Biopsies from 240 patients (median age, 67 years; range, 39-91 years) with a median prostate-specific antigen level of 6.5 ng/mL (range, 0.6-97.0 ng/mL) were included in the analyses. Artificial intelligence-assisted review by pathologists was associated with a 5.6% increase (95% CI, 3.2%-7.9%; P < .001) in agreement with subspecialists (from 69.7% for unassisted reviews to 75.3% for assisted reviews) across all biopsies and a 6.2% increase (95% CI, 2.7%-9.8%; P = .001) in agreement with subspecialists (from 72.3% for unassisted reviews to 78.5% for assisted reviews) for grade group 1 biopsies. A secondary analysis indicated that AI assistance was also associated with improvements in tumor detection, mean review time, mean self-reported confidence, and interpathologist agreement. Conclusions and Relevance: In this study, the use of an AI-based assistive tool for the review of prostate biopsies was associated with improvements in the quality, efficiency, and consistency of cancer detection and grading.

Fast image and video colorization using chrominance blending.

Colorization, the task of coloring a grayscale image or video, involves assigning from the single dimension of intensity or luminance a quantity that varies in three dimensions, such as red, green, and blue channels. Mapping between intensity and color is, therefore, not unique, and colorization is ambiguous in nature and requires some amount of human interaction or external information. A computationally simple, yet effective, approach of colorization is presented in this paper. The method is fast and it can be conveniently used "on the fly," permitting the user to interactively get the desired results promptly after providing a reduced set of chrominance scribbles. Based on the concepts of luminance-weighted chrominance blending and fast intrinsic distance computations, high-quality colorization results for still images and video are obtained at a fraction of the complexity and computational cost of previously reported techniques. Possible extensions of the algorithm introduced here included the capability of changing the colors of an existing color image or video, as well as changing the underlying luminance, and many other special effects demonstrated here.

Toward multiple catheters detection in fluoroscopic image guided interventions.

Catheters are routinely inserted via vessels to cavities of the heart during fluoroscopic image guided interventions for electrophysiology (EP) procedures such as ablation. During such interventions, the catheter undergoes nonrigid deformation due to physician interaction, patient's breathing, and cardiac motions. EP clinical applications can benefit from fast and accurate automatic catheter tracking in the fluoroscopic images. The typical low quality in fluoroscopic images and the presence of other medical instruments in the scene make the automatic detection and tracking of catheters in clinical environments very challenging. Toward the development of such an application, a robust and efficient method for detecting and tracking the catheter sheath is developed. The proposed approach exploits the clinical setup knowledge to constrain the search space while boosting both tracking speed and accuracy, and is based on a computationally efficient framework to trace the sheath and simultaneously detect one or multiple catheter tips. The algorithm is based on a modification of the fast marching weighted distance computation that efficiently calculates, on the fly, important geodesic properties in relevant regions of the image. This is followed by a cascade classifier for detecting the catheter tips. The proposed technique is validated on 1107 fluoroscopic images acquired on multiple patients across four different clinics, achieving multiple catheter tracking at a rate of 10 images/s with a very low false positive rate of 1.06.

Esophagus silhouette extraction and reconstruction from fluoroscopic views for cardiac ablation procedure guidance.

Cardiac ablation involves the risk of serious complications when thermal injury to the esophagus occurs. This paper proposes to reduce the risk of such injuries by a proactive visualization technique, improving physician awareness of the esophagus location in the absence of or in addition to a reactive monitoring device such as a thermal probe. This is achieved by combining a graphical representation of the esophagus with live fluoroscopy. Toward this goal, we present an automated method to reconstruct and visualize a 3-D esophagus model from fluoroscopy image sequences acquired using different C-arm viewing directions. In order to visualize the esophagus under fluoroscopy, it is first biomarked by swallowing a contrast agent such as barium. Images obtained in this procedure are then used to automatically extract the 2-D esophagus silhouette and reconstruct a 3-D surface of the esophagus internal wall. Once the 3-D representation has been computed, it can be visualized using fluoroscopy overlay techniques. Compared to 3-D esophagus imaging using CT or C-arm CT, our proposed fluoroscopy method requires low radiation dose and enables a simpler workflow on geometry-calibrated standard C-arm systems.

Automatic image-based cardiac and respiratory cycle synchronization and gating of image sequences.

We propose a novel method to detect the current state of the quasi-periodic system from image sequences which in turn will enable us to synchronize/gate the image sequences to obtain images of the organ system at similar configurations. The method uses the cumulated phase shift in the spectral domain of successive image frames as a measure of the net motion of objects in the scene. The proposed method is applicable to 2D and 3D time varying sequences and is not specific to the imaging modality. We demonstrate its effectiveness on X-Ray Angiographic and Cardiac and Liver Ultrasound sequences. Knowledge of the current (cardiac or respiratory) phase of the system, opens up the possibility for a purely image based cardiac and respiratory gating scheme for interventional and radiotherapy procedures.