A retrieval-augmented chatbot based on GPT-4 provides appropriate differential diagnosis in gastrointestinal radiology: a proof of concept study.

BACKGROUND: We investigated the potential of an imaging-aware GPT-4-based chatbot in providing diagnoses based on imaging descriptions of abdominal pathologies. METHODS: Utilizing zero-shot learning via the LlamaIndex framework, GPT-4 was enhanced using the 96 documents from the Radiographics Top 10 Reading List on gastrointestinal imaging, creating a gastrointestinal imaging-aware chatbot (GIA-CB). To assess its diagnostic capability, 50 cases on a variety of abdominal pathologies were created, comprising radiological findings in fluoroscopy, MRI, and CT. We compared the GIA-CB to the generic GPT-4 chatbot (g-CB) in providing the primary and 2 additional differential diagnoses, using interpretations from senior-level radiologists as ground truth. The trustworthiness of the GIA-CB was evaluated by investigating the source documents as provided by the knowledge-retrieval mechanism. Mann-Whitney U test was employed. RESULTS: The GIA-CB demonstrated a high capability to identify the most appropriate differential diagnosis in 39/50 cases (78%), significantly surpassing the g-CB in 27/50 cases (54%) (p = 0.006). Notably, the GIA-CB offered the primary differential in the top 3 differential diagnoses in 45/50 cases (90%) versus g-CB with 37/50 cases (74%) (p = 0.022) and always with appropriate explanations. The median response time was 29.8 s for GIA-CB and 15.7 s for g-CB, and the mean cost per case was $0.15 and $0.02, respectively. CONCLUSIONS: The GIA-CB not only provided an accurate diagnosis for gastrointestinal pathologies, but also direct access to source documents, providing insight into the decision-making process, a step towards trustworthy and explainable AI. Integrating context-specific data into AI models can support evidence-based clinical decision-making. RELEVANCE STATEMENT: A context-aware GPT-4 chatbot demonstrates high accuracy in providing differential diagnoses based on imaging descriptions, surpassing the generic GPT-4. It provided formulated rationale and source excerpts supporting the diagnoses, thus enhancing trustworthy decision-support. KEY POINTS: • Knowledge retrieval enhances differential diagnoses in a gastrointestinal imaging-aware chatbot (GIA-CB). • GIA-CB outperformed the generic counterpart, providing formulated rationale and source excerpts. • GIA-CB has the potential to pave the way for AI-assisted decision support systems.

Photon-counting detector computed tomography for metal artifact reduction: a comparative study of different artifact reduction techniques in patients with orthopedic implants.

PURPOSE: Artifacts caused by metallic implants remain a challenge in computed tomography (CT). We investigated the impact of photon-counting detector computed tomography (PCD-CT) for artifact reduction in patients with orthopedic implants with respect to image quality and diagnostic confidence using different artifact reduction approaches. MATERIAL AND METHODS: In this prospective study, consecutive patients with orthopedic implants underwent PCD-CT imaging of the implant area. Four series were reconstructed for each patient (clinical standard reconstruction [PCD-CTStd], monoenergetic images at 140 keV [PCD-CT140keV], iterative metal artifact reduction (iMAR) corrected [PCD-CTiMAR], combination of iMAR and 140 keV monoenergetic [PCD-CT140keV+iMAR]). Subsequently, three radiologists evaluated the reconstructions in a random and blinded manner for image quality, artifact severity, anatomy delineation (adjacent and distant), and diagnostic confidence using a 5-point Likert scale (5 = excellent). In addition, the coefficient of variation [CV] and the relative quantitative artifact reduction potential were obtained as objective measures. RESULTS: We enrolled 39 patients with a mean age of 67.3 ± 13.2 years (51%; n = 20 male) and a mean BMI of 26.1 ± 4 kg/m2. All image quality measures and diagnostic confidence were significantly higher for the iMAR vs. non-iMAR reconstructions (all p < 0.001). No significant effect of the different artifact reduction approaches on CV was observed (p = 0.26). The quantitative analysis indicated the most effective artifact reduction for the iMAR reconstructions, which was higher than PCD-CT140keV (p < 0.001). CONCLUSION: PCD-CT allows for effective metal artifact reduction in patients with orthopedic implants, resulting in superior image quality and diagnostic confidence with the potential to improve patient management and clinical decision making.

Impact of temporal resolution on perfusion metrics, therapy decision, and radiation dose reduction in brain CT perfusion in patients with suspected stroke.

PURPOSE: CT perfusion of the brain is a powerful tool in stroke imaging, though the radiation dose is rather high. Several strategies for dose reduction have been proposed, including increasing the intervals between the dynamic scans. We determined the impact of temporal resolution on perfusion metrics, therapy decision, and radiation dose reduction in brain CT perfusion from a large dataset of patients with suspected stroke. METHODS: We retrospectively included 3555 perfusion scans from our clinical routine dataset. All cases were processed using the perfusion software VEOcore with a standard sampling of 1.5 s, as well as simulated reduced temporal resolution of 3.0, 4.5, and 6.0 s by leaving out respective time points. The resulting perfusion maps and calculated volumes of infarct core and mismatch were compared quantitatively. Finally, hypothetical decisions for mechanical thrombectomy following the DEFUSE-3 criteria were compared. RESULTS: The agreement between calculated volumes for core (ICC = 0.99, 0.99, and 0.98) and hypoperfusion (ICC = 0.99, 0.99, and 0.97) was excellent for all temporal sampling schemes. Of the 1226 cases with vascular occlusion, 14 (1%) for 3.0 s sampling, 23 (2%) for 4.5 s sampling, and 63 (5%) for 6.0 s sampling would have been treated differently if the DEFUSE-3 criteria had been applied. Reduction of temporal resolution to 3.0 s, 4.5 s, and 6.0 s reduced the radiation dose by a factor of 2, 3, or 4. CONCLUSION: Reducing the temporal sampling of brain perfusion CT has only a minor impact on image quality and treatment decision, but significantly reduces the radiation dose to that of standard non-contrast CT.

Value of virtual non-contrast images to identify uncomplicated cystic renal lesions: photon-counting detector CT vs. dual-energy integrating detector CT.

PURPOSE: To investigate the value of photon-counting detector CT (PCD-CT) derived virtual non-contrast (VNC) reconstructions to identify renal cysts in comparison with conventional dual-energy integrating detector (DE EID) CT-derived VNC reconstructions. MATERIAL AND METHODS: We prospectively enrolled consecutive patients with simple renal cysts (Bosniak classification-Version 2019, density ≤ 20 HU and/or enhancement ≤ 20 HU) who underwent multiphase (non-contrast, arterial, portal venous phase) PCD-CT and for whom non-contrast and portal venous phase DE EID-CT was available. Subsequently, VNC reconstructions were calculated for all contrast phases and density as well as contrast enhancement within the cysts were measured and compared. MRI and/or ultrasound served as reference standards for lesion classification. RESULTS: 19 patients (1 cyst per patient; age 69.5 ± 10.7 years; 17 [89.5%] male) were included. Density measurements on PCD-CT non-contrast and VNC reconstructions (arterial and portal venous phase) revealed no significant effect on HU values (p = 0.301). In contrast, a significant difference between non-contrast vs. VNC images was found for DE EID-CT (p = 0.02). For PCD-CT, enhancement for VNC reconstructions was < 20 HU for all evaluated cysts. DE EID-CT measurements revealed an enhancement of > 20 HU in five lesions (26.3%) using the VNC reconstructions, which was not seen with the non-contrast images. CONCLUSION: PCD-CT-derived VNC images allow for reliable and accurate characterization of simple cystic renal lesions similar to non-contrast scans whereas VNC images calculated from DE EID-CT resulted in substantial false characterization. Thus, PCD-CT-derived VNC images may substitute for non-contrast images and reduce radiation dose and follow-up imaging.

Impact of different metal artifact reduction techniques in photon-counting computed tomography head and neck scans in patients with dental hardware.

OBJECTIVES: Metal artifacts remain a challenge in computed tomography. We investigated the potential of photon-counting computed tomography (PCD-CT) for metal artifact reduction using an iterative metal artifact reduction (iMAR) algorithm alone and in combination with high keV monoenergetic images (140 keV) in patients with dental hardware. MATERIAL AND METHODS: Consecutive patients with dental implants were prospectively included in this study and received PCD-CT imaging of the craniofacial area. Four series were reconstructed (standard [PCD-CTstd], monoenergetic at 140 keV [PCD-CT140keV], iMAR corrected [PCD-CTiMAR], combination of iMAR and 140 keV monoenergetic [PCD-CTiMAR+140keV]). All reconstructions were assessed qualitatively by four radiologists (independent and blinded reading on a 5-point Likert scale [5 = excellent; no artifact]) regarding overall image quality, artifact severity, and delineation of adjacent and distant anatomy. To assess signal homogeneity and evaluate the magnitude of artifact reduction, we performed quantitative measures of coefficient of variation (CV) and a region of interest (ROI)-based relative change in artifact reduction [PCD-CT/PCD-CTstd]. RESULTS: We enrolled 48 patients (mean age 66.5 ± 11.2 years, 50% (n = 24) males; mean BMI 25.2 ± 4.7 kg/m2; mean CTDIvol 6.2 ± 6 mGy). We found improved overall image quality, reduced artifacts and superior delineation of both adjacent and distant anatomy for the iMAR vs. non-iMAR reconstructions (all p < 0.001). No significant effect of the different artifact reduction approaches on CV was observed (p = 0.42). The ROI-based analysis indicated the most effective artifact reduction for the iMAR reconstructions, which was significantly higher compared to PCD-CT140keV (p < 0.001). CONCLUSION: PCD-CT offers highly effective approaches for metal artifact reduction with the potential to overcome current diagnostic challenges in patients with dental implants. CLINICAL RELEVANCE STATEMENT: Metallic artifacts pose a significant challenge in CT imaging, potentially leading to missed findings. Our study shows that PCD-CT with iMAR post-processing reduces artifacts, improves image quality, and can possibly reveal pathologies previously obscured by artifacts, without additional dose application. KEY POINTS: • Photon-counting detector CT (PCD-CT) offers highly effective approaches for metal artifact reduction in patients with dental fillings/implants. • Iterative metal artifact reduction (iMAR) is superior to high keV monoenergetic reconstructions at 140 keV for artifact reduction and provides higher image quality. • Signal homogeneity of the reconstructed images is not affected by the different artifact reduction techniques.

Impact of Photon-Counting Detector Computed Tomography on Image Quality and Radiation Dose in Patients With Multiple Myeloma.

OBJECTIVE: Computed tomography (CT) is an established method for the diagnosis, staging, and treatment of multiple myeloma. Here, we investigated the potential of photon-counting detector computed tomography (PCD-CT) in terms of image quality, diagnostic confidence, and radiation dose compared with energy-integrating detector CT (EID-CT). MATERIALS AND METHODS: In this prospective study, patients with known multiple myeloma underwent clinically indicated whole-body PCD-CT. The image quality of PCD-CT was assessed qualitatively by three independent radiologists for overall image quality, edge sharpness, image noise, lesion conspicuity, and diagnostic confidence using a 5-point Likert scale (5 = excellent), and quantitatively for signal homogeneity using the coefficient of variation (CV) of Hounsfield Units (HU) values and modulation transfer function (MTF) via the full width at half maximum (FWHM) in the frequency space. The results were compared with those of the current clinical standard EID-CT protocols as controls. Additionally, the radiation dose (CTDIvol) was determined. RESULTS: We enrolled 35 patients with multiple myeloma (mean age 69.8 ± 9.1 years; 18 [51%] males). Qualitative image analysis revealed superior scores (median [interquartile range]) for PCD-CT regarding overall image quality (4.0 [4.0-5.0] vs. 4.0 [3.0-4.0]), edge sharpness (4.0 [4.0-5.0] vs. 4.0 [3.0-4.0]), image noise (4.0 [4.0-4.0] vs. 3.0 [3.0-4.0]), lesion conspicuity (4.0 [4.0-5.0] vs. 4.0 [3.0-4.0]), and diagnostic confidence (4.0 [4.0-5.0] vs. 4.0 [3.0-4.0]) compared with EID-CT (P ≤ 0.004). In quantitative image analyses, PCD-CT compared with EID-CT revealed a substantially lower FWHM (2.89 vs. 25.68 cy/pixel) and a significantly more homogeneous signal (mean CV ± standard deviation [SD], 0.99 ± 0.65 vs. 1.66 ± 0.5; P < 0.001) at a significantly lower radiation dose (mean CTDIvol ± SD, 3.33 ± 0.82 vs. 7.19 ± 3.57 mGy; P < 0.001). CONCLUSION: Whole-body PCD-CT provides significantly higher subjective and objective image quality at significantly reduced radiation doses than the current clinical standard EID-CT protocols, along with readily available multi-spectral data, facilitating the potential for further advanced post-processing.

A Context-based Chatbot Surpasses Trained Radiologists and Generic ChatGPT in Following the ACR Appropriateness Guidelines.

Background Radiological imaging guidelines are crucial for accurate diagnosis and optimal patient care as they result in standardized decisions and thus reduce inappropriate imaging studies. Purpose In the present study, we investigated the potential to support clinical decision-making using an interactive chatbot designed to provide personalized imaging recommendations from American College of Radiology (ACR) appropriateness criteria documents using semantic similarity processing. Methods We utilized 209 ACR appropriateness criteria documents as specialized knowledge base and employed LlamaIndex, a framework that allows to connect large language models with external data, and the ChatGPT 3.5-Turbo to create an appropriateness criteria contexted chatbot (accGPT). Fifty clinical case files were used to compare the accGPT's performance against general radiologists at varying experience levels and to generic ChatGPT 3.5 and 4.0. Results All chatbots reached at least human performance level. For the 50 case files, the accGPT performed best in providing correct recommendations that were "usually appropriate" according to the ACR criteria and also did provide the highest proportion of consistently correct answers in comparison with generic chatbots and radiologists. Further, the chatbots provided substantial time and cost savings, with an average decision time of 5 minutes and a cost of 0.19 € for all cases, compared to 50 minutes and 29.99 € for radiologists (both p < 0.01). Conclusion ChatGPT-based algorithms have the potential to substantially improve the decision-making for clinical imaging studies in accordance with ACR guidelines. Specifically, a context-based algorithm performed superior to its generic counterpart, demonstrating the value of tailoring AI solutions to specific healthcare applications.

Spectral aortoiliac photon-counting CT angiography with minimal quantity of contrast agent.

The incidence of vascular and especially aortic pathologies is increasing, which leads to a higher frequency of vascular imaging. As renal pathologies also become more frequent, especially in an aging population, the need for effective preventative scan protocols with reduced contrast material is pressing. An 81-year-old female patient in our institution required a follow-up imaging of an incidental, asymptomatic abdominal aortic aneurysm. Although the patient was suffering from incipient chronic renal failure, a contrast-enhanced aortoiliac computed tomography angiography was performed using a first generation, clinical photon-counting detector computed tomography scanner. This scanner allows a modified scan protocol with a significant reduction of contrast agent while preserving diagnostic confidence. Technically, this is feasible by dual-source spectral image acquisition and dynamic monochromatic reconstruction near the K-edge of Iodine without loss of temporal or spatial resolution. The results are promising, allowing vascular imaging with significantly less risk of renal damage. In this regard, further research into optimal scan-protocols and post-processing is needed.

Deep learning segmentation results in precise delineation of the putamen in multiple system atrophy.

OBJECTIVES: The precise segmentation of atrophic structures remains challenging in neurodegenerative diseases. We determined the performance of a Deep Neural Patchwork (DNP) in comparison to established segmentation algorithms regarding the ability to delineate the putamen in multiple system atrophy (MSA), Parkinson's disease (PD), and healthy controls. METHODS: We retrospectively included patients with MSA and PD as well as healthy controls. A DNP was trained on manual segmentations of the putamen as ground truth. For this, the cohort was randomly split into a training (N = 131) and test set (N = 120). The DNP's performance was compared with putaminal segmentations as derived by Automatic Anatomic Labelling, Freesurfer and Fastsurfer. For validation, we assessed the diagnostic accuracy of the resulting segmentations in the delineation of MSA vs. PD and healthy controls. RESULTS: A total of 251 subjects (61 patients with MSA, 158 patients with PD, and 32 healthy controls; mean age of 61.5 ± 8.8 years) were included. Compared to the dice-coefficient of the DNP (0.96), we noted significantly weaker performance for AAL3 (0.72; p < .001), Freesurfer (0.82; p < .001), and Fastsurfer (0.84, p < .001). This was corroborated by the superior diagnostic performance of MSA vs. PD and HC of the DNP (AUC 0.93) versus the AUC of 0.88 for AAL3 (p = 0.02), 0.86 for Freesurfer (p = 0.048), and 0.85 for Fastsurfer (p = 0.04). CONCLUSION: By utilization of a DNP, accurate segmentations of the putamen can be obtained even if substantial atrophy is present. This allows for more precise extraction of imaging parameters or shape features from the putamen in relevant patient cohorts. CLINICAL RELEVANCE STATEMENT: Deep learning-based segmentation of the putamen was superior to currently available algorithms and is beneficial for the diagnosis of multiple system atrophy. KEY POINTS: • A Deep Neural Patchwork precisely delineates the putamen and performs equal to human labeling in multiple system atrophy, even when pronounced putaminal volume loss is present. • The Deep Neural Patchwork-based segmentation was more capable to differentiate between multiple system atrophy and Parkinson's disease than the AAL3 atlas, Freesurfer, or Fastsurfer.

Photon-Counting Computed Tomography (PC-CT) of the spine: impact on diagnostic confidence and radiation dose.

OBJECTIVES: Computed tomography (CT) is employed to evaluate surgical outcome after spinal interventions. Here, we investigate the potential of multispectral photon-counting computed tomography (PC-CT) on image quality, diagnostic confidence, and radiation dose compared to an energy-integrating CT (EID-CT). METHODS: In this prospective study, 32 patients underwent PC-CT of the spine. Data was reconstructed in two ways: (1) standard bone kernel with 65-keV (PC-CTstd) and (2) 130-keV monoenergetic images (PC-CT130 keV). Prior EID-CT was available for 17 patients; for the remaining 15, an age-, sex-, and body mass index-matched EID-CT cohort was identified. Image quality (5-point Likert scales on overall, sharpness, artifacts, noise, diagnostic confidence) of PC-CTstd and EID-CT was assessed by four radiologists independently. If metallic implants were present (n = 10), PC-CTstd and PC-CT130 keV images were again assessed by 5-point Likert scales by the same radiologists. Hounsfield units (HU) were measured within metallic artifact and compared between PC-CTstd and PC-CT130 keV. Finally, the radiation dose (CTDIvol) was evaluated. RESULTS: Sharpness was rated significantly higher (p = 0.009) and noise significantly lower (p < 0.001) in PC-CTstd vs. EID-CT. In the subset of patients with metallic implants, reading scores for PC-CT130 keV revealed superior ratings vs. PC-CTstd for image quality, artifacts, noise, and diagnostic confidence (all p < 0.001) accompanied by a significant increase of HU values within the artifact (p < 0.001). Radiation dose was significantly lower for PC-CT vs. EID-CT (mean CTDIvol: 8.83 vs. 15.7 mGy; p < 0.001). CONCLUSIONS: PC-CT of the spine with high-kiloelectronvolt reconstructions provides sharper images, higher diagnostic confidence, and lower radiation dose in patients with metallic implants. KEY POINTS: • Compared to energy-integrating CT, photon-counting CT of the spine had significantly higher sharpness and lower image noise while radiation dose was reduced by 45%. • In patients with metallic implants, virtual monochromatic photon-counting images at 130 keV were superior to standard reconstruction at 65 keV in terms of image quality, artifacts, noise, and diagnostic confidence.

Hippocampus-avoidance whole-brain radiation therapy with a simultaneous integrated boost for multiple brain metastases.

BACKGROUND: The current study was aimed at investigating the feasibility of hippocampus-avoidance whole-brain radiation therapy with a simultaneous integrated boost (HA-WBRT+SIB) for metastases and at assessing tumor control in comparison with conventional whole-brain radiation therapy (WBRT) in patients with multiple brain metastases. METHODS: Between August 2012 and December 2016, 66 patients were treated within a monocentric feasibility trial with HA-WBRT+SIB: hippocampus-avoidance WBRT (30 Gy in 12 fractions, dose to 98% of the hippocampal volume ≤ 9 Gy) and a simultaneous integrated boost (51 or 42 Gy in 12 fractions) for metastases/resection cavities. Intracranial tumor control, hippocampal failure, and survival were subsequently compared with a retrospective cohort treated with WBRT via propensity score matching analysis. RESULTS: After 1:1 propensity score matching, there were 62 HA-WBRT+SIB patients and 62 WBRT patients. Local tumor control (LTC) of existing metastases was significantly higher after HA-WBRT+SIB (98% vs 82% at 1 year; P = .007), whereas distant intracranial tumor control was significantly higher after WBRT (82% vs 69% at 1 year; P = .016); this corresponded to higher biologically effective doses. Intracranial progression-free survival (PFS; 13.5 vs 6.4 months; P = .03) and overall survival (9.9 vs 6.2 months; P = .001) were significantly better in the HA-WBRT+SIB cohort. Four patients (6.5%) developed hippocampal metastases after hippocampus avoidance. The neurologic death rate after HA-WBRT+SIB was 27.4%. CONCLUSIONS: HA-WBRT+SIB can be an efficient therapeutic option for patients with multiple brain metastases and is associated with improved LTC of existing metastases, higher intracranial PFS, a reduction of the neurologic death rate, and an acceptable risk of radiation necrosis. The therapy has the potential to prevent neurocognitive adverse effects, which will be further evaluated in the multicenter, phase 2 HIPPORAD trial.