RESUMEN
BACKGROUND: A study was undertaken to assess the effectiveness of open-source large language models (LLMs) in extracting clinical data from unstructured mechanical thrombectomy reports in patients with ischemic stroke caused by a vessel occlusion. METHODS: We deployed local open-source LLMs to extract data points from free-text procedural reports in patients who underwent mechanical thrombectomy between September 2020 and June 2023 in our institution. The external dataset was obtained from a second university hospital and comprised consecutive cases treated between September 2023 and March 2024. Ground truth labeling was facilitated by a human-in-the-loop (HITL) approach, with time metrics recorded for both automated and manual data extractions. We tested three models-Mixtral, Qwen, and BioMistral-assessing their performance on precision, recall, and F1 score across 15 clinical categories such as National Institute of Health Stroke Scale (NIHSS) scores, occluded vessels, and medication details. RESULTS: The study included 1000 consecutive reports from our primary institution and 50 reports from a secondary institution. Mixtral showed the highest precision, achieving 0.99 for first series time extraction and 0.69 for occluded vessel identification within the internal dataset. In the external dataset, precision ranged from 1.00 for NIHSS scores to 0.70 for occluded vessels. Qwen showed moderate precision with a high of 0.85 for NIHSS scores and a low of 0.28 for occluded vessels. BioMistral had the broadest range of precision, from 0.81 for first series times to 0.14 for medication details. The HITL approach yielded an average time savings of 65.6% per case, with variations from 45.95% to 79.56%. CONCLUSION: This study highlights the potential of using LLMs for automated clinical data extraction from medical reports. Incorporating HITL annotations enhances precision and also ensures the reliability of the extracted data. This methodology presents a scalable privacy-preserving option that can significantly support clinical documentation and research endeavors.
RESUMEN
BACKGROUND: Selective water uptake by neurons and glial cells and subsequent brain tissue oedema are key pathophysiological processes of hypoxic-ischemic encephalopathy (HIE) after cardiac arrest (CA). Although brain computed tomography (CT) is widely used to assess the severity of HIE, changes of brain radiodensity over time have not been investigated. These could be used to quantify regional brain net water uptake (NWU), a potential prognostic biomarker. METHODS: We conducted an observational prognostic accuracy study including a derivation (single center cardiac arrest registry) and a validation (international multicenter TTM2 trial) cohort. Early (<6 h) and follow-up (>24 h) head CTs of CA patients were used to determine regional NWU for grey and white matter regions after co-registration with a brain atlas. Neurological outcome was dichotomized as good versus poor using the Cerebral Performance Category Scale (CPC) in the derivation cohort and Modified Rankin Scale (mRS) in the validation cohort. RESULTS: We included 115 patients (81 derivation, 34 validation) with out-of-hospital (OHCA) and in-hospital cardiac arrest (IHCA). Regional brain water content remained unchanged in patients with good outcome. In patients with poor neurological outcome, we found considerable regional water uptake with the strongest effect in the basal ganglia. NWU >8% in the putamen and caudate nucleus predicted poor outcome with 100% specificity (95%-CI: 86-100%) and 43% (moderate) sensitivity (95%-CI: 31-56%). CONCLUSION: This pilot study indicates that NWU derived from serial head CTs is a promising novel biomarker for outcome prediction after CA. NWU >8% in basal ganglia grey matter regions predicted poor outcome while absence of NWU indicated good outcome. NWU and follow-up CTs should be investigated in larger, prospective trials with standardized CT acquisition protocols.
Asunto(s)
Biomarcadores , Tomografía Computarizada por Rayos X , Humanos , Masculino , Femenino , Persona de Mediana Edad , Tomografía Computarizada por Rayos X/métodos , Anciano , Pronóstico , Biomarcadores/metabolismo , Biomarcadores/análisis , Paro Cardíaco Extrahospitalario/terapia , Paro Cardíaco Extrahospitalario/diagnóstico por imagen , Paro Cardíaco/metabolismo , Encéfalo/diagnóstico por imagen , Encéfalo/metabolismo , Hipoxia-Isquemia Encefálica/diagnóstico por imagen , Hipoxia-Isquemia Encefálica/metabolismo , Edema Encefálico/etiología , Edema Encefálico/diagnóstico por imagen , Edema Encefálico/metabolismo , Sistema de RegistrosRESUMEN
BACKGROUND: Participation in multimodal leisure activities, such as playing a musical instrument, may be protective against brain aging and dementia in older adults (OA). Potential neuroprotective correlates underlying musical activity remain unclear. OBJECTIVE: This cross-sectional study investigated the association between lifetime musical activity and resting-state functional connectivity (RSFC) in three higher-order brain networks: the Default Mode, Fronto-Parietal, and Salience networks. METHODS: We assessed 130 cognitively unimpaired participants (≥ 60 years) from the baseline cohort of the DZNE-Longitudinal Cognitive Impairment and Dementia Study (DELCODE) study. Lifetime musical activity was operationalized by the self-reported participation in musical instrument playing across early, middle, and late life stages using the Lifetime of Experiences Questionnaire (LEQ). Participants who reported musical activity during all life stages (n = 65) were compared to controls who were matched on demographic and reserve characteristics (including education, intelligence, socioeconomic status, self-reported physical activity, age, and sex) and never played a musical instrument (n = 65) in local (seed-to-voxel) and global (within-network and between-network) RSFC patterns using pre-specified network seeds. RESULTS: Older participants with lifetime musical activity showed significantly higher local RSFC between the medial prefrontal cortex (Default Mode Network seed) and temporal as well as frontal regions, namely the right temporal pole and the right precentral gyrus extending into the superior frontal gyrus, compared to matched controls. There were no significant group differences in global RSFC within or between the three networks. CONCLUSION: We show that playing a musical instrument during life relates to higher RSFC of the medial prefrontal cortex with distant brain regions involved in higher-order cognitive and motor processes. Preserved or enhanced functional connectivity could potentially contribute to better brain health and resilience in OA with a history in musical activity. TRIAL REGISTRATION: German Clinical Trials Register (DRKS00007966, 04/05/2015).
Asunto(s)
Cognición , Imagen por Resonancia Magnética , Música , Humanos , Masculino , Femenino , Anciano , Persona de Mediana Edad , Cognición/fisiología , Estudios Transversales , Red Nerviosa/fisiología , Red Nerviosa/diagnóstico por imagen , Encéfalo/fisiología , Encéfalo/diagnóstico por imagenRESUMEN
Purpose: To improve reliability of metabolite quantification at both, 3 T and 7 T, we propose a novel parametrized macromolecules quantification model (PRaMM) for brain 1 H MRS, in which the ratios of macromolecule peak intensities are used as soft constraints. Methods: Full- and metabolite-nulled spectra were acquired in three different brain regions with different ratios of grey and white matter from six healthy volunteers, at both 3 T and 7 T. Metabolite-nulled spectra were used to identify highly correlated macromolecular signal contributions and estimate the ratios of their intensities. These ratios were then used as soft constraints in the proposed PRaMM model for quantification of full spectra. The PRaMM model was validated by comparison with a single component macromolecule model and a macromolecule subtraction technique. Moreover, the influence of the PRaMM model on the repeatability and reproducibility compared to those other methods was investigated. Results: The developed PRaMM model performed better than the two other approaches in all three investigated brain regions. Several estimates of metabolite concentration and their Cramér-Rao lower bounds were affected by the PRaMM model reproducibility, and repeatability of the achieved concentrations were tested by evaluating the method on a second repeated acquisitions dataset. While the observed effects on both metrics were not significant, the fit quality metrics were improved for the PRaMM method (p≤0.0001). Minimally detectable changes are in the range 0.5 - 1.9 mM and percent coefficients of variations are lower than 10% for almost all the clinically relevant metabolites. Furthermore, potential overparameterization was ruled out. Conclusion: Here, the PRaMM model, a method for an improved quantification of metabolites was developed, and a method to investigate the role of the MM background and its individual components from a clinical perspective is proposed.
RESUMEN
BACKGROUND: The objective of this study was to assess the performance of the first publicly available automated 3D segmentation for spontaneous intracerebral hemorrhage (ICH) based on a 3D neural network before and after retraining. METHODS: We performed an independent validation of this model using a multicenter retrospective cohort. Performance metrics were evaluated using the dice score (DSC), sensitivity, and positive predictive values (PPV). We retrained the original model (OM) and assessed the performance via an external validation design. A multivariate linear regression model was used to identify independent variables associated with the model's performance. Agreements in volumetric measurements and segmentation were evaluated using Pearson's correlation coefficients (r) and intraclass correlation coefficients (ICC), respectively. With 1040 patients, the OM had a median DSC, sensitivity, and PPV of 0.84, 0.79, and 0.93, compared to thoseo f 0.83, 0.80, and 0.91 in the retrained model (RM). However, the median DSC for infratentorial ICH was relatively low and improved significantly after retraining, at p < 0.001. ICH volume and location were significantly associated with the DSC, at p < 0.05. The agreement between volumetric measurements (r > 0.90, p > 0.05) and segmentations (ICC ≥ 0.9, p < 0.001) was excellent. CONCLUSION: The model demonstrated good generalization in an external validation cohort. Location-specific variances improved significantly after retraining. External validation and retraining are important steps to consider before applying deep learning models in new clinical settings.
RESUMEN
OBJECTIVES: Non-contrast computed tomography (NCCT) markers are robust predictors of parenchymal hematoma expansion in intracerebral hemorrhage (ICH). We investigated whether NCCT features can also identify ICH patients at risk of intraventricular hemorrhage (IVH) growth. METHODS: Patients with acute spontaneous ICH admitted at four tertiary centers in Germany and Italy were retrospectively included from January 2017 to June 2020. NCCT markers were rated by two investigators for heterogeneous density, hypodensity, black hole sign, swirl sign, blend sign, fluid level, island sign, satellite sign, and irregular shape. ICH and IVH volumes were semi-manually segmented. IVH growth was defined as IVH expansion > 1 mL (eIVH) or any delayed IVH (dIVH) on follow-up imaging. Predictors of eIVH and dIVH were explored with multivariable logistic regression. Hypothesized moderators and mediators were independently assessed in PROCESS macro models. RESULTS: A total of 731 patients were included, of whom 185 (25.31%) suffered from IVH growth, 130 (17.78%) had eIVH, and 55 (7.52%) had dIVH. Irregular shape was significantly associated with IVH growth (OR 1.68; 95%CI [1.16-2.44]; p = 0.006). In the subgroup analysis stratified by the IVH growth type, hypodensities were significantly associated with eIVH (OR 2.06; 95%CI [1.48-2.64]; p = 0.015), whereas irregular shape (OR 2.72; 95%CI [1.91-3.53]; p = 0.016) in dIVH. The association between NCCT markers and IVH growth was not mediated by parenchymal hematoma expansion. CONCLUSIONS: NCCT features identified ICH patients at a high risk of IVH growth. Our findings suggest the possibility to stratify the risk of IVH growth with baseline NCCT and might inform ongoing and future studies. CLINICAL RELEVANCE STATEMENT: Non-contrast CT features identified ICH patients at a high risk of intraventricular hemorrhage growth with subtype-specific differences. Our findings may assist in the risk stratification of intraventricular hemorrhage growth with baseline CT and might inform ongoing and future clinical studies. KEY POINTS: ⢠NCCT features identified ICH patients at a high risk of IVH growth with subtype-specific differences. ⢠The effect of NCCT features was not moderated by time and location or indirectly mediated by hematoma expansion. ⢠Our findings may assist in the risk stratification of IVH growth with baseline NCCT and might inform ongoing and future studies.
Asunto(s)
Hemorragia Cerebral , Tomografía Computarizada por Rayos X , Humanos , Estudios Retrospectivos , Tomografía Computarizada por Rayos X/métodos , Hemorragia Cerebral/diagnóstico por imagen , Hematoma/diagnóstico por imagen , Alemania/epidemiologíaRESUMEN
INTRODUCTION: The hippocampus is the most prominent single region of interest (ROI) for the diagnosis and prediction of Alzheimer's disease (AD). However, its suitability in the earliest stages of cognitive decline, i.e., subjective cognitive decline (SCD), remains uncertain which warrants the pursuit of alternative or complementary regions. The amygdala might be a promising candidate, given its implication in memory as well as other psychiatric disorders, e.g. depression and anxiety, which are prevalent in SCD. In this 7 tesla (T) magnetic resonance imaging (MRI) study, we aimed to compare the contribution of volumetric measurements of the hippocampus, the amygdala, and their respective subfields, for early diagnosis and prediction in an AD-related study population. METHODS: Participants from a longitudinal study were grouped into SCD (n = 29), mild cognitive impairment (MCI, n = 23), AD (n = 22) and healthy control (HC, n = 31). All participants underwent 7T MRI at baseline and extensive neuropsychological testing at up to three visits (baseline n = 105, 1-year n = 78, 3-year n = 39). Analysis of covariance (ANCOVA) was used to assess group differences of baseline volumes of the amygdala and the hippocampus and their subfields. Linear mixed models were used to estimate the effects of baseline volumes on yearly changes of a z-scaled memory score. All models were adjusted to age, sex and education. RESULTS: Compared to the HC group, individuals with SCD showed smaller amygdala ROI volumes (range across subfields -11% to -1%), but not hippocampus ROI volumes (-2% to 1%) except for the hippocampus-amygdala-transition-area (-7%). However, cross-sectional associations between baseline memory and volumes were smaller for amygdala ROIs (std. ß [95% CI] ranging between 0.16 [0.08; 0.25] and 0.46 [0.31; 0.60]) than hippocampus ROIs (between 0.32 [0.19; 0.44] and 0.53 [0.40; 0.67]). Further, the association of baseline volumes with yearly memory change in the HC and SCD groups was similarly weak for amygdala ROIs and hippocampus ROIs. In the MCI group, volumes of amygdala ROIs were associated with a relevant yearly memory decline [95% CI] ranging between -0.12 [-0.24; 0.00] and -0.26 [-0.42; -0.09] for individuals with 20% smaller volumes than the HC group. However, effects were stronger for hippocampus ROIs with a corresponding yearly memory decline ranging between -0.21 [-0.35; -0.07] and -0.31 [-0.50; -0.13]. CONCLUSION: Volumes of amygdala ROIs, as determined by 7T MRI, might contribute to objectively and non-invasively identify patients with SCD, and thus aid early diagnosis and treatment of individuals at risk to develop dementia due to AD, however associations with other psychiatric disorders should be evaluated in further studies. The amygdala's value in the prediction of longitudinal memory changes in the SCD group remains questionable. Primarily in patients with MCI, memory decline over 3 years appears to be more strongly associated with volumes of hippocampus ROIs than amygdala ROIs.
Asunto(s)
Enfermedad de Alzheimer , Disfunción Cognitiva , Humanos , Estudios de Seguimiento , Enfermedad de Alzheimer/patología , Estudios Longitudinales , Estudios Transversales , Disfunción Cognitiva/patología , Imagen por Resonancia Magnética , Amígdala del Cerebelo/diagnóstico por imagen , Amígdala del Cerebelo/patología , Pruebas Neuropsicológicas , Trastornos de la Memoria/diagnóstico por imagen , Trastornos de la Memoria/etiologíaRESUMEN
Background and Purpose: Fully automated methods for segmentation and volume quantification of intraparenchymal hemorrhage (ICH), intraventricular hemorrhage extension (IVH), and perihematomal edema (PHE) are gaining increasing interest. Yet, reliabilities demonstrate considerable variances amongst each other. Our aim was therefore to evaluate both the intra- and interrater reliability of ICH, IVH and PHE on ground-truth segmentation masks. Methods: Patients with primary spontaneous ICH were retrospectively included from a German tertiary stroke center (Charité Berlin; January 2016−June 2020). Baseline and follow-up non-contrast Computed Tomography (NCCT) scans were analyzed for ICH, IVH, and PHE volume quantification by two radiology residents. Raters were blinded to all demographic and outcome data. Inter- and intrarater agreements were determined by calculating the Intraclass Correlation Coefficient (ICC) for a randomly selected set of patients with ICH, IVH, and PHE. Results: 100 out of 670 patients were included in the analysis. Interrater agreements ranged from an ICC of 0.998 for ICH (95% CI [0.993; 0.997]), to an ICC of 0.979 for IVH (95% CI [0.984; 0.993]), and an ICC of 0.886 for PHE (95% CI [0.760; 0.938]), all p-values < 0.001. Intrarater agreements ranged from an ICC of 0.997 for ICH (95% CI [0.996; 0.998]), to an ICC of 0.995 for IVH (95% CI [0.992; 0.996]), and an ICC of 0.980 for PHE (95% CI [0.971; 0.987]), all p-values < 0.001. Conclusion Manual segmentations of ICH, IVH, and PHE demonstrate good-to-excellent inter- and intrarater reliabilities, with the highest agreement for ICH and IVH and lowest for PHE. Therefore, the degree of variances reported in fully automated quantification methods might be related amongst others to variances in ground-truth masks.
Asunto(s)
Hemorragia Cerebral , Máscaras , Humanos , Estudios Retrospectivos , Reproducibilidad de los Resultados , Hemorragia Cerebral/diagnóstico por imagen , Hemorragia Cerebral/patología , EdemaRESUMEN
BACKGROUND: Noncontrast Computed Tomography (NCCT) features are promising markers for acute hematoma expansion (HE) in patients with intracerebral hemorrhage (ICH). It remains unclear whether accurate identification of these markers is also reliable in raters with different levels of experience. METHODS: Patients with acute spontaneous ICH admitted at four tertiary centers in Germany and Italy were retrospectively included from January 2017 to June 2020. In total, nine NCCT markers were rated by one radiology resident, one radiology fellow, and one neuroradiology fellow with different levels experience in ICH imaging. Interrater reliabilities of the resident and radiology fellow were evaluated by calculated Cohen's kappa (κ) statistics in reference to the neuroradiology fellow who was referred as the gold standard. Gold-standard ratings were evaluated by calculated interrater κ statistics. Global interrater reliabilities were evaluated by calculated Fleiss kappa statistics across all three readers. A comparison of receiver operating characteristics (ROCs) was used to evaluate differences in the diagnostic accuracy for predicting acute hematoma expansion (HE) among the raters. RESULTS: Substantial-to-almost-perfect interrater concordance was found for the resident with interrater Cohen's kappa from 0.70 (95% CI 0.65-0.81) to 0.96 (95% CI 0.94-0.98). The interrater Cohen's kappa for the radiology fellow was moderate to almost perfect and ranged from 0.58 (95% CI 0.52-0.65) to 94 (95% CI 92-0.97). The intrarater gold-standard Cohen's kappa was almost perfect and ranged from 0.79 (95% CI 0.78-0.90) to 0.98 (95% CI 0.78-0.90). The global interrater Fleiss kappa ranged from 0.62 (95%CI 0.57-0.66) to 0.93 (95%CI 0.89-0.97). The diagnostic accuracy for the prediction of acute hematoma expansion (HE) was different for the island sign and fluid sign, with p-values < 0.05. CONCLUSION: The NCCT markers had a substantial-to-almost-perfect interrater agreement among raters with different levels of experience. Differences in the diagnostic accuracy for the prediction of acute HE were found in two out of nine NCCT markers. The study highlights the promising utility of NCCT markers for acute HE prediction.
Asunto(s)
Hemorragia Cerebral , Tomografía Computarizada por Rayos X , Humanos , Estudios Retrospectivos , Reproducibilidad de los Resultados , Hemorragia Cerebral/diagnóstico por imagen , Hematoma/diagnóstico por imagen , RadiólogosRESUMEN
Background: White matter hyperintensities (WMH), a biomarker of small vessel disease, are often found in Alzheimer's disease (AD) and their advanced detection and quantification can be beneficial for research and clinical applications. To investigate WMH in large-scale multicenter studies on cognitive impairment and AD, appropriate automated WMH segmentation algorithms are required. This study aimed to compare the performance of segmentation tools and provide information on their application in multicenter research. Methods: We used a pseudo-randomly selected dataset (n = 50) from the DZNE-multicenter observational Longitudinal Cognitive Impairment and Dementia Study (DELCODE) that included 3D fluid-attenuated inversion recovery (FLAIR) images from participants across the cognitive continuum. Performances of top-rated algorithms for automated WMH segmentation [Brain Intensity Abnormality Classification Algorithm (BIANCA), lesion segmentation toolbox (LST), lesion growth algorithm (LGA), LST lesion prediction algorithm (LPA), pgs, and sysu_media] were compared to manual reference segmentation (RS). Results: Across tools, segmentation performance was moderate for global WMH volume and number of detected lesions. After retraining on a DELCODE subset, the deep learning algorithm sysu_media showed the highest performances with an average Dice's coefficient of 0.702 (±0.109 SD) for volume and a mean F1-score of 0.642 (±0.109 SD) for the number of lesions. The intra-class correlation was excellent for all algorithms (>0.9) but BIANCA (0.835). Performance improved with high WMH burden and varied across brain regions. Conclusion: To conclude, the deep learning algorithm, when retrained, performed well in the multicenter context. Nevertheless, the performance was close to traditional methods. We provide methodological recommendations for future studies using automated WMH segmentation to quantify and assess WMH along the continuum of cognitive impairment and AD dementia.
RESUMEN
Background and Purpose: In the setting of acute ischemic stroke, increased blood-brain barrier permeability (BBBP) as a sign of injury is believed to be associated with increased risk of poor outcome. Pre-clinical studies show that selected serum biomarkers including C-reactive protein (CRP), interleukin-6 (IL-6), tumor necrosis factor-alpha (TNFα), matrix metallopeptidases (MMP), and vascular endothelial growth factors (VEGFs) may play a role in BBBP post-stroke. In the subacute phase of stroke, increased BBBP may also be caused by regenerative mechanisms such as vascular remodeling and therefore may improve functional recovery. Our aim was to investigate the evolution of BBBP in ischemic stroke using contrast-enhanced (CE) magnetic resonance imaging (MRI) and to analyze potential associations with blood-derived biomarkers as well as functional recovery in subacute ischemic stroke patients. Methods: This is an exploratory analysis of subacute ischemic stroke patients enrolled in the BAPTISe study nested within the randomized controlled PHYS-STROKE trial (interventions: 4 weeks of aerobic fitness training vs. relaxation). Patients with at least one CE-MRI before (v1) or after (v2) the intervention were eligible for this analysis. The prevalence of increased BBBP was visually assessed on T1-weighted MR-images based on extent of contrast-agent enhancement within the ischemic lesion. The intensity of increased BBBP was assessed semi-quantitatively by normalizing the mean voxel intensity within the region of interest (ROI) to the contralateral hemisphere ("normalized CE-ROI"). Selected serum biomarkers (high-sensitive CRP, IL-6, TNF-α, MMP-9, and VEGF) at v1 (before intervention) were analyzed as continuous and dichotomized variables defined by laboratory cut-off levels. Functional outcome was assessed at 6 months after stroke using the modified Rankin Scale (mRS). Results: Ninety-three patients with a median baseline NIHSS of 9 [IQR 6-12] were included into the analysis. The median time to v1 MRI was 30 days [IQR 18-37], and the median lesion volume on v1 MRI was 4 ml [IQR 1.2-23.4]. Seventy patients (80%) had increased BBBP visible on v1 MRI. After the trial intervention, increased BBBP was still detectable in 52 patients (74%) on v2 MRI. The median time to v2 MRI was 56 days [IQR 46-67]. The presence of increased BBBP on v1 MRI was associated with larger lesion volumes and more severe strokes. Aerobic fitness training did not influence the increase of BBBP evaluated at v2. In linear mixed models, the time from stroke onset to MRI was inversely associated with normalized CE-ROI (coefficient -0.002, Standard Error 0.007, p < 0.01). Selected serum biomarkers were not associated with the presence or evolution of increased BBBP. Multivariable regression analysis did not identify the occurrence or evolution of increased BBBP as an independent predictor of favorable functional outcome post-stroke. Conclusion: In patients with moderate-to-severe subacute stroke, three out of four patients demonstrated increased BBB permeability, which decreased over time. The presence of increased BBBP was associated with larger lesion volumes and more severe strokes. We could not detect an association between selected serum biomarkers of inflammation and an increased BBBP in this cohort. No clear association with favorable functional outcome was observed. Trial registration: NCT01954797.