Large Language Models for Automated Synoptic Reports and Resectability Categorization in Pancreatic Cancer.

Background Structured radiology reports for pancreatic ductal adenocarcinoma (PDAC) improve surgical decision-making over free-text reports, but radiologist adoption is variable. Resectability criteria are applied inconsistently. Purpose To evaluate the performance of large language models (LLMs) in automatically creating PDAC synoptic reports from original reports and to explore performance in categorizing tumor resectability. Materials and Methods In this institutional review board-approved retrospective study, 180 consecutive PDAC staging CT reports on patients referred to the authors' European Society for Medical Oncology-designated cancer center from January to December 2018 were included. Reports were reviewed by two radiologists to establish the reference standard for 14 key findings and National Comprehensive Cancer Network (NCCN) resectability category. GPT-3.5 and GPT-4 (accessed September 18-29, 2023) were prompted to create synoptic reports from original reports with the same 14 features, and their performance was evaluated (recall, precision, F1 score). To categorize resectability, three prompting strategies (default knowledge, in-context knowledge, chain-of-thought) were used for both LLMs. Hepatopancreaticobiliary surgeons reviewed original and artificial intelligence (AI)-generated reports to determine resectability, with accuracy and review time compared. The McNemar test, t test, Wilcoxon signed-rank test, and mixed effects logistic regression models were used where appropriate. Results GPT-4 outperformed GPT-3.5 in the creation of synoptic reports (F1 score: 0.997 vs 0.967, respectively). Compared with GPT-3.5, GPT-4 achieved equal or higher F1 scores for all 14 extracted features. GPT-4 had higher precision than GPT-3.5 for extracting superior mesenteric artery involvement (100% vs 88.8%, respectively). For categorizing resectability, GPT-4 outperformed GPT-3.5 for each prompting strategy. For GPT-4, chain-of-thought prompting was most accurate, outperforming in-context knowledge prompting (92% vs 83%, respectively; P = .002), which outperformed the default knowledge strategy (83% vs 67%, P < .001). Surgeons were more accurate in categorizing resectability using AI-generated reports than original reports (83% vs 76%, respectively; P = .03), while spending less time on each report (58%; 95% CI: 0.53, 0.62). Conclusion GPT-4 created near-perfect PDAC synoptic reports from original reports. GPT-4 with chain-of-thought achieved high accuracy in categorizing resectability. Surgeons were more accurate and efficient using AI-generated reports. © RSNA, 2024 Supplemental material is available for this article. See also the editorial by Chang in this issue.

Radiomics using computed tomography to predict CD73 expression and prognosis of colorectal cancer liver metastases.

BACKGROUND: Finding a noninvasive radiomic surrogate of tumor immune features could help identify patients more likely to respond to novel immune checkpoint inhibitors. Particularly, CD73 is an ectonucleotidase that catalyzes the breakdown of extracellular AMP into immunosuppressive adenosine, which can be blocked by therapeutic antibodies. High CD73 expression in colorectal cancer liver metastasis (CRLM) resected with curative intent is associated with early recurrence and shorter patient survival. The aim of this study was hence to evaluate whether machine learning analysis of preoperative liver CT-scan could estimate high vs low CD73 expression in CRLM and whether such radiomic score would have a prognostic significance. METHODS: We trained an Attentive Interpretable Tabular Learning (TabNet) model to predict, from preoperative CT images, stratified expression levels of CD73 (CD73High vs. CD73Low) assessed by immunofluorescence (IF) on tissue microarrays. Radiomic features were extracted from 160 segmented CRLM of 122 patients with matched IF data, preprocessed and used to train the predictive model. We applied a five-fold cross-validation and validated the performance on a hold-out test set. RESULTS: TabNet provided areas under the receiver operating characteristic curve of 0.95 (95% CI 0.87 to 1.0) and 0.79 (0.65 to 0.92) on the training and hold-out test sets respectively, and outperformed other machine learning models. The TabNet-derived score, termed rad-CD73, was positively correlated with CD73 histological expression in matched CRLM (Spearman's ρ = 0.6004; P < 0.0001). The median time to recurrence (TTR) and disease-specific survival (DSS) after CRLM resection in rad-CD73High vs rad-CD73Low patients was 13.0 vs 23.6 months (P = 0.0098) and 53.4 vs 126.0 months (P = 0.0222), respectively. The prognostic value of rad-CD73 was independent of the standard clinical risk score, for both TTR (HR = 2.11, 95% CI 1.30 to 3.45, P < 0.005) and DSS (HR = 1.88, 95% CI 1.11 to 3.18, P = 0.020). CONCLUSIONS: Our findings reveal promising results for non-invasive CT-scan-based prediction of CD73 expression in CRLM and warrant further validation as to whether rad-CD73 could assist oncologists as a biomarker of prognosis and response to immunotherapies targeting the adenosine pathway.

Prognostic implications of adaptive immune features in MMR-proficient colorectal liver metastases classified by histopathological growth patterns.

BACKGROUND: After resection, colorectal cancer liver metastases (CRLM) surrounded by a desmoplastic rim carry a better prognosis than the metastases replacing the adjacent liver. However, these histopathological growth patterns (HGPs) are insufficient to guide clinical decision-making. We explored whether the adaptive immune features of HGPs could refine prognostication. METHODS: From 276 metastases resected in 176 patients classified by HGPs, tissue microarrays were used to assess intratumoral T cells (CD3), antigen presentation capacity (MHC class I) and CD73 expression producing immunosuppressive adenosine. We tested correlations between these variables and patient outcomes. RESULTS: The 101 (57.4%) patients with dominant desmoplastic HGP had a median recurrence-free survival (RFS) of 17.1 months compared to 13.3 months in the 75 patients (42.6%) with dominant replacement HGP (p = 0.037). In desmoplastic CRLM, high vs. low CD73 was the only prognostically informative immune parameter and was associated with a median RFS of 12.3 months compared to 26.3, respectively (p = 0.010). Only in dominant replacement CRLM, we found a subgroup (n = 23) with high intratumoral MHC-I expression but poor CD3+ T cell infiltration, a phenotype associated with a short median RFS of 7.9 months. CONCLUSIONS: Combining the assessments of HGP and adaptive immune features in resected CRLM could help identify patients at risk of early recurrence.

MRI geometric distortion: Impact on tangential whole-breast IMRT.

The purpose of this study was to determine the impact of magnetic resonance imaging (MRI) geometric distortions when using MRI for target delineation and planning for whole-breast, intensity-modulated radiotherapy (IMRT). Residual system distortions and combined systematic and patient-induced distortions are considered. This retrospective study investigated 18 patients who underwent whole-breast external beam radiotherapy, where both CT and MRIs were acquired for treatment planning. Distortion phantoms were imaged on two MRI systems, dedicated to radiotherapy planning (a wide, closed-bore 3T and an open-bore 1T). Patient scans were acquired on the 3T system. To simulate MRI-based planning, distortion maps representing residual system distortions were generated via deformable registration between phantom CT and MRIs. Patient CT images and structures were altered to match the residual system distortion measured by the phantoms on each scanner. The patient CTs were also registered to the corresponding patient MRI scans, to assess patient and residual system effects. Tangential IMRT plans were generated and optimized on each resulting CT dataset, then propagated to the original patient CT space. The resulting dose distributions were then evaluated with respect to the standard clinically acceptable DVH and visual assessment criteria. Maximum residual systematic distortion was measured to be 7.9 mm (95%<4.7mm) and 11.9 mm (95%<4.6mm) for the 3T and 1T scanners, respectively, which did not result in clinically unacceptable plans. Eight of the plans accounting for patient and systematic distortions were deemed clinically unacceptable when assessed on the original CT. For these plans, the mean difference in PTV V95 (volume receiving 95% prescription dose) was 0.13±2.51% and -0.73±1.93% for right- and left-sided patients, respectively. Residual system distortions alone had minimal impact on the dosimetry for the two scanners investigated. The combination of MRI systematic and patient-related distortions can result in unacceptable dosimetry for whole-breast IMRT, a potential issue when considering MRI-only radiotherapy treatment planning. PACS number(s): 87.61.-c, 87.57.cp, 87.57.nj, 87.55.D.

Real-time simulation of viscoelastic tissue behavior with physics-guided deep learning.

Finite element methods (FEM) are popular approaches for simulation of soft tissues with elastic or viscoelastic behavior. However, their usage in real-time applications, such as in virtual reality surgical training, is limited by computational cost. In this application scenario, which typically involves transportable simulators, the computing hardware severely constrains the size or the level of details of the simulated scene. To address this limitation, data-driven approaches have been suggested to simulate mechanical deformations by learning the mapping rules from FEM generated datasets. Prior data-driven approaches have ignored the physical laws of the underlying engineering problem and have consequently been restricted to simulation cases of simple hyperelastic materials where the temporal variations were effectively ignored. However, most surgical training scenarios require more complex hyperelastic models to deal with the viscoelastic properties of tissues. This type of material exhibits both viscous and elastic behaviors when subjected to external force, requiring the implementation of time-dependant state variables. Herein, we propose a deep learning method for predicting displacement fields of soft tissues with viscoelastic properties. The main contribution of this work is the use of a physics-guided loss function for the optimization of the deep learning model parameters. The proposed deep learning model is based on convolutional (CNN) and recurrent layers (LSTM) to predict spatiotemporal variations. It is augmented with a mass conservation law in the lost function to prevent the generation of physically inconsistent results. The deep learning model is trained on a set of FEM datasets that are generated from a commercially available state-of-the-art numerical neurosurgery simulator. The use of the physics-guided loss function in a deep learning model has led to a better generalization in the prediction of deformations in unseen simulation cases. Moreover, the proposed method achieves a better accuracy over the conventional CNN models, where improvements were observed in unseen tissue from 8% to 30% depending on the magnitude of external forces. It is hoped that the present investigation will help in filling the gap in applying deep learning in virtual reality simulators, hence improving their computational performance (compared to FEM simulations) and ultimately their usefulness.

Homogeneity in immune features between colorectal liver metastases better identifies patients with good prognosis compared to pathological response to preoperative chemotherapy.

In colorectal cancer liver metastases (CRLM), the density of tumor-infiltrating lymphocytes, the expression of class I major histocompatibility complex (MHC-I), and the pathological response to preoperative chemotherapy have been associated with oncological outcomes after complete resection. However, the prognostic significance of the heterogeneity of these features in patients with multiple CRLMs remains under investigation. We used a tissue microarray of 220 mismatch repair-gene proficient CRLMs resected in 97 patients followed prospectively to quantify CD3+ T cells and MHC-I by immunohistochemistry. Histopathological response to preoperative chemotherapy was assessed using standard scoring systems. We tested associations between clinical, immunological, and pathological features with oncologic outcomes. Overall, 29 patients (30.2%) had CRLMs homogeneous for CD3+ T cell infiltration and MHC-I. Patients with immune homogeneous compared to heterogeneous CRLMs had longer median time to recurrence (TTR) (30 vs. 12 months, p = .0018) and disease-specific survival (DSS) (not reached vs. 48 months, p = .0009). At 6 years, 80% of the patients with immune homogeneous CRLMs were still alive. Homogeneity of response to preoperative chemotherapy was seen in 60 (61.9%) and 69 (80.2%) patients according to different grading systems and was not associated with TTR or DSS. CD3 and MHC-I heterogeneity was independent of response to pre-operative chemotherapy and of other clinicopathological variables for their association with oncological outcomes. In patients with multiple CRLMs resected with curative intent, similar adaptive immune features seen across metastases could be more informative than pathological response to pre-operative chemotherapy in predicting oncological outcomes.

Factors influencing acceptance and trust of chatbots in juvenile offenders' risk assessment training.

Introduction: Research has identified simulation-based training with chatbots and virtual avatars as an effective educational strategy in some domains, such as medicine and mental health disciplines. Several studies on interactive systems have also suggested that user experience is decisive for adoption. As interest increases, it becomes important to examine the factors influencing user acceptance and trust in simulation-based training systems, and to validate applicability to specific learning tasks. The aim of this research is twofold: (1) to examine the perceived acceptance and trust in a risk assessment training chatbot developed to help students assess risk and needs of juvenile offenders, and (2) to examine the factors influencing students' perceptions of acceptance and trust. Methods: Participants were 112 criminology students in an undergraduate course in a Canadian university. Participants were directed to use a custom-designed chatbot with a virtual 3D avatar for juvenile offenders' risk assessment training, to complete online questionnaires and a risk assessment exercise. Results: Results show satisfactory levels of acceptance and trust in the chatbot. Concerning acceptance, more than half appeared to be satisfied or very satisfied with the chatbot, while most participants appeared to be neutral or satisfied with the benevolence and credibility of the chatbot. Discussion: Results suggest that acceptance and trust do not only depend on the design of the chatbot software, but also on the characteristics of the user, and most prominently on self-efficacy, state anxiety, learning styles and neuroticism personality traits. As trust and acceptance play a vital role in determining technology success, these results are encouraging.

VitalSeer: The development of a contactless sensing technology based on a user-centric data-driven clinical approach.

The COVID-19 pandemic presented challenges to the healthcare system while catalyzing the adoption of virtual care. The need for remote assessment and real-time monitoring of physiological vital signs has driven towards a need for virtual care solutions. This paper presents the outcome of a multidisciplinary collaboration to ensure clinical usability of a remote contactless sensing technology, VitalSeer, and to help close gaps between emerging technologies and clinical practice. The paper describes the user-centric data-driven clinical approach to address the needs as identified by clinical experts through the iterative and agile development cycle. It highlights findings from preliminary studies to validate proof-of-concept VitalSeer's adoptability, accessibility and usability. The studies on volunteers demonstrated the accuracy of VitalSeer's heart rate model at a low MAE of 0.74 (bpm) and a RMSE of 1.2 bpm, below the threshold of clinical grade contact-based sensors. The paper concludes with a discussion on the technology implications in emergency medicine and community care.

Prognostic value of CD73 expression in resected colorectal cancer liver metastasis.

Immune checkpoint blockade has not yet been effective in patients with mismatch repair proficient metastatic colorectal cancer. Targeting immunosuppressive metabolic pathways is being explored as a new immunotherapeutic approach. We assessed whether CD73, the rate limiting enzyme that catalyzes the degradation of extracellular AMP into immunosuppressive adenosine, could be an immunological determinant of colorectal liver metastases (CRLMs). By immunofluorescence on tissue microarrays, intratumoral CD73 expression (tCD73) was analyzed in 391 CRLMs resected in 215 patients, and soluble CD73 (sCD73) was measured by ELISA in the pre-operative serum of 193 patients. High tCD73 was associated with worse pathological features, such as multiple and larger CRLMs, and poorer pathologic response to pre-operative chemotherapy. The median time to recurrence and disease-specific survival after CRLM resection was significantly shorter in patients with high tCD73 (11.0 and 46.4 months, respectively) compared with low tCD73 (19.0 and 61.5 months, respectively). tCD73 was strongly associated with patient outcomes independently of clinicopathological variables. sCD73 did not correlate with tCD73. Patients with high levels of sCD73 also had shorter disease-specific survival. Our results suggested that CD73 in CRLMs may be prognostically informative and may help select patients more likely to respond to adenosine pathway blocking agents.

Similarity clustering-based atlas selection for pelvic CT image segmentation.

PURPOSE: To demonstrate selection of a small representative subset of images from a pool of images comprising a potential atlas (PA) pelvic CT set to be used for autosegmentation of a separate target image set. The aim is to balance the need for the atlas set to represent anatomical diversity with the need to minimize resources required to create a high quality atlas set (such as multiobserver delineation), while retaining access to additional information available for the PA image set. METHODS: Preprocessing was performed for image standardization, followed by image registration. Clustering was used to select the subset that provided the best coverage of a target dataset as measured by postregistration image intensity similarities. Tests for clustering robustness were performed including repeated clustering runs using different starting seeds and clustering repeatedly using 90% of the target dataset chosen randomly. Comparisons of coverage of a target set (comprising 711 pelvic CT images) were made for atlas sets of five images (chosen from a PA set of 39 pelvic CT and MR images) (a) at random (averaged over 50 random atlas selections), (b) based solely on image similarities within the PA set (representing prospective atlas development), (c) based on similarities within the PA set and between the PA and target dataset (representing retrospective atlas development). Comparisons were also made to coverage provided by the entire PA set of 39 images. RESULTS: Exemplar selection was highly robust with exemplar selection results being unaffected by choice of starting seed with very occasional change to one of the exemplar choices when the target set was reduced. Coverage of the target set, as measured by best normalized cross-correlation similarity of target images to any exemplar image, provided by five well-selected atlas images (mean = 0.6497) was more similar to coverage provided by the entire PA set (mean = 0.6658) than randomly chosen atlas subsets (mean = 0.5977). This was true both of the mean values and the shape of the distributions. Retrospective selection of atlases (mean = 0.6497) provided a very small improvement over prospective atlas selection (mean = 0.6431). All differences were significant (P < 1.0E-10). CONCLUSIONS: Selection of a small representative image set from one dataset can be utilized to develop an atlas set for either retrospective or prospective autosegmentation of a different target dataset. The coverage provided by such a judiciously selected subset has the potential to facilitate propagation of numerous retrospectively defined structures, utilizing additional information available with multimodal imaging in the atlas set, without the need to create large atlas image sets.

Reduced motion and improved rectal dosimetry through endorectal immobilization for prostate stereotactic body radiotherapy.

OBJECTIVE: PROMETHEUS (ACTRN12615000223538) is a multicentre clinical trial investigating the feasibility of 19 Gy in 2 fractions of stereotactic body radiotherapy (SBRT) as a boost technique for prostate cancer. The objective of this substudy was to evaluate intrafraction motion using cine MRI and assess the dosimetric impact of using a rectal displacement device (RDD). METHODS: The initial 10 patients recruited underwent planning CT and MRI, with and without a RDD. Cine MRI images were captured using an interleaved T2 HASTE sequence in sagittal and axial planes with a temporal resolution of 5.2 s acquired over 4.3 min. Points of interest (POIs) were defined and a validated tracking algorithm measured displacement of these points over the 4.3 min in the anteroposterior, superior-inferior and left-right directions. Plans were generated with and without a RDD to examine the impact on dosimetry. RESULTS: There was an overall trend for increasing displacement in all directions as time progressed when no RDD was in situ . points of interest remained comparatively stable with the RDD. In the sagittal plane, the RDD resulted in statistically significant improvement in the range of anteroposterior displacement for the rectal wall, anterior prostate, prostate apex and base. Dosimetrically, the use of a RDD significantly reduced rectal V16, V14 and Dmax, as well as the percentage of posterior rectal wall receiving 8.5 Gy. CONCLUSION: The RDD used in stereotactic prostate radiotherapy leads to reduced intrafraction motion of the prostate and rectum, with increasing improvement with time. It also results in significant improvement in rectal wall dosimetry. ADVANCES IN KNOWLEDGE: It was found that the rectal displacement device improved prostate stabilization significantly, improved rectum stabilization and dosimetry significantly. The rectal displacement device did not improve target volume dosimetry.

Divergence from osteoporosis screening guidelines in older breast cancer patients treated with anti-estrogen therapy: A population-based cohort study.

PURPOSE: Older Breast Cancer (BC) survivors are an increased risk of osteoporosis due to natural aging and long-term cancer treatment-related toxicity. It is well known that anti-estrogen therapy (AET), especially aromatase inhibitors (AI), is associated with rapid bone loss and thus increases the risk of osteoporosis. This study characterizes patterns and predictors of receiving guideline-recommended bone densitometry (BD) screening at AET initiation. METHODS: A retrospective cohort study (1998-2012) of all women ≥65 years of age initiating AET was designed using claims data from Quebec's universal health care. Associations with BD screening were estimated using a generalized estimating equations regression model, adjusting for clustering of patients within physicians. RESULTS: Among 16,480 women initiating AET, 36.1% received a baseline BD. Among AI users, the rate was 58.4%. In the multivariate analysis, age, lower socioeconomic status, tamoxifen use, lack of periodic health exam and having a general practitioner as the AET prescriber were associated with lower odds of BD screening. In terms of quality of care-related variables, lack of guideline-appropriate radiotherapy (OR: 0.69 (95% CI, 0.57-0.83), or chemotherapy consideration (0.82 (95% CI, 0.71-0.94)) and non-adherence to AET (0.76 (95% CI, 0.68-0.84)) were associated with lower odds of receiving BD screening. Women diagnosed with BC after 2003 had significantly better odds of being screened. CONCLUSION: Despite an increase in rates since 2003, BD screening remains suboptimal, especially for women at higher risk of osteoporosis. Coordination of health care and service-delivery monitoring can potentially optimize long-term management of treatment-related toxicity in older BC survivors.

Patterns and predictors of emergency department visits among older patients after breast cancer surgery: A population-based cohort study.

OBJECTIVES: To characterize rates, reasons for, and associated predictors for emergency department (ED) visits after breast cancer (BC) surgery. METHODS: All women over 65 years undergoing curative surgery for non-metastatic incident BC (1998-2012) were identified using Quebec's universal healthcare administrative databases. Reasons for ED visits within 45days of operation were reported. Associated factors were estimated using Cox regression. RESULTS: Of 24,463 patients, 12.8% had postoperative ED visits. Most frequent reasons were: superficial infection, noninfectious gastrointestinal, trauma or wound (other than breast), noninfectious respiratory, and breast wound disruption. Significant predictors included localized (aHR, 1.24, CI 1.04-1.49) or regional disease (aHR 1.64, CI 1.41-1.92), mastectomy (aHR 1.22, CI 1.10-1.34), each operation before definitive oncologic control (aHR 1.12, CI 1.03-1.21), lower institutional volume (aHR 1.23, CI 1.09-1.38), having 6-10 prescriptions (aHR 1.23, CI 1.15-1.31) or >10 (aHR 1.53, CI 1.33-1.77), benzodiazepine use (aHR 1.09, CI 1.01-1.18), anticoagulant use (aHR 1.29, CI 1.13-1.46), cardiovascular disease (aHR 1.15, CI 1.05-1.26), diabetes (aHR 1.11, CI 1.00-1.24), past hospitalization (aHR 1.25, CI 1.17-1.34), and lower income (aHR 1.12, CI 1.04-1.20). CONCLUSION: Identification of risk factors in older patients before BC surgery could help prevent postoperative ED visits.

A lightweight rapid application development framework for biomedical image analysis.

Biomedical imaging analysis typically comprises a variety of complex tasks requiring sophisticated algorithms and visualising high dimensional data. The successful integration and deployment of the enabling software to clinical (research) partners, for rigorous evaluation and testing, is a crucial step to facilitate adoption of research innovations within medical settings. In this paper, we introduce the Simple Medical Imaging Library Interface (SMILI), an object oriented open-source framework with a compact suite of objects geared for rapid biomedical imaging (cross-platform) application development and deployment. SMILI supports the development of both command-line (shell and Python scripting) and graphical applications utilising the same set of processing algorithms. It provides a substantial subset of features when compared to more complex packages, yet it is small enough to ship with clinical applications with limited overhead and has a license suitable for commercial use. After describing where SMILI fits within the existing biomedical imaging software ecosystem, by comparing it to other state-of-the-art offerings, we demonstrate its capabilities in creating a clinical application for manual measurement of cam-type lesions of the femoral head-neck region for the investigation of femoro-acetabular impingement (FAI) from three dimensional (3D) magnetic resonance (MR) images of the hip. This application for the investigation of FAI proved to be convenient for radiological analyses and resulted in high intra (ICC=0.97) and inter-observer (ICC=0.95) reliabilities for measurement of α-angles of the femoral head-neck region. We believe that SMILI is particularly well suited for prototyping biomedical imaging applications requiring user interaction and/or visualisation of 3D mesh, scalar, vector or tensor data.

Regression and statistical shape model based substitute CT generation for MRI alone external beam radiation therapy from standard clinical MRI sequences.

In MR only radiation therapy planning, generation of the tissue specific HU map directly from the MRI would eliminate the need of CT image acquisition and may improve radiation therapy planning. The aim of this work is to generate and validate substitute CT (sCT) scans generated from standard T2 weighted MR pelvic scans in prostate radiation therapy dose planning. A Siemens Skyra 3T MRI scanner with laser bridge, flat couch and pelvic coil mounts was used to scan 39 patients scheduled for external beam radiation therapy for localized prostate cancer. For sCT generation a whole pelvis MRI (1.6 mm 3D isotropic T2w SPACE sequence) was acquired. Patients received a routine planning CT scan. Co-registered whole pelvis CT and T2w MRI pairs were used as training images. Advanced tissue specific non-linear regression models to predict HU for the fat, muscle, bladder and air were created from co-registered CT-MRI image pairs. On a test case T2w MRI, the bones and bladder were automatically segmented using a novel statistical shape and appearance model, while other soft tissues were separated using an Expectation-Maximization based clustering model. The CT bone in the training database that was most 'similar' to the segmented bone was then transformed with deformable registration to create the sCT component of the test case T2w MRI bone tissue. Predictions for the bone, air and soft tissue from the separate regression models were successively combined to generate a whole pelvis sCT. The change in monitor units between the sCT-based plans relative to the gold standard CT plan for the same IMRT dose plan was found to be [Formula: see text] (mean ± standard deviation) for 39 patients. The 3D Gamma pass rate was [Formula: see text] (2 mm/2%). The novel hybrid model is computationally efficient, generating an sCT in 20 min from standard T2w images for prostate cancer radiation therapy dose planning and DRR generation.

MRI-alone radiation therapy planning for prostate cancer: Automatic fiducial marker detection.

PURPOSE: The feasibility of radiation therapy treatment planning using substitute computed tomography (sCT) generated from magnetic resonance images (MRIs) has been demonstrated by a number of research groups. One challenge with an MRI-alone workflow is the accurate identification of intraprostatic gold fiducial markers, which are frequently used for prostate localization prior to each dose delivery fraction. This paper investigates a template-matching approach for the detection of these seeds in MRI. METHODS: Two different gradient echo T1 and T2* weighted MRI sequences were acquired from fifteen prostate cancer patients and evaluated for seed detection. For training, seed templates from manual contours were selected in a spectral clustering manifold learning framework. This aids in clustering "similar" gold fiducial markers together. The marker with the minimum distance to a cluster centroid was selected as the representative template of that cluster during training. During testing, Gaussian mixture modeling followed by a Markovian model was used in automatic detection of the probable candidates. The probable candidates were rigidly registered to the templates identified from spectral clustering, and a similarity metric is computed for ranking and detection. RESULTS: A fiducial detection accuracy of 95% was obtained compared to manual observations. Expert radiation therapist observers were able to correctly identify all three implanted seeds on 11 of the 15 scans (the proposed method correctly identified all seeds on 10 of the 15). CONCLUSIONS: An novel automatic framework for gold fiducial marker detection in MRI is proposed and evaluated with detection accuracies comparable to manual detection. When radiation therapists are unable to determine the seed location in MRI, they refer back to the planning CT (only available in the existing clinical framework); similarly, an automatic quality control is built into the automatic software to ensure that all gold seeds are either correctly detected or a warning is raised for further manual intervention.

Robust inverse-consistent affine CT-MR registration in MRI-assisted and MRI-alone prostate radiation therapy.

BACKGROUND: CT-MR registration is a critical component of many radiation oncology protocols. In prostate external beam radiation therapy, it allows the propagation of MR-derived contours to reference CT images at the planning stage, and it enables dose mapping during dosimetry studies. The use of carefully registered CT-MR atlases allows the estimation of patient specific electron density maps from MRI scans, enabling MRI-alone radiation therapy planning and treatment adaptation. In all cases, the precision and accuracy achieved by registration influences the quality of the entire process. PROBLEM: Most current registration algorithms do not robustly generalize and lack inverse-consistency, increasing the risk of human error and acting as a source of bias in studies where information is propagated in a particular direction, e.g. CT to MR or vice versa. In MRI-based treatment planning where both CT and MR scans serve as spatial references, inverse-consistency is critical, if under-acknowledged. PURPOSE: A robust, inverse-consistent, rigid/affine registration algorithm that is well suited to CT-MR alignment in prostate radiation therapy is presented. METHOD: The presented method is based on a robust block-matching optimization process that utilises a half-way space definition to maintain inverse-consistency. Inverse-consistency substantially reduces the influence of the order of input images, simplifying analysis, and increasing robustness. An open source implementation is available online at http://aehrc.github.io/Mirorr/. RESULTS: Experimental results on a challenging 35 CT-MR pelvis dataset demonstrate that the proposed method is more accurate than other popular registration packages and is at least as accurate as the state of the art, while being more robust and having an order of magnitude higher inverse-consistency than competing approaches. CONCLUSION: The presented results demonstrate that the proposed registration algorithm is readily applicable to prostate radiation therapy planning.

Continuous table acquisition MRI for radiotherapy treatment planning: distortion assessment with a new extended 3D volumetric phantom.

PURPOSE: Accurate geometry is required for radiotherapy treatment planning (RTP). When considering the use of magnetic resonance imaging (MRI) for RTP, geometric distortions observed in the acquired images should be considered. While scanner technology and vendor supplied correction algorithms provide some correction, large distortions are still present in images, even when considering considerably smaller scan lengths than those typically acquired with CT in conventional RTP. This study investigates MRI acquisition with a moving table compared with static scans for potential geometric benefits for RTP. METHODS: A full field of view (FOV) phantom (diameter 500 mm; length 513 mm) was developed for measuring geometric distortions in MR images over volumes pertinent to RTP. The phantom consisted of layers of refined plastic within which vitamin E capsules were inserted. The phantom was scanned on CT to provide the geometric gold standard and on MRI, with differences in capsule location determining the distortion. MRI images were acquired with two techniques. For the first method, standard static table acquisitions were considered. Both 2D and 3D acquisition techniques were investigated. With the second technique, images were acquired with a moving table. The same sequence was acquired with a static table and then with table speeds of 1.1 mm/s and 2 mm/s. All of the MR images acquired were registered to the CT dataset using a deformable B-spline registration with the resulting deformation fields providing the distortion information for each acquisition. RESULTS: MR images acquired with the moving table enabled imaging of the whole phantom length while images acquired with a static table were only able to image 50%-70% of the phantom length of 513 mm. Maximum distortion values were reduced across a larger volume when imaging with a moving table. Increased table speed resulted in a larger contribution of distortion from gradient nonlinearities in the through-plane direction and an increased blurring of capsule images, resulting in an apparent capsule volume increase by up to 170% in extreme axial FOV regions. Blurring increased with table speed and in the central regions of the phantom, geometric distortion was less for static table acquisitions compared to a table speed of 2 mm/s over the same volume. Overall, the best geometric accuracy was achieved with a table speed of 1.1 mm/s. CONCLUSIONS: The phantom designed enables full FOV imaging for distortion assessment for the purposes of RTP. MRI acquisition with a moving table extends the imaging volume in the z direction with reduced distortions which could be useful particularly if considering MR-only planning. If utilizing MR images to provide additional soft tissue information to the planning CT, standard acquisition sequences over a smaller volume would avoid introducing additional blurring or distortions from the through-plane table movement.

Automatic Substitute Computed Tomography Generation and Contouring for Magnetic Resonance Imaging (MRI)-Alone External Beam Radiation Therapy From Standard MRI Sequences.

PURPOSE: To validate automatic substitute computed tomography CT (sCT) scans generated from standard T2-weighted (T2w) magnetic resonance (MR) pelvic scans for MR-Sim prostate treatment planning. PATIENTS AND METHODS: A Siemens Skyra 3T MR imaging (MRI) scanner with laser bridge, flat couch, and pelvic coil mounts was used to scan 39 patients scheduled for external beam radiation therapy for localized prostate cancer. For sCT generation a whole-pelvis MRI scan (1.6 mm 3-dimensional isotropic T2w SPACE [Sampling Perfection with Application optimized Contrasts using different flip angle Evolution] sequence) was acquired. Three additional small field of view scans were acquired: T2w, T2*w, and T1w flip angle 80° for gold fiducials. Patients received a routine planning CT scan. Manual contouring of the prostate, rectum, bladder, and bones was performed independently on the CT and MR scans. Three experienced observers contoured each organ on MRI, allowing interobserver quantification. To generate a training database, each patient CT scan was coregistered to their whole-pelvis T2w using symmetric rigid registration and structure-guided deformable registration. A new multi-atlas local weighted voting method was used to generate automatic contours and sCT results. RESULTS: The mean error in Hounsfield units between the sCT and corresponding patient CT (within the body contour) was 0.6 ± 14.7 (mean ± 1 SD), with a mean absolute error of 40.5 ± 8.2 Hounsfield units. Automatic contouring results were very close to the expert interobserver level (Dice similarity coefficient): prostate 0.80 ± 0.08, bladder 0.86 ± 0.12, rectum 0.84 ± 0.06, bones 0.91 ± 0.03, and body 1.00 ± 0.003. The change in monitor units between the sCT-based plans relative to the gold standard CT plan for the same dose prescription was found to be 0.3% ± 0.8%. The 3-dimensional γ pass rate was 1.00 ± 0.00 (2 mm/2%). CONCLUSIONS: The MR-Sim setup and automatic sCT generation methods using standard MR sequences generates realistic contours and electron densities for prostate cancer radiation therapy dose planning and digitally reconstructed radiograph generation.