The grade of individual prostate cancer lesions predicted by magnetic resonance imaging and positron emission tomography.

BACKGROUND: Multiparametric magnetic resonance imaging (mpMRI) and positron emission tomography (PET) are widely used for the management of prostate cancer (PCa). However, how these modalities complement each other in PCa risk stratification is still largely unknown. We aim to provide insights into the potential of mpMRI and PET for PCa risk stratification. METHODS: We analyzed data from 55 consecutive patients with elevated prostate-specific antigen and biopsy-proven PCa enrolled in a prospective study between December 2016 and December 2019. [68Ga]PSMA-11 PET (PSMA-PET), [11C]Acetate PET (Acetate-PET) and mpMRI were co-registered with whole-mount histopathology. Lower- and higher-grade lesions were defined by International Society of Urological Pathology (ISUP) grade groups (IGG). We used PET and mpMRI data to differentiate between grades in two cases: IGG 3 vs. IGG 2 (case 1) and IGG ≥ 3 vs. IGG ≤ 2 (case 2). The performance was evaluated by receiver operating characteristic (ROC) analysis. RESULTS: We find that the maximum standardized uptake value (SUVmax) for PSMA-PET achieves the highest area under the ROC curve (AUC), with AUCs of 0.72 (case 1) and 0.79 (case 2). Combining the volume transfer constant, apparent diffusion coefficient and T2-weighted images (each normalized to non-malignant prostatic tissue) results in AUCs of 0.70 (case 1) and 0.70 (case 2). Adding PSMA-SUVmax increases the AUCs by 0.09 (p < 0.01) and 0.12 (p < 0.01), respectively. CONCLUSIONS: By co-registering whole-mount histopathology and in-vivo imaging we show that mpMRI and PET can distinguish between lower- and higher-grade prostate cancer, using partially discriminative cut-off values.

Magnetic Resonance Imaging (MRI) and Positron Emission Tomography (PET) are two medical imaging methods commonly used to image prostate cancers. However, the relationship between images obtained with these methods and prostate cancer aggressiveness is not well understood. Here, we investigate whether MRI and PET can differentiate between lower- and higher-grade prostate tumors, where grade is an indicator of how aggressive the disease is likely to be. We find that the characteristics of prostate cancer tumors as seen on MRI and PET scans can help to predict tumor grade. This means that these imaging methods may be helpful when clinicians are predicting patient prognosis and deciding on appropriate treatments. However, further validation is necessary before these approaches are widely implemented for this purpose.

Improving MR image quality with a multi-task model, using convolutional losses.

PURPOSE: During the acquisition of MRI data, patient-, sequence-, or hardware-related factors can introduce artefacts that degrade image quality. Four of the most significant tasks for improving MRI image quality have been bias field correction, super-resolution, motion-, and noise correction. Machine learning has achieved outstanding results in improving MR image quality for these tasks individually, yet multi-task methods are rarely explored. METHODS: In this study, we developed a model to simultaneously correct for all four aforementioned artefacts using multi-task learning. Two different datasets were collected, one consisting of brain scans while the other pelvic scans, which were used to train separate models, implementing their corresponding artefact augmentations. Additionally, we explored a novel loss function that does not only aim to reconstruct the individual pixel values, but also the image gradients, to produce sharper, more realistic results. The difference between the evaluated methods was tested for significance using a Friedman test of equivalence followed by a Nemenyi post-hoc test. RESULTS: Our proposed model generally outperformed other commonly-used correction methods for individual artefacts, consistently achieving equal or superior results in at least one of the evaluation metrics. For images with multiple simultaneous artefacts, we show that the performance of using a combination of models, trained to correct individual artefacts depends heavily on the order that they were applied. This is not an issue for our proposed multi-task model. The model trained using our novel convolutional loss function always outperformed the model trained with a mean squared error loss, when evaluated using Visual Information Fidelity, a quality metric connected to perceptual quality. CONCLUSION: We trained two models for multi-task MRI artefact correction of brain, and pelvic scans. We used a novel loss function that significantly improves the image quality of the outputs over using mean squared error. The approach performs well on real world data, and it provides insight into which artefacts it detects and corrects for. Our proposed model and source code were made publicly available.

Region of interest focused MRI to synthetic CT translation using regression and segmentation multi-task network.

Objective. In MR-only clinical workflow, replacing CT with MR image is of advantage for workflow efficiency and reduces radiation to the patient. An important step required to eliminate CT scan from the workflow is to generate the information provided by CT via an MR image. In this work, we aim to demonstrate a method to generate accurate synthetic CT (sCT) from an MR image to suit the radiation therapy (RT) treatment planning workflow. We show the feasibility of the method and make way for a broader clinical evaluation.Approach. We present a machine learning method for sCT generation from zero-echo-time (ZTE) MRI aimed at structural and quantitative accuracies of the image, with a particular focus on the accurate bone density value prediction. The misestimation of bone density in the radiation path could lead to unintended dose delivery to the target volume and results in suboptimal treatment outcome. We propose a loss function that favors a spatially sparse bone region in the image. We harness the ability of the multi-task network to produce correlated outputs as a framework to enable localization of region of interest (RoI) via segmentation, emphasize regression of values within RoI and still retain the overall accuracy via global regression. The network is optimized by a composite loss function that combines a dedicated loss from each task.Main results. We have included 54 brain patient images in this study and tested the sCT images against reference CT on a subset of 20 cases. A pilot dose evaluation was performed on 9 of the 20 test cases to demonstrate the viability of the generated sCT in RT planning. The average quantitative metrics produced by the proposed method over the test set were-(a) mean absolute error (MAE) of 70 ± 8.6 HU; (b) peak signal-to-noise ratio (PSNR) of 29.4 ± 2.8 dB; structural similarity metric (SSIM) of 0.95 ± 0.02; and (d) Dice coefficient of the body region of 0.984 ± 0.Significance. We demonstrate that the proposed method generates sCT images that resemble visual characteristics of a real CT image and has a quantitative accuracy that suits RT dose planning application. We compare the dose calculation from the proposed sCT and the real CT in a radiation therapy treatment planning setup and show that sCT based planning falls within 0.5% target dose error. The method presented here with an initial dose evaluation makes an encouraging precursor to a broader clinical evaluation of sCT based RT planning on different anatomical regions.

Histopathology-validated lesion detection rates of clinically significant prostate cancer with mpMRI, [ 68 Ga]PSMA-11-PET and [ 11 C]Acetate-PET.

OBJECTIVE: PET/CT and multiparametric MRI (mpMRI) are important diagnostic tools in clinically significant prostate cancer (csPC). The aim of this study was to compare csPC detection rates with [ 68 Ga]PSMA-11-PET (PSMA)-PET, [ 11 C]Acetate (ACE)-PET, and mpMRI with histopathology as reference, to identify the most suitable imaging modalities for subsequent hybrid imaging. An additional aim was to compare inter-reader variability to assess reproducibility. METHODS: During 2016-2019, all study participants were examined with PSMA-PET/mpMRI and ACE-PET/CT prior to radical prostatectomy. PSMA-PET, ACE-PET and mpMRI were evaluated separately by two observers, and were compared with histopathology-defined csPC. Statistical analyses included two-sided McNemar test and index of specific agreement. RESULTS: Fifty-five study participants were included, with 130 histopathological intraprostatic lesions >0.05 cc. Of these, 32% (42/130) were classified as csPC with ISUP grade ≥2 and volume >0.5 cc. PSMA-PET and mpMRI showed no difference in performance ( P  = 0.48), with mean csPC detection rate of 70% (29.5/42) and 74% (31/42), respectively, while with ACE-PET the mean csPC detection rate was 37% (15.5/42). Interobserver agreement was higher with PSMA-PET compared to mpMRI [79% (26/33) vs 67% (24/38)]. Including all detected lesions from each pair of observers, the detection rate increased to 90% (38/42) with mpMRI, and 79% (33/42) with PSMA-PET. CONCLUSION: PSMA-PET and mpMRI showed high csPC detection rates and superior performance compared to ACE-PET. The interobserver agreement indicates higher reproducibility with PSMA-PET. The combined result of all observers in both PSMA-PET and mpMRI showed the highest detection rate, suggesting an added value of a hybrid imaging approach.

Towards MR contrast independent synthetic CT generation.

The use of synthetic CT (sCT) in the radiotherapy workflow would reduce costs and scan time while removing the uncertainties around working with both MR and CT modalities. The performance of deep learning (DL) solutions for sCT generation is steadily increasing, however most proposed methods were trained and validated on private datasets of a single contrast from a single scanner. Such solutions might not perform equally well on other datasets, limiting their general usability and therefore value. Additionally, functional evaluations of sCTs such as dosimetric comparisons with CT-based dose calculations better show the impact of the methods, but the evaluations are more labor intensive than pixel-wise metrics. To improve the generalization of an sCT model, we propose to incorporate a pre-trained DL model to pre-process the input MR images by generating artificial proton density, T1 and T2 maps (i.e. contrast-independent quantitative maps), which are then used for sCT generation. Using a dataset of only T2w MR images, the robustness towards input MR contrasts of this approach is compared to a model that was trained using the MR images directly. We evaluate the generated sCTs using pixel-wise metrics and calculating mean radiological depths, as an approximation of the mean delivered dose. On T2w images acquired with the same settings as the training dataset, there was no significant difference between the performance of the models. However, when evaluated on T1w images, and a wide range of other contrasts and scanners from both public and private datasets, our approach outperforms the baseline model. Using a dataset of T2w MR images, our proposed model implements synthetic quantitative maps to generate sCT images, improving the generalization towards other contrasts. Our code and trained models are publicly available.

Hyaluronic acid spacer in prostate cancer radiotherapy: dosimetric effects, spacer stability and long-term toxicity and PRO in a phase II study.

BACKGROUND: Perirectal spacers may be beneficial to reduce rectal side effects from radiotherapy (RT). Here, we present the impact of a hyaluronic acid (HA) perirectal spacer on rectal dose as well as spacer stability, long-term gastrointestinal (GI) and genitourinary (GU) toxicity and patient-reported outcome (PRO). METHODS: In this phase II study 81 patients with low- and intermediate-risk prostate cancer received transrectal injections with HA before external beam RT (78 Gy in 39 fractions). The HA spacer was evaluated with MRI four times; before (MR0) and after HA-injection (MR1), at the middle (MR2) and at the end (MR3) of RT. GI and GU toxicity was assessed by physician for up to five years according to the RTOG scale. PROs were collected using the Swedish National Prostate Cancer Registry and Prostate cancer symptom scale questionnaires. RESULTS: There was a significant reduction in rectal V70% (54.6 Gy) and V90% (70.2 Gy) between MR0 and MR1, as well as between MR0 to MR2 and MR3. From MR1 to MR2/MR3, HA thickness decreased with 28%/32% and CTV-rectum space with 19%/17% in the middle level. The cumulative late grade ≥ 2 GI toxicity at 5 years was 5% and the proportion of PRO moderate or severe overall bowel problems at 5 years follow-up was 12%. Cumulative late grade ≥ 2 GU toxicity at 5 years was 12% and moderate or severe overall urinary problems at 5 years were 10%. CONCLUSION: We show that the HA spacer reduced rectal dose and long-term toxicity.

A Data-Adaptive Loss Function for Incomplete Data and Incremental Learning in Semantic Image Segmentation.

In the last years, deep learning has dramatically improved the performances in a variety of medical image analysis applications. Among different types of deep learning models, convolutional neural networks have been among the most successful and they have been used in many applications in medical imaging. Training deep convolutional neural networks often requires large amounts of image data to generalize well to new unseen images. It is often time-consuming and expensive to collect large amounts of data in the medical image domain due to expensive imaging systems, and the need for experts to manually make ground truth annotations. A potential problem arises if new structures are added when a decision support system is already deployed and in use. Since the field of radiation therapy is constantly developing, the new structures would also have to be covered by the decision support system. In the present work, we propose a novel loss function to solve multiple problems: imbalanced datasets, partially-labeled data, and incremental learning. The proposed loss function adapts to the available data in order to utilize all available data, even when some have missing annotations. We demonstrate that the proposed loss function also works well in an incremental learning setting, where an existing model is easily adapted to semi-automatically incorporate delineations of new organs when they appear. Experiments on a large in-house dataset show that the proposed method performs on par with baseline models, while greatly reducing the training time and eliminating the hassle of maintaining multiple models in practice.

QU-BraTS: MICCAI BraTS 2020 Challenge on Quantifying Uncertainty in Brain Tumor Segmentation - Analysis of Ranking Scores and Benchmarking Results.

Deep learning (DL) models have provided state-of-the-art performance in various medical imaging benchmarking challenges, including the Brain Tumor Segmentation (BraTS) challenges. However, the task of focal pathology multi-compartment segmentation (e.g., tumor and lesion sub-regions) is particularly challenging, and potential errors hinder translating DL models into clinical workflows. Quantifying the reliability of DL model predictions in the form of uncertainties could enable clinical review of the most uncertain regions, thereby building trust and paving the way toward clinical translation. Several uncertainty estimation methods have recently been introduced for DL medical image segmentation tasks. Developing scores to evaluate and compare the performance of uncertainty measures will assist the end-user in making more informed decisions. In this study, we explore and evaluate a score developed during the BraTS 2019 and BraTS 2020 task on uncertainty quantification (QU-BraTS) and designed to assess and rank uncertainty estimates for brain tumor multi-compartment segmentation. This score (1) rewards uncertainty estimates that produce high confidence in correct assertions and those that assign low confidence levels at incorrect assertions, and (2) penalizes uncertainty measures that lead to a higher percentage of under-confident correct assertions. We further benchmark the segmentation uncertainties generated by 14 independent participating teams of QU-BraTS 2020, all of which also participated in the main BraTS segmentation task. Overall, our findings confirm the importance and complementary value that uncertainty estimates provide to segmentation algorithms, highlighting the need for uncertainty quantification in medical image analyses. Finally, in favor of transparency and reproducibility, our evaluation code is made publicly available at https://github.com/RagMeh11/QU-BraTS.

Intrafractional motion models based on principal components in Magnetic Resonance guided prostate radiotherapy.

BACKGROUND AND PURPOSE: Devices that combine an MR-scanner with a Linac for radiotherapy, referred to as MR-Linac systems, introduce the possibility to acquire high resolution images prior and during treatment. Hence, there is a possibility to acquire individualised learning sets for motion models for each fraction and the construction of intrafractional motion models. We investigated the feasibility for a principal component analysis (PCA) based, intrafractional motion model of the male pelvic region. MATERIALS AND METHODS: 4D-scans of nine healthy male volunteers were utilized, FOV covering the entire pelvic region including prostate, bladder and rectum with manual segmentation of each organ at each time frame. Deformable image registration with an optical flow algorithm was performed for each subject with the first time frame as reference. PCA was performed on a subset of the resulting displacement vector fields to construct individualised motion models evaluated on the remaining fields. RESULTS: The registration algorithm produced accurate registration result, in general DICE overlap > 0.95 across all time frames. Cumulative variance of the eigen values from the PCA showed that 50% or more of the motion is explained in the first component for all subjects. However, the size and direction for the components differed between subjects. Adding more than two components did not improve the accuracy significantly and the model was able to explain motion down to about 1 mm. CONCLUSIONS: An individualised intrafractional male pelvic motion model is feasible. Geometric accuracy was about 1 mm based on 1-2 principal components.

Deep learning-based classification and structure name standardization for organ at risk and target delineations in prostate cancer radiotherapy.

Radiotherapy (RT) datasets can suffer from variations in annotation of organ at risk (OAR) and target structures. Annotation standards exist, but their description for prostate targets is limited. This restricts the use of such data for supervised machine learning purposes as it requires properly annotated data. The aim of this work was to develop a modality independent deep learning (DL) model for automatic classification and annotation of prostate RT DICOM structures. Delineated prostate organs at risk (OAR), support- and target structures (gross tumor volume [GTV]/clinical target volume [CTV]/planning target volume [PTV]), along with or without separate vesicles and/or lymph nodes, were extracted as binary masks from 1854 patients. An image modality independent 2D InceptionResNetV2 classification network was trained with varying amounts of training data using four image input channels. Channel 1-3 consisted of orthogonal 2D projections from each individual binary structure. The fourth channel contained a summation of the other available binary structure masks. Structure classification performance was assessed in independent CT (n = 200 pat) and magnetic resonance imaging (MRI) (n = 40 pat) test datasets and an external CT (n = 99 pat) dataset from another clinic. A weighted classification accuracy of 99.4% was achieved during training. The unweighted classification accuracy and the weighted average F1 score among different structures in the CT test dataset were 98.8% and 98.4% and 98.6% and 98.5% for the MRI test dataset, respectively. The external CT dataset yielded the corresponding results 98.4% and 98.7% when analyzed for trained structures only, and results from the full dataset yielded 79.6% and 75.2%. Most misclassifications in the external CT dataset occurred due to multiple CTVs and PTVs being fused together, which was not included in the training data. Our proposed DL-based method for automated renaming and standardization of prostate radiotherapy annotations shows great potential. Clinic specific contouring standards however need to be represented in the training data for successful use. Source code is available at https://github.com/jamtheim/DicomRTStructRenamerPublic.

Registration of histopathology to magnetic resonance imaging of prostate cancer.

BACKGROUND AND PURPOSE: The diagnostic accuracy of new imaging techniques requires validation, preferably by histopathological verification. The aim of this study was to develop and present a registration procedure between histopathology and in-vivo magnetic resonance imaging (MRI) of the prostate, to estimate its uncertainty and to evaluate the benefit of adding a contour-correcting registration. MATERIALS AND METHODS: For twenty-five prostate cancer patients, planned for radical prostatectomy, a 3D-printed prostate mold based on in-vivo MRI was created and an ex-vivo MRI of the specimen, placed inside the mold, was performed. Each histopathology slice was registered to its corresponding ex-vivo MRI slice using a 2D-affine registration. The ex-vivo MRI was rigidly registered to the in-vivo MRI and the resulting transform was applied to the histopathology stack. A 2D deformable registration was used to correct for specimen distortion concerning the specimen's fit inside the mold. We estimated the spatial uncertainty by comparing positions of landmarks in the in-vivo MRI and the corresponding registered histopathology stack. RESULTS: Eighty-four landmarks were identified, located in the urethra (62%), prostatic cysts (33%), and the ejaculatory ducts (5%). The median number of landmarks was 3 per patient. We showed a median in-plane error of 1.8 mm before and 1.7 mm after the contour-correcting deformable registration. In patients with extraprostatic margins, the median in-plane error improved from 2.1 mm to 1.8 mm after the contour-correcting deformable registration. CONCLUSIONS: Our registration procedure accurately registers histopathology to in-vivo MRI, with low uncertainty. The contour-correcting registration was beneficial in patients with extraprostatic surgical margins.

Artificial intelligence and the medical physics profession - A Swedish perspective.

BACKGROUND: There is a continuous and dynamic discussion on artificial intelligence (AI) in present-day society. AI is expected to impact on healthcare processes and could contribute to a more sustainable use of resources allocated to healthcare in the future. The aim for this work was to establish a foundation for a Swedish perspective on the potential effect of AI on the medical physics profession. MATERIALS AND METHODS: We designed a survey to gauge viewpoints regarding AI in the Swedish medical physics community. Based on the survey results and present-day situation in Sweden, a SWOT analysis was performed on the implications of AI for the medical physics profession. RESULTS: Out of 411 survey recipients, 163 responded (40%). The Swedish medical physicists with a professional license believed (90%) that AI would change the practice of medical physics but did not foresee (81%) that AI would pose a risk to their practice and career. The respondents were largely positive to the inclusion of AI in educational programmes. According to self-assessment, the respondents' knowledge of and workplace preparedness for AI was generally low. CONCLUSIONS: From the survey and SWOT analysis we conclude that AI will change the medical physics profession and that there are opportunities for the profession associated with the adoption of AI in healthcare. To overcome the weakness of limited AI knowledge, potentially threatening the role of medical physicists, and build upon the strong position in Swedish healthcare, medical physics education and training should include learning objectives on AI.

Impact of neoadjuvant androgen deprivation therapy on magnetic resonance imaging features in prostate cancer before radiotherapy.

BACKGROUND AND PURPOSE: In locally advanced prostate cancer (PC), androgen deprivation therapy (ADT) in combination with whole prostate radiotherapy (RT) is the standard treatment. ADT affects the prostate as well as the tumour on multiparametric magnetic resonance imaging (MRI) with decreased PC conspicuity and impaired localisation of the prostate lesion. Image texture analysis has been suggested to be of aid in separating tumour from normal tissue. The aim of the study was to investigate the impact of ADT on baseline defined MRI features in prostate cancer with the goal to investigate if it might be of use in radiotherapy planning. MATERIALS AND METHODS: Fifty PC patients were included. Multiparametric MRI was performed before, and three months after ADT. At baseline, a tumour volume was delineated on apparent diffusion coefficient (ADC) maps with suspected tumour content and a reference volume in normal prostatic tissue. These volumes were transferred to MRIs after ADT and were analysed with first-order -and invariant Haralick -features. RESULTS: At baseline, the median value and several of the invariant Haralick features of ADC, showed a significant difference between tumour and reference volumes. After ADT, only ADC median value could significantly differentiate the two volumes. CONCLUSIONS: Invariant Haralick -features could not distinguish between baseline MRI defined PC and normal tissue after ADT. First-order median value remained significantly different in tumour and reference volumes after ADT, but the difference was less pronounced than before ADT.

IPEM Topical Report: an international IPEM survey of MRI use for external beam radiotherapy treatment planning.

Introduction/Background. Despite growing interest in magnetic resonance imaging (MRI), integration in external beam radiotherapy (EBRT) treatment planning uptake varies globally. In order to understand the current international landscape of MRI in EBRT a survey has been performed in 11 countries. This work reports on differences and common themes identified.Methods. A multi-disciplinary Institute of Physics and Engineering in Medicine working party modified a survey previously used in the UK to understand current practice using MRI for EBRT treatment planning, investigate how MRI is currently used and managed as well as identify knowledge gaps. It was distributed electronically within 11 countries: Australia, Belgium, Denmark, Finland, France, Italy, the Netherlands, New Zealand, Sweden, the UK and the USA.Results. The survey response rate within the USA was <1% and hence these results omitted from the analysis. In the other 10 countries the survey had a median response rate of 77% per country. Direct MRI access, defined as either having a dedicated MRI scanner for radiotherapy (RT) or access to a radiology MRI scanner, varied between countries. France, Italy and the UK reported the lowest direct MRI access rates and all other countries reported direct access in ≥82% of centres. Whilst ≥83% of centres in Denmark and Sweden reported having dedicated MRI scanners for EBRT, all other countries reported ≤29%. Anatomical sites receiving MRI for EBRT varied between countries with brain, prostate, head and neck being most common. Commissioning and QA of image registration and MRI scanners varied greatly, as did MRI sequences performed, staffing models and training given to different staff groups. The lack of financial reimbursement for MR was a consistent barrier for MRI implementation for RT for all countries and MR access was a reported important barrier for all countries except Sweden and Denmark.Conclusion. No country has a comprehensive approach for MR in EBRT adoption and financial barriers are present worldwide. Variations between countries in practice, equipment, staffing models, training, QA and MRI sequences have been identified, and are likely to be due to differences in funding as well as a lack of consensus or guidelines in the literature. Access to dedicated MR for EBRT is limited in all but Sweden and Denmark, but in all countries there are financial challenges with ongoing per patient costs. Despite these challenges, significant interest exists in increasing MR guided EBRT planning over the next 5 years.

An MR-only acquisition and artificial intelligence based image-processing protocol for photon and proton therapy using a low field MR.

OBJECTIVE: Recent developments on synthetically generated CTs (sCT), hybrid MRI linacs and MR-only simulations underlined the clinical feasibility and acceptance of MR guided radiation therapy. However, considering clinical application of open and low field MR with a limited field of view can result in truncation of the patient's anatomy which further affects the MR to sCT conversion. In this study an acquisition protocol and subsequent MR image stitching is proposed to overcome the limited field of view restriction of open MR scanners, for MR-only photon and proton therapy. MATERIAL AND METHODS: 12 prostate cancer patients scanned with an open 0.35T scanner were included. To obtain the full body contour an enhanced imaging protocol including two repeated scans after bilateral table movement was introduced. All required structures (patient contour, target and organ at risk) were delineated on a post-processed combined transversal image set (stitched MRI). The postprocessed MR was converted into a sCT by a pretrained neural network generator. Inversely planned photon and proton plans (VMAT and SFUD) were designed using the sCT and recalculated for rigidly and deformably registered CT images and compared based on D2%, D50%, V70Gy for organs at risk and based on D2%, D50%, D98% for the CTV and PTV. The stitched MRI and the untruncated MRI were compared to the CT, and the maximum surface distance was calculated. The sCT was evaluated with respect to delineation accuracy by comparing on stitched MRI and sCT using the DICE coefficient for femoral bones and the whole body. RESULTS: Maximum surface distance analysis revealed uncertainties in lateral direction of 1-3mm on average. DICE coefficient analysis confirms good performance of the sCT conversion, i.e. 92%, 93%, and 100% were obtained for femoral bone left and right and whole body. Dose comparison resulted in uncertainties below 1% between deformed CT and sCT and below 2% between rigidly registered CT and sCT in the CTV for photon and proton treatment plans. DISCUSSION: A newly developed acquisition protocol for open MR scanners and subsequent Sct generation revealed good acceptance for photon and proton therapy. Moreover, this protocol tackles the restriction of the limited FOVs and expands the capacities towards MR guided proton therapy with horizontal beam lines.

Robust treatment planning of dose painting for prostate cancer based on ADC-to-Gleason score mappings - what is the potential to increase the tumor control probability?

BACKGROUND AND PURPOSE: The aim of this study was to evaluate the potential to increase the tumor control probability (TCP) with 'dose painting by numbers' (DPBN) plans optimized in a treatment planning system (TPS) compared to uniform dose plans. The DPBN optimization was based on our earlier published formalism for prostate cancer that is driven by dose-responses of Gleason scores mapped from apparent diffusion coefficients (ADC). MATERIAL AND METHODS: For 17 included patients, a set of DPBN plans were optimized in a TPS by maximizing the TCP for an equal average dose to the prostate volume (CTVT) as for a conventional uniform dose treatment. For the plan optimizations we applied different photon energies, different precisions for the ADC-to-Gleason mappings, and different CTVT positioning uncertainties. The TCP increasing potential was evaluated by the DPBN efficiency, defined as the ratio of TCP increases for DPBN plans by TCP increases for ideal DPBN prescriptions (optimized without considering radiation transport phenomena, uncertainties of the CTVT positioning, and uncertainties of the ADC-to-Gleason mapping). RESULTS: The median DPBN efficiency for the most conservative planning scenario optimized with a low precision ADC-to-Gleason mapping, and a positioning uncertainty of 0.6 cm was 10%, meaning that more than half of the patients had a TCP gain of at least 10% of the TCP for an ideal DPBN prescription. By increasing the precision of the ADC-to-Gleason mapping, and decreasing the positioning uncertainty the median DPBN efficiency increased by up to 40%. CONCLUSIONS: TCP increases with DPBN plans optimized in a TPS were found more likely with a high precision mapping of image data into dose-responses and a high certainty of the tumor positioning. These findings motivate further development to ensure precise mappings of image data into dose-responses and to ensure a high spatial certainty of the tumor positioning when implementing DPBN clinically.

ESTRO ACROP guideline for target volume delineation of skull base tumors.

BACKGROUND AND PURPOSE: For skull base tumors, target definition is the key to safe high-dose treatments because surrounding normal tissues are very sensitive to radiation. In the present work we established a joint ESTRO ACROP guideline for the target volume definition of skull base tumors. MATERIAL AND METHODS: A comprehensive literature search was conducted in PubMed using various combinations of the following medical subjects headings (MeSH) and free-text words: "radiation therapy" or "stereotactic radiosurgery" or "proton therapy" or "particle beam therapy" and "skull base neoplasms" "pituitary neoplasms", "meningioma", "craniopharyngioma", "chordoma", "chondrosarcoma", "acoustic neuroma/vestibular schwannoma", "organs at risk", "gross tumor volume", "clinical tumor volume", "planning tumor volume", "target volume", "target delineation", "dose constraints". The ACROP committee identified sixteen European experts in close interaction with the ESTRO clinical committee who analyzed and discussed the body of evidence concerning target delineation. RESULTS: All experts agree that magnetic resonance (MR) images with high three-dimensional spatial accuracy and tissue-contrast definition, both T2-weighted and volumetric T1-weighted sequences, are required to improve target delineation. In detail, several key issues were identified and discussed: i) radiation techniques and immobilization, ii) imaging techniques and target delineation, and iii) technical aspects of radiation treatments including planning techniques and dose-fractionation schedules. Specific target delineation issues with regard to different skull base tumors, including pituitary adenomas, meningiomas, craniopharyngiomas, acoustic neuromas, chordomas and chondrosarcomas are presented. CONCLUSIONS: This ESTRO ACROP guideline achieved detailed recommendations on target volume definition for skull base tumors, as well as comprehensive advice about imaging modalities and radiation techniques.

Improved PET/MRI attenuation correction in the pelvic region using a statistical decomposition method on T2-weighted images.

BACKGROUND: Attenuation correction of PET/MRI is a remaining problem for whole-body PET/MRI. The statistical decomposition algorithm (SDA) is a probabilistic atlas-based method that calculates synthetic CTs from T2-weighted MRI scans. In this study, we evaluated the application of SDA for attenuation correction of PET images in the pelvic region. MATERIALS AND METHOD: Twelve patients were retrospectively selected from an ongoing prostate cancer research study. The patients had same-day scans of [11C]acetate PET/MRI and CT. The CT images were non-rigidly registered to the PET/MRI geometry, and PET images were reconstructed with attenuation correction employing CT, SDA-generated CT, and the built-in Dixon sequence-based method of the scanner. The PET images reconstructed using CT-based attenuation correction were used as ground truth. RESULTS: The mean whole-image PET uptake error was reduced from - 5.4% for Dixon-PET to - 0.9% for SDA-PET. The prostate standardized uptake value (SUV) quantification error was significantly reduced from - 5.6% for Dixon-PET to - 2.3% for SDA-PET. CONCLUSION: Attenuation correction with SDA improves quantification of PET/MR images in the pelvic region compared to the Dixon-based method.

Evaluation of multislice inputs to convolutional neural networks for medical image segmentation.

PURPOSE: When using convolutional neural networks (CNNs) for segmentation of organs and lesions in medical images, the conventional approach is to work with inputs and outputs either as single slice [two-dimensional (2D)] or whole volumes [three-dimensional (3D)]. One common alternative, in this study denoted as pseudo-3D, is to use a stack of adjacent slices as input and produce a prediction for at least the central slice. This approach gives the network the possibility to capture 3D spatial information, with only a minor additional computational cost. METHODS: In this study, we systematically evaluate the segmentation performance and computational costs of this pseudo-3D approach as a function of the number of input slices, and compare the results to conventional end-to-end 2D and 3D CNNs, and to triplanar orthogonal 2D CNNs. The standard pseudo-3D method regards the neighboring slices as multiple input image channels. We additionally design and evaluate a novel, simple approach where the input stack is a volumetric input that is repeatably convolved in 3D to obtain a 2D feature map. This 2D map is in turn fed into a standard 2D network. We conducted experiments using two different CNN backbone architectures and on eight diverse data sets covering different anatomical regions, imaging modalities, and segmentation tasks. RESULTS: We found that while both pseudo-3D methods can process a large number of slices at once and still be computationally much more efficient than fully 3D CNNs, a significant improvement over a regular 2D CNN was only observed with two of the eight data sets. triplanar networks had the poorest performance of all the evaluated models. An analysis of the structural properties of the segmentation masks revealed no relations to the segmentation performance with respect to the number of input slices. A post hoc rank sum test which combined all metrics and data sets yielded that only our newly proposed pseudo-3D method with an input size of 13 slices outperformed almost all methods. CONCLUSION: In the general case, multislice inputs appear not to improve segmentation results over using 2D or 3D CNNs. For the particular case of 13 input slices, the proposed novel pseudo-3D method does appear to have a slight advantage across all data sets compared to all other methods evaluated in this work.

Latent space manipulation for high-resolution medical image synthesis via the StyleGAN.

INTRODUCTION: This paper explores the potential of the StyleGAN model as an high-resolution image generator for synthetic medical images. The possibility to generate sample patient images of different modalities can be helpful for training deep learning algorithms as e.g. a data augmentation technique. METHODS: The StyleGAN model was trained on Computed Tomography (CT) and T2- weighted Magnetic Resonance (MR) images from 100 patients with pelvic malignancies. The resulting model was investigated with regards to three features: Image Modality, Sex, and Longitudinal Slice Position. Further, the style transfer feature of the StyleGAN was used to move images between the modalities. The root-mean-squard error (RMSE) and the Mean Absolute Error (MAE) were used to quantify errors for MR and CT, respectively. RESULTS: We demonstrate how these features can be transformed by manipulating the latent style vectors, and attempt to quantify how the errors change as we move through the latent style space. The best results were achieved by using the style transfer feature of the StyleGAN (58.7 HU MAE for MR to CT and 0.339 RMSE for CT to MR). Slices below and above an initial central slice can be predicted with an error below 75 HU MAE and 0.3 RMSE within 4cm for CT and MR, respectively. DISCUSSION: The StyleGAN is a promising model to use for generating synthetic medical images for MR and CT modalities as well as for 3D volumes.