Opportunities for personalised follow-up in breast cancer: the gap between daily practice and recurrence risk.

PURPOSE: Follow-up guidelines barely diverge from a one-size-fits-all approach, even though the risk of recurrence differs per patient. However, the personalization of breast cancer care improves outcomes for patients. This study explores the variation in follow-up pathways in the Netherlands using real-world data to determine guideline adherence and the gap between daily practice and risk-based surveillance, to demonstrate the benefits of personalized risk-based surveillance compared with usual care. METHODS: Patients with stage I-III invasive breast cancer who received surgical treatment in a general hospital between 2005 and 2020 were selected from the Netherlands Cancer Registry and included all imaging activities during follow-up from hospital-based electronic health records. Process analysis techniques were used to map patients and activities to investigate the real-world utilisation of resources and identify the opportunities for improvement. The INFLUENCE 2.0 nomogram was used for risk prediction of recurrence. RESULTS: In the period between 2005 and 2020, 3478 patients were included with a mean follow-up of 4.9 years. In the first 12 months following treatment, patients visited the hospital between 1 and 5 times (mean 1.3, IQR 1-1) and received between 1 and 9 imaging activities (mean 1.7, IQR 1-2). Mammogram was the prevailing imaging modality, accounting for 70% of imaging activities. Patients with a low predicted risk of recurrence visited the hospital more often. CONCLUSIONS: Deviations from the guideline were not in line with the risk of recurrence and revealed a large gap, indicating that it is hard for clinicians to accurately estimate this risk and therefore objective risk predictions could bridge this gap.

Comparing modeling strategies combining changes in multiple serum tumor biomarkers for early prediction of immunotherapy non-response in non-small cell lung cancer.

BACKGROUND: Patients treated with immune checkpoint inhibitors (ICI) are at risk of adverse events (AEs) even though not all patients will benefit. Serum tumor markers (STMs) are known to reflect tumor activity and might therefore be useful to predict response, guide treatment decisions and thereby prevent AEs. OBJECTIVE: This study aims to compare a range of prediction methods to predict non-response using multiple sequentially measured STMs. METHODS: Nine prediction models were compared to predict treatment non-response at 6-months (n = 412) using bi-weekly CYFRA, CEA, CA-125, NSE, and SCC measurements determined in the first 6-weeks of therapy. All methods were applied to six different biomarker combinations including two to five STMs. Model performance was assessed based on sensitivity, while model training aimed at 95% specificity to ensure a low false-positive rate. RESULTS: In the validation cohort, boosting provided the highest sensitivity at a fixed specificity across most STM combinations (12.9% -59.4%). Boosting applied to CYFRA and CEA achieved the highest sensitivity on the validation data while maintaining a specificity >95%. CONCLUSIONS: Non-response in NSCLC patients treated with ICIs can be predicted with a specificity >95% by combining multiple sequentially measured STMs in a prediction model. Clinical use is subject to further external validation.

Willingness to participate in combination screening for lung cancer, chronic obstructive pulmonary disease and cardiovascular disease in four European countries.

OBJECTIVES: Lung cancer screening (LCS), using low-dose computed tomography (LDCT), can be more efficient by simultaneously screening for chronic obstructive pulmonary disease (COPD) and cardiovascular disease (CVD), the Big-3 diseases. This study aimed to determine the willingness to participate in (combinations of) Big-3 screening in four European countries and the relative importance of amendable participation barriers. METHODS: An online cross-sectional survey aimed at (former) smokers aged 50-75 years elicited the willingness of individuals to participate in Big-3 screening and used analytical hierarchy processing (AHP) to determine the importance of participation barriers. RESULTS: Respondents were from France (n = 391), Germany (n = 338), Italy (n = 399), and the Netherlands (n = 342), and consisted of 51.2% men. The willingness to participate in screening was marginally influenced by the diseases screened for (maximum difference of 3.1%, for Big-3 screening (73.4%) vs. lung cancer and COPD screening (70.3%)) and by country (maximum difference of 3.7%, between France (68.5%) and the Netherlands (72.3%)). The largest effect on willingness to participate was personal perceived risk of lung cancer. The most important barriers were the missed cases during screening (weight 0.19) and frequency of screening (weight 0.14), while diseases screened for (weight 0.11) ranked low. CONCLUSIONS: The difference in willingness to participate in LCS showed marginal increase with inclusion of more diseases and limited variation between countries. A marginal increase in participation might result in a marginal additional benefit of Big-3 screening. The amendable participation barriers are similar to previous studies, and the new criterion, diseases screened for, is relatively unimportant. CLINICAL RELEVANCE STATEMENT: Adding diseases to combination screening modestly improves participation, driven by personal perceived risk. These findings guide program design and campaigns for lung cancer and Big-3 screening. Benefits of Big-3 screening lie in long-term health and economic impact, not participation increase. KEY POINTS: • It is unknown whether or how combination screening might affect participation. • The addition of chronic obstructive pulmonary disease and cardiovascular disease to lung cancer screening resulted in a marginal increase in willingness to participate. • The primary determinant influencing individuals' engagement in such programs is their personal perceived risk of the disease.

External validation of 87 clinical prediction models supporting clinical decisions for breast cancer patients.

INTRODUCTION: Numerous prediction models have been developed to support treatment-related decisions for breast cancer patients. External validation, a prerequisite for implementation in clinical practice, has been performed for only a few models. This study aims to externally validate published clinical prediction models using population-based Dutch data. METHODS: Patient-, tumor- and treatment-related data were derived from the Netherlands Cancer Registry (NCR). Model performance was assessed using the area under the receiver operating characteristic curve (AUC), scaled Brier score, and model calibration. Net benefit across applicable risk thresholds was evaluated with decision curve analysis. RESULTS: After assessing 922 models, 87 (9%) were included for validation. Models were excluded due to an incomplete model description (n = 262 (28%)), lack of required data (n = 521 (57%)), previously validated or developed with NCR data (n = 45 (5%)), or the associated NCR sample size was insufficient (n = 7 (1%)). The included models predicted survival (33 (38%) overall, 27 (31%) breast cancer-specific, and 3 (3%) other cause-specific), locoregional recurrence (n = 7 (8%)), disease free survival (n = 7 (8%)), metastases (n = 5 (6%)), lymph node involvement (n = 3 (3%)), pathologic complete response (n = 1 (1%)), and surgical margins (n = 1 (1%)). Seven models (8%) showed poor (AUC<0.6), 39 (45%) moderate (AUC:0.6-0.7), 38 (46%) good (AUC:0.7-0.9), and 3 (3%) excellent (AUC≥0.9) discrimination. Using the scaled Brier score, worse performance than an uninformative model was found in 34 (39%) models. CONCLUSION: Comprehensive registry data supports broad validation of published prediction models. Model performance varies considerably in new patient populations, affirming the importance of external validation studies before applying models in clinical practice. Well performing models could be clinically useful in a Dutch setting after careful impact evaluation.

Population-Based Screening Using Low-Dose Chest Computed Tomography: A Systematic Review of Health Economic Evaluations.

BACKGROUND: Chest low-dose computed tomography (LDCT) is a promising technology for population-based screening because it is non-invasive, relatively inexpensive, associated with low radiation and highly sensitive to lung cancer. To improve the cost-effectiveness of lung cancer screening, simultaneous screening for other diseases could be considered. This systematic review was conducted to analyse studies that published evidence on the cost-effectiveness of chest LDCT screening programs for different diseases. METHODS: Scopus and PubMed were searched for English publications (1 January 2011-22 July 2022) using search terms related to screening, computed tomography and cost-effectiveness. An additional search specifically searched for the cost-effectiveness of screening for lung cancer, chronic obstructive pulmonary disease or cardiovascular disease. Included publications should present a full health economic evaluation of population screening with chest LDCT. The extracted data included the disease screened for, model type, country context of screening, inclusion of comorbidities or incidental findings, incremental costs, incremental effects and the resulting cost-effectiveness ratio amongst others. Reporting quality was assessed using the 2022 Consolidated Health Economic Evaluation Reporting Standards (CHEERS) checklist. RESULTS: The search yielded 1799 unique papers, of which 43 were included. Most papers focused on lung cancer screening (n = 40), and three were on coronary calcium scoring. Microsimulation was the most commonly applied modelling type (n = 16), followed by life table analysis (n = 10) and Markov cohort models (n = 10). Studies reflected the healthcare context of the US (n = 15), Canada (n = 4), the UK (n = 3) and 13 other countries. The reported incremental cost-effectiveness ratio ranged from US$10,000 to US$90,000/quality-adjusted life year (QALY) for lung cancer screening compared to no screening and was US$15,900/QALY-US$45,300/QALY for coronary calcium scoring compared to no screening. DISCUSSION: Almost all health economic evaluations of LDCT screening focused on lung cancer. Literature regarding the health economic benefits of simultaneous LDCT screening for multiple diseases is absent. Most studies suggest LDCT screening is cost-effective for current and former smokers aged 55-74 with a minimum of 30 pack-years of smoking history. Consequently, more evidence on LDCT is needed to support further cost-effectiveness analyses. Preferably evidence on simultaneous screening for multiple diseases is needed, but alternatively, on single-disease screening. REGISTRATION OF SYSTEMATIC REVIEW: Prospective Register of Ongoing Systematic Reviews registration CRD42021290228 can be accessed https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=290228 .

Modeling strategies to analyse longitudinal biomarker data: An illustration on predicting immunotherapy non-response in non-small cell lung cancer.

Serum tumor markers acquired through a blood draw are known to reflect tumor activity. Their non-invasive nature allows for more frequent testing compared to traditional imaging methods used for response evaluations. Our study aims to compare nine prediction methods to accurately, and with a low false positive rate, predict progressive disease despite treatment (i.e. non-response) using longitudinal tumor biomarker data. Bi-weekly measurements of CYFRA, CA-125, CEA, NSE, and SCC were available from a cohort of 412 advanced stage non-small cell lung cancer (NSCLC) patients treated up to two years with immune checkpoint inhibitors. Serum tumor marker measurements from the first six weeks after treatment initiation were used to predict treatment response at 6 months. Nine models with varying complexity were evaluated in this study, showing how longitudinal biomarker data can be used to predict non-response to immunotherapy in NSCLC patients.

The value of time-dependent risk predictions in a screening context - a comprehensive simulation analysis validated on German cancer registry data.

BACKGROUND: Risk-prediction tools allow classifying individuals into risk groups based on risk thresholds. Such risk categorization is often used to inform screening schemes by offering screening only to individuals at increased risk of harmful events. Adding information concerning an individual's risk development over time would allow assessing not just who to screen but also when to screen. This paper illustrates the value of personalised, time-dependent risk predictions to optimize risk-based screening schemes. METHODS: In a simulation analysis, two different time-dependent risk-based screening approaches are compared to another risk-based, but time-independent approach regarding their impact on screening efficiency. For this purpose, 81 scenarios featuring 5000 patients with five consecutive annual risk estimations for a hypothetical disease D are simulated, using different parameters to model disease progression and risk distribution. This simulation analysis is validated using a real-world clinical case study based on German breast cancer patients and the INFLUENCE-nomogram for locoregional breast cancer recurrence. RESULTS: If individual risk estimations were used to personalise screening for a disease D aiming at detecting a 90% of curable cases, more than 20% of screening examinations could be avoided relative to a conventional uninformed approach, depending on the simulated scenario. Whereas an individual but time-independent approach is associated with acceptable saving potentials in case of a relatively homogenous risk distribution, the time-dependent approaches are superior when the complexity of a scenario increases. With slowly progressing diseases, risk-accumulation over time needs to be considered to achieve the highest screening efficiency on population level, for rapidly progressing diseases, an interval-specific approach is superior. The possible benefits of time-dependent risk-based screening were confirmed in the real-world clinical case study. CONCLUSIONS: Appropriate approaches to use time-dependent risk predictions may considerably enhance screening efficiency on individual and population level. Therefore, predicting risk development over time should be supported by future prediction tools and be incorporated in decision algorithms.

Developing a dynamic simulation model to support the nationwide implementation of whole genome sequencing in lung cancer.

BACKGROUND: This study shows how dynamic simulation modeling can be applied in the context of the nationwide implementation of Whole Genome Sequencing (WGS) for non-small cell lung cancer (NSCLC) to inform organizational decisions regarding the use of complex and disruptive health technologies and how these decisions affect their potential value. METHODS: Using the case of the nationwide implementation of WGS into clinical practice in lung cancer in the Dutch healthcare system, we developed a simulation model to show that including service delivery features across the diagnostic pathway can provide essential insight into the affordability and accessibility of care at the systems level. The model was implemented as a hybrid Agent-Based Model and Discrete-Event Simulation model in AnyLogic and included 78 hospital agents, 7 molecular tumor board agents, 1 WGS facility agent, and 5313 patient agents each year in simulation time. RESULTS: The model included patient and provider heterogeneity, including referral patterns, capacity constraints, and diagnostic workflows. Patient preference and adoption by healthcare professionals were also modeled. The model was used to analyze a scenario in which only academic hospitals have implemented WGS. To prevent delays in the diagnostic pathway, the capacity to sequence at least 1600 biopsies yearly should be present. There is a two-fold increase in mean diagnostic pathway duration between no patients referred or all patients referred for further diagnostics. CONCLUSIONS: The systems model can complement conventional health economic evaluations to investigate how the organization of the workflow can influence the actual use and impact of WGS. Insufficient capacity to provide WGS and referral patterns can substantially impact the duration of the diagnostic pathway and thus should be considered in the implementation of WGS.

Comparing Modeling Approaches for Discrete Event Simulations With Competing Risks Based on Censored Individual Patient Data: A Simulation Study and Illustration in Colorectal Cancer.

OBJECTIVES: This study aimed to provide detailed guidance on modeling approaches for implementing competing events in discrete event simulations based on censored individual patient data (IPD). METHODS: The event-specific distributions (ESDs) approach sampled times from event-specific time-to-event distributions and simulated the first event to occur. The unimodal distribution and regression approach sampled a time from a combined unimodal time-to-event distribution, representing all events, and used a (multinomial) logistic regression model to select the event to be simulated. A simulation study assessed performance in terms of relative absolute event incidence difference and relative entropy of time-to-event distributions for different types and levels of right censoring, numbers of events, distribution overlap, and sample sizes. Differences in cost-effectiveness estimates were illustrated in a colorectal cancer case study. RESULTS: Increased levels of censoring negatively affected the modeling approaches' performance. A lower number of competing events and higher overlap of distributions improved performance. When IPD were censored at random times, ESD performed best. When censoring occurred owing to a maximum follow-up time for 2 events, ESD performed better for a low level of censoring (ie, 10%). For 3 or 4 competing events, ESD better represented the probabilities of events, whereas unimodal distribution and regression better represented the time to events. Differences in cost-effectiveness estimates, both compared with no censoring and between approaches, increased with increasing censoring levels. CONCLUSIONS: Modelers should be aware of the different modeling approaches available and that selection between approaches may be informed by data characteristics. Performing and reporting extensive validation efforts remains essential to ensure IPD are appropriately represented.

Efficacy, cost-minimization, and budget impact of a personalized discharge letter for basal cell carcinoma patients to reduce low-value follow-up care.

BACKGROUND: The incidence of keratinocyte carcinomas is high and rapidly growing. Approximately 80% of keratinocyte carcinomas consist of basal cell carcinomas (BCC) with 50% of these being considered as low-risk tumors. Nevertheless, 83% of the low-risk BCC patients were found to receive more follow-up care than recommended according to the Dutch BCC guideline, which is one visit post-treatment for this group. More efficient management could reduce unnecessary follow-up care and related costs. OBJECTIVES: To study the efficacy, cost-utility, and budget impact of a personalized discharge letter for low-risk BCC patients compared with usual care (no personalized letter). METHODS: In a multi-center intervention study, a personalized discharge letter in addition to usual care was compared to usual care in first-time BCC patients. Model-based cost-utility and budget impact analyses were conducted, using individual patient data gathered via surveys. The outcome measures were number of follow-up visits, costs and quality adjusted life years (QALY) per patient. RESULTS: A total of 473 first-time BCC patients were recruited. The personalized discharge letter decreased the number of follow-up visits by 14.8% in the first year. The incremental costs after five years were -€24.45 per patient. The QALYs were 4.12 after five years and very similar in both groups. The national budget impact was -€2,7 million after five years. CONCLUSIONS: The distribution of a personalized discharge letter decreases the number of unnecessary follow-up visits and implementing the intervention in a large eligible population would results in substantial cost savings, contributing to restraining the growing BCC costs.

Can we increase efficiency of CT lung cancer screening by combining with CVD and COPD screening? Results of an early economic evaluation.

OBJECTIVES: Estimating the maximum acceptable cost (MAC) per screened individual for low-dose computed tomography (LDCT) lung cancer (LC) screening, and determining the effect of additionally screening for chronic obstructive pulmonary disease (COPD), cardiovascular disease (CVD), or both on the MAC. METHODS: A model-based early health technology assessment (HTA) was conducted to estimate whether a new intervention could be cost-effective by calculating the MAC at a willingness-to-pay (WTP) of €20k/quality-adjusted life-year (QALY) and €80k/QALY, for a population of current and former smokers, aged 50-75 years in The Netherlands. The MAC was estimated based on incremental QALYs gained from a stage shift assuming screened individuals are detected in earlier disease stages. Data were obtained from literature and publicly available statistics and validated with experts. RESULTS: The MAC per individual for implementing LC screening at a WTP of €20k/QALY was €113. If COPD, CVD, or both were included in screening, the MAC increased to €230, €895, or €971 respectively. Scenario analyses assessed whether screening-specific disease high-risk populations would improve cost-effectiveness, showing that high-risk CVD populations were more likely to improve economic viability compared to COPD. CONCLUSIONS: The economic viability of combined screening is substantially larger than for LC screening alone, primarily due to benefits from CVD screening, and is dependent on the target screening population, which is key to optimise the screening program. The total cost of breast and cervical cancer screening is lower (€420) than the MAC of Big-3, indicating that Big-3 screening may be acceptable from a health economic perspective. KEY POINTS: • Once-off combined low-dose CT screening for lung cancer, COPD, and CVD in individuals aged 50-75 years is potentially cost-effective if screening would cost less than €971 per screened individual. • Multi-disease screening requires detailed insight into the co-occurrence of these diseases to identify the optimal target screening population. • With the same target screening population and WTP, lung cancer-only screening should cost less than €113 per screened individual to be cost-effective.

The majority of 922 prediction models supporting breast cancer decision-making are at high risk of bias.

OBJECTIVES: To systematically review the currently available prediction models that may support treatment decision-making in breast cancer. STUDY DESIGN AND SETTING: Literature was systematically searched to identify studies reporting on development of prediction models aiming to support breast cancer treatment decision-making, published between January 2010 and December 2020. Quality and risk of bias were assessed using the Prediction model Risk Of Bias (ROB) Assessment Tool (PROBAST). RESULTS: After screening 20,460 studies, 534 studies were included, reporting on 922 models. The 922 models predicted: mortality (n = 417 45%), recurrence (n = 217, 24%), lymph node involvement (n = 141, 15%), adverse events (n = 58, 6%), treatment response (n = 56, 6%), or other outcomes (n = 33, 4%). In total, 285 models (31%) lacked a complete description of the final model and could not be applied to new patients. Most models (n = 878, 95%) were considered to contain high ROB. CONCLUSION: A substantial overlap in predictor variables and outcomes between the models was observed. Most models were not reported according to established reporting guidelines or showed methodological flaws during the development and/or validation of the model. Further development of prediction models with thorough quality and validity assessment is an essential first step for future clinical application.

Choosing a Metamodel of a Simulation Model for Uncertainty Quantification.

BACKGROUND: Metamodeling may substantially reduce the computational expense of individual-level state transition simulation models (IL-STM) for calibration, uncertainty quantification, and health policy evaluation. However, because of the lack of guidance and readily available computer code, metamodels are still not widely used in health economics and public health. In this study, we provide guidance on how to choose a metamodel for uncertainty quantification. METHODS: We built a simulation study to evaluate the prediction accuracy and computational expense of metamodels for uncertainty quantification using life-years gained (LYG) by treatment as the IL-STM outcome. We analyzed how metamodel accuracy changes with the characteristics of the simulation model using a linear model (LM), Gaussian process regression (GP), generalized additive models (GAMs), and artificial neural networks (ANNs). Finally, we tested these metamodels in a case study consisting of a probabilistic analysis of a lung cancer IL-STM. RESULTS: In a scenario with low uncertainty in model parameters (i.e., small confidence interval), sufficient numbers of simulated life histories, and simulation model runs, commonly used metamodels (LM, ANNs, GAMs, and GP) have similar, good accuracy, with errors smaller than 1% for predicting LYG. With a higher level of uncertainty in model parameters, the prediction accuracy of GP and ANN is superior to LM. In the case study, we found that in the worst case, the best metamodel had an error of about 2.1%. CONCLUSION: To obtain good prediction accuracy, in an efficient way, we recommend starting with LM, and if the resulting accuracy is insufficient, we recommend trying ANNs and eventually also GP regression.

Improving early diagnosis of cardiovascular disease in patients with type 2 diabetes and COPD: protocol of the RED-CVD cluster randomised diagnostic trial.

INTRODUCTION: The early stages of chronic progressive cardiovascular disease (CVD) generally cause non-specific symptoms that patients often do not spontaneously mention to their general practitioner, and are therefore easily missed. A proactive diagnostic strategy has the potential to uncover these frequently missed early stages, creating an opportunity for earlier intervention. This is of particular importance for chronic progressive CVDs with evidence-based therapies known to improve prognosis, such as ischaemic heart disease, atrial fibrillation and heart failure.Patients with type 2 diabetes or chronic obstructive pulmonary disease (COPD) are at particularly high risk of developing CVD. In the current study, we will demonstrate the feasibility and effectiveness of screening these high-risk patients with our early diagnosis strategy, using tools that are readily available in primary care, such as symptom questionnaires (to be filled out by the patients themselves), natriuretic peptide measurement and electrocardiography. METHODS AND ANALYSIS: The Reviving the Early Diagnosis-CVD trial is a multicentre, cluster randomised diagnostic trial performed in primary care practices across the Netherlands. We aim to include 1300 (2×650) patients who participate in a primary care disease management programme for COPD or type 2 diabetes. Practices will be randomised to the intervention arm (performing the early diagnosis strategy during the routine visits that are part of the disease management programmes) or the control arm (care as usual). The main outcome is the number of newly detected cases with CVDs in both arms, and the subsequent therapies they received. Secondary endpoints include quality of life, cost-effectiveness and the added diagnostic value of family and reproductive history questionnaires and three (novel) biomarkers (high-sensitive troponin-I, growth differentiation factor-15 and suppressor of tumourigenicity 2). Finally newly initiated treatments will be compared in both groups. ETHICS AND DISSEMINATION: The protocol was approved by the Medical Ethical Committee of the University Medical Center Utrecht, the Netherlands. Results are expected in 2022 and will be disseminated through international peer-reviewed publications. TRIAL REGISTRATION NUMBER: NTR7360.

Clinicopathologic predictors of early relapse in advanced epithelial ovarian cancer: development of prediction models using nationwide data.

OBJECTIVE: To identify clinicopathologic factors predictive of early relapse (platinum-free interval (PFI) of ≤6 months) in advanced epithelial ovarian cancer (EOC) in first-line treatment, and to develop and internally validate risk prediction models for early relapse. METHODS: All consecutive patients diagnosed with advanced stage EOC between 01-01-2008 and 31-12-2015 were identified from the Netherlands Cancer Registry. Patients who underwent cytoreductive surgery and platinum-based chemotherapy as initial EOC treatment were selected. Two prediction models, i.e. pretreatment and postoperative, were developed. Candidate predictors of early relapse were fitted into multivariable logistic regression models. Model performance was assessed on calibration and discrimination. Internal validation was performed through bootstrapping to correct for model optimism. RESULTS: A total of 4,557 advanced EOC patients were identified, including 1,302 early relapsers and 3,171 late or non-relapsers. Early relapsers were more likely to have FIGO stage IV, mucinous or clear cell type EOC, ascites, >1 cm residual disease, and to have undergone NACT-ICS. The final pretreatment model demonstrated subpar model performance (AUC = 0.64 [95 %-CI 0.62-0.66]). The final postoperative model based on age, FIGO stage, pretreatment CA-125 level, histologic subtype, presence of ascites, treatment approach, and residual disease after debulking, demonstrated adequate model performance (AUC = 0.72 [95 %-CI 0.71-0.74]). Bootstrap validation revealed minimal optimism of the final postoperative model. CONCLUSION: A (postoperative) discriminative model has been developed and presented online that predicts the risk of early relapse in advanced EOC patients. Although external validation is still required, this prediction model can support patient counselling in daily clinical practice.

Whole genome sequencing in oncology: using scenario drafting to explore future developments.

BACKGROUND: In oncology, Whole Genome Sequencing (WGS) is not yet widely implemented due to uncertainties such as the required infrastructure and expertise, costs and reimbursements, and unknown pan-cancer clinical utility. Therefore, this study aimed to investigate possible future developments facilitating or impeding the use of WGS as a molecular diagnostic in oncology through scenario drafting. METHODS: A four-step process was adopted for scenario drafting. First, the literature was searched for barriers and facilitators related to the implementation of WGS. Second, they were prioritized by international experts, and third, combined into coherent scenarios. Fourth, the scenarios were implemented in an online survey and their likelihood of taking place within 5 years was elicited from another group of experts. Based on the minimum, maximum, and most likely (mode) parameters, individual Program Evaluation and Review Technique (PERT) probability density functions were determined. Subsequently, individual opinions were aggregated by performing unweighted linear pooling, from which summary statistics were extracted and reported. RESULTS: Sixty-two unique barriers and facilitators were extracted from 70 articles. Price, clinical utility, and turnaround time of WGS were ranked as the most important aspects. Nine scenarios were developed and scored on likelihood by 18 experts. The scenario about introducing WGS as a clinical diagnostic with a lower price, shorter turnaround time, and improved degree of actionability, scored the highest likelihood (median: 68.3%). Scenarios with low likelihoods and strong consensus were about better treatment responses to more actionable targets (26.1%), and the effect of centralizing WGS (24.1%). CONCLUSIONS: Based on current expert opinions, the implementation of WGS as a clinical diagnostic in oncology is heavily dependent on the price, clinical utility (both in terms of identifying actionable targets as in adding sufficient value in subsequent treatment), and turnaround time. These aspects and the optimal way of service provision are the main drivers for the implementation of WGS and should be focused on in further research. More knowledge regarding these factors is needed to inform strategic decision making regarding the implementation of WGS, which warrants support from all relevant stakeholders.

Modeling Diagnostic Strategies to Manage Toxic Adverse Events following Cancer Immunotherapy.

BACKGROUND: Although immunotherapy (IMT) provides significant survival benefits in selected patients, approximately 10% of patients experience (serious) immune-related adverse events (irAEs). The early detection of adverse events will prevent irAEs from progressing to severe stages, and routine testing for irAEs has become common practice. Because a positive test outcome might indicate a clinically manifesting irAE that requires treatment to (temporarily) discontinue, the occurrence of false-positive test outcomes is expected to negatively affect treatment outcomes. This study explores how the UPPAAL modeling environment can be used to assess the impact of test accuracy (i.e., test sensitivity and specificity), on the probability of patients entering palliative care within 11 IMT cycles. METHODS: A timed automata-based model was constructed using real-world data and expert consultation. Model calibration was performed using data from 248 non-small-cell lung cancer patients treated with nivolumab. A scenario analysis was performed to evaluate the effect of changes in test accuracy on the probability of patients transitioning to palliative care. RESULTS: The constructed model was used to estimate the cumulative probabilities for the patients' transition to palliative care, which were found to match real-world clinical observations after model calibration. The scenario analysis showed that the specificity of laboratory tests for routine monitoring has a strong effect on the probability of patients transitioning to palliative care, whereas the effect of test sensitivity was limited. CONCLUSION: We have obtained interesting insights by simulating a care pathway and disease progression using UPPAAL. The scenario analysis indicates that an increase in test specificity results in decreased discontinuation of treatment due to suspicion of irAEs, through a reduction of false-positive test outcomes.

Using Metamodeling to Identify the Optimal Strategy for Colorectal Cancer Screening.

OBJECTIVES: Metamodeling can address computational challenges within decision-analytic modeling studies evaluating many strategies. This article illustrates the value of metamodeling for evaluating colorectal cancer screening strategies while accounting for colonoscopy capacity constraints. METHODS: In a traditional approach, the best screening strategy was identified from a limited subset of strategies evaluated with the validated Adenoma and Serrated pathway to Colorectal CAncer model. In a metamodeling approach, metamodels were fitted to this limited subset to evaluate all potentially plausible strategies and determine the best overall screening strategy. Approaches were compared based on the best screening strategy in life-years gained compared with no screening. Metamodel runtime and accuracy was assessed. RESULTS: The metamodeling approach evaluated >40 000 strategies in <1 minute with high accuracy after 1 adaptive sampling step (mean absolute error: 0.0002 life-years) using 300 samples in total (generation time: 8 days). Findings indicated that health outcomes could be improved without requiring additional colonoscopy capacity. Obtaining similar insights using the traditional approach could require at least 1000 samples (generation time: 28 days). Suggested benefits from screening at ages <40 years require adequate validation of the underlying Adenoma and Serrated pathway to Colorectal CAncer model before making policy recommendations. CONCLUSIONS: Metamodeling allows rapid assessment of a vast set of strategies, which may lead to identification of more favorable strategies compared to a traditional approach. Nevertheless, metamodel validation and identifying extrapolation beyond the support of the original decision-analytic model are critical to the interpretation of results. The screening strategies identified with metamodeling support ongoing discussions on decreasing the starting age of colorectal cancer screening.

External validation of the Memorial Sloan Kettering Cancer Centre and Briganti nomograms for the prediction of lymph node involvement of prostate cancer using clinical stage assessed by magnetic resonance imaging.

OBJECTIVES: To evaluate the impact of using clinical stage assessed by multiparametric magnetic resonance imaging (mpMRI) on the performance of two established nomograms for the prediction of pelvic lymph node involvement (LNI) in patients with prostate cancer. PATIENTS AND METHODS: Patients undergoing robot-assisted extended pelvic lymph node dissection (ePLND) from 2015 to 2019 at three teaching hospitals were retrospectively evaluated. Risk of LNI was calculated four times for each patient, using clinical tumour stage (T-stage) assessed by digital rectal examination (DRE) and by mpMRI, in the Memorial Sloan Kettering Cancer Centre (MSKCC; 2018) and Briganti (2012) nomograms. Discrimination (area under the curve [AUC]), calibration, and the net benefit of these four strategies were assessed and compared. RESULTS: A total of 1062 patients were included, of whom 301 (28%) had histologically proven LNI. Using DRE T-stage resulted in AUCs of 0.71 (95% confidence interval [CI] 0.70-0.72) for the MSKCC and 0.73 (95% CI 0.72-0.74) for the Briganti nomogram. Using mpMRI T-stage, the AUCs were 0.72 (95% CI 0.71-0.73) for the MSKCC and 0.75 (95% CI 0.74-0.76) for the Briganti nomogram. mpMRI T-stage resulted in equivalent calibration compared with DRE T-stage. Combined use of mpMRI T-stage and the Briganti 2012 nomogram was shown to be superior in terms of AUC, calibration, and net benefit. Use of mpMRI T-stage led to increased sensitivity for the detection of LNI for all risk thresholds in both models, countered by a decreased specificity, compared with DRE T-stage. CONCLUSION: T-stage as assessed by mpMRI is an appropriate alternative for T-stage assessed by DRE to determine nomogram-based risk of LNI in patients with prostate cancer, and was associated with improved model performance of both the MSKCC 2018 and Briganti 2012 nomograms.

Real-World Utilization of Biomarker Testing for Patients with Advanced Non-Small Cell Lung Cancer in a Tertiary Referral Center and Referring Hospitals.

The continued introduction of biomarkers and innovative testing methods makes already complex diagnosis in patients with stage IV non-small-cell lung cancer (NSCLC) even more complex. This study primarily analyzed variations in biomarker testing in clinical practice in patients referred to a comprehensive cancer center in the Netherlands. The secondary aim was to compare the cost of biomarker testing with the cost of whole-genome sequencing. The cohort included 102 stage IV NSCLC patients who received biomarker testing in 2017 or 2018 at the comprehensive cancer center. The complete biomarker testing history of the cohort was identified using linked data from the comprehensive cancer center and the nationwide network and registry of histopathology and cytopathology in the Netherlands. Unique biomarker-test combinations, costs, turnaround times, and test utilization were examined. The results indicate substantial variation in test utilization and sequences. The mean cost per patient of biomarker testing was 2259.92 ± 1217.10 USD, or 1881.23 ± 1013.15 EUR. Targeted gene panels were most frequently conducted, followed by IHC analysis for programmed cell death protein ligand 1. Typically, the most common biomarkers were assessed within the first tests, and emerging biomarkers were tested further down the test sequence. At the cost of current biomarker testing, replacing current testing with whole-genome sequencing would have led to cost-savings in only two patients (2%).