Opportunities for personalised follow-up in breast cancer: the gap between daily practice and recurrence risk.

PURPOSE: Follow-up guidelines barely diverge from a one-size-fits-all approach, even though the risk of recurrence differs per patient. However, the personalization of breast cancer care improves outcomes for patients. This study explores the variation in follow-up pathways in the Netherlands using real-world data to determine guideline adherence and the gap between daily practice and risk-based surveillance, to demonstrate the benefits of personalized risk-based surveillance compared with usual care. METHODS: Patients with stage I-III invasive breast cancer who received surgical treatment in a general hospital between 2005 and 2020 were selected from the Netherlands Cancer Registry and included all imaging activities during follow-up from hospital-based electronic health records. Process analysis techniques were used to map patients and activities to investigate the real-world utilisation of resources and identify the opportunities for improvement. The INFLUENCE 2.0 nomogram was used for risk prediction of recurrence. RESULTS: In the period between 2005 and 2020, 3478 patients were included with a mean follow-up of 4.9 years. In the first 12 months following treatment, patients visited the hospital between 1 and 5 times (mean 1.3, IQR 1-1) and received between 1 and 9 imaging activities (mean 1.7, IQR 1-2). Mammogram was the prevailing imaging modality, accounting for 70% of imaging activities. Patients with a low predicted risk of recurrence visited the hospital more often. CONCLUSIONS: Deviations from the guideline were not in line with the risk of recurrence and revealed a large gap, indicating that it is hard for clinicians to accurately estimate this risk and therefore objective risk predictions could bridge this gap.

A direct comparison in diagnostic performance of CDUS, FDG-PET/CT and MRI in patients suspected of giant cell arteritis.

OBJECTIVES: This study directly compares diagnostic performance of Colour Duplex Ultrasound (CDUS), Fluor-18-deoxyglucose Positron Emission Tomography Computed Tomography (FDG-PET/CT) and Magnetic Resonance Imaging (MRI) in patients suspected of giant cell arteritis (GCA). METHODS: Patients with suspected GCA were included in a nested-case control pilot study. CDUS, whole body FDG-PET/CT and cranial MRI were performed within 5 working days after initial clinical evaluation. Clinical diagnosis after six months follow-up by experienced rheumatologists in the field of GCA, blinded for imaging, was used as reference standard. Diagnostic performance of the imaging modalities was determined. Stratification for GCA subtype was performed and imaging results were evaluated in different risk stratification groups. RESULTS: In total, 23 patients with GCA and 19 patients suspected of but not diagnosed with GCA were included. Sensitivity was 69.6% (95%CI 50.4%-88.8%) for CDUS, 52.2% (95%CI 31.4%-73.0%) for FDG-PET/CT and 56.5% (95%CI 35.8%-77.2%) for MRI. Specificity was 100% for CDUS, FDG-PET/CT and MRI. FDG-PET/CT was negative for GCA in all isolated cranial GCA patients (n = 8), while MRI was negative in all isolated extracranial GCA patients (n = 4). In 4 GCA patients with false-negative (n = 2; intermediate and high risk) or inconclusive (n = 2; low and intermediate risk) CDUS results, further imaging confirmed diagnosis. CONCLUSIONS: Sensitivity of CDUS was highest, while specificity was excellent in all imaging modalities. Nevertheless, confidence intervals of all imaging modalities were overlapping. Following EULAR recommendations, CDUS can be used as a first test to diagnose GCA. With insufficient evidence for GCA, further testing considering GCA subtype is warranted.

Comparing modeling strategies combining changes in multiple serum tumor biomarkers for early prediction of immunotherapy non-response in non-small cell lung cancer.

BACKGROUND: Patients treated with immune checkpoint inhibitors (ICI) are at risk of adverse events (AEs) even though not all patients will benefit. Serum tumor markers (STMs) are known to reflect tumor activity and might therefore be useful to predict response, guide treatment decisions and thereby prevent AEs. OBJECTIVE: This study aims to compare a range of prediction methods to predict non-response using multiple sequentially measured STMs. METHODS: Nine prediction models were compared to predict treatment non-response at 6-months (n = 412) using bi-weekly CYFRA, CEA, CA-125, NSE, and SCC measurements determined in the first 6-weeks of therapy. All methods were applied to six different biomarker combinations including two to five STMs. Model performance was assessed based on sensitivity, while model training aimed at 95% specificity to ensure a low false-positive rate. RESULTS: In the validation cohort, boosting provided the highest sensitivity at a fixed specificity across most STM combinations (12.9% -59.4%). Boosting applied to CYFRA and CEA achieved the highest sensitivity on the validation data while maintaining a specificity >95%. CONCLUSIONS: Non-response in NSCLC patients treated with ICIs can be predicted with a specificity >95% by combining multiple sequentially measured STMs in a prediction model. Clinical use is subject to further external validation.

Validating Health Economic Models With the Probabilistic Analysis Check dashBOARD.

OBJECTIVES: Health economic (HE) models are often considered as "black boxes" because they are not publicly available and lack transparency, which prevents independent scrutiny of HE models. Additionally, validation efforts and validation status of HE models are not systematically reported. Methods to validate HE models in absence of their full underlying code are therefore urgently needed to improve health policy making. This study aimed to develop and test a generic dashboard to systematically explore the workings of HE models and validate their model parameters and outcomes. METHODS: The Probabilistic Analysis Check dashBOARD (PACBOARD) was developed using insights from literature, health economists, and a data scientist. Functionalities of PACBOARD are (1) exploring and validating model parameters and outcomes using standardized validation tests and interactive plots, (2) visualizing and investigating the relationship between model parameters and outcomes using metamodeling, and (3) predicting HE outcomes using the fitted metamodel. To test PACBOARD, 2 mock HE models were developed, and errors were introduced in these models, eg, negative costs inputs, utility values exceeding 1. PACBOARD metamodeling predictions of incremental net monetary benefit were validated against the original model's outcomes. RESULTS: PACBOARD automatically identified all errors introduced in the erroneous HE models. Metamodel predictions were accurate compared with the original model outcomes. CONCLUSIONS: PACBOARD is a unique dashboard aiming at improving the feasibility and transparency of validation efforts of HE models. PACBOARD allows users to explore the working of HE models using metamodeling based on HE models' parameters and outcomes.

Willingness to participate in combination screening for lung cancer, chronic obstructive pulmonary disease and cardiovascular disease in four European countries.

OBJECTIVES: Lung cancer screening (LCS), using low-dose computed tomography (LDCT), can be more efficient by simultaneously screening for chronic obstructive pulmonary disease (COPD) and cardiovascular disease (CVD), the Big-3 diseases. This study aimed to determine the willingness to participate in (combinations of) Big-3 screening in four European countries and the relative importance of amendable participation barriers. METHODS: An online cross-sectional survey aimed at (former) smokers aged 50-75 years elicited the willingness of individuals to participate in Big-3 screening and used analytical hierarchy processing (AHP) to determine the importance of participation barriers. RESULTS: Respondents were from France (n = 391), Germany (n = 338), Italy (n = 399), and the Netherlands (n = 342), and consisted of 51.2% men. The willingness to participate in screening was marginally influenced by the diseases screened for (maximum difference of 3.1%, for Big-3 screening (73.4%) vs. lung cancer and COPD screening (70.3%)) and by country (maximum difference of 3.7%, between France (68.5%) and the Netherlands (72.3%)). The largest effect on willingness to participate was personal perceived risk of lung cancer. The most important barriers were the missed cases during screening (weight 0.19) and frequency of screening (weight 0.14), while diseases screened for (weight 0.11) ranked low. CONCLUSIONS: The difference in willingness to participate in LCS showed marginal increase with inclusion of more diseases and limited variation between countries. A marginal increase in participation might result in a marginal additional benefit of Big-3 screening. The amendable participation barriers are similar to previous studies, and the new criterion, diseases screened for, is relatively unimportant. CLINICAL RELEVANCE STATEMENT: Adding diseases to combination screening modestly improves participation, driven by personal perceived risk. These findings guide program design and campaigns for lung cancer and Big-3 screening. Benefits of Big-3 screening lie in long-term health and economic impact, not participation increase. KEY POINTS: • It is unknown whether or how combination screening might affect participation. • The addition of chronic obstructive pulmonary disease and cardiovascular disease to lung cancer screening resulted in a marginal increase in willingness to participate. • The primary determinant influencing individuals' engagement in such programs is their personal perceived risk of the disease.

Consolidated Health Economic Evaluation Reporting Standards - Value of Information (CHEERS-VOI): Explanation and Elaboration.

OBJECTIVES: Although the ISPOR Value of Information (VOI) Task Force's reports outline VOI concepts and provide good-practice recommendations, there is no guidance for reporting VOI analyses. VOI analyses are usually performed alongside economic evaluations for which the Consolidated Health Economic Evaluation Reporting Standards (CHEERS) 2022 Statement provides reporting guidelines. Thus, we developed the CHEERS-VOI checklist to provide reporting guidance and checklist to support the transparent, reproducible, and high-quality reporting of VOI analyses. METHODS: A comprehensive literature review generated a list of 26 candidate reporting items. These candidate items underwent a Delphi procedure with Delphi participants through 3 survey rounds. Participants rated each item on a 9-point Likert scale to indicate its relevance when reporting the minimal, essential information about VOI methods and provided comments. The Delphi results were reviewed at 2-day consensus meetings and the checklist was finalized using anonymous voting. RESULTS: We had 30, 25, and 24 Delphi respondents in rounds 1, 2, and 3, respectively. After incorporating revisions recommended by the Delphi participants, all 26 candidate items proceeded to the 2-day consensus meetings. The final CHEERS-VOI checklist includes all CHEERS items, but 7 items require elaboration when reporting VOI. Further, 6 new items were added to report information relevant only to VOI (eg, VOI methods applied). CONCLUSIONS: The CHEERS-VOI checklist should be used when a VOI analysis is performed alongside economic evaluations. The CHEERS-VOI checklist will help decision makers, analysts and peer reviewers in the assessment and interpretation of VOI analyses and thereby increase transparency and rigor in decision making.

Can we increase efficiency of CT lung cancer screening by combining with CVD and COPD screening? Results of an early economic evaluation.

OBJECTIVES: Estimating the maximum acceptable cost (MAC) per screened individual for low-dose computed tomography (LDCT) lung cancer (LC) screening, and determining the effect of additionally screening for chronic obstructive pulmonary disease (COPD), cardiovascular disease (CVD), or both on the MAC. METHODS: A model-based early health technology assessment (HTA) was conducted to estimate whether a new intervention could be cost-effective by calculating the MAC at a willingness-to-pay (WTP) of €20k/quality-adjusted life-year (QALY) and €80k/QALY, for a population of current and former smokers, aged 50-75 years in The Netherlands. The MAC was estimated based on incremental QALYs gained from a stage shift assuming screened individuals are detected in earlier disease stages. Data were obtained from literature and publicly available statistics and validated with experts. RESULTS: The MAC per individual for implementing LC screening at a WTP of €20k/QALY was €113. If COPD, CVD, or both were included in screening, the MAC increased to €230, €895, or €971 respectively. Scenario analyses assessed whether screening-specific disease high-risk populations would improve cost-effectiveness, showing that high-risk CVD populations were more likely to improve economic viability compared to COPD. CONCLUSIONS: The economic viability of combined screening is substantially larger than for LC screening alone, primarily due to benefits from CVD screening, and is dependent on the target screening population, which is key to optimise the screening program. The total cost of breast and cervical cancer screening is lower (€420) than the MAC of Big-3, indicating that Big-3 screening may be acceptable from a health economic perspective. KEY POINTS: • Once-off combined low-dose CT screening for lung cancer, COPD, and CVD in individuals aged 50-75 years is potentially cost-effective if screening would cost less than €971 per screened individual. • Multi-disease screening requires detailed insight into the co-occurrence of these diseases to identify the optimal target screening population. • With the same target screening population and WTP, lung cancer-only screening should cost less than €113 per screened individual to be cost-effective.

Systematic Review of Health Economic Evaluations Focused on Artificial Intelligence in Healthcare: The Tortoise and the Cheetah.

OBJECTIVES: This study aimed to systematically review recent health economic evaluations (HEEs) of artificial intelligence (AI) applications in healthcare. The aim was to discuss pertinent methods, reporting quality and challenges for future implementation of AI in healthcare, and additionally advise future HEEs. METHODS: A systematic literature review was conducted in 2 databases (PubMed and Scopus) for articles published in the last 5 years. Two reviewers performed independent screening, full-text inclusion, data extraction, and appraisal. The Consolidated Health Economic Evaluation Reporting Standards and Philips checklist were used for the quality assessment of included studies. RESULTS: A total of 884 unique studies were identified; 20 were included for full-text review, covering a wide range of medical specialties and care pathway phases. The most commonly evaluated type of AI was automated medical image analysis models (n = 9, 45%). The prevailing health economic analysis was cost minimization (n = 8, 40%) with the costs saved per case as preferred outcome measure. A total of 9 studies (45%) reported model-based HEEs, 4 of which applied a time horizon >1 year. The evidence supporting the chosen analytical methods, assessment of uncertainty, and model structures was underreported. The reporting quality of the articles was moderate as on average studies reported on 66% of Consolidated Health Economic Evaluation Reporting Standards items. CONCLUSIONS: HEEs of AI in healthcare are limited and often focus on costs rather than health impact. Surprisingly, model-based long-term evaluations are just as uncommon as model-based short-term evaluations. Consequently, insight into the actual benefits offered by AI is lagging behind current technological developments.

Comparing Modeling Approaches for Discrete Event Simulations With Competing Risks Based on Censored Individual Patient Data: A Simulation Study and Illustration in Colorectal Cancer.

OBJECTIVES: This study aimed to provide detailed guidance on modeling approaches for implementing competing events in discrete event simulations based on censored individual patient data (IPD). METHODS: The event-specific distributions (ESDs) approach sampled times from event-specific time-to-event distributions and simulated the first event to occur. The unimodal distribution and regression approach sampled a time from a combined unimodal time-to-event distribution, representing all events, and used a (multinomial) logistic regression model to select the event to be simulated. A simulation study assessed performance in terms of relative absolute event incidence difference and relative entropy of time-to-event distributions for different types and levels of right censoring, numbers of events, distribution overlap, and sample sizes. Differences in cost-effectiveness estimates were illustrated in a colorectal cancer case study. RESULTS: Increased levels of censoring negatively affected the modeling approaches' performance. A lower number of competing events and higher overlap of distributions improved performance. When IPD were censored at random times, ESD performed best. When censoring occurred owing to a maximum follow-up time for 2 events, ESD performed better for a low level of censoring (ie, 10%). For 3 or 4 competing events, ESD better represented the probabilities of events, whereas unimodal distribution and regression better represented the time to events. Differences in cost-effectiveness estimates, both compared with no censoring and between approaches, increased with increasing censoring levels. CONCLUSIONS: Modelers should be aware of the different modeling approaches available and that selection between approaches may be informed by data characteristics. Performing and reporting extensive validation efforts remains essential to ensure IPD are appropriately represented.

The value of time-dependent risk predictions in a screening context - a comprehensive simulation analysis validated on German cancer registry data.

BACKGROUND: Risk-prediction tools allow classifying individuals into risk groups based on risk thresholds. Such risk categorization is often used to inform screening schemes by offering screening only to individuals at increased risk of harmful events. Adding information concerning an individual's risk development over time would allow assessing not just who to screen but also when to screen. This paper illustrates the value of personalised, time-dependent risk predictions to optimize risk-based screening schemes. METHODS: In a simulation analysis, two different time-dependent risk-based screening approaches are compared to another risk-based, but time-independent approach regarding their impact on screening efficiency. For this purpose, 81 scenarios featuring 5000 patients with five consecutive annual risk estimations for a hypothetical disease D are simulated, using different parameters to model disease progression and risk distribution. This simulation analysis is validated using a real-world clinical case study based on German breast cancer patients and the INFLUENCE-nomogram for locoregional breast cancer recurrence. RESULTS: If individual risk estimations were used to personalise screening for a disease D aiming at detecting a 90% of curable cases, more than 20% of screening examinations could be avoided relative to a conventional uninformed approach, depending on the simulated scenario. Whereas an individual but time-independent approach is associated with acceptable saving potentials in case of a relatively homogenous risk distribution, the time-dependent approaches are superior when the complexity of a scenario increases. With slowly progressing diseases, risk-accumulation over time needs to be considered to achieve the highest screening efficiency on population level, for rapidly progressing diseases, an interval-specific approach is superior. The possible benefits of time-dependent risk-based screening were confirmed in the real-world clinical case study. CONCLUSIONS: Appropriate approaches to use time-dependent risk predictions may considerably enhance screening efficiency on individual and population level. Therefore, predicting risk development over time should be supported by future prediction tools and be incorporated in decision algorithms.

Developing a dynamic simulation model to support the nationwide implementation of whole genome sequencing in lung cancer.

BACKGROUND: This study shows how dynamic simulation modeling can be applied in the context of the nationwide implementation of Whole Genome Sequencing (WGS) for non-small cell lung cancer (NSCLC) to inform organizational decisions regarding the use of complex and disruptive health technologies and how these decisions affect their potential value. METHODS: Using the case of the nationwide implementation of WGS into clinical practice in lung cancer in the Dutch healthcare system, we developed a simulation model to show that including service delivery features across the diagnostic pathway can provide essential insight into the affordability and accessibility of care at the systems level. The model was implemented as a hybrid Agent-Based Model and Discrete-Event Simulation model in AnyLogic and included 78 hospital agents, 7 molecular tumor board agents, 1 WGS facility agent, and 5313 patient agents each year in simulation time. RESULTS: The model included patient and provider heterogeneity, including referral patterns, capacity constraints, and diagnostic workflows. Patient preference and adoption by healthcare professionals were also modeled. The model was used to analyze a scenario in which only academic hospitals have implemented WGS. To prevent delays in the diagnostic pathway, the capacity to sequence at least 1600 biopsies yearly should be present. There is a two-fold increase in mean diagnostic pathway duration between no patients referred or all patients referred for further diagnostics. CONCLUSIONS: The systems model can complement conventional health economic evaluations to investigate how the organization of the workflow can influence the actual use and impact of WGS. Insufficient capacity to provide WGS and referral patterns can substantially impact the duration of the diagnostic pathway and thus should be considered in the implementation of WGS.

Monitoring of rheumatoid arthritis: a patient survey on disease insight and possible added value of an innovative inflammation monitoring device.

To enable patients with rheumatoid arthritis (RA) and their healthcare professionals to choose the optimal treatment, it is crucial to accurately assess the current state of inflammatory activity. The objectives of this study were to (1) investigate the perspective of RA patients on their insight into the current status of their disease, and to (2) investigate the patients' perspective on the possible added value of a monitoring device based on optical spectral transmission-called the HandScan-that measures the location and severity of joint inflammation. A survey was distributed online among patients with RA in the Netherlands. Four-hundred and eight patients with RA completed the survey. Of these, 298 (73%) felt they have sufficient insight into their current disease status. Most respondents perceived either a large (n = 242; 59%) or small (n = 148; 36%) added value of the HandScan in their monitoring process, mostly because the device provides additional knowledge on the presence of inflammation. This perceived added value was higher for respondents experienced with the device (n = 46; p = .04). Respondents preferred monitoring with the device on every (n = 192; 47%) or most (n = 171; 42%) visits to the outpatient clinic, or even more often than on every visit (n = 17; 4%). Monitoring RA using an optical spectral transmission device is seen by patients as a possibly valuable addition to the monitoring process of inflammatory activity during visits to an outpatient clinic. Their main reason was that the device can increase insight into their current disease status. More insight may support patients in discussing treatment options with their rheumatologist.

The societal impact of implementing an at-home blood sampling device for chronic care patients: patient preferences and cost impact.

BACKGROUND: Diabetes mellitus, cardiovascular diseases, chronic kidney disease, and thyroid diseases are chronic diseases that require regular monitoring through blood tests. This paper first investigates the experiences of chronic care patients with venipuncture and their expectations of an at-home blood-sampling device, and then assesses the impact on societal costs of implementing such a device in current practice. METHODS: An online survey was distributed among chronic care patients to gain insight into their experience of blood sampling in current practice, and their expectations of an at-home blood-sampling device. The survey results were used as input parameters in a patient-level monte carlo analysis developed to represent a hypothetical cohort of Dutch chronically ill patients to investigate the impact on societal costs compared to usual care. RESULTS: In total, 1311 patients participated in the survey, of which 31% experience the time spent on the phlebotomy appointment as a burden. Of all respondents, 71% prefer to use an at-home blood-sampling device to monitor their chronic disease. The cost analysis indicated that implementing an at-home blood-sampling device increases the cost of phlebotomy itself by €27.25 per patient per year, but it reduces the overall societal costs by €24.86 per patient per year, mainly due to limiting productivity loss. CONCLUSIONS: Patients consider an at-home blood-sampling device to be more user-friendly than venous phlebotomy on location. Long waiting times and crowded locations can be avoided by using an at-home blood-sampling device. Implementing such a device is likely cost-saving as it is expected to reduce societal costs.

Whole genome sequencing in oncology: using scenario drafting to explore future developments.

BACKGROUND: In oncology, Whole Genome Sequencing (WGS) is not yet widely implemented due to uncertainties such as the required infrastructure and expertise, costs and reimbursements, and unknown pan-cancer clinical utility. Therefore, this study aimed to investigate possible future developments facilitating or impeding the use of WGS as a molecular diagnostic in oncology through scenario drafting. METHODS: A four-step process was adopted for scenario drafting. First, the literature was searched for barriers and facilitators related to the implementation of WGS. Second, they were prioritized by international experts, and third, combined into coherent scenarios. Fourth, the scenarios were implemented in an online survey and their likelihood of taking place within 5 years was elicited from another group of experts. Based on the minimum, maximum, and most likely (mode) parameters, individual Program Evaluation and Review Technique (PERT) probability density functions were determined. Subsequently, individual opinions were aggregated by performing unweighted linear pooling, from which summary statistics were extracted and reported. RESULTS: Sixty-two unique barriers and facilitators were extracted from 70 articles. Price, clinical utility, and turnaround time of WGS were ranked as the most important aspects. Nine scenarios were developed and scored on likelihood by 18 experts. The scenario about introducing WGS as a clinical diagnostic with a lower price, shorter turnaround time, and improved degree of actionability, scored the highest likelihood (median: 68.3%). Scenarios with low likelihoods and strong consensus were about better treatment responses to more actionable targets (26.1%), and the effect of centralizing WGS (24.1%). CONCLUSIONS: Based on current expert opinions, the implementation of WGS as a clinical diagnostic in oncology is heavily dependent on the price, clinical utility (both in terms of identifying actionable targets as in adding sufficient value in subsequent treatment), and turnaround time. These aspects and the optimal way of service provision are the main drivers for the implementation of WGS and should be focused on in further research. More knowledge regarding these factors is needed to inform strategic decision making regarding the implementation of WGS, which warrants support from all relevant stakeholders.

External validation of the Memorial Sloan Kettering Cancer Centre and Briganti nomograms for the prediction of lymph node involvement of prostate cancer using clinical stage assessed by magnetic resonance imaging.

OBJECTIVES: To evaluate the impact of using clinical stage assessed by multiparametric magnetic resonance imaging (mpMRI) on the performance of two established nomograms for the prediction of pelvic lymph node involvement (LNI) in patients with prostate cancer. PATIENTS AND METHODS: Patients undergoing robot-assisted extended pelvic lymph node dissection (ePLND) from 2015 to 2019 at three teaching hospitals were retrospectively evaluated. Risk of LNI was calculated four times for each patient, using clinical tumour stage (T-stage) assessed by digital rectal examination (DRE) and by mpMRI, in the Memorial Sloan Kettering Cancer Centre (MSKCC; 2018) and Briganti (2012) nomograms. Discrimination (area under the curve [AUC]), calibration, and the net benefit of these four strategies were assessed and compared. RESULTS: A total of 1062 patients were included, of whom 301 (28%) had histologically proven LNI. Using DRE T-stage resulted in AUCs of 0.71 (95% confidence interval [CI] 0.70-0.72) for the MSKCC and 0.73 (95% CI 0.72-0.74) for the Briganti nomogram. Using mpMRI T-stage, the AUCs were 0.72 (95% CI 0.71-0.73) for the MSKCC and 0.75 (95% CI 0.74-0.76) for the Briganti nomogram. mpMRI T-stage resulted in equivalent calibration compared with DRE T-stage. Combined use of mpMRI T-stage and the Briganti 2012 nomogram was shown to be superior in terms of AUC, calibration, and net benefit. Use of mpMRI T-stage led to increased sensitivity for the detection of LNI for all risk thresholds in both models, countered by a decreased specificity, compared with DRE T-stage. CONCLUSION: T-stage as assessed by mpMRI is an appropriate alternative for T-stage assessed by DRE to determine nomogram-based risk of LNI in patients with prostate cancer, and was associated with improved model performance of both the MSKCC 2018 and Briganti 2012 nomograms.

Using Metamodeling to Identify the Optimal Strategy for Colorectal Cancer Screening.

OBJECTIVES: Metamodeling can address computational challenges within decision-analytic modeling studies evaluating many strategies. This article illustrates the value of metamodeling for evaluating colorectal cancer screening strategies while accounting for colonoscopy capacity constraints. METHODS: In a traditional approach, the best screening strategy was identified from a limited subset of strategies evaluated with the validated Adenoma and Serrated pathway to Colorectal CAncer model. In a metamodeling approach, metamodels were fitted to this limited subset to evaluate all potentially plausible strategies and determine the best overall screening strategy. Approaches were compared based on the best screening strategy in life-years gained compared with no screening. Metamodel runtime and accuracy was assessed. RESULTS: The metamodeling approach evaluated >40 000 strategies in <1 minute with high accuracy after 1 adaptive sampling step (mean absolute error: 0.0002 life-years) using 300 samples in total (generation time: 8 days). Findings indicated that health outcomes could be improved without requiring additional colonoscopy capacity. Obtaining similar insights using the traditional approach could require at least 1000 samples (generation time: 28 days). Suggested benefits from screening at ages <40 years require adequate validation of the underlying Adenoma and Serrated pathway to Colorectal CAncer model before making policy recommendations. CONCLUSIONS: Metamodeling allows rapid assessment of a vast set of strategies, which may lead to identification of more favorable strategies compared to a traditional approach. Nevertheless, metamodel validation and identifying extrapolation beyond the support of the original decision-analytic model are critical to the interpretation of results. The screening strategies identified with metamodeling support ongoing discussions on decreasing the starting age of colorectal cancer screening.

Proactive screening for symptoms: A simple method to improve early detection of unrecognized cardiovascular disease in primary care. Results from the Lifelines Cohort Study.

Cardiovascular disease (CVD) often goes unrecognized, despite symptoms frequently being present. Proactive screening for symptoms might improve early recognition and prevent disease progression or acute cardiovascular events. We studied the diagnostic value of symptoms for the detection of unrecognized atrial fibrillation (AF), heart failure (HF), and coronary artery disease (CAD) and developed a corresponding screening questionnaire. We included 100,311 participants (mean age 52 ± 9 years, 58% women) from the population-based Lifelines Cohort Study. For each outcome (unrecognized AF/HF/CAD), we built a multivariable model containing demographics and symptoms. These models were combined into one 'three-disease' diagnostic model and questionnaire for all three outcomes. Results were validated in Lifelines participants with chronic obstructive pulmonary disease (COPD) and diabetes mellitus (DM). Unrecognized CVD was identified in 1325 participants (1.3%): AF in 131 (0.1%), HF in 599 (0.6%), and CAD in 687 (0.7%). Added to age, sex, and body mass index, palpitations were independent predictors for unrecognized AF; palpitations, chest pain, dyspnea, exercise intolerance, health-related stress, and self-expected health worsening for unrecognized HF; smoking, chest pain, exercise intolerance, and claudication for unrecognized CAD. Area under the curve for the combined diagnostic model was 0.752 (95% CI 0.737-0.766) in the total population and 0.757 (95% CI 0.734-0.781) in participants with COPD and DM. At the chosen threshold, the questionnaire had low specificity, but high sensitivity. In conclusion, a short questionnaire about demographics and symptoms can improve early detection of CVD and help pre-select people who should or should not undergo further screening for CVD.

Applying Risk-Based Follow-Up Strategies on the Dutch Breast Cancer Population: Consequences for Care and Costs.

OBJECTIVES: An important aim of follow-up after primary breast cancer treatment is early detection of locoregional recurrences (LRR). This study compares 2 personalized follow-up scheme simulations based on LRR risk predictions provided by a time-dependent prognostic model for breast cancer LRR and quantifies their possible follow-up efficiency. METHODS: Surgically treated early patients with breast cancer between 2003 and 2008 were selected from the Netherlands Cancer Registry. The INFLUENCE nomogram was used to estimate the 5-year annual LRR. Applying 2 thresholds, they were defined according to Youden's J-statistic and a predefined follow-up sensitivity of 95%, respectively. These patient's risk estimations served as the basis for scheduling follow-up visits; 2 personalized follow-up schemes were simulated. The number of potentially saved follow-up visits and corresponding cost savings for each follow-up scheme were compared with the current Dutch breast cancer guideline recommendation and the observed utilization of follow-up on a training and testing cohort. RESULTS: Using LRR risk-predictions for 30 379 Dutch patients with breast cancer from 2003 to 2006 (training cohort), 2 thresholds were calculated. The threshold according to Youden's approach yielded a follow-up sensitivity of 62.5% and a potential saving of 62.1% of follow-up visits and €24.8 million in 5 years. When the threshold corresponding to 95% follow-up sensitivity was used, 17% of follow-up visits and €7 million were saved compared with the guidelines. Similar results were obtained by applying these thresholds to the testing cohort of 11 462 patients from 2007 to 2008. Compared with the observed utilization of follow-up, the potential cost-savings decline moderately. CONCLUSIONS: Personalized follow-up schemes based on the INFLUENCE nomogram's individual risk estimations for breast cancer LRR could decrease the number of follow-up visits if one accepts a limited risk of delayed LRR detection.

Value of Information Analytical Methods: Report 2 of the ISPOR Value of Information Analysis Emerging Good Practices Task Force.

The allocation of healthcare resources among competing priorities requires an assessment of the expected costs and health effects of investing resources in the activities and of the opportunity cost of the expenditure. To date, much effort has been devoted to assessing the expected costs and health effects, but there remains an important need to also reflect the consequences of uncertainty in resource allocation decisions and the value of further research to reduce uncertainty. Decision making with uncertainty may turn out to be suboptimal, resulting in health loss. Consequently, there may be value in reducing uncertainty, through the collection of new evidence, to better inform resource decisions. This value can be quantified using value of information (VOI) analysis. This report from the ISPOR VOI Task Force describes methods for computing 4 VOI measures: the expected value of perfect information, expected value of partial perfect information (EVPPI), expected value of sample information (EVSI), and expected net benefit of sampling (ENBS). Several methods exist for computing EVPPI and EVSI, and this report provides guidance on selecting the most appropriate method based on the features of the decision problem. The report provides a number of recommendations for good practice when planning, undertaking, or reviewing VOI analyses. The software needed to compute VOI is discussed, and areas for future research are highlighted.

Value of Information Analysis for Research Decisions-An Introduction: Report 1 of the ISPOR Value of Information Analysis Emerging Good Practices Task Force.

Healthcare resource allocation decisions made under conditions of uncertainty may turn out to be suboptimal. In a resource constrained system in which there is a fixed budget, these suboptimal decisions will result in health loss. Consequently, there may be value in reducing uncertainty, through the collection of new evidence, to make better resource allocation decisions. This value can be quantified using a value of information (VOI) analysis. This report, from the ISPOR VOI Task Force, introduces VOI analysis, defines key concepts and terminology, and outlines the role of VOI for supporting decision making, including the steps involved in undertaking and interpreting VOI analyses. The report is specifically aimed at those tasked with making decisions about the adoption of healthcare or the funding of healthcare research. The report provides a number of recommendations for good practice when planning, undertaking, or reviewing the results of VOI analyses.