Real-world post-deployment performance of a novel machine learning-based digital health technology for skin lesion assessment and suggestions for post-market surveillance.

Introduction: Deep Ensemble for Recognition of Malignancy (DERM) is an artificial intelligence as a medical device (AIaMD) tool for skin lesion assessment. Methods: We report prospective real-world performance from its deployment within skin cancer pathways at two National Health Service hospitals (UK) between July 2021 and October 2022. Results: A total of 14,500 cases were seen, including patients 18-100 years old with Fitzpatrick skin types I-VI represented. Based on 8,571 lesions assessed by DERM with confirmed outcomes, versions A and B demonstrated very high sensitivity for detecting melanoma (95.0-100.0%) or malignancy (96.0-100.0%). Benign lesion specificity was 40.7-49.4% (DERM-vA) and 70.1-73.4% (DERM-vB). DERM identified 15.0-31.0% of cases as eligible for discharge. Discussion: We show DERM performance in-line with sensitivity targets and pre-marketing authorisation research, and it reduced the caseload for hospital specialists in two pathways. Based on our experience we offer suggestions on key elements of post-market surveillance for AIaMDs.

Health technology assessment of diagnostic tests: a state of the art review of methods guidance from international organizations.

OBJECTIVES: To identify which international health technology assessment (HTA) agencies are undertaking evaluations of medical tests, summarize commonalities and differences in methodological approach, and highlight examples of good practice. METHODS: A methodological review incorporating: systematic identification of HTA guidance documents mentioning evaluation of tests; identification of key contributing organizations and abstraction of approaches to all essential HTA steps; summary of similarities and differences between organizations; and identification of important emergent themes which define the current state of the art and frontiers where further development is needed. RESULTS: Seven key organizations were identified from 216 screened. The main themes were: elucidation of claims of test benefits; attitude to direct and indirect evidence of clinical effectiveness (including evidence linkage); searching; quality assessment; and health economic evaluation. With the exception of dealing with test accuracy data, approaches were largely based on general approaches to HTA with few test-specific modifications. Elucidation of test claims and attitude to direct and indirect evidence are where we identified the biggest dissimilarities in approach. CONCLUSIONS: There is consensus on some aspects of HTA of tests, such as dealing with test accuracy, and examples of good practice which HTA organizations new to test evaluation can emulate. The focus on test accuracy contrasts with universal acknowledgment that it is not a sufficient evidence base for test evaluation. There are frontiers where methodological development is urgently required, notably integrating direct and indirect evidence and standardizing approaches to evidence linkage.

Variation in Model-Based Economic Evaluations of Low-Dose Computed Tomography Screening for Lung Cancer: A Methodological Review.

OBJECTIVES: There is significant heterogeneity in the results of published model-based economic evaluations of low-dose computed tomography (LDCT) screening for lung cancer. We sought to understand and demonstrate how these models differ. METHODS: An expansion and update of a previous systematic review (N = 19). Databases (including MEDLINE and Embase) were searched. Studies were included if strategies involving (single or multiple) LDCT screening were compared with no screening or other imaging modalities, in a population at risk of lung cancer. More detailed data extraction of studies from the previous review was conducted. Studies were critically appraised using the Consensus Health Economic Criteria list. RESULTS: A total of 16 new studies met the inclusion criteria, giving a total of 35 studies. There are geographic and temporal differences and differences in screening intervals and eligible populations. Studies varied in the types of models used, for example, decision tree, Markov, and microsimulation models. Most conducted a cost-effectiveness analysis (using life-years gained) or cost-utility analysis. The potential for overdiagnosis was considered in many models, unlike with other potential consequences of screening. Some studies report considering lead-time bias, but fewer mention length bias. Generally, the more recent studies, involving more complex modeling, tended to meet more of the critical appraisal criteria, with notable exceptions. CONCLUSIONS: There are many differences across the economic evaluations contributing to variation in estimates of the cost-effectiveness of LDCT screening for lung cancer. Several methodological factors and evidence needs have been highlighted that will require consideration in future economic evaluations to achieve better agreement.

An evaluation of a national mass media campaign to raise public awareness of possible lung cancer symptoms in England in 2016 and 2017.

BACKGROUND: A two-phase 'respiratory symptoms' mass media campaign was conducted in 2016 and 2017 in England raising awareness of cough and worsening shortness of breath as symptoms warranting a general practitioner (GP) visit. METHOD: A prospectively planned pre-post evaluation was done using routinely collected data on 15 metrics, including GP attendance, GP referral, emergency presentations, cancers diagnosed (five metrics), cancer stage, investigations (two metrics), outpatient attendances, inpatient admissions, major lung resections and 1-year survival. The primary analysis compared 2015 with 2017. Trends in metrics over the whole period were also considered. The effects of the campaign on awareness of lung cancer symptoms were evaluated using bespoke surveys. RESULTS: There were small favourable statistically significant and clinically important changes over 2 years in 11 of the 15 metrics measured, including a 2.11% (95% confidence interval 1.02-3.20, p < 0.001) improvement in the percentage of lung cancers diagnosed at an early stage. However, these changes were not accompanied by increases in GP attendances. Furthermore, the time trends showed a gradual change in the metrics rather than steep changes occurring during or after the campaigns. CONCLUSION: There were small positive changes in most metrics relating to lung cancer diagnosis after this campaign. However, the pattern over time challenges whether the improvements are wholly attributable to the campaign. Given the importance of education on cancer in its own right, raising awareness of symptoms should remain important. However further research is needed to maximise the effect on health outcomes.

Lung cancer screening by low-dose computed tomography: a cost-effectiveness analysis of alternative programmes in the UK using a newly developed natural history-based economic model.

BACKGROUND: A systematic review of economic evaluations for lung cancer identified no economic models of the UK setting based on disease natural history. We first sought to develop a new model of natural history for population screening, then sought to explore the cost-effectiveness of multiple alternative potential programmes. METHODS: An individual patient model (ENaBL) was constructed in MS Excel® and calibrated against data from the US National Lung Screening Trial. Costs were taken from the UK Lung Cancer Screening Trial and took the perspective of the NHS and PSS. Simulants were current or former smokers aged between 55 and 80 years and so at a higher risk of lung cancer relative to the general population. Subgroups were defined by further restricting age and risk of lung cancer as predicted by patient self-questionnaire. Programme designs were single, triple, annual and biennial arrangements of LDCT screens, thereby examining number and interval length. Forty-eight distinct screening strategies were compared to the current practice of no screening. The primary outcome was incremental cost-effectiveness of strategies (additional cost per QALY gained). RESULTS: LDCT screening is predicted to bring forward the stage distribution at diagnosis and reduce lung cancer mortality, with decreases versus no screening ranging from 4.2 to 7.7% depending on screen frequency. Overall healthcare costs are predicted to increase; treatment cost savings from earlier detection are outweighed by the costs of over-diagnosis. Single-screen programmes for people 55-75 or 60-75 years with ≥ 3% predicted lung cancer risk may be cost-effective at the £30,000 per QALY threshold (respective ICERs of £28,784 and £28,169 per QALY gained). Annual and biennial screening programmes were not predicted to be cost-effective at any cost-effectiveness threshold. LIMITATIONS: LDCT performance was unaffected by lung cancer type, stage or location and the impact of a national screening programme of smoking behaviour was not included. CONCLUSION: Lung cancer screening may not be cost-effective at the threshold of £20,000 per QALY commonly used in the UK but may be cost-effective at the higher threshold of £30,000 per QALY.

Strategies to identify individuals with monogenic diabetes: results of an economic evaluation.

OBJECTIVES: To evaluate and compare the lifetime costs associated with strategies to identify individuals with monogenic diabetes and change their treatment to more appropriate therapy. DESIGN: A decision analytical model from the perspective of the National Health Service (NHS) in England and Wales was developed and analysed. The model was informed by the literature, routinely collected data and a clinical study conducted in parallel with the modelling. SETTING: Secondary care in the UK. PARTICIPANTS: Simulations based on characteristics of patients diagnosed with diabetes <30 years old. INTERVENTIONS: Four test-treatment strategies to identify individuals with monogenic diabetes in a prevalent cohort of diabetics diagnosed under the age of 30 years were modelled: clinician-based genetic test referral, targeted genetic testing based on clinical prediction models, targeted genetic testing based on biomarkers, and blanket genetic testing. The results of the test-treatment strategies were compared with a strategy of no genetic testing. PRIMARY AND SECONDARY OUTCOME MEASURES: Discounted lifetime costs, proportion of cases of monogenic diabetes identified. RESULTS: Based on current evidence, strategies using clinical characteristics or biomarkers were estimated to save approximately £100-£200 per person with diabetes over a lifetime compared with no testing. Sensitivity analyses indicated that the prevalence of monogenic diabetes, the uptake of testing, and the frequency of home blood glucose monitoring had the largest impact on the results (ranging from savings of £400-£50 per person), but did not change the overall findings. The model is limited by many model inputs being based on very few individuals, and some long-term data informed by clinical opinion. CONCLUSIONS: Costs to the NHS could be saved with targeted genetic testing based on clinical characteristics or biomarkers. More research should focus on the economic case for the use of such strategies closer to the time of diabetes diagnosis. TRIAL REGISTRATION NUMBER: NCT01238380.

Cost-effectiveness analysis of reflex testing for Lynch syndrome in women with endometrial cancer in the UK setting.

BACKGROUND: Lynch syndrome is a hereditary cancer syndrome caused by constitutional pathogenic variants in the DNA mismatch repair (MMR) system, leading to increased risk of colorectal, endometrial and other cancers. The study aimed to identify the incremental costs and consequences of strategies to identify Lynch syndrome in women with endometrial cancer. METHODS: A decision-analytic model was developed to evaluate the relative cost-effectiveness of reflex testing strategies for identifying Lynch syndrome in women with endometrial cancer taking the NHS perspective and a lifetime horizon. Model input parameters were sourced from various published sources. Consequences were measured using quality-adjusted life years (QALYs). A cost-effectiveness threshold of £20 000/QALY was used. RESULTS: Reflex testing for Lynch syndrome using MMR immunohistochemistry and MLH1 methylation testing was cost-effective versus no testing, costing £14 200 per QALY gained. There was uncertainty due to parameter imprecision, with an estimated 42% chance this strategy is not cost-effective compared with no testing. Age had a significant impact on cost-effectiveness, with testing not predicted to be cost-effective in patients aged 65 years and over. CONCLUSIONS: Testing for Lynch syndrome in younger women with endometrial cancer using MMR immunohistochemistry and MLH1 methylation testing may be cost-effective. Age cut-offs may be controversial and adversely affect implementation.

Three biomarker tests to help diagnose preterm labour: a systematic review and economic evaluation.

BACKGROUND: Preterm birth may result in short- and long-term health problems for the child. Accurate diagnoses of preterm births could prevent unnecessary (or ensure appropriate) admissions into hospitals or transfers to specialist units. OBJECTIVES: The purpose of this report is to assess the test accuracy, clinical effectiveness and cost-effectiveness of the diagnostic tests PartoSure™ (Parsagen Diagnostics Inc., Boston, MA, USA), Actim® Partus (Medix Biochemica, Espoo, Finland) and the Rapid Fetal Fibronectin (fFN)® 10Q Cassette Kit (Hologic, Inc., Marlborough, MA, USA) at thresholds ≠50 ng/ml [quantitative fFN (qfFN)] for women presenting with signs and symptoms of preterm labour relative to fFN at 50 ng/ml. METHODS: Systematic reviews of the published literature were conducted for diagnostic test accuracy (DTA) studies of PartoSure, Actim Partus and qfFN for predicting preterm birth, the clinical effectiveness following treatment decisions informed by test results and economic evaluations of the tests. A model-based economic evaluation was also conducted to extrapolate long-term outcomes from the results of the diagnostic tests. The model followed the structure of the model that informed the 2015 National Institute for Health and Care Excellence guidelines on preterm labour diagnosis and treatment, but with antenatal steroids use, as opposed to tocolysis, driving health outcomes. RESULTS: Twenty studies were identified evaluating DTA against the reference standard of delivery within 7 days and seven studies were identified evaluating DTA against the reference standard of delivery within 48 hours. Two studies assessed two of the index tests within the same population. One study demonstrated that depending on the threshold used, qfFN was more or less accurate than Actim Partus, whereas the other indicated little difference between PartoSure and Actim Partus. No study assessing qfFN and PartoSure in the same population was identified. The test accuracy results from the other included studies revealed a high level of uncertainty, primarily attributable to substantial methodological, clinical and statistical heterogeneity between studies. No study compared all three tests simultaneously. No clinical effectiveness studies evaluating any of the three biomarker tests were identified. One partial economic evaluation was identified for predicting preterm birth. It assessed the number needed to treat to prevent a respiratory distress syndrome case with a 'treat-all' strategy, relative to testing with qualitative fFN. Because of the lack of data, our de novo model involved the assumption that management of pregnant women fully adhered to the results of the tests. In the base-case analysis for a woman at 30 weeks' gestation, Actim Partus had lower health-care costs and fewer quality-adjusted life-years (QALYs) than qfFN at 50 ng/ml, reducing costs at a rate of £56,030 per QALY lost compared with qfFN at 50 ng/ml. PartoSure is less costly than Actim Partus while being equally effective, but this is based on diagnostic accuracy data from a small study. Treatment with qfFN at 200 ng/ml and 500 ng/ml resulted in lower cost savings per QALY lost relative to fFN at 50 ng/ml than treatment with Actim Partus. In contrast, qfFN at 10 ng/ml increased QALYs, by 0.002, and had a cost per QALY gained of £140,267 relative to fFN at 50 ng/ml. Similar qualitative results were obtained for women presenting at different gestational ages. CONCLUSION: There is a high degree of uncertainty surrounding the test accuracy and cost-effectiveness results. We are aware of four ongoing UK trials, two of which plan to enrol > 1000 participants. The results of these trials may significantly alter the findings presented here. STUDY REGISTRATION: The study is registered as PROSPERO CRD42017072696. FUNDING: The National Institute for Health Research Health Technology Assessment programme.

Infants may suffer from health problems if they are born early. If a mother has symptoms of labour before her baby is due, a test could be used to predict if the symptoms are real or a false alarm. A test could help the doctor to decide whether the mother needs treatment or to move to a specialist hospital or if she could be sent home (if it is a false alarm). Our report compares three tests [PartoSure™ (Parsagen Diagnostics Inc., Boston, MA, USA), Actim^® Partus (Medix Biochemica, Espoo, Finland) and the Fetal Fibronectin (fFN) Test (Hologic, Inc., Marlborough, MA, USA)] on how well they predict an early birth and how the costs and the long-term health outcomes of the child compare between and among tests. All the published literature reporting the accuracy of the three tests and their costs was reviewed. We developed a new cost-effectiveness model, which estimated the long-term health outcomes of the child based on the test results. Twenty of the studies reviewed looked at how good the tests were at predicting an early birth within the next 7 days, and six looked at predicting birth within 48 hours. The designs of the studies and the women taking part in the studies varied greatly. This meant that comparing the accuracy of the tests was very difficult and it would be unfair to decide which test was the best. Our model suggested no firm conclusions for the cost-effectiveness of fFN compared with Actim Partus. PartoSure appears to be less costly than Actim Partus and equally good at predicting preterm birth, but this is based on a study of very few patients. There were no data that allowed us to compare all three tests together. The accuracy of the results is uncertain, mainly because all the studies are very different. We are aware of four related UK trials that are currently ongoing that plan to include large numbers of women.

Low-dose computed tomography for lung cancer screening in high-risk populations: a systematic review and economic evaluation.

BACKGROUND: Diagnosis of lung cancer frequently occurs in its later stages. Low-dose computed tomography (LDCT) could detect lung cancer early. OBJECTIVES: To estimate the clinical effectiveness and cost-effectiveness of LDCT lung cancer screening in high-risk populations. DATA SOURCES: Bibliographic sources included MEDLINE, EMBASE, Web of Science and The Cochrane Library. METHODS: Clinical effectiveness - a systematic review of randomised controlled trials (RCTs) comparing LDCT screening programmes with usual care (no screening) or other imaging screening programmes [such as chest X-ray (CXR)] was conducted. Bibliographic sources included MEDLINE, EMBASE, Web of Science and The Cochrane Library. Meta-analyses, including network meta-analyses, were performed. Cost-effectiveness - an independent economic model employing discrete event simulation and using a natural history model calibrated to results from a large RCT was developed. There were 12 different population eligibility criteria and four intervention frequencies [(1) single screen, (2) triple screen, (3) annual screening and (4) biennial screening] and a no-screening control arm. RESULTS: Clinical effectiveness - 12 RCTs were included, four of which currently contribute evidence on mortality. Meta-analysis of these demonstrated that LDCT, with ≤ 9.80 years of follow-up, was associated with a non-statistically significant decrease in lung cancer mortality (pooled relative risk 0.94, 95% confidence interval 0.74 to 1.19). The findings also showed that LDCT screening demonstrated a non-statistically significant increase in all-cause mortality. Given the considerable heterogeneity detected between studies for both outcomes, the results should be treated with caution. Network meta-analysis, including six RCTs, was performed to assess the relative clinical effectiveness of LDCT, CXR and usual care. The results showed that LDCT was ranked as the best screening strategy in terms of lung cancer mortality reduction. CXR had a 99.7% probability of being the worst intervention and usual care was ranked second. Cost-effectiveness - screening programmes are predicted to be more effective than no screening, reduce lung cancer mortality and result in more lung cancer diagnoses. Screening programmes also increase costs. Screening for lung cancer is unlikely to be cost-effective at a threshold of £20,000/quality-adjusted life-year (QALY), but may be cost-effective at a threshold of £30,000/QALY. The incremental cost-effectiveness ratio for a single screen in smokers aged 60-75 years with at least a 3% risk of lung cancer is £28,169 per QALY. Sensitivity and scenario analyses were conducted. Screening was only cost-effective at a threshold of £20,000/QALY in only a minority of analyses. LIMITATIONS: Clinical effectiveness - the largest of the included RCTs compared LDCT with CXR screening rather than no screening. Cost-effectiveness - a representative cost to the NHS of lung cancer has not been recently estimated according to key variables such as stage at diagnosis. Certain costs associated with running a screening programme have not been included. CONCLUSIONS: LDCT screening may be clinically effective in reducing lung cancer mortality, but there is considerable uncertainty. There is evidence that a single round of screening could be considered cost-effective at conventional thresholds, but there is significant uncertainty about the effect on costs and the magnitude of benefits. FUTURE WORK: Clinical effectiveness and cost-effectiveness estimates should be updated with the anticipated results from several ongoing RCTs [particularly the NEderlands Leuvens Longkanker Screenings ONderzoek (NELSON) screening trial]. STUDY REGISTRATION: This study is registered as PROSPERO CRD42016048530. FUNDING: The National Institute for Health Research Health Technology Assessment programme.

Cost-effectiveness of diagnostic and therapeutic interventions for chronic hepatitis C: a systematic review of model-based analyses.

BACKGROUND: Decisions about which subgroup of chronic hepatitis C (CHC) patients should be treated with direct acting anti-viral agents (DAAs) have economic importance due to high drug prices. Treat-all DAA strategies for CHC have gained acceptance despite high drug acquisition costs. However, there are also costs associated with the surveillance of CHC to determine a subgroup of patients with significant impairment. The aim of this systematic review was to describe the modelling methods used and summarise results in cost-effectiveness analyses (CEAs) of both CHC treatment with DAAs and surveillance of liver disease. METHODS: Electronic databases including Embase and Medline were searched from inception to May 2015. Eligible studies included models predicting costs and/or outcomes for interventions, surveillance, or management of people with CHC. Narrative and quantitative synthesis were conducted. Quality appraisal was conducted using validated checklists. The review was conducted following principles published by NHS Centre for Research and Dissemination. RESULTS: Forty-one CEAs met the eligibility criteria for the review; 37 evaluated an intervention and four evaluated surveillance strategies for targeting DAA treatment to those likely to gain most benefit. Included studies were of variable quality mostly due to reporting omissions. Of the 37 CEAs, eight models that enabled comparative analysis were fully appraised and synthesized. These models provided non-unique cost-effectiveness estimates in a specific DAA comparison in a specific population defined in terms of genotype, prior treatment status, and presence or absence of cirrhosis. Marked heterogeneity in cost-effectiveness estimates was observed despite this stratification. Approximately half of the estimates suggested that DAAs were cost-effective considering a threshold of US$30,000 and 73% with threshold of US$50,000. Two models evaluating surveillance strategies suggested that treating all CHC patients regardless of the staging of liver disease could be cost-effective. CONCLUSIONS: CEAs of CHC treatments need to better account for variability in their estimates. This analysis suggested that there are still circumstances where DAAs are not cost-effective. Surveillance in place of a treat-all strategy may still need to be considered as an option for deploying DAAs, particularly where acquisition cost is at the limit of affordability for a given health system.

Micro-costing analysis of guideline-based treatment by direct-acting agents: the real-life case of hepatitis C management in Brazil.

BACKGROUND: Eradication of hepatitis C virus (HCV) using direct-acting agents (DAA) has been associated with a financial burden to health authorities worldwide. We aimed to evaluate the guideline-based treatment costs by DAAs from the perspective of the Brazilian Ministry of Health (BMoH). METHODS: The activity based costing method was used to estimate the cost for monitoring/treatment of genotype-1 (GT1) HCV patients by the following strategies: peg-interferon (PEG-IFN)/ribavirin (RBV) for 48 weeks, PEG-IFN/RBV plus boceprevir (BOC) or telaprevir (TEL) for 48 weeks, and sofosbuvir (SOF) plus daclastavir (DCV) or simeprevir (SIM) for 12 weeks. Costs were reported in United States Dollars without (US$) and with adjustment for purchasing power parity (PPP$). Drug costs were collected at the National Database of Health Prices and an overview of the literature was performed to assess effectiveness of SOF/DCV and SOF/SIM regimens in real-world cohorts. RESULTS: Treatment costs of GT1-HCV patients were PPP$ 43,176.28 (US$ 24,020.16) for PEG-IFN/RBV, PPP$ 71,196.03 (US$ 39,578.23) for PEG-IFN/RBV/BOC and PPP$ 86,250.33 (US$ 47,946.92) for PEG-IFN/RBV/TEL. Treatment by all-oral interferon-free regimens were the less expensive approach: PPP$ 19,761.72 (US$ 10,985.90) for SOF/DCV and PPP$ 21,590.91 (US$ 12,002.75) for SOF/SIM. The overview reported HCV eradication in up to 98% for SOF/DCV and 96% for SOF/SIM. CONCLUSION: Strategies with all oral interferon-free might lead to lower costs for management of GT1-HCV patients compared to IFN-based regimens in Brazil. This occurred mainly because of high discounts over international DAA prices due to negotiation between BMoH and pharmaceutical industries.

Molecular testing for Lynch syndrome in people with colorectal cancer: systematic reviews and economic evaluation.

BACKGROUND: Inherited mutations in deoxyribonucleic acid (DNA) mismatch repair (MMR) genes lead to an increased risk of colorectal cancer (CRC), gynaecological cancers and other cancers, known as Lynch syndrome (LS). Risk-reducing interventions can be offered to individuals with known LS-causing mutations. The mutations can be identified by comprehensive testing of the MMR genes, but this would be prohibitively expensive in the general population. Tumour-based tests - microsatellite instability (MSI) and MMR immunohistochemistry (IHC) - are used in CRC patients to identify individuals at high risk of LS for genetic testing. MLH1 (MutL homologue 1) promoter methylation and BRAF V600E testing can be conducted on tumour material to rule out certain sporadic cancers. OBJECTIVES: To investigate whether testing for LS in CRC patients using MSI or IHC (with or without MLH1 promoter methylation testing and BRAF V600E testing) is clinically effective (in terms of identifying Lynch syndrome and improving outcomes for patients) and represents a cost-effective use of NHS resources. REVIEW METHODS: Systematic reviews were conducted of the published literature on diagnostic test accuracy studies of MSI and/or IHC testing for LS, end-to-end studies of screening for LS in CRC patients and economic evaluations of screening for LS in CRC patients. A model-based economic evaluation was conducted to extrapolate long-term outcomes from the results of the diagnostic test accuracy review. The model was extended from a model previously developed by the authors. RESULTS: Ten studies were identified that evaluated the diagnostic test accuracy of MSI and/or IHC testing for identifying LS in CRC patients. For MSI testing, sensitivity ranged from 66.7% to 100.0% and specificity ranged from 61.1% to 92.5%. For IHC, sensitivity ranged from 80.8% to 100.0% and specificity ranged from 80.5% to 91.9%. When tumours showing low levels of MSI were treated as a positive result, the sensitivity of MSI testing increased but specificity fell. No end-to-end studies of screening for LS in CRC patients were identified. Nine economic evaluations of screening for LS in CRC were identified. None of the included studies fully matched the decision problem and hence a new economic evaluation was required. The base-case results in the economic evaluation suggest that screening for LS in CRC patients using IHC, BRAF V600E and MLH1 promoter methylation testing would be cost-effective at a threshold of £20,000 per quality-adjusted life-year (QALY). The incremental cost-effectiveness ratio for this strategy was £11,008 per QALY compared with no screening. Screening without tumour tests is not predicted to be cost-effective. LIMITATIONS: Most of the diagnostic test accuracy studies identified were rated as having a risk of bias or were conducted in unrepresentative samples. There was no direct evidence that screening improves long-term outcomes. No probabilistic sensitivity analysis was conducted. CONCLUSIONS: Systematic review evidence suggests that MSI- and IHC-based testing can be used to identify LS in CRC patients, although there was heterogeneity in the methods used in the studies identified and the results of the studies. There was no high-quality empirical evidence that screening improves long-term outcomes and so an evidence linkage approach using modelling was necessary. Key determinants of whether or not screening is cost-effective are the accuracy of tumour-based tests, CRC risk without surveillance, the number of relatives identified for cascade testing, colonoscopic surveillance effectiveness and the acceptance of genetic testing. Future work should investigate screening for more causes of hereditary CRC and screening for LS in endometrial cancer patients. STUDY REGISTRATION: This study is registered as PROSPERO CRD42016033879. FUNDING: The National Institute for Health Research Health Technology Assessment programme.

Population-Based Assessment of a Biomarker-Based Screening Pathway to Aid Diagnosis of Monogenic Diabetes in Young-Onset Patients.

OBJECTIVE: Monogenic diabetes, a young-onset form of diabetes, is often misdiagnosed as type 1 diabetes, resulting in unnecessary treatment with insulin. A screening approach for monogenic diabetes is needed to accurately select suitable patients for expensive diagnostic genetic testing. We used C-peptide and islet autoantibodies, highly sensitive and specific biomarkers for discriminating type 1 from non-type 1 diabetes, in a biomarker screening pathway for monogenic diabetes. RESEARCH DESIGN AND METHODS: We studied patients diagnosed at age 30 years or younger, currently younger than 50 years, in two U.K. regions with existing high detection of monogenic diabetes. The biomarker screening pathway comprised three stages: 1) assessment of endogenous insulin secretion using urinary C-peptide/creatinine ratio (UCPCR); 2) if UCPCR was ≥0.2 nmol/mmol, measurement of GAD and IA2 islet autoantibodies; and 3) if negative for both autoantibodies, molecular genetic diagnostic testing for 35 monogenic diabetes subtypes. RESULTS: A total of 1,407 patients participated (1,365 with no known genetic cause, 34 with monogenic diabetes, and 8 with cystic fibrosis-related diabetes). A total of 386 out of 1,365 (28%) patients had a UCPCR ≥0.2 nmol/mmol, and 216 out of 386 (56%) were negative for GAD and IA2 and underwent molecular genetic testing. Seventeen new cases of monogenic diabetes were diagnosed (8 common Maturity Onset Diabetes of the Young [Sanger sequencing] and 9 rarer causes [next-generation sequencing]) in addition to the 34 known cases (estimated prevalence of 3.6% [51/1,407] [95% CI 2.7-4.7%]). The positive predictive value was 20%, suggesting a 1-in-5 detection rate for the pathway. The negative predictive value was 99.9%. CONCLUSIONS: The biomarker screening pathway for monogenic diabetes is an effective, cheap, and easily implemented approach to systematically screening all young-onset patients. The minimum prevalence of monogenic diabetes is 3.6% of patients diagnosed at age 30 years or younger.

Systematic Review of Health Economic Impact Evaluations of Risk Prediction Models: Stop Developing, Start Evaluating.

BACKGROUND: Although health economic evaluations (HEEs) are increasingly common for therapeutic interventions, they appear to be rare for the use of risk prediction models (PMs). OBJECTIVES: To evaluate the current state of HEEs of PMs by performing a comprehensive systematic review. METHODS: Four databases were searched for HEEs of PM-based strategies. Two reviewers independently selected eligible articles. A checklist was compiled to score items focusing on general characteristics of HEEs of PMs, model characteristics and quality of HEEs, evidence on PMs typically used in the HEEs, and the specific challenges in performing HEEs of PMs. RESULTS: After screening 791 abstracts, 171 full texts, and reference checking, 40 eligible HEEs evaluating 60 PMs were identified. In these HEEs, PM strategies were compared with current practice (n = 32; 80%), to other stratification methods for patient management (n = 19; 48%), to an extended PM (n = 9; 23%), or to alternative PMs (n = 5; 13%). The PMs guided decisions on treatment (n = 42; 70%), further testing (n = 18; 30%), or treatment prioritization (n = 4; 7%). For 36 (60%) PMs, only a single decision threshold was evaluated. Costs of risk prediction were ignored for 28 (46%) PMs. Uncertainty in outcomes was assessed using probabilistic sensitivity analyses in 22 (55%) HEEs. CONCLUSIONS: Despite the huge number of PMs in the medical literature, HEE of PMs remains rare. In addition, we observed great variety in their quality and methodology, which may complicate interpretation of HEE results and implementation of PMs in practice. Guidance on HEE of PMs could encourage and standardize their application and enhance methodological quality, thereby improving adequate use of PM strategies.

Immunosuppressive therapy for kidney transplantation in adults: a systematic review and economic model.

BACKGROUND: End-stage renal disease is a long-term irreversible decline in kidney function requiring renal replacement therapy: kidney transplantation, haemodialysis or peritoneal dialysis. The preferred option is kidney transplantation, followed by immunosuppressive therapy (induction and maintenance therapy) to reduce the risk of kidney rejection and prolong graft survival. OBJECTIVES: To review and update the evidence for the clinical effectiveness and cost-effectiveness of basiliximab (BAS) (Simulect(®), Novartis Pharmaceuticals UK Ltd) and rabbit anti-human thymocyte immunoglobulin (rATG) (Thymoglobulin(®), Sanofi) as induction therapy, and immediate-release tacrolimus (TAC) (Adoport(®), Sandoz; Capexion(®), Mylan; Modigraf(®), Astellas Pharma; Perixis(®), Accord Healthcare; Prograf(®), Astellas Pharma; Tacni(®), Teva; Vivadex(®), Dexcel Pharma), prolonged-release tacrolimus (Advagraf(®) Astellas Pharma), belatacept (BEL) (Nulojix(®), Bristol-Myers Squibb), mycophenolate mofetil (MMF) (Arzip(®), Zentiva; CellCept(®), Roche Products; Myfenax(®), Teva), mycophenolate sodium (MPS) (Myfortic(®), Novartis Pharmaceuticals UK Ltd), sirolimus (SRL) (Rapamune(®), Pfizer) and everolimus (EVL) (Certican(®), Novartis) as maintenance therapy in adult renal transplantation. METHODS: Clinical effectiveness searches were conducted until 18 November 2014 in MEDLINE (via Ovid), EMBASE (via Ovid), Cochrane Central Register of Controlled Trials (via Wiley Online Library) and Web of Science (via ISI), Cochrane Database of Systematic Reviews, Database of Abstracts of Reviews of Effects and Health Technology Assessment (The Cochrane Library via Wiley Online Library) and Health Management Information Consortium (via Ovid). Cost-effectiveness searches were conducted until 18 November 2014 using a costs or economic literature search filter in MEDLINE (via Ovid), EMBASE (via Ovid), NHS Economic Evaluation Database (via Wiley Online Library), Web of Science (via ISI), Health Economic Evaluations Database (via Wiley Online Library) and the American Economic Association's electronic bibliography (via EconLit, EBSCOhost). Included studies were selected according to predefined methods and criteria. A random-effects model was used to analyse clinical effectiveness data (odds ratios for binary data and mean differences for continuous data). Network meta-analyses were undertaken within a Bayesian framework. A new discrete time-state transition economic model (semi-Markov) was developed, with acute rejection, graft function (GRF) and new-onset diabetes mellitus used to extrapolate graft survival. Recipients were assumed to be in one of three health states: functioning graft, graft loss or death. RESULTS: Eighty-nine randomised controlled trials (RCTs), of variable quality, were included. For induction therapy, no treatment appeared more effective than another in reducing graft loss or mortality. Compared with placebo/no induction, rATG and BAS appeared more effective in reducing biopsy-proven acute rejection (BPAR) and BAS appeared more effective at improving GRF. For maintenance therapy, no treatment was better for all outcomes and no treatment appeared most effective at reducing graft loss. BEL + MMF appeared more effective than TAC + MMF and SRL + MMF at reducing mortality. MMF + CSA (ciclosporin), TAC + MMF, SRL + TAC, TAC + AZA (azathioprine) and EVL + CSA appeared more effective than CSA + AZA and EVL + MPS at reducing BPAR. SRL + AZA, TAC + AZA, TAC + MMF and BEL + MMF appeared to improve GRF compared with CSA + AZA and MMF + CSA. In the base-case deterministic and probabilistic analyses, BAS, MMF and TAC were predicted to be cost-effective at £20,000 and £30,000 per quality-adjusted life-year (QALY). When comparing all regimens, only BAS + TAC + MMF was cost-effective at £20,000 and £30,000 per QALY. LIMITATIONS: For included trials, there was substantial methodological heterogeneity, few trials reported follow-up beyond 1 year, and there were insufficient data to perform subgroup analysis. Treatment discontinuation and switching were not modelled. FUTURE WORK: High-quality, better-reported, longer-term RCTs are needed. Ideally, these would be sufficiently powered for subgroup analysis and include health-related quality of life as an outcome. CONCLUSION: Only a regimen of BAS induction followed by maintenance with TAC and MMF is likely to be cost-effective at £20,000-30,000 per QALY. STUDY REGISTRATION: This study is registered as PROSPERO CRD42014013189. FUNDING: The National Institute for Health Research Health Technology Assessment programme.

Immunosuppressive therapy for kidney transplantation in children and adolescents: systematic review and economic evaluation.

BACKGROUND: End-stage renal disease is a long-term irreversible decline in kidney function requiring kidney transplantation, haemodialysis or peritoneal dialysis. The preferred option is kidney transplantation followed by induction and maintenance immunosuppressive therapy to reduce the risk of kidney rejection and prolong graft survival. OBJECTIVES: To systematically review and update the evidence for the clinical effectiveness and cost-effectiveness of basiliximab (BAS) (Simulect,(®) Novartis Pharmaceuticals) and rabbit antihuman thymocyte immunoglobulin (Thymoglobuline,(®) Sanofi) as induction therapy and immediate-release tacrolimus [Adoport(®) (Sandoz); Capexion(®) (Mylan); Modigraf(®) (Astellas Pharma); Perixis(®) (Accord Healthcare); Prograf(®) (Astellas Pharma); Tacni(®) (Teva); Vivadex(®) (Dexcel Pharma)], prolonged-release tacrolimus (Advagraf,(®) Astellas Pharma); belatacept (BEL) (Nulojix,(®) Bristol-Myers Squibb), mycophenolate mofetil (MMF) [Arzip(®) (Zentiva), CellCept(®) (Roche Products), Myfenax(®) (Teva), generic MMF is manufactured by Accord Healthcare, Actavis, Arrow Pharmaceuticals, Dr Reddy's Laboratories, Mylan, Sandoz and Wockhardt], mycophenolate sodium, sirolimus (Rapamune,(®) Pfizer) and everolimus (Certican,(®) Novartis Pharmaceuticals) as maintenance therapy in children and adolescents undergoing renal transplantation. DATA SOURCES: Clinical effectiveness searches were conducted to 7 January 2015 in MEDLINE (via Ovid), EMBASE (via Ovid), Cochrane Central Register of Controlled Trials (via Wiley Online Library) and Web of Science [via Institute for Scientific Information (ISI)], Cochrane Database of Systematic Reviews, Database of Abstracts of Reviews of Effects and Health Technology Assessment (HTA) (The Cochrane Library via Wiley Online Library) and Health Management Information Consortium (via Ovid). Cost-effectiveness searches were conducted to 15 January 2015 using a costs or economic literature search filter in MEDLINE (via Ovid), EMBASE (via Ovid), NHS Economic Evaluation Databases (via Wiley Online Library), Web of Science (via ISI), Health Economic Evaluations Database (via Wiley Online Library) and EconLit (via EBSCOhost). REVIEW METHODS: Titles and abstracts were screened according to predefined inclusion criteria, as were full texts of identified studies. Included studies were extracted and quality appraised. Data were meta-analysed when appropriate. A new discrete time state transition economic model (semi-Markov) was developed; graft function, and incidences of acute rejection and new-onset diabetes mellitus were used to extrapolate graft survival. Recipients were assumed to be in one of three health states: functioning graft, graft loss or death. RESULTS: Three randomised controlled trials (RCTs) and four non-RCTs were included. The RCTs only evaluated BAS and tacrolimus (TAC). No statistically significant differences in key outcomes were found between BAS and placebo/no induction. Statistically significantly higher graft function (p < 0.01) and less biopsy-proven acute rejection (odds ratio 0.29, 95% confidence interval 0.15 to 0.57) was found between TAC and ciclosporin (CSA). Only one cost-effectiveness study was identified, which informed NICE guidance TA99. BAS [with TAC and azathioprine (AZA)] was predicted to be cost-effective at £20,000-30,000 per quality-adjusted life year (QALY) versus no induction (BAS was dominant). BAS (with CSA and MMF) was not predicted to be cost-effective at £20,000-30,000 per QALY versus no induction (BAS was dominated). TAC (with AZA) was predicted to be cost-effective at £20,000-30,000 per QALY versus CSA (TAC was dominant). A model based on adult evidence suggests that at a cost-effectiveness threshold of £20,000-30,000 per QALY, BAS and TAC are cost-effective in all considered combinations; MMF was also cost-effective with CSA but not TAC. LIMITATIONS: The RCT evidence is very limited; analyses comparing all interventions need to rely on adult evidence. CONCLUSIONS: TAC is likely to be cost-effective (vs. CSA, in combination with AZA) at £20,000-30,000 per QALY. Analysis based on one RCT found BAS to be dominant, but analysis based on another RCT found BAS to be dominated. BAS plus TAC and AZA was predicted to be cost-effective at £20,000-30,000 per QALY when all regimens were compared using extrapolated adult evidence. High-quality primary effectiveness research is needed. The UK Renal Registry could form the basis for a prospective primary study. STUDY REGISTRATION: This study is registered as PROSPERO CRD42014013544. FUNDING: The National Institute for Health Research HTA programme.

A programme of studies including assessment of diagnostic accuracy of school hearing screening tests and a cost-effectiveness model of school entry hearing screening programmes.

BACKGROUND: Identification of permanent hearing impairment at the earliest possible age is crucial to maximise the development of speech and language. Universal newborn hearing screening identifies the majority of the 1 in 1000 children born with a hearing impairment, but later onset can occur at any time and there is no optimum time for further screening. A universal but non-standardised school entry screening (SES) programme is in place in many parts of the UK but its value is questioned. OBJECTIVES: To evaluate the diagnostic accuracy of hearing screening tests and the cost-effectiveness of the SES programme in the UK. DESIGN: Systematic review, case-control diagnostic accuracy study, comparison of routinely collected data for services with and without a SES programme, parental questionnaires, observation of practical implementation and cost-effectiveness modelling. SETTING: Second- and third-tier audiology services; community. PARTICIPANTS: Children aged 4-6 years and their parents. MAIN OUTCOME MEASURES: Diagnostic accuracy of two hearing screening devices, referral rate and source, yield, age at referral and cost per quality-adjusted life-year. RESULTS: The review of diagnostic accuracy studies concluded that research to date demonstrates marked variability in the design, methodological quality and results. The pure-tone screen (PTS) (Amplivox, Eynsham, UK) and HearCheck (HC) screener (Siemens, Frimley, UK) devices had high sensitivity (PTS ≥ 89%, HC ≥ 83%) and specificity (PTS ≥ 78%, HC ≥ 83%) for identifying hearing impairment. The rate of referral for hearing problems was 36% lower with SES (Nottingham) relative to no SES (Cambridge) [rate ratio 0.64, 95% confidence interval (CI) 0.59 to 0.69; p < 0.001]. The yield of confirmed cases did not differ between areas with and without SES (rate ratio 0.82, 95% CI 0.63 to 1.06; p = 0.12). The mean age of referral did not differ between areas with and without SES for all referrals but children with confirmed hearing impairment were older at referral in the site with SES (mean age difference 0.47 years, 95% CI 0.24 to 0.70 years; p < 0.001). Parental responses revealed that the consequences to the family of the referral process are minor. A SES programme is unlikely to be cost-effective and, using base-case assumptions, is dominated by a no screening strategy. A SES programme could be cost-effective if there are fewer referrals associated with SES programmes or if referrals occur more quickly with SES programmes. CONCLUSIONS: A SES programme using the PTS or HC screener is unlikely to be effective in increasing the identified number of cases with hearing impairment and lowering the average age at identification and is therefore unlikely to represent good value for money. This finding is, however, critically dependent on the results of the observational study comparing Nottingham and Cambridge, which has limitations. The following are suggested: systematic reviews of the accuracy of devices used to measure hearing at school entry; characterisation and measurement of the cost-effectiveness of different approaches to the ad-hoc referral system; examination of programme specificity as opposed to test specificity; further observational comparative studies of different programmes; and opportunistic trials of withdrawal of SES programmes. TRIAL REGISTRATION: Current Controlled Trials ISRCTN61668996. FUNDING: This project was funded by the NIHR Health Technology Assessment programme and will be published in full in Health Technology Assessment; Vol. 20, No. 36. See the NIHR Journals Library website for further project information.

The effectiveness and cost-effectiveness of erythropoiesis-stimulating agents (epoetin and darbepoetin) for treating cancer treatment-induced anaemia (including review of technology appraisal no. 142): a systematic review and economic model.

BACKGROUND: Anaemia is a common side effect of cancer treatments and can lead to a reduction in quality of life. Erythropoiesis-stimulating agents (ESAs) are licensed for use in conjunction with red blood cell transfusions to improve cancer treatment-induced anaemia (CIA). OBJECTIVE: To investigate the effectiveness and cost-effectiveness of ESAs in anaemia associated with cancer treatment (specifically chemotherapy). DATA SOURCES: The following databases were searched from 2004 to 2013: The Cochrane Library, MEDLINE, MEDLINE In-Process & Other Non-Indexed Citations, EMBASE, Web of Science, Cumulative Index to Nursing and Allied Health Literature, British Nursing Index, Health Management Information Consortium, Current Controlled Trials and ClinicalTrials.gov. The US Food and Drug Administration and European Medicines Agency websites were also searched. Bibliographies of included papers were scrutinised for further potentially includable studies. REVIEW METHODS: The clinical effectiveness review followed principles published by the NHS Centre for Reviews and Dissemination. Randomised controlled trials (RCTs), or systematic reviews of RCTs, of ESAs (epoetin or darbepoetin) for treating people with CIA were eligible for inclusion in the review. Comparators were best supportive care, placebo or other ESAs. Anaemia- and malignancy-related outcomes, health-related quality of life (HRQoL) and adverse events (AEs) were evaluated. When appropriate, data were pooled using meta-analysis. An empirical health economic model was developed comparing ESA treatment with no ESA treatment. The model comprised two components: one evaluating short-term costs and quality-adjusted life-years (QALYs) (while patients are anaemic) and one evaluating long-term QALYs. Costs and benefits were discounted at 3.5% per annum. Probabilistic and univariate deterministic sensitivity analyses were performed. RESULTS: Of 1457 titles and abstracts screened, 23 studies assessing ESAs within their licensed indication (based on start dose administered) were included in the review. None of the RCTs were completely aligned with current European Union licenses. The results suggest a clinical benefit from ESAs for anaemia-related outcomes and an improvement in HRQoL scores. The impact of ESAs on AEs and survival remains highly uncertain, although point estimates are lower, confidence intervals are wide and not statistically significant. Base-case incremental cost-effectiveness ratios (ICERs) for ESA treatment compared with no ESA treatment ranged from £ 19,429 to £ 35,018 per QALY gained, but sensitivity and scenario analyses demonstrate considerable uncertainty in these ICERs, including the possibility of overall health disbenefit. All ICERs were sensitive to survival and cost. LIMITATIONS: The relative effectiveness of ESAs was not addressed; all ESAs were assumed to have equivalent efficacy. No studies were completely aligned with their European labelling beyond the starting dose evaluated. There is questionable generalisability given that the included trials were published >20 years ago and there have been many changes to chemotherapy as well as to the quality of supportive treatment. Trial quality was moderate or poor and there was considerable unexplained heterogeneity for a number of outcomes, particularly survival, and evidence of publication bias. Adjustments were not made to account for multiple testing. CONCLUSIONS: ESAs could be cost-effective when used closer to licence, but there is considerable uncertainty, mainly because of unknown impacts on overall survival. STUDY REGISTRATION: This study is registered as PROSPERO CRD42013005812. FUNDING: The National Institute for Health Research Health Technology Assessment programme.

Chronic Hepatitis C: An Overview of Evidence on Epidemiology and Management from a Brazilian Perspective.

Chronic hepatitis C remains one of the main causes of chronic liver disease worldwide and presents a variable natural history ranging from minimal changes to advanced fibrosis and cirrhosis and its complications, such as development of hepatocellular carcinoma. Approximately, 1.45 million people are estimated to be infected by HCV in Brazil representing a major public health issue. The aim of this paper was to review the epidemiology and management of chronic hepatitis C from a Brazilian perspective. The management of chronic hepatitis C has been challenged by the use of noninvasive methods to stage liver fibrosis as an alternative to liver biopsy and the high cost of new interferon-free antiviral treatments. Moreover, the need of cost-effectiveness analysis in hepatitis C and the recent changes in treatment protocols were discussed.