Real-World Evidence to Inform Regulatory Decision Making: A Scoping Review.

Real-world evidence (RWE) is increasingly considered in regulatory decision making. When, and to which extent, RWE is considered relevant by regulators likely depends on many factors. This review aimed to identify factors that make RWE necessary or desirable to inform regulatory decision making. A scoping review was conducted using literature databases (PubMed, Embase, Emcare, Web of Science, and Cochrane Library) and websites of regulatory agencies, health technology assessment agencies, research institutes, and professional organizations involved with RWE. Articles were included if: (1) they discussed factors or contexts that impact whether RWE could be necessary or desirable in regulatory decision making; (2) focused on pharmacological or biological interventions in humans; and (3) considered decision making in Europe or North America, or without a focus on a specific region. We included 118 articles in the scoping review. Two major themes and six subthemes were identified. The first theme concerns questions addressable with RWE, with subthemes epidemiology and benefit-risk assessment. The second theme concerns contextual factors, with subthemes feasibility, ethical considerations, limitations of available evidence, and disease and treatment-specific aspects. Collectively, these themes encompassed 43 factors influencing the need for RWE in regulatory decisions. Although single factors may not make RWE fully necessary, their cumulative influence could make RWE essential and pivotal in regulatory decision making. This overview contributes to ongoing discussions emphasizing the nuanced interplay of factors influencing the necessity or desirability of RWE to inform regulatory decision making.

Opportunities and Challenges for Decentralized Clinical Trial Approaches: European Health Technology Assessment Perspective.

OBJECTIVES: Decentralized clinical trial (DCT) approaches are clinical trials in which some or all trial activities take place closer to participants' proximities instead of a traditional investigative site. Data from DCTs may be used for clinical and economic evaluations by health technology assessment (HTA) bodies to support reimbursement decision making. This study aimed to explore the opportunities and challenges for DCT approaches from an HTA perspective by interviewing representatives from European HTA bodies. METHODS: We conducted semistructured interviews with 25 European HTA representatives between September 2022 and February 2023, and transcripts were analyzed after thematic analysis. RESULTS: Two main themes were identified from the data relating to (1) DCT approaches in HTA and (2) trial-level acceptance and relevance. Experience with assessing DCTs was limited and a variety of knowledge about DCTs was observed. The respondents recognized the opportunity of DCTs to reduce recall bias when participant-reported outcome data can be collected more frequently and conveniently from home. Concerns were expressed about the data quality when participants become responsible for data collection. Despite this challenge, the respondents recognized the potential of DCTs to increase the generalizability of results because data can be collected in a setting reflective of the everyday situation potentially from a more diverse participant group. CONCLUSIONS: DCTs could generate relevant results for HTA decision making when data are collected in a real-world setting from a diverse participant group. Increased awareness of the opportunities and challenges could help HTA assessors in their appraisal of DCT approaches.

Assessment of the Regulatory Dialogue Between Pharmaceutical Companies and the European Medicines Agency on the Choice of Noninferiority Margins.

Choosing a noninferiority margin is one of the main challenges when designing a noninferiority trial. The European Medicines Agency (EMA) published a guidance report on the choice of margins in 2005. Nonetheless, in 2008 and 2009 they did not accept 41% (35 of 86) of the noninferiority margins that were proposed by pharmaceutical companies in the context of scientific-advice letters. In this study, we focus on whether the EMA's recommendations were followed by pharmaceutical companies, and on a possible relationship with eventual drug approval. Five of the 35 unaccepted margins were equivalence margins; we considered only the 30 unaccepted noninferiority margins in our analysis. Twelve of these margins were defined based on clinical and statistical considerations (the approach recommended by the EMA) and were rejected due to unacceptable clinical considerations. The other 18 margins were rejected because they were considered too wide. The EMA's recommendations were followed in the cases of 10 of the 15 margins (67%) for which information on follow-through of recommendations was available. The main reason for ignoring the EMA's recommendation in the other 5 cases was that the margins had been accepted by the US Food and Drug Administration. The proportions of approved drugs for which recommendations were and were not followed were similar, yet numbers were too low for formal statistical testing. This study shows that the main concern of regulators with regard to noninferiority trials was the strictness of margins from a clinical perspective. Future studies using more recent data, including data on the US Food and Drug Administration, may help in assessing the impact of guideline recommendations on noninferiority margins used for drug approval and may assist in reaching consensus among regulators about the choice of margins.

Conditional Financing of Drugs in the Netherlands: Past, Present, and Future-Results From Stakeholder Interviews.

BACKGROUND: Conditional financing (CF) of hospital drugs was implemented in the Netherlands as a form of managed entry agreements between 2006 and 2012. CF was a 4-year process comprising 3 stages: initial health technology assessment of the drug (T = 0), conduct of outcomes research studies, and reassessment of the drug (T = 4). OBJECTIVES: To analyze stakeholder experiences in implementing CF in practice. METHODS: Public and private stakeholders were approached for participation in stakeholder interviews through standardized email invitations. An interview guide was developed to guide discussions that covered the following topics: perceived aims of CF, functioning of CF, impact of CF, and conclusions and future perspectives. Extensive summaries were generated for each interview and subsequently used for directed content analysis. RESULTS: Thirty stakeholders were interviewed. Differences emerged among the stakeholders on the perceived aims of CF. Conversely, there was some agreement among stakeholders on the shortcomings in the functioning of CF, the positive impact of CF on the Dutch healthcare setting, and improvement points for CF. CONCLUSIONS: Despite stakeholders' belief that CF either did not meet its aims or only partially did so, there was agreement on the need for new policy to address the same aims of CF in the future. Nevertheless, stakeholders diverged on whether CF should be improved on the basis of learnings identified and reintroduced into practice or replaced with new policy schemes.

Cost-effectiveness of PCSK9 inhibition in addition to standard lipid-lowering therapy in patients at high risk for vascular disease.

BACKGROUND: As proprotein convertase subtilisin-kexin type 9 (PCSK9) monoclonal antibodies are entering the market, we assessed the cost-effectiveness of PCSK9 inhibition added to standard lipid-lowering therapy in patient groups at high risk for major adverse cardiovascular events (MACE). METHODS: A lifetime Markov Model was designed to estimate healthcare costs, quality-adjusted life years (QALYs) and incremental cost-effectiveness ratios (ICERs) for PCSK9 inhibition added to standard therapy in patients with Familial Hypercholesterolemia (FH), patients with vascular disease at high MACE recurrence risk, and patients with vascular disease with diabetes mellitus. The balance between costs and health outcomes was established for a broad range of potential relative risk reductions and drug costs. RESULTS: The expected QALY gain per patient and ICER in the main scenario were 1.4 QALYs for €78,485/QALY gained in patients with FH, 0.22 QALYs for €176,735/QALY gained in those with vascular disease and a predicted risk of MACE ≥30% in 10years, and 0.22 QALYs for €295,543/QALY gained in those with vascular disease and diabetes. Results were sensitive to assumptions on PCSK9 inhibitor treatment efficacy, and vascular event risks. CONCLUSION: The costs and effects of PCSK9 inhibition added to standard lipid-lowering treatment in patient groups at high risk for MACE can be estimated and adapted to a specific clinical setting. PCSK9 inhibition could be cost-effective in patients with FH. In patients with vascular disease PCSK9 inhibition is less cost-effective, however, a price development may change clinical practice. This model may aid treatment and reimbursement decisions regarding PCSK9 inhibitors.

Using Real-World Data in Health Technology Assessment (HTA) Practice: A Comparative Study of Five HTA Agencies.

BACKGROUND: Reimbursement decisions are conventionally based on evidence from randomised controlled trials (RCTs), which often have high internal validity but low external validity. Real-world data (RWD) may provide complimentary evidence for relative effectiveness assessments (REAs) and cost-effectiveness assessments (CEAs). This study examines whether RWD is incorporated in health technology assessment (HTA) of melanoma drugs by European HTA agencies, as well as differences in RWD use between agencies and across time. METHODS: HTA reports published between 1 January 2011 and 31 December 2016 were retrieved from websites of agencies representing five jurisdictions: England [National Institute for Health and Care Excellence (NICE)], Scotland [Scottish Medicines Consortium (SMC)], France [Haute Autorité de santé (HAS)], Germany [Institute for Quality and Efficacy in Healthcare (IQWiG)] and The Netherlands [Zorginstituut Nederland (ZIN)]. A standardized data extraction form was used to extract information on RWD inclusion for both REAs and CEAs. RESULTS: Overall, 52 reports were retrieved, all of which contained REAs; CEAs were present in 25 of the reports. RWD was included in 28 of the 52 REAs (54%), mainly to estimate melanoma prevalence, and in 22 of the 25 (88%) CEAs, mainly to extrapolate long-term effectiveness and/or identify drug-related costs. Differences emerged between agencies regarding RWD use in REAs; the ZIN and IQWiG cited RWD for evidence on prevalence, whereas the NICE, SMC and HAS additionally cited RWD use for drug effectiveness. No visible trend for RWD use in REAs and CEAs over time was observed. CONCLUSION: In general, RWD inclusion was higher in CEAs than REAs, and was mostly used to estimate melanoma prevalence in REAs or to predict long-term effectiveness in CEAs. Differences emerged between agencies' use of RWD; however, no visible trends for RWD use over time were observed.

Early health technology assessments in pharmacogenomics: a case example in cardiovascular drugs.

AIM: To assess the required characteristics (cost, sensitivity and specificity) of a pharmacogenomic test for being a cost-effective prevention of angiotensin-converting enzyme inhibitors induced angioedema. Furthermore, we assessed the influence of only testing high-risk populations. MATERIALS & METHODS: A decision tree was used. RESULTS: With a willingness-to-pay threshold of €20,000 and €80,000 per quality adjusted life year, a 100% sensitive and specific test may have a maximum cost of €1.30 and €1.95, respectively. When only genotyping high-risk populations, the maximum test price would be €5.03 and €7.55, respectively. CONCLUSION: This theoretical pharmacogenomic test is only cost-effective at high specificity, high sensitivity and a low price. Only testing high-risk populations yields more realistic maximum test prices for cost-effectiveness of the intervention.

What Is Real-World Data? A Review of Definitions Based on Literature and Stakeholder Interviews.

BACKGROUND: Despite increasing recognition of the value of real-world data (RWD), consensus on the definition of RWD is lacking. OBJECTIVES: To review definitions publicly available for RWD to shed light on similarities and differences between them. METHODS: A literature review and stakeholder interviews were used to compile data from eight groups of stakeholders. Data from documents and interviews were subjected to coding analysis. Definitions identified were classified into four categories: 1) data collected in a non-randomized controlled trial setting, 2) data collected in a non-interventional/non-controlled setting, 3) data collected in a non-experimental setting, and 4) others (i.e., data that do not fit into the other three categories). The frequency of definitions identified per category was recorded. RESULTS: Fifty-three documents and 20 interviews were assessed. Thirty-eight definitions were identified: 20 out of 38 definitions (53%) were category 1 definitions, 9 (24%) were category 2 definitions, 5 (13%) were category 3 definitions, and 4 (11%) were category 4 definitions. Differences were identified between, and within, definition categories. For example, opinions differed on the aspects of intervention with which non-interventional/non-controlled settings should abide. No definitions were provided in two interviews or identified in 33 documents. CONCLUSIONS: Most of the definitions defined RWD as data collected in a non-randomized controlled trial setting. A considerable number of definitions, however, diverged from this concept. Moreover, a significant number of authors and stakeholders did not have an official, institutional definition for RWD. Persisting variability in stakeholder definitions of RWD may lead to disparities among different stakeholders when discussing RWD use in decision making.

The impact of quality-of-life data in relative effectiveness assessments of new anti-cancer drugs in European countries.

PURPOSE: The aim of this study is to investigate the role of health-related quality-of-life (QoL) data in relative effectiveness assessments (REAs) of new anti-cancer drugs across European jurisdictions, during health technology assessment procedures. METHODS: Comparative analysis of guidelines and publicly available REAs in six European jurisdictions of anti-cancer drugs approved by EMA between 2011 and 2013. RESULTS: Fourteen anti-cancer drugs were included, adding up to 79 REAs. Whilst all guidelines state that QoL is a relevant endpoint to determine the relative effectiveness of new cancer drugs, QoL data were included in only 54% of the 79 reports and their impact on the recommendations was limited. CONCLUSIONS: Whilst national guidelines recognize the relevance of QoL to determine the relative effectiveness of new anti-cancer drugs, this is not well-reflected in current assessments. Developing and implementing into REAs specific evidence requirements for QoL data would improve the use of this patient-centred outcome in future reimbursement and pricing decisions.

Policies for Use of Real-World Data in Health Technology Assessment (HTA): A Comparative Study of Six HTA Agencies.

BACKGROUND: Randomized controlled trials provide robust data on the efficacy of interventions rather than on effectiveness. Health technology assessment (HTA) agencies worldwide are thus exploring whether real-world data (RWD) may provide alternative sources of data on effectiveness of interventions. Presently, an overview of HTA agencies' policies for RWD use in relative effectiveness assessments (REA) is lacking. OBJECTIVES: To review policies of six European HTA agencies on RWD use in REA of drugs. A literature review and stakeholder interviews were conducted to collect information on RWD policies for six agencies: the Dental and Pharmaceutical Benefits Agency (Sweden), the National Institute for Health and Care Excellence (United Kingdom), the Institute for Quality and Efficiency in Healthcare (Germany), the High Authority for Health (France), the Italian Medicines Agency (Italy), and the National Healthcare Institute (The Netherlands). The following contexts for RWD use in REA of drugs were reviewed: initial reimbursement discussions, pharmacoeconomic analyses, and conditional reimbursement schemes. We identified 13 policy documents and 9 academic publications, and conducted 6 interviews. RESULTS: Policies for RWD use in REA of drugs notably differed across contexts. Moreover, policies differed between HTA agencies. Such variations might discourage the use of RWD for HTA. CONCLUSIONS: To facilitate the use of RWD for HTA across Europe, more alignment of policies seems necessary. Recent articles and project proposals of the European network of HTA may provide a starting point to achieve this.

Pharmacogenomics in Pediatric Patients: Towards Personalized Medicine.

It is well known that drug responses differ among patients with regard to dose requirements, efficacy, and adverse drug reactions (ADRs). The differences in drug responses are partially explained by genetic variation. This paper highlights some examples of areas in which the different responses (dose, efficacy, and ADRs) are studied in children, including cancer (cisplatin), thrombosis (vitamin K antagonists), and asthma (long-acting ß2 agonists). For childhood cancer, the replication of data is challenging due to a high heterogeneity in study populations, which is mostly due to all the different treatment protocols. For example, the replication cohorts of the association of variants in TPMT and COMT with cisplatin-induced ototoxicity gave conflicting results, possibly as a result of this heterogeneity. For the vitamin K antagonists, the evidence of the association between variants in VKORC1 and CYP2C9 and the dose is clear. Genetic dosing models have been developed, but the implementation is held back by the impossibility of conducting a randomized controlled trial with such a small and diverse population. For the long-acting ß2 agonists, there is enough evidence for the association between variant ADRB2 Arg16 and treatment response to start clinical trials to assess clinical value and cost effectiveness of genotyping. However, further research is still needed to define the different asthma phenotypes to study associations in comparable cohorts. These examples show the challenges which are encountered in pediatric pharmacogenomic studies. They also display the importance of collaborations to obtain good quality evidence for the implementation of genetic testing in clinical practice to optimize and personalize treatment.

Efficacy and Safety Assessment of the Addition of Bevacizumab to Adjuvant Therapy Agents in Cancer Patients: A Systematic Review and Meta-Analysis of Randomized Controlled Trials.

AIM: To evaluate the efficacy and safety of bevacizumab in the adjuvant cancer therapy setting within different subset of patients. METHODS & DESIGN/ RESULTS: PubMed, EMBASE, Cochrane and Clinical trials.gov databases were searched for English language studies of randomized controlled trials comparing bevacizumab and adjuvant therapy with adjuvant therapy alone published from January 1966 to 7th of May 2014. Progression free survival, overall survival, overall response rate, safety and quality of life were analyzed using random- or fixed-effects models according to the PRISMA guidelines. We obtained data from 44 randomized controlled trials (30,828 patients). Combining bevacizumab with different adjuvant therapies resulted in significant improvement of progression free survival (log hazard ratio, 0.87; 95% confidence interval (CI), 0.84-0.89), overall survival (log hazard ratio, 0.96; 95% CI, 0.94-0.98) and overall response rate (relative risk, 1.46; 95% CI: 1.33-1.59) compared to adjuvant therapy alone in all studied tumor types. In subgroup analyses, there were no interactions of bevacizumab with baseline characteristics on progression free survival and overall survival, while overall response rate was influenced by tumor type and bevacizumab dose (p-value: 0.02). Although bevacizumab use resulted in additional expected adverse drug reactions except anemia and fatigue, it was not associated with a significant decline in quality of life. There was a trend towards a higher risk of several side effects in patients treated by high-dose bevacizumab compared to the low-dose e.g. all grade proteinuria (9.24; 95% CI: 6.60-12.94 vs. 2.64; 95% CI: 1.29-5.40). CONCLUSIONS: Combining bevacizumab with different adjuvant therapies provides a survival benefit across all major subsets of patients, including by tumor type, type of adjuvant therapy, and duration and dose of bevacizumab therapy. Though bevacizumab was associated with increased risks of some adverse drug reactions such as hypertension and bleeding, anemia and fatigue were improved by the addition of bevacizumab.

Can a Joint Assessment Provide Relevant Information for National/Local Relative Effectiveness Assessments? An In-Depth Comparison of Pazopanib Assessments.

BACKGROUND: In many European jurisdictions, relative effectiveness assessments (REAs) of pharmaceuticals are performed during the reimbursement decision-making process. International collaboration in the production of these assessments may prevent the duplication of information in various jurisdictions. A first pilot of a joint REA (pazopanib for the treatment of renal cell carcinoma) was published in 2011. OBJECTIVE: The objective was to investigate how well the methods used in the joint REA match the methods used in the national/local assessments on the same topic. METHODS: National/local assessments from European jurisdictions, available in English language, were identified through a literature search and an e-mail request to health technology assessment organizations. Data were abstracted from joint and national/local assessments using a structured data abstraction form. Results were compared for differences and similarities. RESULTS: In total, five national/local reports were included (Belgium, England/Wales, France, The Netherlands, and Scotland). The general methods (indication, main comparator, main end points, main trial) were similar. The details of the assessment (e.g., exact wording of indication, additional comparators, additional trials included, and method of indirect comparison), however, varied. Despite these differences, the joint REA included nearly all comparators, end points, trials, and methods of analysis that were used in national/local REA reports. CONCLUSIONS: This study has shown overlap in the methods national/local REA bodies in Europe have chosen for a pazopanib REA for renal cell carcinoma, except for the use and methods of indirect comparisons. Although some additional comparators and outcomes differed between national/local REAs, they can be captured in a comprehensive joint REA.

Are ECG monitoring recommendations before prescription of QT-prolonging drugs applied in daily practice? The example of haloperidol.

PURPOSE: Monitoring of the QT duration by electrocardiography (ECG) prior to treatment is frequently recommended in the label of QT-prolonging drugs. It is, however, unknown how often general practitioners in daily clinical practice are adhering to these risk-minimization measures. We assessed the frequency of ECG measurements in patients where haloperidol was initiated in primary care. METHODS: Patients (≥18 years) with a first prescription of haloperidol in the UK Clinical Practice Research Datalink (2009-2013) were included. The proportion of ECGs made was determined in two blocks of 4 weeks: during the exposure period when haloperidol was initiated, and during the control period, 1 year before. Conditional logistic regression analysis was applied to calculate the relative risk of having an ECG in the exposure period compared with the control period. Subgroup analyses were performed to assess the proportion of ECG measurements in patients with one or more additional risk factors for QT prolongation. RESULTS: In total, 3420 patients were prescribed haloperidol during the exposure period, and 1.8% of them had an ECG at treatment initiation, compared with 0.8% during the control period (relative risk [RR] 2.4 [1.5-3.8]). Of the patients with additional risk factors for QT prolongation, 1.9% of the patients had an ECG at initiation of the prescription, compared with 1.0% during the control period (RR 2.1 [1.2-3.5]). CONCLUSIONS: Compliance with recommendations to perform an electrocardiogram when starting a new QT-prolonging drug is extremely low, when haloperidol is taken as an example.

Economic evaluation of a pharmacogenetic dosing algorithm for coumarin anticoagulants in The Netherlands.

AIM: To investigate the cost-effectiveness of a pharmacogenetic dosing algorithm versus a clinical dosing algorithm for coumarin anticoagulants in The Netherlands. MATERIALS & METHODS: A decision-analytic Markov model was used to analyze the cost-effectiveness of pharmacogenetic dosing of phenprocoumon and acenocoumarol versus clinical dosing. RESULTS: Pharmacogenetic dosing increased costs by €33 and quality-adjusted life-years (QALYs) by 0.001. The incremental cost-effectiveness ratios were €28,349 and €24,427 per QALY gained for phenprocoumon and acenocoumarol, respectively. At a willingness-to-pay threshold of €20,000 per QALY, the pharmacogenetic dosing algorithm was not likely to be cost effective compared with the clinical dosing algorithm. CONCLUSION: Pharmacogenetic dosing improves health only slightly when compared with clinical dosing. However, availability of low-cost genotyping would make it a cost-effective option.

Performance of prior event rate ratio adjustment method in pharmacoepidemiology: a simulation study.

PURPOSE: Prior event rate ratio (PERR) adjustment method has been proposed to control for unmeasured confounding. We aimed to assess the performance of the PERR method in realistic pharmacoepidemiological settings. METHODS: Simulation studies were performed with varying effects of prior events on the probability of subsequent exposure and post-events, incidence rates, effects of confounders, and rate of mortality/dropout. Exposure effects were estimated using conventional rate ratio (RR) and PERR adjustment method (i.e. ratio of RR post-exposure initiation and RR prior to initiation of exposure). RESULTS: In the presence of unmeasured confounding, both conventional and the PERR method may yield biased estimates, but PERR estimates appear generally less biased estimates than the conventional method. However, when prior events strongly influence the probability of subsequent exposure, the exposure effect from the PERR method was more biased than the conventional method. For instance, when the effect of prior events on the exposure was RR = 1.60, the effect estimate from the PERR method was RR = 1.13 and from the conventional method was RR = 2.48 (true exposure effect, RR = 2). In all settings, the variation of the estimates was larger for the PERR method than for the conventional method. CONCLUSION: The PERR adjustment method can be applied to reduce bias as a result of unmeasured confounding. However, only in particular situations, it can completely remove the bias as a result of unmeasured confounding. When applying this method, theoretical justification using available clinical knowledge for assumptions of the PERR method should be provided.

A comparative study of the role of disease severity in drug reimbursement decision making in four European countries.

Considerations beyond cost-effectiveness are important in reimbursement decision making. We assessed the importance of disease severity in drug reimbursement decision making in Belgium, France, The Netherlands and Sweden. We investigated scientific literature and policy documents and conducted three interviews in each country (four in The Netherlands) with persons involved in drug reimbursement. Disease severity is an important consideration, especially where the level is high. The Netherlands operationalizes disease severity using the proportional shortfall approach. Sweden uses categories to give an indication of the level of severity. In The Netherlands and Sweden, severity only implicitly plays a role in the decision whether to reimburse a drug, whereas in Belgium and France it also explicitly plays a role in determining the willingness to use public resources. Interviewees acknowledged that as well as a qualitative description of the disease, quantitative information may also be useful as input for decision making. None of them, however, considered this to be of decisive importance. Although disease severity is important in drug reimbursement decision making in all four countries, all seem to struggle in explicitly specifying its actual role. Belgium and France are the most explicit by using levels of severity in setting reimbursement levels; all four countries could, however, improve the transparency of its actual importance relative to the other criteria in the decision-making process.

Cost effectiveness of new oral anticoagulants for stroke prevention in patients with atrial fibrillation in two different European healthcare settings.

OBJECTIVES: Our objectives were to investigate the cost effectiveness of apixaban, rivaroxaban, and dabigatran compared with coumarin derivatives for stroke prevention in patients with atrial fibrillation in a country with specialized anticoagulation clinics (the Netherlands) and in a country without these clinics (the UK). METHODS: A decision-analytic Markov model was used to analyse the cost effectiveness of apixaban, rivaroxaban, and dabigatran compared with coumarin derivatives in the Netherlands and the UK over a lifetime horizon. RESULTS: In the Netherlands, the use of rivaroxaban, apixaban, or dabigatran increased health by 0.166, 0.365, and 0.374 quality-adjusted life-years (QALYs) compared with coumarin derivatives, but also increased costs by 5,681, 4,754, and 5,465, respectively. The incremental cost-effectiveness ratios (ICERs) were 34,248, 13,024, and 14,626 per QALY gained. In the UK, health was increased by 0.302, 0.455, and 0.461 QALYs, and the incremental costs were similar for all three new oral anticoagulants (5,118-5,217). The ICERs varied from 11,172 to 16,949 per QALY gained. In the Netherlands, apixaban had the highest chance (37 %) of being cost effective at a threshold of 20,000; in the UK, this chance was 41 % for dabigatran. The quality of care, reflected in time in therapeutic range, had an important influence on the ICER. CONCLUSIONS: Apixaban, rivaroxaban, and dabigatran are cost-effective alternatives to coumarin derivatives in the UK, while in the Netherlands, only apixaban and dabigatran could be considered cost effective. The cost effectiveness of the new oral anticoagulants is largely dependent on the setting and quality of local anticoagulant care facilities.