Risk assessment tools for bleeding in patients with unprovoked venous thromboembolism: an analysis of the PLATO-VTE study.

BACKGROUND: Guidelines suggest indefinite anticoagulation after unprovoked venous thromboembolism (VTE) unless the bleeding risk is high, yet there is no consistent guidance on assessing bleeding risk. OBJECTIVES: This study aimed to evaluate the performance of 5 bleeding risk tools (RIETE, VTE-BLEED, CHAP, VTE-PREDICT, and ABC-Bleeding). METHODS: PLATO-VTE, a prospective cohort study, included patients aged ≥40 years with a first unprovoked VTE. Risk estimates were calculated at VTE diagnosis and after 3 months of treatment. Primary outcome was clinically relevant bleeding, as per International Society on Thrombosis and Haemostasis criteria, during 24-month follow-up. Discrimination was assessed by the area under the receiver operating characteristic curve (AUROC). Patients were classified as having a "high risk" and "non-high risk" of bleeding according to predefined thresholds; bleeding risk in both groups was compared by hazard ratios (HRs). RESULTS: Of 514 patients, 38 (7.4%) had an on-treatment bleeding. AUROCs were 0.58 (95% CI, 0.48-0.68) for ABC-Bleeding, 0.56 (95% CI, 0.46-0.66) for RIETE, 0.53 (95% CI, 0.43-0.64) for CHAP, 0.50 (95% CI, 0.41-0.59) for VTE-BLEED, and 0.50 (95% CI, 0.40-0.60) for VTE-PREDICT. The proportion of high-risk patients ranged from 1.4% with RIETE to 36.9% with VTE-BLEED. The bleeding incidence in the high-risk groups ranged from 0% with RIETE to 13.0% with ABC-Bleeding, and in the non-high-risk groups, it varied from 7.7% with ABC-Bleeding to 9.6% with RIETE. HRs ranged from 0.93 (95% CI, 0.46-1.9) for VTE-BLEED to 1.67 (95% CI, 0.86-3.2) for ABC-Bleeding. Recalibration at 3-month follow-up did not alter the results. CONCLUSION: In this cohort, discrimination of currently available bleeding risk tools was poor. These data do not support their use in patients with unprovoked VTE.

Hysterosalpingo-foam sonography versus hysterosalpingography during fertility work-up: an economic evaluation alongside a randomized controlled trial.

STUDY QUESTION: What are the costs and effects of tubal patency testing by hysterosalpingo-foam sonography (HyFoSy) compared to hysterosalpingography (HSG) in infertile women during the fertility work-up? SUMMARY ANSWER: During the fertility work-up, clinical management based on the test results of HyFoSy leads to slightly lower, though not statistically significant, live birth rates, at lower costs, compared to management based on HSG results. WHAT IS KNOWN ALREADY: Traditionally, tubal patency testing during the fertility work-up is performed by HSG. The FOAM trial, formally a non-inferiority study, showed that management decisions based on the results of HyFoSy resulted in a comparable live birth rate at 12 months compared to HSG (46% versus 47%; difference -1.2%, 95% CI: -3.4% to 1.5%; P = 0.27). Compared to HSG, HyFoSy is associated with significantly less pain, it lacks ionizing radiation and exposure to iodinated contrast medium. Moreover, HyFoSy can be performed by a gynaecologist during a one-stop fertility work-up. To our knowledge, the costs of both strategies have never been compared. STUDY DESIGN, SIZE, DURATION: We performed an economic evaluation alongside the FOAM trial, a randomized multicenter study conducted in the Netherlands. Participating infertile women underwent, both HyFoSy and HSG, in a randomized order. The results of both tests were compared and women with discordant test results were randomly allocated to management based on the results of one of the tests. The follow-up period was twelve months. PARTICIPANTS/MATERIALS, SETTING, METHODS: We studied 1160 infertile women (18-41 years) scheduled for tubal patency testing. The primary outcome was ongoing pregnancy leading to live birth. The economic evaluation compared costs and effects of management based on either test within 12 months. We calculated incremental cost-effectiveness ratios (ICERs): the difference in total costs and chance of live birth. Data were analyzed using the intention to treat principle. MAIN RESULTS AND THE ROLE OF CHANCE: Between May 2015 and January 2019, 1026 of the 1160 women underwent both tubal tests and had data available: 747 women with concordant results (48% live births), 136 with inconclusive results (40% live births), and 143 with discordant results (41% had a live birth after management based on HyFoSy results versus 49% with live birth after management based on HSG results). When comparing the two strategies-management based on HyfoSy results versus HSG results-the estimated chance of live birth was 46% after HyFoSy versus 47% after HSG (difference -1.2%; 95% CI: -3.4% to 1.5%). For the procedures itself, HyFoSy cost €136 and HSG €280. When costs of additional fertility treatments were incorporated, the mean total costs per couple were €3307 for the HyFoSy strategy and €3427 for the HSG strategy (mean difference €-119; 95% CI: €-125 to €-114). So, while HyFoSy led to lower costs per couple, live birth rates were also slightly lower. The ICER was €10 042, meaning that by using HyFoSy instead of HSG we would save €10 042 per each additional live birth lost. LIMITATIONS, REASONS FOR CAUTION: When interpreting the results of this study, it needs to be considered that there was a considerable uncertainty around the ICER, and that the direct fertility enhancing effect of both tubal patency tests was not incorporated as women underwent both tubal patency tests in this study. WIDER IMPLICATION OF THE FINDINGS: Compared to clinical management based on HSG results, management guided by HyFoSy leads to slightly lower live birth rates (though not statistically significant) at lower costs, less pain, without ionizing radiation and iodinated contrast exposure. Further research on the comparison of the direct fertility-enhancing effect of both tubal patency tests is needed. STUDY FUNDING/COMPETING INTEREST(S): FOAM trial was an investigator-initiated study, funded by ZonMw, a Dutch organization for Health Research and Development (project number 837001504). IQ Medical Ventures provided the ExEm®-FOAM kits free of charge. The funders had no role in study design, collection, analysis, and interpretation of the data. K.D. reports travel-and speakers fees from Guerbet and her department received research grants from Guerbet outside the submitted work. H.R.V. received consulting-and travel fee from Ferring. A.M.v.P. reports received consulting fee from DEKRA and fee for an expert meeting from Ferring, both outside the submitted work. C.H.d.K. received travel fee from Merck. F.J.M.B. received a grant from Merck and speakers fee from Besins Healthcare. F.J.M.B. is a member of the advisory board of Merck and Ferring. J.v.D. reported speakers fee from Ferring. J.S. reports a research agreement with Takeda and consultancy for Sanofi on MR of motility outside the submitted work. M.v.W. received a travel grant from Oxford Press in the role of deputy editor for Human Reproduction and participates in a DSMB as independent methodologist in obstetrics studies in which she has no other role. B.W.M. received an investigator grant from NHMRC GNT1176437. B.W.M. reports consultancy for ObsEva, Merck, Guerbet, iGenomix, and Merck KGaA and travel support from Merck KGaA. V.M. received research grants from Guerbet, Merck, and Ferring and travel and speakers fees from Guerbet. The other authors do not report conflicts of interest. TRIAL REGISTRATION NUMBER: International Clinical Trials Registry Platform No. NTR4746.

Liver Investigation: Testing Marker Utility in Steatohepatitis (LITMUS): Assessment & validation of imaging modality performance across the NAFLD spectrum in a prospectively recruited cohort study (the LITMUS imaging study): Study protocol.

Non-alcoholic fatty liver disease (NAFLD) is the liver manifestation of the metabolic syndrome with global prevalence reaching epidemic levels. Despite the high disease burden in the population only a small proportion of those with NAFLD will develop progressive liver disease, for which there is currently no approved pharmacotherapy. Identifying those who are at risk of progressive NAFLD currently requires a liver biopsy which is problematic. Firstly, liver biopsy is invasive and therefore not appropriate for use in a condition like NAFLD that affects a large proportion of the population. Secondly, biopsy is limited by sampling and observer dependent variability which can lead to misclassification of disease severity. Non-invasive biomarkers are therefore needed to replace liver biopsy in the assessment of NAFLD. Our study addresses this unmet need. The LITMUS Imaging Study is a prospectively recruited multi-centre cohort study evaluating magnetic resonance imaging and elastography, and ultrasound elastography against liver histology as the reference standard. Imaging biomarkers and biopsy are acquired within a 100-day window. The study employs standardised processes for imaging data collection and analysis as well as a real time central monitoring and quality control process for all the data submitted for analysis. It is anticipated that the high-quality data generated from this study will underpin changes in clinical practice for the benefit of people with NAFLD. Study Registration: clinicaltrials.gov: NCT05479721.

[The role of effectiveness in coverage decisions]. / Effectiviteit als criterium bij pakketbeheer.

Since the introduction of the Health Insurance Act, effectiveness has been one of the criteria for coverage decisions in the Netherlands. The Health Insurance Board, later succeeded by Zorginstituut Nederland, elaborated that criterion: when assessing whether care meets the "state of science and practice", it uses the principles of evidence-based medicine. In recent years, several organisations have called for the structural evaluation of health care interventions and the removal of non-effective care from the benefits package. This intention was also reflected in the Integral Care Agreement concluded last year.

Personalized Decision Making on Genomic Testing in Early Breast Cancer: Expanding the MINDACT Trial with Decision-Analytic Modeling.

BACKGROUND: Genomic tests may improve upon clinical risk estimation with traditional prognostic factors. We aimed to explore how evidence on the prognostic strength of a genomic signature (clinical validity) can contribute to individualized decision making on starting chemotherapy for women with breast cancer (clinical utility). METHODS: The MINDACT trial was a randomized trial that enrolled 6693 women with early-stage breast cancer. A 70-gene signature (Mammaprint) was used to estimate genomic risk, and clinical risk was estimated by a dichotomized version of the Adjuvant!Online risk calculator. Women with discordant risk results were randomized to the use of chemotherapy. We simulated the full risk distribution of these women and estimated individual benefit, assuming a constant relative effect of chemotherapy. RESULTS: The trial showed a prognostic effect of the genomic signature (adjusted hazard ratio 2.4). A decision-analytic modeling approach identified far fewer women as candidates for genetic testing (4% rather than 50%) and fewer benefiting from chemotherapy (3% rather than 27%) as compared with the MINDACT trial report. The selection of women benefitting from genetic testing and chemotherapy depended strongly on the required benefit from treatment and the assumed therapeutic effect of chemotherapy. CONCLUSIONS: A high-quality pragmatic trial was insufficient to directly inform clinical practice on the utility of a genomic test for individual women. The indication for genomic testing may be far more limited than suggested by the MINDACT trial.

OPTimal IMAging strategy in patients suspected of non-traumatic pulmonary disease at the emergency department: chest X-ray or ultra-low-dose chest CT (OPTIMACT) trial-statistical analysis plan.

BACKGROUND: A chest X-ray is a standard imaging procedure in the diagnostic work-up of patients suspected of having non-traumatic pulmonary disease. Compared to a chest X-ray, an ultra-low-dose (ULD) chest computed tomography (CT) scan provides substantially more detailed information on pulmonary conditions. To what extent this translates into an improvement in patient outcomes and health care efficiency is yet unknown. The OPTimal IMAging strategy in patients suspected of non-traumatic pulmonary disease at the emergency department: chest X-ray or ultra-low-dose chest CT (OPTIMACT) study is a multicenter, pragmatic, non-inferiority randomized controlled trial designed to evaluate replacement of chest X-ray by ULD chest CT in the diagnostic work-up of such patients, in terms of patient-related health outcomes and costs. During randomly assigned periods of 1 calendar month, either conventional chest X-ray or ULD chest CT scan was used as the imaging strategy. This paper presents in detail the statistical analysis plan of the OPTIMACT trial, developed prior to data analysis. METHODS/RESULTS: Functional health at 28 days is the primary clinical outcome. Functional health at 28 days is measured by the physical component summary scale of the Short Form (SF)-12 questionnaire version 1. Secondary outcomes are mental health (mental component summary scale of the SF-12), length of hospital stay, mortality within 28 days, quality-adjusted life year equivalent during the first 28 days (derived from the EuroQol five-dimension, five-level instrument), correct diagnoses at emergency department discharge as compared to the final post hoc diagnosis at day 28, number of patients in follow-up because of incidental findings on chest X-ray or ULD chest CT, and health care costs. CONCLUSIONS: After this pragmatic trial we will have precise estimates of the effectiveness of replacing chest X-ray with ULD chest CT in terms of patient-related health outcomes and costs. TRIAL REGISTRATION: Netherlands National Trial Register: NTR6163. Registered on 6 December 2016.

The FOAM study: is Hysterosalpingo foam sonography (HyFoSy) a cost-effective alternative for hysterosalpingography (HSG) in assessing tubal patency in subfertile women? Study protocol for a randomized controlled trial.

BACKGROUND: Tubal pathology is a causative factor in 20% of subfertile couples. Traditionally, tubal testing during fertility work-up is performed by hysterosalpingography (HSG). Hysterosalpingo-foam sonography (HyFoSy) is a new technique that is thought to have comparable accuracy as HSG, while it is less expensive and more patient friendly. HyFoSy would be an acceptable alternative for HSG, provided it has similar effectiveness in terms of patient outcomes. METHODS/DESIGN: We aim to compare the effectiveness and costs of management guided by HyFoSy or by HSG. Consenting women will undergo tubal testing by both HyFoSy and HSG in a randomized order during fertility work-up. The study group will consist of 1163 subfertile women between 18 and 41 years old who are scheduled for tubal patency testing during their fertility work-up. Women with anovulatory cycles not responding to ovulation induction, endometriosis, severe male subfertility or a known contrast (iodine) allergy will be excluded. We anticipate that 7 % (N = 82) of the participants will have discordant test results for HyFoSy and HSG. These participants will be randomly allocated to either a management strategy based on HyFoSy or a management strategy based on HSG, resulting in either a diagnostic laparoscopy with chromopertubation or a strategy that assumes tubal patency (intrauterine insemination or expectant management). The primary outcome is ongoing pregnancy leading to live birth within 12 months after randomization. Secondary outcomes are patient pain scores, time to pregnancy, clinical pregnancy, miscarriage rate, multiple pregnancy rate, preterm birth rate and number of additional treatments. Costs will be estimated by counting resource use and calculating unit prices. DISCUSSION: This trial will compare the effectiveness and costs of HyFoSy versus HSG in assessing tubal patency in subfertile women. TRIAL REGISTRATION: Dutch Trial Register (NTR 4746, http://www.trialregister.nl ). Date of registration: 19 August 2014.

Cost-effectiveness of curettage vs. expectant management in women with an incomplete evacuation after misoprostol treatment for first-trimester miscarriage: a randomized controlled trial and cohort study.

INTRODUCTION: Curettage is more effective than expectant management in women with suspected incomplete evacuation after misoprostol treatment for first-trimester miscarriage. The cost-effectiveness of curettage vs. expectant management in this group is unknown. MATERIAL AND METHODS: From June 2012 until July 2014 we conducted a randomized controlled trial and parallel cohort study in the Netherlands, comparing curettage with expectant management in women with an incomplete evacuation of the uterus after misoprostol treatment for first-trimester miscarriage. Successful treatment was defined as a sonographic finding of an empty uterus 6 weeks after study entry, or an uneventful course. Cost-effectiveness and cost-utility analyses were performed. We included costs of healthcare utilization, informal care and lost productivity. Cost-effectiveness planes and cost-effectiveness acceptability curves were estimated using bootstrapping. RESULTS: We included 256 women from 27 hospitals; 95 curettage and 161 expectant management. Treatment was successful in 96% of the women treated with curettage vs. 83% of the women after expectant management (mean difference 13%, 95% confidence interval 5-20). Mean costs were significantly higher in the curettage group (mean difference €1157; 95% C confidence interval €955-1388). The incremental cost-effectiveness ratio for curettage vs. expectant management was €8586 per successfully treated woman. The cost-effectiveness acceptability curve showed that at a willingness-to-pay of €18 200/extra successfully treated women, the probability that curettage is cost-effective is 95%. CONCLUSIONS: Curettage is not cost-effective compared with expectant management in women with an incomplete evacuation of the uterus after misoprostol treatment. This indicates that curettage in this group should be restrained.

OPTimal IMAging strategy in patients suspected of non-traumatic pulmonary disease at the emergency department: chest X-ray or ultra-low-dose CT (OPTIMACT)-a randomised controlled trial chest X-ray or ultra-low-dose CT at the ED: design and rationale.

BACKGROUND: Chest X-ray has been the standard imaging method for patients suspected of non-traumatic pulmonary disease at the emergency department (ED) for years. Recently, ultra-low-dose chest computed tomography (ULD chest CT) has been introduced, which provides substantially more detailed information on pulmonary conditions that may cause pulmonary disease, with a dose in the order of chest X-ray (0.1 vs. 0.05 mSv). The OPTimal IMAging strategy in patients suspected of non-traumatic pulmonary disease at the emergency department: chest X-ray or CT (OPTIMACT) study is a randomized trial designed to evaluate the effectiveness of replacing chest X-ray for ULD chest CT in the diagnostic work-up of patients suspected of non-traumatic pulmonary disease at the ED. METHODS: Two thousand four hundred patients presenting at the ED with pulmonary complaints and suspected of non-traumatic pulmonary disease will be enrolled in this multicenter, pragmatic, randomized trial. During randomly assigned periods of one calendar month, either conventional chest X-ray or ULD chest CT scan will be used as the imaging strategy. Randomization will rely on computer-generated blocks of 2 months to control for seasonal effects. Chest X-ray and ULD chest CT will be performed in a standardized way, after obtaining the clinical history and performing physical examination and initial laboratory tests. The primary outcome measure is functional health at 28 days. Secondary outcome measures are mental health, length of hospital stay, mortality within 28 days, quality-adjusted life years (QALYs) during the first 28 days, correct diagnoses at ED discharge as compared to the final post hoc diagnosis, and number of patients in follow-up because of incidental findings on chest X-ray or ULD chest CT. In an economic evaluation, we will estimate total health care costs during the first 28 days. DISCUSSION: This pragmatic trial will clarify the effects of replacing chest X-ray by ULD chest CT in daily practice, in terms of patient-related health outcomes and costs, in the diagnostic work-up of patients suspected of non-traumatic pulmonary disease at the ED. TRIAL REGISTRATION: The OPTIMACT trial is registered in the Netherlands National Trial Register under number NTR6163. The date of registration is December 6, 2016.

Selecting pH cut-offs for the safe verification of nasogastric feeding tube placement: a decision analytical modelling approach.

OBJECTIVES: The existing British National Patient Safety Agency (NPSA) safety guideline recommends testing the pH of nasogastric (NG) tube aspirates. Feeding is considered safe if a pH of 5.5 or lower has been observed; otherwise chest X-rays are recommended. Our previous research found that at 5.5, the pH test lacks sensitivity towards oesophageal placements, a major risk identified by feeding experts. The aim of this research is to use a decision analytic modelling approach to systematically assess the safety of the pH test under cut-offs 1-9. MATERIALS AND METHODS: We mapped out the care pathway according to the existing safety guideline where the pH test is used as a first-line test, followed by chest x-rays. Decision outcomes were scored on a 0-100 scale in terms of safety. Sensitivities and specificities of the pH test at each cut-off were extracted from our previous research. Aggregating outcome scores and probabilities resulted in weighted scores which enabled an analysis of the relative safety of the checking procedure under various pH cut-offs. RESULTS: The pH test was the safest under cut-off 5 when there was ≥30% of NG tube misplacements. Under cut-off 5, respiratory feeding was excluded; oesophageal feeding was kept to a minimum to balance the need of chest X-rays for patients with a pH higher than 5. Routine chest X-rays were less safe than the pH test while to feed all without safety checks was the most risky. DISCUSSION: The safety of the current checking procedure is sensitive to the choice of pH cut-offs, the impact of feeding delays, the accuracy of the pH in the oesophagus, as well as the extent of tube misplacements. CONCLUSIONS: The pH test with 5 as the cut-off was the safest overall. It is important to understand the local clinical environment so that appropriate choice of pH cut-offs can be made to maximise safety and to minimise the use of chest X-rays. TRIAL REGISTRATION NUMBER: ISRCTN11170249; Pre-results.

Cost-effectiveness of laparoscopy as diagnostic tool before primary cytoreductive surgery in ovarian cancer.

OBJECTIVE: To evaluate the cost-effectiveness of a diagnostic laparoscopy prior to primary cytoreductive surgery to prevent futile primary cytoreductive surgery (i.e. leaving >1cm residual disease) in patients suspected of advanced stage ovarian cancer. METHODS: An economic analysis was conducted alongside a randomized controlled trial in which patients suspected of advanced stage ovarian cancer who qualified for primary cytoreductive surgery were randomized to either laparoscopy or primary cytoreductive surgery. Direct medical costs from a health care perspective over a 6-month time horizon were analyzed. Health outcomes were expressed in quality-adjusted life-years (QALYs) and utility was based on patient's response to the EQ-5D questionnaires. We primarily focused on direct medical costs based on Dutch standard prices. RESULTS: We studied 201 patients, of whom 102 were randomized to laparoscopy and 99 to primary cytoreductive surgery. No significant difference in QALYs (utility=0.01; 95% CI 0.006 to 0.02) was observed. Laparoscopy reduced the number of futile laparotomies from 39% to 10%, while its costs were € 1400 per intervention, making the overall costs of both strategies comparable (difference € -80 per patient (95% CI -470 to 300)). Findings were consistent across various sensitivity analyses. CONCLUSION: In patients with suspected advanced stage ovarian cancer, a diagnostic laparoscopy reduced the number of futile laparotomies, without increasing total direct medical health care costs, or adversely affecting complications or quality of life.

Cost-effectiveness of single versus double embryo transfer in IVF in relation to female age.

OBJECTIVE: To evaluate the cost-effectiveness of single embryo transfer followed by an additional frozen-thawed single embryo transfer, if more embryos are available, as compared to double embryo transfer in relation to female age. STUDY DESIGN: We used a decision tree model to evaluate the costs from a healthcare provider perspective and the pregnancy rates of two embryo transfer policies: one fresh single embryo transfer followed by an additional frozen-thawed single embryo transfer, if more embryos are available (strategy I), and double embryo transfer (strategy II). The analysis was performed on an intention-to-treat basis. Sensitivity analyses were carried out to evaluate the robustness of our model and to identify which model parameters had the strongest impact on the results. RESULTS: SET followed by an additional frozen-thawed single embryo transfer if available was dominant, less costly and more effective, over DET in women under 32 years. In women aged 32 or older DET was more effective than SET followed by an additional frozen-thawed single embryo transfer if available but also more costly. CONCLUSION: SET followed by an additional frozen-thawed single embryo transfer should be the preferred strategy in women under 32 undergoing IVF. The choice for SET followed by an additional frozen-thawed single embryo transfer or DET in women aged 32 or older depends on individual patient preferences and on how much society is willing to pay for an extra child. There is a strong need for a randomized clinical trial comparing the cost and effects of SET followed by an additional frozen-thawed single embryo transfer and DET in the latter category of women.

Validation of new cancer biomarkers: a position statement from the European group on tumor markers.

BACKGROUND: Biomarkers are playing increasingly important roles in the detection and management of patients with cancer. Despite an enormous number of publications on cancer biomarkers, few of these biomarkers are in widespread clinical use. CONTENT: In this review, we discuss the key steps in advancing a newly discovered cancer candidate biomarker from pilot studies to clinical application. Four main steps are necessary for a biomarker to reach the clinic: analytical validation of the biomarker assay, clinical validation of the biomarker test, demonstration of clinical value from performance of the biomarker test, and regulatory approval. In addition to these 4 steps, all biomarker studies should be reported in a detailed and transparent manner, using previously published checklists and guidelines. Finally, all biomarker studies relating to demonstration of clinical value should be registered before initiation of the study. SUMMARY: Application of the methodology outlined above should result in a more efficient and effective approach to the development of cancer biomarkers as well as the reporting of cancer biomarker studies. With rigorous application, all stakeholders, and especially patients, would be expected to benefit.

Circulating antigen tests and urine reagent strips for diagnosis of active schistosomiasis in endemic areas.

BACKGROUND: Point-of-care (POC) tests for diagnosing schistosomiasis include tests based on circulating antigen detection and urine reagent strip tests. If they had sufficient diagnostic accuracy they could replace conventional microscopy as they provide a quicker answer and are easier to use. OBJECTIVES: To summarise the diagnostic accuracy of: a) urine reagent strip tests in detecting active Schistosoma haematobium infection, with microscopy as the reference standard; and b) circulating antigen tests for detecting active Schistosoma infection in geographical regions endemic for Schistosoma mansoni or S. haematobium or both, with microscopy as the reference standard. SEARCH METHODS: We searched the electronic databases MEDLINE, EMBASE, BIOSIS, MEDION, and Health Technology Assessment (HTA) without language restriction up to 30 June 2014. SELECTION CRITERIA: We included studies that used microscopy as the reference standard: for S. haematobium, microscopy of urine prepared by filtration, centrifugation, or sedimentation methods; and for S. mansoni, microscopy of stool by Kato-Katz thick smear. We included studies on participants residing in endemic areas only. DATA COLLECTION AND ANALYSIS: Two review authors independently extracted data, assessed quality of the data using QUADAS-2, and performed meta-analysis where appropriate. Using the variability of test thresholds, we used the hierarchical summary receiver operating characteristic (HSROC) model for all eligible tests (except the circulating cathodic antigen (CCA) POC for S. mansoni, where the bivariate random-effects model was more appropriate). We investigated heterogeneity, and carried out indirect comparisons where data were sufficient. Results for sensitivity and specificity are presented as percentages with 95% confidence intervals (CI). MAIN RESULTS: We included 90 studies; 88 from field settings in Africa. The median S. haematobium infection prevalence was 41% (range 1% to 89%) and 36% for S. mansoni (range 8% to 95%). Study design and conduct were poorly reported against current standards. Tests for S. haematobium Urine reagent test strips versus microscopyCompared to microscopy, the detection of microhaematuria on test strips had the highest sensitivity and specificity (sensitivity 75%, 95% CI 71% to 79%; specificity 87%, 95% CI 84% to 90%; 74 studies, 102,447 participants). For proteinuria, sensitivity was 61% and specificity was 82% (82,113 participants); and for leukocyturia, sensitivity was 58% and specificity 61% (1532 participants). However, the difference in overall test accuracy between the urine reagent strips for microhaematuria and proteinuria was not found to be different when we compared separate populations (P = 0.25), or when direct comparisons within the same individuals were performed (paired studies; P = 0.21).When tests were evaluated against the higher quality reference standard (when multiple samples were analysed), sensitivity was marginally lower for microhaematuria (71% vs 75%) and for proteinuria (49% vs 61%). The specificity of these tests was comparable. Antigen assayCompared to microscopy, the CCA test showed considerable heterogeneity; meta-analytic sensitivity estimate was 39%, 95% CI 6% to 73%; specificity 78%, 95% CI 55% to 100% (four studies, 901 participants). Tests for S. mansoni Compared to microscopy, the CCA test meta-analytic estimates for detecting S. mansoni at a single threshold of trace positive were: sensitivity 89% (95% CI 86% to 92%); and specificity 55% (95% CI 46% to 65%; 15 studies, 6091 participants) Against a higher quality reference standard, the sensitivity results were comparable (89% vs 88%) but specificity was higher (66% vs 55%). For the CAA test, sensitivity ranged from 47% to 94%, and specificity from 8% to 100% (4 studies, 1583 participants). AUTHORS' CONCLUSIONS: Among the evaluated tests for S. haematobium infection, microhaematuria correctly detected the largest proportions of infections and non-infections identified by microscopy.The CCA POC test for S. mansoni detects a very large proportion of infections identified by microscopy, but it misclassifies a large proportion of microscopy negatives as positives in endemic areas with a moderate to high prevalence of infection, possibly because the test is potentially more sensitive than microscopy.

Cochran's Q test was useful to assess heterogeneity in likelihood ratios in studies of diagnostic accuracy.

OBJECTIVES: Empirical evaluations have demonstrated that diagnostic accuracy frequently shows significant heterogeneity between subgroups of patients within a study. We propose to use Cochran's Q test to assess heterogeneity in diagnostic likelihood ratios (LRs). STUDY DESIGN AND SETTING: We reanalyzed published data of six articles that showed within-study heterogeneity in diagnostic accuracy. We used the Q test to assess heterogeneity in LRs and compared the results of the Q test with those obtained using another method for stratified analysis of LRs, based on subgroup confidence intervals. We also studied the behavior of the Q test using hypothetical data. RESULTS: The Q test detected significant heterogeneity in LRs in all six example data sets. The Q test detected significant heterogeneity in LRs more frequently than the confidence interval approach (38% vs. 20%). When applied to hypothetical data, the Q test would be able to detect relatively small variations in LRs, of about a twofold increase, in a study including 300 participants. CONCLUSION: Reanalysis of published data using the Q test can be easily performed to assess heterogeneity in diagnostic LRs between subgroups of patients, potentially providing important information to clinicians who base their decisions on published LRs.

Applying Grading of Recommendations Assessment, Development and Evaluation (GRADE) to diagnostic tests was challenging but doable.

OBJECTIVES: The Grading of Recommendations Assessment, Development and Evaluation (GRADE) Working Group developed an approach to assess the quality of evidence of diagnostic tests. Its use in Cochrane diagnostic test accuracy reviews is new. We applied this approach to three Cochrane reviews with the aim of better understanding the application of the GRADE criteria to such reviews. STUDY DESIGN AND SETTING: We selected reviews to achieve clinical and methodological diversities. At least three assessors independently assessed each review according to the GRADE criteria of risk of bias, indirectness, imprecision, inconsistency, and publication bias. Two teleconferences were held to share experiences. RESULTS: For the interpretation of the GRADE criteria, it made a difference whether assessors looked at the evidence from a patient-important outcome perspective or from a test accuracy standpoint. GRADE criteria such as inconsistency, imprecision, and publication bias were challenging to apply as was the assessment of comparative test accuracy reviews. CONCLUSION: The perspective from which evidence is graded can influence judgments about quality. Guidance on application of GRADE to comparative test reviews and on the GRADE criteria of inconsistency, imprecision, and publication bias will facilitate the operationalization of GRADE for diagnostics.

An independent jury-based consensus conference model for the development of recommendations in medico-surgical practice.

BACKGROUND: There is an increasing demand for standardization in the choice of treatments for specific conditions, so-called personalized medicine. The task is far from trivial, because the perspectives from many stakeholders must be respected, including patients and health care providers, as well as payers or governments to better control costs while optimizing quality of care. One approach to provide widely accepted therapies is the consensus conference. METHODS: We describe a novel methodology to achieve consensus in controversial areas with the main goal to minimize biases. RESULTS: The principle of this approach relies on a clear distinction between those who provide the evidence (experts) and those who draw the final recommendations (the jury). The jury consists of individuals with sufficient background knowledge to cover the perspectives of all stakeholders' without being involved directly in the topic under evaluation. The organizing committee, the experts, and the jury interact within 3 phases: Preparation, the actual consensus conference, and deliberations. Each question is addressed by a panel of experts, leading to the proposition of recommendations at the conference meeting, which are challenged by the jury and the audience. Based on all available information, the jury finalizes the consensus recommendations, which are eventually published and made available to all. CONCLUSION: This novel model of consensus conference allows the construction of consensual, evidence-based, explicit recommendations for therapies in a process that may also identify issues for further research, eventually fostering progress in the field.

From biomarkers to medical tests: the changing landscape of test evaluation.

Regulators and healthcare payers are increasingly demanding evidence that biomarkers deliver patient benefits to justify their use in clinical practice. Laboratory professionals need to be familiar with these evidence requirements to better engage in biomarker research and decisions about their appropriate use. This paper by a multidisciplinary group of the European Federation of Clinical Chemistry and Laboratory Medicine describes the pathway of a laboratory assay measuring a biomarker to becoming a medically useful test. We define the key terms, principles and components of the test evaluation process. Unlike previously described linearly staged models, we illustrate how the essential components of analytical and clinical performances, clinical and cost-effectiveness and the broader impact of testing assemble in a dynamic cycle. We highlight the importance of defining clinical goals and how the intended application of the biomarker in the clinical pathway should drive each component of test evaluation. This approach emphasizes the interaction of the different components, and that clinical effectiveness data should be fed back to refine analytical and clinical performances to achieve improved outcomes. The framework aims to support the understanding of key stakeholders. The laboratory profession needs to strengthen collaboration with industry and experts in evidence-based medicine, regulatory bodies and policy makers for better decisions about the use of new and existing medical tests.