Benefit-Harm Analysis for Informed Decision Making on Participating in Colorectal Cancer Screening: A Modeling Study.

OBJECTIVES: To facilitate informed decision making on participating in colorectal cancer (CRC) screening, we assessed the benefit-harm balance of CRC screening for a wide range of subgroups over different time horizons. METHODS: The study combined incidence proportions of benefits and harms of (not) participating in CRC screening estimated by the Adenoma and Serrated pathway to CAncer microsimulation model, a preference eliciting survey, and benefit-harm balance modeling combining all outcomes to determine the net health benefit of CRC screening over 10, 20, and 30 years. Probability of net health benefit was estimated for 210 different subgroups based on age, sex, previous participation in CRC screening, and lifestyle. RESULTS: CRC screening was net beneficial in 183 of 210 subgroups over 30 years (median probability [MP] of 0.79, interquartile range [IQR] of 0.69-0.85) across subgroups. Net health benefit was greater for men (MP 0.82; IQR 0.69-0.89) than women (MP 0.76; IQR 0.67-0.83) and for those without history of participation in previous screenings (MP 0.84; IQR 0.80-0.89) compared with those with (MP 0.69; IQR 0.59-0.75). Net health benefit decreased with increasing age, from MP of 0.84 (IQR 0.80-0.86) at age 55 to 0.61 (IQR 0.56-0.71) at age 75. Shorter time horizons led to lower benefit, with MP of 0.70 (IQR 0.62-0.80) over 20 years and 0.54 (IQR 0.48-0.67) over 10 years. CONCLUSIONS: Our benefit-harm analysis provides information about net health benefit of screening participation, based on important characteristics and preferences of individuals, which could assist screening invitees in making informed decisions on screening participation.

Perceived Importance of the Benefits and Harms of Colorectal Cancer Screening: A Best-Worst Scaling Study.

OBJECTIVES: To elicit the relative importance of the benefits and harms of colorectal cancer (CRC) screening among potential screening participants in the Dutch population. METHODS: In a consensus meeting with 11 experts, risk reduction of CRC and CRC deaths (benefits) and complications from colonoscopy, stress of receiving positive fecal immunological test (FIT) results, as well as false-positive and false-negative FIT results (harms) were selected as determinant end points to consider during decision making. We conducted an online best-worst scaling survey among adults aged 55 to 75 years from the Dutch Health Care Consumer Panel of The Netherlands Institute for Health Services Research to elicit preference values for these outcomes. The preference values were estimated using conditional logit regression. RESULTS: Of 265 participants, 234 (89%) had ever participated in CRC screening. Compared with the stress of receiving a positive FIT result, the outcome perceived most important was the risk of CRC death (odds ratio [OR] 4.5; 95% confidence interval [CI] 3.9-5.1), followed by risk of CRC (OR 4.1; 95% CI 3.6-4.7), a false-negative FIT result (OR 3.1; 95% CI 2.7-3.5), colonoscopy complications (OR 1.6; 95% CI 1.4-1.8), and a false-positive FIT result (OR 1.4; 95% CI 1.3-1.6). The magnitude of these differences in perceived importance varied according to age, educational level, ethnic background, and whether the individual had previously participated in CRC screening. CONCLUSION: Dutch men and women eligible for FIT-based CRC screening perceive the benefits of screening to be more important than the harms.

Cross-Sectional Evaluation of Open Science Practices at Imaging Journals: A Meta-Research Study.

Objective: To evaluate open science policies of imaging journals, and compliance to these policies in published articles. Methods: From imaging journals listed we extracted open science policy details: protocol registration, reporting guidelines, funding, ethics and conflicts of interest (COI), data sharing, and open access publishing. The 10 most recently published studies from each journal were assessed to determine adherence to these policies. We calculated the proportion of open science policies into an Open Science Score (OSS) for all journals and articles. We evaluated relationships between OSS and journal/article level variables. Results: 82 journals/820 articles were included. The OSS of journals and articles was 58.3% and 31.8%, respectively. Of the journals, 65.9% had registration and 78.1% had reporting guideline policies. 79.3% of journals were members of COPE, 81.7% had plagiarism policies, 100% required disclosure of funding, and 97.6% required disclosure of COI and ethics approval. 81.7% had data sharing policies and 15.9% were fully open access. 7.8% of articles had a registered protocol, 8.4% followed a reporting guideline, 77.4% disclosed funding, 88.7% disclosed COI, and 85.6% reported ethics approval. 12.3% of articles shared their data. 51% of articles were available through open access or as a preprint. OSS was higher for journal with DOAJ membership (80% vs 54.2%; P < .0001). Impact factor was not correlated with journal OSS. Knowledge synthesis articles has a higher OSS scores (44.5%) than prospective/retrospective studies (32.6%, 30.0%, P < .0001). Conclusion: Imaging journals endorsed just over half of open science practices considered; however, the application of these practices at the article level was lower.

Evaluating the Impact of Peer Review on the Completeness of Reporting in Imaging Diagnostic Test Accuracy Research.

BACKGROUND: Despite the nearly ubiquitous reported use of peer review among reputable medical journals, there is limited evidence to support the use of peer review to improve the quality of biomedical research and in particular, imaging diagnostic test accuracy (DTA) research. PURPOSE: To evaluate whether peer review of DTA studies published by imaging journals is associated with changes in completeness of reporting, transparency for risk of bias assessment, and spin. STUDY TYPE: Retrospective cross-sectional study. STUDY SAMPLE: Cross-sectional study of articles published in Journal of Magnetic Resonance Imaging (JMRI), Canadian Association of Radiologists Journal (CARJ), and European Radiology (EuRad) before March 31, 2020. ASSESSMENT: Initial submitted and final versions of manuscripts were evaluated for completeness of reporting using the Standards for Reporting Diagnostic Accuracy Studies (STARD) 2015 and STARD for Abstracts guidelines, transparency of reporting for risk of bias assessment based on Quality Assessment of Diagnostic Accuracy Studies 2 (QUADAS-2), and actual and potential spin using modified published criteria. STATISTICAL TESTS: Two-tailed paired t-tests and paired Wilcoxon signed-rank tests were used for comparisons. A P value <0.05 was considered to be statistically significant. RESULTS: We included 84 diagnostic accuracy studies accepted by three journals between 2014 and 2020 (JMRI = 30, CARJ = 23, and EuRad = 31) of the 692 which were screened. Completeness of reporting according to STARD 2015 increased significantly between initial submissions and final accepted versions (average reported items: 16.67 vs. 17.47, change of 0.80 [95% confidence interval 0.25-1.17]). No significant difference was found for the reporting of STARD for Abstracts (5.28 vs. 5.25, change of -0.03 [-0.15 to 0.11], P = 0.74), QUADAS-2 (6.08 vs. 6.11, change of 0.03 [-1.00 to 0.50], P = 0.92), actual "spin" (2.36 vs. 2.40, change of 0.04 [0.00 to 1.00], P = 0.39) or potential "spin" (2.93 vs. 2.81, change of -0.12 [-1.00 to 0.00], P = 0.23) practices. CONCLUSION: Peer review is associated with a marginal improvement in completeness of reporting in published imaging DTA studies, but not with improvement in transparency for risk of bias assessment or reduction in spin. LEVEL OF EVIDENCE: 3 TECHNICAL EFFICACY STAGE: 1.

Association of Accuracy, Conclusions, and Reporting Completeness With Acceptance by Radiology Conferences and Journals.

BACKGROUND: Preferential publication of studies with positive findings can lead to overestimation of diagnostic test accuracy (i.e. publication bias). Understanding the contribution of the editorial process to publication bias could inform interventions to optimize the evidence guiding clinical decisions. PURPOSE/HYPOTHESIS: To evaluate whether accuracy estimates, abstract conclusion positivity, and completeness of abstract reporting are associated with acceptance to radiology conferences and journals. STUDY TYPE: Meta-research. POPULATION: Abstracts submitted to radiology conferences (European Society of Gastrointestinal and Abdominal Radiology (ESGAR) and International Society for Magnetic Resonance in Medicine (ISMRM)) from 2008 to 2018 and manuscripts submitted to radiology journals (Radiology, Journal of Magnetic Resonance Imaging [JMRI]) from 2017 to 2018. Primary clinical studies evaluating sensitivity and specificity of a diagnostic imaging test in humans with available editorial decisions were included. ASSESSMENT: Primary variables (Youden's index [YI > 0.8 vs. <0.8], abstract conclusion positivity [positive vs. neutral/negative], number of reported items on the Standards for Reporting of Diagnostic Accuracy Studies [STARD] for Abstract guideline) and confounding variables (prospective vs. retrospective/unreported, sample size, study duration, interobserver agreement assessment, subspecialty, modality) were extracted. STATISTICAL TESTS: Multivariable logistic regression to obtain adjusted odds ratio (OR) as a measure of the association between the primary variables and acceptance by radiology conferences and journals; 95% confidence intervals (CIs) and P-values were obtained; the threshold for statistical significance was P < 0.05. RESULTS: A total of 1000 conference abstracts (500 ESGAR and 500 ISMRM) and 1000 journal manuscripts (505 Radiology and 495 JMRI) were included. Conference abstract acceptance was not significantly associated with YI (adjusted OR = 0.97 for YI > 0.8; CI = 0.70-1.35), conclusion positivity (OR = 1.21 for positive conclusions; CI = 0.75-1.90) or STARD for Abstracts adherence (OR = 0.96 per unit increase in reported items; CI = 0.82-1.18). Manuscripts with positive abstract conclusions were less likely to be accepted by radiology journals (OR = 0.45; CI = 0.24-0.86), while YI (OR = 0.85; CI = 0.56-1.29) and STARD for Abstracts adherence (OR = 1.06; CI = 0.87-1.30) showed no significant association. Positive conclusions were present in 86.7% of submitted conference abstracts and 90.2% of journal manuscripts. DATA CONCLUSION: Diagnostic test accuracy studies with positive findings were not preferentially accepted by the evaluated radiology conferences or journals. EVIDENCE LEVEL: 3 TECHNICAL EFFICACY: Stage 2.

QUADAS-C: A Tool for Assessing Risk of Bias in Comparative Diagnostic Accuracy Studies.

Comparative diagnostic test accuracy studies assess and compare the accuracy of 2 or more tests in the same study. Although these studies have the potential to yield reliable evidence regarding comparative accuracy, shortcomings in the design, conduct, and analysis may bias their results. The currently recommended quality assessment tool for diagnostic test accuracy studies, QUADAS-2 (Quality Assessment of Diagnostic Accuracy Studies-2), is not designed for the assessment of test comparisons. The QUADAS-C (Quality Assessment of Diagnostic Accuracy Studies-Comparative) tool was developed as an extension of QUADAS-2 to assess the risk of bias in comparative diagnostic test accuracy studies. Through a 4-round Delphi study involving 24 international experts in test evaluation and a face-to-face consensus meeting, an initial version of the tool was developed that was revised and finalized following a pilot study among potential users. The QUADAS-C tool retains the same 4-domain structure of QUADAS-2 (Patient Selection, Index Test, Reference Standard, and Flow and Timing) and comprises additional questions to each QUADAS-2 domain. A risk-of-bias judgment for comparative accuracy requires a risk-of-bias judgment for the accuracy of each test (resulting from QUADAS-2) and additional criteria specific to test comparisons. Examples of such additional criteria include whether participants either received all index tests or were randomly assigned to index tests, and whether index tests were interpreted with blinding to the results of other index tests. The QUADAS-C tool will be useful for systematic reviews of diagnostic test accuracy addressing comparative questions. Furthermore, researchers may use this tool to identify and avoid risk of bias when designing a comparative diagnostic test accuracy study.

Preferred Reporting Items for a Systematic Review and Meta-analysis of Diagnostic Test Accuracy Studies: The PRISMA-DTA Statement.

Importance: Systematic reviews of diagnostic test accuracy synthesize data from primary diagnostic studies that have evaluated the accuracy of 1 or more index tests against a reference standard, provide estimates of test performance, allow comparisons of the accuracy of different tests, and facilitate the identification of sources of variability in test accuracy. Objective: To develop the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) diagnostic test accuracy guideline as a stand-alone extension of the PRISMA statement. Modifications to the PRISMA statement reflect the specific requirements for reporting of systematic reviews and meta-analyses of diagnostic test accuracy studies and the abstracts for these reviews. Design: Established standards from the Enhancing the Quality and Transparency of Health Research (EQUATOR) Network were followed for the development of the guideline. The original PRISMA statement was used as a framework on which to modify and add items. A group of 24 multidisciplinary experts used a systematic review of articles on existing reporting guidelines and methods, a 3-round Delphi process, a consensus meeting, pilot testing, and iterative refinement to develop the PRISMA diagnostic test accuracy guideline. The final version of the PRISMA diagnostic test accuracy guideline checklist was approved by the group. Findings: The systematic review (produced 64 items) and the Delphi process (provided feedback on 7 proposed items; 1 item was later split into 2 items) identified 71 potentially relevant items for consideration. The Delphi process reduced these to 60 items that were discussed at the consensus meeting. Following the meeting, pilot testing and iterative feedback were used to generate the 27-item PRISMA diagnostic test accuracy checklist. To reflect specific or optimal contemporary systematic review methods for diagnostic test accuracy, 8 of the 27 original PRISMA items were left unchanged, 17 were modified, 2 were added, and 2 were omitted. Conclusions and Relevance: The 27-item PRISMA diagnostic test accuracy checklist provides specific guidance for reporting of systematic reviews. The PRISMA diagnostic test accuracy guideline can facilitate the transparent reporting of reviews, and may assist in the evaluation of validity and applicability, enhance replicability of reviews, and make the results from systematic reviews of diagnostic test accuracy studies more useful.

Rapid Tests for Influenza, Respiratory Syncytial Virus, and Other Respiratory Viruses: A Systematic Review and Meta-analysis.

Rapid diagnosis of respiratory virus infections contributes to patient care. This systematic review evaluates the diagnostic accuracy of rapid tests for the detection of respiratory viruses. We searched Medline and EMBASE for studies evaluating these tests against polymerase chain reaction as the reference standard. Of 179 studies included, 134 evaluated rapid tests for influenza viruses, 32 for respiratory syncytial virus (RSV), and 13 for other respiratory viruses. We used the bivariate random effects model for quantitative meta-analysis of the results. Most tests detected only influenza viruses or RSV. Summary sensitivity and specificity estimates of tests for influenza were 61.1% and 98.9%. For RSV, summary sensitivity was 75.3%, and specificity, 98.7%. We assessed the quality of studies using the Quality Assessment of Diagnostic Accuracy Studies (QUADAS-2) checklist. Because of incomplete reporting, the risk of bias was often unclear. Despite their intended use at the point of care, 26.3% of tests were evaluated in a laboratory setting. Although newly developed tests seem more sensitive, high-quality evaluations of these tests are lacking.

Overinterpretation of Research Findings: Evidence of "Spin" in Systematic Reviews of Diagnostic Accuracy Studies.

BACKGROUND: We wished to assess the frequency of overinterpretation in systematic reviews of diagnostic accuracy studies. METHODS: MEDLINE was searched through PubMed from December 2015 to January 2016. Systematic reviews of diagnostic accuracy studies in English were included if they reported one or more metaanalyses of accuracy estimates. We built and piloted a list of 10 items that represent actual overinterpretation in the abstract and/or full-text conclusion, and a list of 9 items that represent potential overinterpretation. Two investigators independently used the items to score each included systematic review, with disagreements resolved by consensus. RESULTS: We included 112 systematic reviews. The majority had a positive conclusion regarding the accuracy or clinical usefulness of the investigated test in the abstract (n = 83; 74%) and full-text (n = 83; 74%). Of the 112 reviews, 81 (72%) contained at least 1 actual form of overinterpretation in the abstract, and 77 (69%) in the full-text. This was most often a "positive conclusion, not reflecting the reported summary accuracy estimates," in 55 (49%) abstracts and 56 (50%) full-texts and a "positive conclusion, not taking high risk of bias and/or applicability concerns into account," in 47 abstracts (42%) and 26 full-texts (23%). Of these 112 reviews, 107 (96%) contained a form of potential overinterpretation, most frequently "nonrecommended statistical methods for metaanalysis performed" (n = 57; 51%). CONCLUSIONS: Most recent systematic reviews of diagnostic accuracy studies present positive conclusions and a majority contain a form of overinterpretation. This may lead to unjustified optimism about test performance and erroneous clinical decisions and recommendations.

Molecular malaria diagnostics: A systematic review and meta-analysis.

Accurate diagnosis of malaria is essential for identification and subsequent treatment of the disease. Currently, microscopy and rapid diagnostic tests are the most commonly used diagnostics, next to treatment based on clinical signs only. These tests are easy to deploy, but have a relatively high detection limit. With declining prevalence in many areas, there is an increasing need for more sensitive diagnostics. Molecular tools may be a suitable alternative, although costs and technical requirements currently hamper their implementation in resource limited settings. A range of (near) point-of-care diagnostics is therefore under development, including simplifications in sample preparation, amplification and/or read-out of the test. Accuracy data, in combination with technical characteristics, are essential in determining which molecular test, if any, would be the most promising to be deployed. This review presents a comprehensive overview of the currently available molecular malaria diagnostics, ranging from well-known tests to platforms in early stages of evaluation, and systematically evaluates their published accuracy. No important difference in accuracy was found between the most commonly used PCR-based assays (conventional, nested and real-time PCR), with most of them having high sensitivity and specificity, implying that there are no reasons other than practical ones to choose one technique over the other. Loop-mediated isothermal amplification and other (novel) diagnostics appear to be highly accurate as well, with some offering potential to be used in resource-limited settings.

Alkaline phosphatase at diagnosis of primary sclerosing cholangitis and 1 year later: evaluation of prognostic value.

BACKGROUND: Primary sclerosing cholangitis (PSC) is a slowly progressive liver disease. Reliable biomarkers to predict outcome are urgently needed to serve as surrogate endpoints and/or stratifiers in clinical trials. Reduction in serum alkaline phosphatase (ALP) has been proposed as prognostic surrogate marker in PSC. The aim of this study was to asses if ALP at diagnosis (T0), 1 year later (T1), and percentage change between both time points hold prognostic value, and to determine the optimal threshold. METHODS: We retrospectively collected ALP levels at T0 and T1 for patients included in a large PSC cohort. The association of ALP at T0, T1, and percentage change with the combined endpoint (PSC-related death, liver transplantation) was analysed. Predictive value was determined using C-statistics. RESULTS: A total of 366 patients were included, of whom 66 (18%) reached an endpoint: 26 (7%) PSC-related death, 40 (11%) liver transplantation. At T0 and T1, 84% used ursodeoxycholic acid. A positive association was observed between level of ALP at T0 and T1 and the hazard of reaching an endpoint, up to values around 2.5 times upper limit of normal (xULN). A larger decrease in ALP between T0 and T1 decreased the event rate. A range of thresholds (0.5-3×ULN) with about similar C-statistics was found. In this cohort, the optimal threshold was 1.3×ULN at T1. CONCLUSION: ALP can be used to discriminate between PSC patients with a good and a poor prognosis. These findings indicate that ALP can serve as stratifier, and potentially as surrogate endpoint for clinical trials in PSC.

Defining the clinical pathway in cochrane diagnostic test accuracy reviews.

BACKGROUND: The value of a medical test depends on the context in which it might be used. Ideally, questions, results and conclusions of a diagnostic test accuracy (DTA) systematic review should be presented in light of this context. There is increasing acceptance of the value for knowing the impact a test can have on downstream consequences such as costs, implications for further testing and treatment options however there is currently no explicit guidance on how to address this. Authors of a Cochrane diagnostic review have recently been asked to include the clinical pathway in which a test maybe used. We aimed to evaluate how authors were developing their clinical pathways in the light of this. METHODS: We searched the Cochrane Database of Systematic Reviews for all published DTA reviews. We included only those reviews that included a clinical pathway. We developed a checklist, based on the guidance in the Cochrane Handbook for DTA review authors. To this, we added a number of additional descriptors. We checked if the included pathways fulfilled these descriptors as defined by our checklist. RESULTS: We found 47 reviews, of which 33 (73 %) contained aspects pertaining to a clinical pathway. The 33 reviews addressed the clinical pathway differently, both in content and format. Of these, 21 provided a textual description and 12 include visual and textual descriptions. There was considerable variation in how comprehensively review authors adhered to our checklist. Eighteen reviews (51 %) linked the index test results to downstream clinical management actions and patient consequences, but only eight went on to differentially report on the consequences for false negative results and nine on the consequences for false positive results. CONCLUSION: There is substantial variation in the clinical pathway descriptions in Cochrane systematic reviews of test accuracy. Most reviews do not link misclassifications (i.e. false negatives and false positive) to downstream patient consequences. Review authors could benefit from more explicit guidance on how to create such pathways, which in turn can help guide them in their evidence selection and appraisal of the evidence in the context of downstream consequences of testing.

Assessing variability in results in systematic reviews of diagnostic studies.

BACKGROUND: To describe approaches used in systematic reviews of diagnostic test accuracy studies for assessing variability in estimates of accuracy between studies and to provide guidance in this area. METHODS: Meta-analyses of diagnostic test accuracy studies published between May and September 2012 were systematically identified. Information on how the variability in results was investigated was extracted. RESULTS: Of the 53 meta-analyses included in the review, most (n=48; 91%) presented variability in diagnostic accuracy estimates visually either through forest plots or ROC plots and the majority (n=40; 75%) presented a test or statistical measure for the variability. Twenty-eight reviews (53%) tested for variability beyond chance using Cochran's Q test and 31 (58%) reviews quantified it with I(2). 7 reviews (13%) presented between-study variance estimates (τ(2)) from random effects models and 3 of these presented a prediction interval or ellipse to facilitate interpretation. Half of all the meta-analyses specified what was considered a significant amount of variability (n=24; 49%). CONCLUSIONS: Approaches to assessing variability in estimates of accuracy varied widely between diagnostic test accuracy reviews and there is room for improvement. We provide initial guidance, complemented by an overview of the currently available approaches.

Applicability and prognostic value of histologic scoring systems in primary sclerosing cholangitis.

BACKGROUND & AIMS: Primary sclerosing cholangitis (PSC) is a chronic cholestatic liver disease. At present, there is no appropriate histologic scoring system available for PSC, evaluating both degree of necroinflammatory activity (grade) and fibrosis (stage). The aim of this study was to assess if three scoring systems, commonly used in different liver diseases could be applied for grading and/or staging of PSC. METHODS: Sixty-four PSC patients from a Dutch cohort, who underwent diagnostic liver biopsy, were included. Staging was scored using Ishak, Nakanuma, and Ludwig systems. Grading was scored using Ishak and Nakanuma systems. Three measures of outcome were defined; transplant-free survival, time to liver transplantation (LTx) and occurrence of cirrhosis related symptoms (CRS). Association of grade and stage with outcome was estimated using Kaplan-Meier log-rank test, and Cox regression analysis. Correlation with biochemistry was assessed by Spearman's rank test. RESULTS: There were strong associations between disease stage measured by Ishak, Nakanuma, and Ludwig staging systems with both outcome measuring transplant-free survival (Hazard ratio (HR) 2.56; 95% CI 1.11-5.89, HR 6.53; 95% CI 2.01-21.22, HR 1.94; 95% CI 1.00-3.79, respectively), and time to LTx (HR 4.18; 95%CI 1.51-11.56, HR 7.05; 95% CI 1.77-28.11, HR 3.13; 95%CI 1.42-6.87, respectively). Ishak and Nakanuma grading systems were not associated with CRS. Weak correlations between histopathology and liver biochemistry were shown. CONCLUSION: Applying the Nakanuma, Ishak, and Ludwig histopathological staging systems is feasible and clinically relevant given their association with transplant-free survival and time to LTx. This suggests that these staging systems could be likely candidates for surrogate endpoints and stratification purposes in clinical trials in PSC.

Procalcitonin, C-reactive protein, and erythrocyte sedimentation rate for the diagnosis of acute pyelonephritis in children.

BACKGROUND: In children with urinary tract infection (UTI), only those with pyelonephritis (and not cystitis) are at risk for developing long-term renal sequelae. If non-invasive biomarkers could accurately differentiate children with cystitis from children with pyelonephritis, treatment and follow-up could potentially be individualized. OBJECTIVES: The objectives of this review were to 1) determine whether procalcitonin, C-reactive protein (CRP), erythrocyte sedimentation rate (ESR) can replace the acute DMSA scan in the diagnostic evaluation of children with UTI; 2) assess the influence of patient and study characteristics on the diagnostic accuracy of these tests, and 3) compare the performance of the three tests to each other. SEARCH METHODS: We searched MEDLINE, EMBASE, DARE, Web of Science, and BIOSIS Previews for this review. The reference lists of all included articles and relevant systematic reviews were searched to identify additional studies not found through the electronic search. SELECTION CRITERIA: We only considered published studies that evaluated the results of an index test (procalcitonin, CRP, ESR) against the results of an acute-phase DMSA scan (conducted within 30 days of the UTI) in children aged 0 to 18 years with a culture-confirmed episode of UTI. The following cutoff values were used for the primary analysis: 0.5 ng/mL for procalcitonin, 20 mg/L for CRP and 30 mm/h for ESR. DATA COLLECTION AND ANALYSIS: Two authors independently applied the selection criteria to all citations and independently abstracted data. We used the bivariate model to calculate pooled random-effects pooled sensitivity and specificity values. MAIN RESULTS: A total of 24 studies met our inclusion criteria. Seventeen studies provided data for the primary analysis: six studies (434 children) included data on procalcitonin, 13 studies (1638 children) included data on CRP, and six studies (1737 children) included data on ESR (some studies had data on more than one test). The summary sensitivity estimates (95% CI) for the procalcitonin, CRP, ESR tests at the aforementioned cutoffs were 0.86 (0.72 to 0.93), 0.94 (0.85 to 0.97), and 0.87 (0.77 to 0.93), respectively. The summary specificity values for procalcitonin, CRP, and ESR tests at these cutoffs were 0.74 (0.55 to 0.87), 0.39 (0.23 to 0.58), and 0.48 (0.33 to 0.64), respectively. AUTHORS' CONCLUSIONS: The ESR test does not appear to be sufficiently accurate to be helpful in differentiating children with cystitis from children with pyelonephritis. A low CRP value (< 20 mg/L) appears to be somewhat useful in ruling out pyelonephritis (decreasing the probability of pyelonephritis to < 20%), but unexplained heterogeneity in the data prevents us from making recommendations at this time. The procalcitonin test seems better suited for ruling in pyelonephritis, but the limited number of studies and the marked heterogeneity between studies prevents us from reaching definitive conclusions. Thus, at present, we do not find any compelling evidence to recommend the routine use of any of these tests in clinical practice.

Circulating antigen tests and urine reagent strips for diagnosis of active schistosomiasis in endemic areas.

BACKGROUND: Point-of-care (POC) tests for diagnosing schistosomiasis include tests based on circulating antigen detection and urine reagent strip tests. If they had sufficient diagnostic accuracy they could replace conventional microscopy as they provide a quicker answer and are easier to use. OBJECTIVES: To summarise the diagnostic accuracy of: a) urine reagent strip tests in detecting active Schistosoma haematobium infection, with microscopy as the reference standard; and b) circulating antigen tests for detecting active Schistosoma infection in geographical regions endemic for Schistosoma mansoni or S. haematobium or both, with microscopy as the reference standard. SEARCH METHODS: We searched the electronic databases MEDLINE, EMBASE, BIOSIS, MEDION, and Health Technology Assessment (HTA) without language restriction up to 30 June 2014. SELECTION CRITERIA: We included studies that used microscopy as the reference standard: for S. haematobium, microscopy of urine prepared by filtration, centrifugation, or sedimentation methods; and for S. mansoni, microscopy of stool by Kato-Katz thick smear. We included studies on participants residing in endemic areas only. DATA COLLECTION AND ANALYSIS: Two review authors independently extracted data, assessed quality of the data using QUADAS-2, and performed meta-analysis where appropriate. Using the variability of test thresholds, we used the hierarchical summary receiver operating characteristic (HSROC) model for all eligible tests (except the circulating cathodic antigen (CCA) POC for S. mansoni, where the bivariate random-effects model was more appropriate). We investigated heterogeneity, and carried out indirect comparisons where data were sufficient. Results for sensitivity and specificity are presented as percentages with 95% confidence intervals (CI). MAIN RESULTS: We included 90 studies; 88 from field settings in Africa. The median S. haematobium infection prevalence was 41% (range 1% to 89%) and 36% for S. mansoni (range 8% to 95%). Study design and conduct were poorly reported against current standards. Tests for S. haematobium Urine reagent test strips versus microscopyCompared to microscopy, the detection of microhaematuria on test strips had the highest sensitivity and specificity (sensitivity 75%, 95% CI 71% to 79%; specificity 87%, 95% CI 84% to 90%; 74 studies, 102,447 participants). For proteinuria, sensitivity was 61% and specificity was 82% (82,113 participants); and for leukocyturia, sensitivity was 58% and specificity 61% (1532 participants). However, the difference in overall test accuracy between the urine reagent strips for microhaematuria and proteinuria was not found to be different when we compared separate populations (P = 0.25), or when direct comparisons within the same individuals were performed (paired studies; P = 0.21).When tests were evaluated against the higher quality reference standard (when multiple samples were analysed), sensitivity was marginally lower for microhaematuria (71% vs 75%) and for proteinuria (49% vs 61%). The specificity of these tests was comparable. Antigen assayCompared to microscopy, the CCA test showed considerable heterogeneity; meta-analytic sensitivity estimate was 39%, 95% CI 6% to 73%; specificity 78%, 95% CI 55% to 100% (four studies, 901 participants). Tests for S. mansoni Compared to microscopy, the CCA test meta-analytic estimates for detecting S. mansoni at a single threshold of trace positive were: sensitivity 89% (95% CI 86% to 92%); and specificity 55% (95% CI 46% to 65%; 15 studies, 6091 participants) Against a higher quality reference standard, the sensitivity results were comparable (89% vs 88%) but specificity was higher (66% vs 55%). For the CAA test, sensitivity ranged from 47% to 94%, and specificity from 8% to 100% (4 studies, 1583 participants). AUTHORS' CONCLUSIONS: Among the evaluated tests for S. haematobium infection, microhaematuria correctly detected the largest proportions of infections and non-infections identified by microscopy.The CCA POC test for S. mansoni detects a very large proportion of infections identified by microscopy, but it misclassifies a large proportion of microscopy negatives as positives in endemic areas with a moderate to high prevalence of infection, possibly because the test is potentially more sensitive than microscopy.

Galactomannan detection for invasive aspergillosis in immunocompromised patients.

BACKGROUND: Invasive aspergillosis is the most common life-threatening opportunistic invasive mycosis in immunocompromised patients. A test for invasive aspergillosis should neither be too invasive nor too great a burden for the already weakened patient. The serum galactomannan enzyme-linked immunosorbent assay (ELISA) seems to have the potential to meet both requirements. OBJECTIVES: To obtain summary estimates of the diagnostic accuracy of galactomannan detection in serum for the diagnosis of invasive aspergillosis. SEARCH METHODS: We searched MEDLINE, EMBASE and Web of Science with both MeSH terms and text words for both aspergillosis and the sandwich ELISA. We checked the reference lists of included studies and review articles for additional studies. We conducted the searches in February 2014. SELECTION CRITERIA: We included cross-sectional studies, case-control designs and consecutive series of patients assessing the diagnostic accuracy of galactomannan detection for the diagnosis of invasive aspergillosis in patients with neutropenia or patients whose neutrophils are functionally compromised. The reference standard was composed of the criteria given by the European Organization for Research and Treatment of Cancer (EORTC) and the Mycoses Study Group (MSG). DATA COLLECTION AND ANALYSIS: Two review authors independently assessed quality and extracted data. We carried out meta-analysis using the bivariate method. We investigated sources of heterogeneity by adding potential sources of heterogeneity to the model as covariates. MAIN RESULTS: We included 54 studies in the review (50 in the meta-analyses), containing 5660 patients, of whom 586 had proven or probable invasive aspergillosis. When using an optical density index (ODI) of 0.5 as a cut-off value, the sensitivity of the test was 82% (73% to 90%) and the specificity was 81% (72% to 90%). At a cut-off value of 1.0 ODI, the sensitivity was 72% (65% to 80%) and the specificity was 88% (84% to 92%). At a cut-off value of 1.5 ODI, the sensitivity was 61% (47% to 75%) and the specificity was 93% (89% to 97%). None of the potential sources of heterogeneity had a statistically significant effect on either sensitivity or specificity. AUTHORS' CONCLUSIONS: If we used the test at a cut-off value of 0.5 ODI in a population of 100 patients with a disease prevalence of 9% (overall median prevalence), two patients who have invasive aspergillosis would be missed (sensitivity 82%, 18% false negatives), and 17 patients would be treated unnecessarily or referred unnecessarily for further testing (specificity 81%, 19% false negatives). If we used the test at a cut-off value of 1.5 in the same population, that would mean that four invasive aspergillosis patients would be missed (sensitivity 61%, 39% false negatives), and six patients would be treated or referred for further testing unnecessarily (specificity 93%, 7% false negatives). These numbers should, however, be interpreted with caution because the results were very heterogeneous.