Author Correction: Chimeric peptidomimetic antibiotics against Gram-negative bacteria.

An Amendment to this paper has been published and can be accessed via a link at the top of the paper.

Chimeric peptidomimetic antibiotics against Gram-negative bacteria.

There is an urgent need for new antibiotics against Gram-negative pathogens that are resistant to carbapenem and third-generation cephalosporins, against which antibiotics of last resort have lost most of their efficacy. Here we describe a class of synthetic antibiotics inspired by scaffolds derived from natural products. These chimeric antibiotics contain a ß-hairpin peptide macrocycle linked to the macrocycle found in the polymyxin and colistin family of natural products. They are bactericidal and have a mechanism of action that involves binding to both lipopolysaccharide and the main component (BamA) of the ß-barrel folding complex (BAM) that is required for the folding and insertion of ß-barrel proteins into the outer membrane of Gram-negative bacteria. Extensively optimized derivatives show potent activity against multidrug-resistant pathogens, including all of the Gram-negative members of the ESKAPE pathogens1. These derivatives also show favourable drug properties and overcome colistin resistance, both in vitro and in vivo. The lead candidate is currently in preclinical toxicology studies that-if successful-will allow progress into clinical studies that have the potential to address life-threatening infections by the Gram-negative pathogens, and thus to resolve a considerable unmet medical need.

QUADAS-C: A Tool for Assessing Risk of Bias in Comparative Diagnostic Accuracy Studies.

Comparative diagnostic test accuracy studies assess and compare the accuracy of 2 or more tests in the same study. Although these studies have the potential to yield reliable evidence regarding comparative accuracy, shortcomings in the design, conduct, and analysis may bias their results. The currently recommended quality assessment tool for diagnostic test accuracy studies, QUADAS-2 (Quality Assessment of Diagnostic Accuracy Studies-2), is not designed for the assessment of test comparisons. The QUADAS-C (Quality Assessment of Diagnostic Accuracy Studies-Comparative) tool was developed as an extension of QUADAS-2 to assess the risk of bias in comparative diagnostic test accuracy studies. Through a 4-round Delphi study involving 24 international experts in test evaluation and a face-to-face consensus meeting, an initial version of the tool was developed that was revised and finalized following a pilot study among potential users. The QUADAS-C tool retains the same 4-domain structure of QUADAS-2 (Patient Selection, Index Test, Reference Standard, and Flow and Timing) and comprises additional questions to each QUADAS-2 domain. A risk-of-bias judgment for comparative accuracy requires a risk-of-bias judgment for the accuracy of each test (resulting from QUADAS-2) and additional criteria specific to test comparisons. Examples of such additional criteria include whether participants either received all index tests or were randomly assigned to index tests, and whether index tests were interpreted with blinding to the results of other index tests. The QUADAS-C tool will be useful for systematic reviews of diagnostic test accuracy addressing comparative questions. Furthermore, researchers may use this tool to identify and avoid risk of bias when designing a comparative diagnostic test accuracy study.

Optimizing the Use of High-Sensitivity Troponin Assays for the Early Rule-out of Myocardial Infarction in Patients Presenting with Chest Pain: A Systematic Review.

BACKGROUND: We assessed the accuracy and clinical effectiveness of high-sensitivity cardiac troponin (hs-cTn) assays for early rule-out of non-ST-segment elevation myocardial infarction (NSTEMI) in adults presenting with acute chest pain. METHODS: Sixteen databases were searched to September 2019. Review methods followed published guidelines. The bivariate model was used to estimate summary sensitivity and specificity with 95% confidence intervals for meta-analyses involving 4 or more studies, otherwise random-effects logistic regression was used. RESULTS: Thirty-seven studies (124 publications) were included in the review. The hs-cTn test strategies evaluated in the included studies were defined by the combination of 4 factors (assay, number of tests, timing of tests, and threshold concentration or change in concentration between tests). Clinical opinion indicated a minimum acceptable sensitivity of 97%. A single test at presentation using a threshold at or near the assay limit of detection could reliably rule-out NSTEMI for a range of hs-cTn assays. Serial testing strategies, which include an immediate rule-out step, increased the proportion ruled out without loss of sensitivity. Finally, serial testing strategies without an immediate rule-out step had excellent sensitivity and specificity, but at the expense of the option for immediate patient discharge. CONCLUSION: Test strategies that comprise an initial rule-out step, based on low hs-cTn concentrations at presentation and a minimum symptom duration, and a second step for those not ruled-out that incorporates a small absolute change in hs-cTn at 1, 2, or 3 hours, produce the highest rule-out rates with a very low risk of missed NSTEMI. PROSPERO REGISTRATION: CRD42019154716.

PROBAST: A Tool to Assess the Risk of Bias and Applicability of Prediction Model Studies.

Clinical prediction models combine multiple predictors to estimate risk for the presence of a particular condition (diagnostic models) or the occurrence of a certain event in the future (prognostic models). PROBAST (Prediction model Risk Of Bias ASsessment Tool), a tool for assessing the risk of bias (ROB) and applicability of diagnostic and prognostic prediction model studies, was developed by a steering group that considered existing ROB tools and reporting guidelines. The tool was informed by a Delphi procedure involving 38 experts and was refined through piloting. PROBAST is organized into the following 4 domains: participants, predictors, outcome, and analysis. These domains contain a total of 20 signaling questions to facilitate structured judgment of ROB, which was defined to occur when shortcomings in study design, conduct, or analysis lead to systematically distorted estimates of model predictive performance. PROBAST enables a focused and transparent approach to assessing the ROB and applicability of studies that develop, validate, or update prediction models for individualized predictions. Although PROBAST was designed for systematic reviews, it can be used more generally in critical appraisal of prediction model studies. Potential users include organizations supporting decision making, researchers and clinicians who are interested in evidence-based medicine or involved in guideline development, journal editors, and manuscript reviewers.

PROBAST: A Tool to Assess Risk of Bias and Applicability of Prediction Model Studies: Explanation and Elaboration.

Prediction models in health care use predictors to estimate for an individual the probability that a condition or disease is already present (diagnostic model) or will occur in the future (prognostic model). Publications on prediction models have become more common in recent years, and competing prediction models frequently exist for the same outcome or target population. Health care providers, guideline developers, and policymakers are often unsure which model to use or recommend, and in which persons or settings. Hence, systematic reviews of these studies are increasingly demanded, required, and performed. A key part of a systematic review of prediction models is examination of risk of bias and applicability to the intended population and setting. To help reviewers with this process, the authors developed PROBAST (Prediction model Risk Of Bias ASsessment Tool) for studies developing, validating, or updating (for example, extending) prediction models, both diagnostic and prognostic. PROBAST was developed through a consensus process involving a group of experts in the field. It includes 20 signaling questions across 4 domains (participants, predictors, outcome, and analysis). This explanation and elaboration document describes the rationale for including each domain and signaling question and guides researchers, reviewers, readers, and guideline developers in how to use them to assess risk of bias and applicability concerns. All concepts are illustrated with published examples across different topics. The latest version of the PROBAST checklist, accompanying documents, and filled-in examples can be downloaded from www.probast.org.

Faecal immunochemical tests (FIT) can help to rule out colorectal cancer in patients presenting in primary care with lower abdominal symptoms: a systematic review conducted to inform new NICE DG30 diagnostic guidance.

BACKGROUND: This study has attempted to assess the effectiveness of quantitative faecal immunochemical tests (FIT) for triage of people presenting with lower abdominal symptoms, where a referral to secondary care for investigation of suspected colorectal cancer (CRC) is being considered, particularly when the 2-week criteria are not met. METHODS: We conducted a systematic review following published guidelines for systematic reviews of diagnostic tests. Twenty-one resources were searched up until March 2016. Summary estimates were calculated using a bivariate model or a random-effects logistic regression model. RESULTS: Nine studies are included in this review. One additional study, included in our systematic review, was provided as 'academic in confidence' and cannot be described herein. When FIT was based on a single faecal sample and a cut-off of 10 µg Hb/g faeces, sensitivity estimates indicated that a negative result using either the OC-Sensor or HM-JACKarc may be adequate to rule out nearly all CRC; the summary estimate of sensitivity for the OC-Sensor was 92.1% (95% confidence interval, CI 86.9-95.3%), based on four studies (n = 4091 participants, 176 with CRC), and the only study of HM-JACKarc to assess the 10 µg Hb/g faeces cut-off (n = 507 participants, 11 with CRC) reported a sensitivity of 100% (95% CI 71.5-100%). The corresponding specificity estimates were 85.8% (95% CI 78.3-91.0%) and 76.6% (95% CI 72.6-80.3%), respectively. When the diagnostic criterion was changed to include lower grades of neoplasia, i.e. the target condition included higher risk adenoma (HRA) as well as CRC, the rule-out performance of both FIT assays was reduced. CONCLUSIONS: There is evidence to suggest that triage using FIT at a cut-off around 10 µg Hb/g faeces has the potential to correctly rule out CRC and avoid colonoscopy in 75-80% of symptomatic patients. SYSTEMATIC REVIEW REGISTRATION: PROSPERO 42016037723.

Cannabinoids for Medical Use: A Systematic Review and Meta-analysis.

IMPORTANCE: Cannabis and cannabinoid drugs are widely used to treat disease or alleviate symptoms, but their efficacy for specific indications is not clear. OBJECTIVE: To conduct a systematic review of the benefits and adverse events (AEs) of cannabinoids. DATA SOURCES: Twenty-eight databases from inception to April 2015. STUDY SELECTION: Randomized clinical trials of cannabinoids for the following indications: nausea and vomiting due to chemotherapy, appetite stimulation in HIV/AIDS, chronic pain, spasticity due to multiple sclerosis or paraplegia, depression, anxiety disorder, sleep disorder, psychosis, glaucoma, or Tourette syndrome. DATA EXTRACTION AND SYNTHESIS: Study quality was assessed using the Cochrane risk of bias tool. All review stages were conducted independently by 2 reviewers. Where possible, data were pooled using random-effects meta-analysis. MAIN OUTCOMES AND MEASURES: Patient-relevant/disease-specific outcomes, activities of daily living, quality of life, global impression of change, and AEs. RESULTS: A total of 79 trials (6462 participants) were included; 4 were judged at low risk of bias. Most trials showed improvement in symptoms associated with cannabinoids but these associations did not reach statistical significance in all trials. Compared with placebo, cannabinoids were associated with a greater average number of patients showing a complete nausea and vomiting response (47% vs 20%; odds ratio [OR], 3.82 [95% CI, 1.55-9.42]; 3 trials), reduction in pain (37% vs 31%; OR, 1.41 [95% CI, 0.99-2.00]; 8 trials), a greater average reduction in numerical rating scale pain assessment (on a 0-10-point scale; weighted mean difference [WMD], -0.46 [95% CI, -0.80 to -0.11]; 6 trials), and average reduction in the Ashworth spasticity scale (WMD, -0.36 [95% CI, -0.69 to -0.05]; 7 trials). There was an increased risk of short-term AEs with cannabinoids, including serious AEs. Common AEs included dizziness, dry mouth, nausea, fatigue, somnolence, euphoria, vomiting, disorientation, drowsiness, confusion, loss of balance, and hallucination. CONCLUSIONS AND RELEVANCE: There was moderate-quality evidence to support the use of cannabinoids for the treatment of chronic pain and spasticity. There was low-quality evidence suggesting that cannabinoids were associated with improvements in nausea and vomiting due to chemotherapy, weight gain in HIV infection, sleep disorders, and Tourette syndrome. Cannabinoids were associated with an increased risk of short-term AEs.

KardiaMobile 6L for measuring QT interval in people having antipsychotic medication to inform early value assessment: a systematic review.

Background: The indication for this assessment is the use of the KardiaMobile six-lead electrocardiogram device for the assessment of QT interval-based cardiac risk in service users prior to the initiation of, or for the monitoring of, antipsychotic medications, which are associated with an established risk of QT interval prolongation. Objectives: To provide an early value assessment of whether KardiaMobile six-lead has the potential to provide an effective and safe alternative to 12-lead electrocardiogram for initial assessment and monitoring of QT interval-based cardiac risk in people taking antipsychotic medications. Review methods: Twenty-seven databases were searched to April/May 2022. Review methods followed published guidelines. Where appropriate, study quality was assessed using appropriate risk of bias tools. Results were summarised by research question; accuracy/technical performance; clinical effects (on cardiac and psychiatric outcomes); service user acceptability/satisfaction; costs of KardiaMobile six-lead. Results: We did not identify any studies which provided information about the diagnostic accuracy of KardiaMobile six-lead, for the detection of corrected QT-interval prolongation, in any population. All studies which reported information about agreement between QT interval measurements (corrected and/or uncorrected) with KardiaMobile six-lead versus 12-lead electrocardiogram were conducted in non-psychiatric populations, used cardiologists and/or multiple readers to interpret electrocardiograms. Where reported or calculable, the mean difference in corrected QT interval between devices (12-lead electrocardiogram vs. KardiaMobile six-lead) was generally small (≤ 10 ms) and corrected QT interval measured using KardiaMobile six-lead was consistently lower than that measured using 12-lead electrocardiogram. All information about the use of KardiaMobile six-lead, in the context of QT interval-based cardiac risk assessment for service users who require antipsychotic medication, was taken from retrospective surveys of staff and service users who had chosen to use KardiaMobile six-lead during pilots, described in two unpublished project reports. It is important to note that both these project reports relate to pilot studies which were not intended to be used in wider evaluations of KardiaMobile six-lead for use in the NHS. Both reports included survey results which indicated that the use of KardiaMobile six-lead may be associated with reductions in the time taken to complete an electrocardiogram and costs, relative to 12-lead electrocardiogram, and that KardiaMobile six-lead was preferred over 12-lead electrocardiogram by almost all responding staff and service users. Limitations: There was a lack of published evidence about the efficacy of KardiaMobile six-lead for initial assessment and monitoring of QT interval-based cardiac risk in people taking antipsychotic medications. Conclusions: There is insufficient evidence to support a full diagnostic assessment evaluating the clinical and cost effectiveness of KardiaMobile six-lead, in the context of QT interval-based cardiac risk assessment for service users who require antipsychotic medication. The evidence to inform the aims of this early value assessment (i.e. to assess whether the device has the potential to be clinically effective and cost-effective) was also limited. This report includes a comprehensive list of research recommendations, both to reduce the uncertainty around this early value assessment and to provide the additional data needed to inform a full diagnostic assessment, including cost-effectiveness modelling. Study registration: This study is registered as PROSPERO CRD42022336695. Funding: This award was funded by the National Institute for Health and Care Research (NIHR) Evidence Synthesis programme (NIHR award ref: NIHR135520) and is published in full in Health Technology Assessment; Vol. 28, No. 19. See the NIHR Funding and Awards website for further award information.

Some medicines used for people with certain mental health problems can increase the risk of developing serious heart conditions. Although these heart conditions are rare, it is generally recommended that people have an electrocardiogram examination before starting to take these medicines. People who need to continue these medications over a period of time may need additional electrocardiograms every so often, to check for any heart problems that have developed recently. KardiaMobile six-lead (or 6-lead) is a portable electrocardiogram that may offer a less intrusive way to take electrocardiogram measurements. This is because less undressing is needed as the electrodes are only applied to fingers of the left and right hand and the left ankle or knee and the cold gel is not needed. Testing using the KardiaMobile six-lead device can be carried out at the patient's home. These features might mean that the KardiaMobile six-lead device could be more acceptable than the 12-lead electrocardiogram to some patients. This assessment considered whether the KardiaMobile six-lead device has the potential to provide an effective and safe alternative to 12-lead electrocardiogram for initial assessment and monitoring of the risk of heart problems in people taking antipsychotic medications. Based on the available evidence, it remains unclear whether KardiaMobile six-lead has adequately demonstrated sufficient evidence of potential advantage(s) over current practice to justify further research to inform assessment of its clinical effectiveness and cost effectiveness. Our report provides detailed recommendations about the research needed, to provide further information about potential benefits so that a decision can be made about whether it should be used in the NHS in England, after further research has been completed.

Software with artificial intelligence-derived algorithms for analysing CT brain scans in people with a suspected acute stroke: a systematic review and cost-effectiveness analysis.

Background: Artificial intelligence-derived software technologies have been developed that are intended to facilitate the review of computed tomography brain scans in patients with suspected stroke. Objectives: To evaluate the clinical and cost-effectiveness of using artificial intelligence-derived software to support review of computed tomography brain scans in acute stroke in the National Health Service setting. Methods: Twenty-five databases were searched to July 2021. The review process included measures to minimise error and bias. Results were summarised by research question, artificial intelligence-derived software technology and study type. The health economic analysis focused on the addition of artificial intelligence-derived software-assisted review of computed tomography angiography brain scans for guiding mechanical thrombectomy treatment decisions for people with an ischaemic stroke. The de novo model (developed in R Shiny, R Foundation for Statistical Computing, Vienna, Austria) consisted of a decision tree (short-term) and a state transition model (long-term) to calculate the mean expected costs and quality-adjusted life-years for people with ischaemic stroke and suspected large-vessel occlusion comparing artificial intelligence-derived software-assisted review to usual care. Results: A total of 22 studies (30 publications) were included in the review; 18/22 studies concerned artificial intelligence-derived software for the interpretation of computed tomography angiography to detect large-vessel occlusion. No study evaluated an artificial intelligence-derived software technology used as specified in the inclusion criteria for this assessment. For artificial intelligence-derived software technology alone, sensitivity and specificity estimates for proximal anterior circulation large-vessel occlusion were 95.4% (95% confidence interval 92.7% to 97.1%) and 79.4% (95% confidence interval 75.8% to 82.6%) for Rapid (iSchemaView, Menlo Park, CA, USA) computed tomography angiography, 91.2% (95% confidence interval 77.0% to 97.0%) and 85.0 (95% confidence interval 64.0% to 94.8%) for Viz LVO (Viz.ai, Inc., San Fransisco, VA, USA) large-vessel occlusion, 83.8% (95% confidence interval 77.3% to 88.7%) and 95.7% (95% confidence interval 91.0% to 98.0%) for Brainomix (Brainomix Ltd, Oxford, UK) e-computed tomography angiography and 98.1% (95% confidence interval 94.5% to 99.3%) and 98.2% (95% confidence interval 95.5% to 99.3%) for Avicenna CINA (Avicenna AI, La Ciotat, France) large-vessel occlusion, based on one study each. These studies were not considered appropriate to inform cost-effectiveness modelling but formed the basis by which the accuracy of artificial intelligence plus human reader could be elicited by expert opinion. Probabilistic analyses based on the expert elicitation to inform the sensitivity of the diagnostic pathway indicated that the addition of artificial intelligence to detect large-vessel occlusion is potentially more effective (quality-adjusted life-year gain of 0.003), more costly (increased costs of £8.61) and cost-effective for willingness-to-pay thresholds of £3380 per quality-adjusted life-year and higher. Limitations and conclusions: The available evidence is not suitable to determine the clinical effectiveness of using artificial intelligence-derived software to support the review of computed tomography brain scans in acute stroke. The economic analyses did not provide evidence to prefer the artificial intelligence-derived software strategy over current clinical practice. However, results indicated that if the addition of artificial intelligence-derived software-assisted review for guiding mechanical thrombectomy treatment decisions increased the sensitivity of the diagnostic pathway (i.e. reduced the proportion of undetected large-vessel occlusions), this may be considered cost-effective. Future work: Large, preferably multicentre, studies are needed (for all artificial intelligence-derived software technologies) that evaluate these technologies as they would be implemented in clinical practice. Study registration: This study is registered as PROSPERO CRD42021269609. Funding: This award was funded by the National Institute for Health and Care Research (NIHR) Evidence Synthesis programme (NIHR award ref: NIHR133836) and is published in full in Health Technology Assessment; Vol. 28, No. 11. See the NIHR Funding and Awards website for further award information.

Stroke is a serious life-threatening medical condition caused by a blood clot or haemorrhage in the brain. Quick and effective management, including a brain scan, of the patients with suspected stroke can make a big difference in their outcome. Artificial intelligence-derived computer programmes exist that are intended to help with the interpretation of computed tomography scans of the brain in stroke. We undertook a thorough review of the existing research into the effectiveness and value for money of using these programmes to help doctors and other specialists to interpret computed tomography brain scans. We found very little evidence to tell us how well artificial intelligence-derived computer programmes work in practice. Some studies have looked at artificial intelligence-derived computer programmes on their own (i.e. not taken together with a doctor's judgement, as they were designed to be used). Other studies have looked at what happens to patients who are treated for stroke when artificial intelligence-derived computer programmes are used; these studies provide no information about whether using artificial intelligence-derived computer programmes may have led to patients who could have benefitted from treatment being missed. It is unclear how well artificial intelligence-derived software-assisted review works when added to current clinical practice.

Systematic review of the accuracy of dual-source cardiac CT for detection of arterial stenosis in difficult to image patient groups.

PURPOSE: To assess the diagnostic performance of dual-source cardiac (DSC) computed tomography (CT) newer-generation CT instruments for identifying anatomically significant coronary artery disease (CAD) in patients who are difficult to image by using 64-section CT. MATERIALS AND METHODS: A literature search comprised bibliographic databases (January 1, 2000, to March 22, 2011, with a pragmatic update on September 6, 2012), trial registries, and conference proceedings. Only studies using invasive coronary angiography as reference standard were included. Risk of bias was assessed (QUADAS-2). Results were stratified according to patient group on the basis of clinical characteristics. Summary estimates of sensitivity and specificity of DSC CT for detecting 50% or greater arterial stenosis were calculated by using a bivariate summary receiver operating characteristic or random-effects model. RESULTS: Twenty-five studies reported accuracy of DSC CT for diagnosing CAD in difficult to image patients; in 22 studies, one of two CT units of the same manufacturer (Somatom Definition or Somatom Definition Flash) was used, and in the remaining three, a different CT unit of another manufacturer (Aquilion One) was used. The pooled, per-patient estimates of sensitivity were 97.7% (95% confidence interval [CI]: 88.0%, 99.9%) and 97.7% (95% CI: 93.2%, 99.3%) for patients with arrhythmias and high heart rates, respectively. The corresponding pooled estimates of specificity were 81.7% (95% CI: 71.6%, 89.4%) and 86.3% (95% CI: 80.2%, 90.7%), respectively. All data were acquired by using Somatom Definition. In two studies with Somatom and one study with Aquilion One, sensitivity estimates of 90% or greater were reported in patients with previous stent implantations; specificities were 81.7% and 89.5% for Somatom and 81.0% for Aquilion One. In patients with high coronary calcium scores, previous bypass grafts, or obesity, only per-segment or per-artery data were available. Sensitivity estimates remained high (>90% in all but one study), and specificities ranged from 79.1% to 100%. All data were acquired by using Somatom Definition. CONCLUSION: DSC CT may be sufficiently accurate to diagnose clinically significant CAD in some or all difficult to image patients. SUPPLEMENTAL MATERIAL: http://radiology.rsna.org/lookup/suppl/doi:10.1148/radiol.13121136/-/DC1.

The Parasite Reduction Ratio (PRR) Assay Version 2: Standardized Assessment of Plasmodium falciparum Viability after Antimalarial Treatment In Vitro.

With artemisinin-resistant Plasmodium falciparum parasites emerging in Africa, the need for new antimalarial chemotypes is persistently high. The ideal pharmacodynamic parameters of a candidate drug are a rapid onset of action and a fast rate of parasite killing or clearance. To determine these parameters, it is essential to discriminate viable from nonviable parasites, which is complicated by the fact that viable parasites can be metabolically inactive, whilst dying parasites can still be metabolically active and morphologically unaffected. Standard growth inhibition assays, read out via microscopy or [3H] hypoxanthine incorporation, cannot reliably discriminate between viable and nonviable parasites. Conversely, the in vitro parasite reduction ratio (PRR) assay is able to measure viable parasites with high sensitivity. It provides valuable pharmacodynamic parameters, such as PRR, 99.9% parasite clearance time (PCT99.9%) and lag phase. Here we report the development of the PRR assay version 2 (V2), which comes with a shorter assay duration, optimized quality controls and an objective, automated analysis pipeline that systematically estimates PRR, PCT99.9% and lag time and returns meaningful secondary parameters such as the maximal killing rate of a drug (Emax) at the assayed concentration. These parameters can be fed directly into pharmacokinetic/pharmacodynamic models, hence aiding and standardizing lead selection, optimization, and dose prediction.

Systematic review and meta-analysis of the value of clinical features to exclude radiographic pneumonia in febrile neutropenic episodes in children and young people.

INTRODUCTION: Children and young people who present with febrile neutropenia (FNP) secondary to malignancies or their treatment frequently do not undergo routine chest radiography. With shorter courses of antibiotic therapy, failure to recognise pneumonia and consequent under-treatment could produce significant problems. METHODS: The review was conducted determine the value of the absence of clinical features of lower respiratory tract infection in excluding radiographic pneumonia at presentation of FNP using Centre for Reviews and Dissemination methods. It was registered with the HTA Registry of systematic reviews, CRD32009100453. Ten bibliographic databases, conference proceedings, reference lists and citations were searched. Cohort studies which compared clinical examination to radiographic findings were included. Results were summarised by random-effects meta-analysis. RESULTS: Four studies were included. Synthesis of the three higher-quality studies gave imprecise estimates of the average sensitivity (75%; 95% CI 52% to 89%) and average specificity (69%; 95% CI 57% to 78%) for clinical examination in the detection of radiographic pneumonia. If the prevalence of pneumonia is 5%, these estimates produce a negative predictive value of 98% (95% CI 96% to 99%). Alternatively, there remains a 1.9% probability of pneumonia (95% CI 0.7% to 4.2%). CONCLUSION: Signs and symptoms of lower respiratory infection have only moderate sensitivity and specificity for pneumonia; the low prevalence of the condition justifies the routine withholding of chest radiographs. However, for those with a predisposition to pneumonia, or re-presenting after a short course of antibiotic therapy, a chest X-ray should be performed despite an absence of signs.

QUADAS-2: a revised tool for the quality assessment of diagnostic accuracy studies.

In 2003, the QUADAS tool for systematic reviews of diagnostic accuracy studies was developed. Experience, anecdotal reports, and feedback suggested areas for improvement; therefore, QUADAS-2 was developed. This tool comprises 4 domains: patient selection, index test, reference standard, and flow and timing. Each domain is assessed in terms of risk of bias, and the first 3 domains are also assessed in terms of concerns regarding applicability. Signalling questions are included to help judge risk of bias. The QUADAS-2 tool is applied in 4 phases: summarize the review question, tailor the tool and produce review-specific guidance, construct a flow diagram for the primary study, and judge bias and applicability. This tool will allow for more transparent rating of bias and applicability of primary diagnostic accuracy studies.

Role of the faecal immunochemical test in patients with risk-stratified suspected colorectal cancer symptoms: A systematic review and meta-analysis to inform the ACPGBI/BSG guidelines.

Background: The UK National Institute for Health and Care Excellence (NICE), recommended in 2017 the use of the faecal immunochemical test (FIT) to guide investigations in patients presenting with NICE-defined low-risk symptoms suspicious for colorectal cancer (CRC). At that time, NICE did not recommend FIT use for high-risk symptoms. This is the first systematic review to evaluate the diagnostic accuracy of FIT in NICE-defined high and low-risk symptoms and was designed to inform the joint ACPGBI/BSG guidelines. Methods: We performed a systematic literature review and meta-analysis. PROSPERO registration number CRD42021224674. Medline and EMBASE databases were searched from inception to 31st March 2022. We included studies recruiting adult patients presenting with suspected CRC symptoms in whom FIT was performed and diagnostic accuracy data for CRC detection could be derived at a limit of detection (LoD) and/or 10 µg haemoglobin/gram faeces threshold in four commonly used analysers. FIT performance was assessed for high-risk, low-risk and individual symptoms where possible. Bivariate meta-analysis was performed where study numbers allowed. Findings: Thirty-one studies (79566 patients) met inclusion criteria. At 10 µg/g, for "all symptoms" (n = 35,945) sensitivity and specificity were 91.0% (95% CI: 88.9, 92.7) and 75.2% (95% CI: 69.6, 80.1); for "high-risk" symptoms (n = 18,264), 88.7% (95% CI: 84.4, 92.0) and 78.5% (95% CI: 73.0, 83.2); and for "low-risk" symptoms (n = 2161), 88.7% (95% CI: 78.1, 95.3) and 88.5% (95% CI: 87.1, 89.9), respectively. At LoD, for "all symptoms" (n = 26,056) sensitivity and specificity were 94.7% (95% CI: 90.5, 97.1) and 66.5% (95% CI: 58.7, 73.6); for "high-risk" symptoms (n = 16,768), 92.8% (95% CI: 86.4, 96.3) and 70.3% (95% CI: 66.5, 73.8); and for "low-risk" symptoms (n = 2082), 94.7% (95% CI: 85.4, 98.9) and 71.9% (95% CI: 69.9, 73.9), respectively. Summary estimates were similar across different analysers. Interpretation: FIT sensitivity for CRC detection is maximised at the LoD; its performance is similar in high and low-risk symptoms, and across different analysers where a common threshold is used. FIT performance for CRC detection is adequate and transferrable to clinical diagnostic pathways. Funding: This review was part-funded by NHS England awarded to RM Partners. RB and RC were funded by research fellowships awarded by Croydon University Hospital.

Relationship between FEV1 change and patient-reported outcomes in randomised trials of inhaled bronchodilators for stable COPD: a systematic review.

BACKGROUND: Interactions between spirometry and patient-reported outcomes in COPD are not well understood. This systematic review and study-level analysis investigated the relationship between changes in FEV1 and changes in health status with bronchodilator therapy. METHODS: Six databases (to October 2009) were searched to identify studies with long-acting bronchodilator therapy reporting FEV1 and health status, dyspnoea or exacerbations. Mean and standard deviations of treatment effects were extracted for each arm of each study. Relationships between changes in trough FEV1 and outcomes were assessed using correlations and random-effects regression modelling. The primary outcome was St George's Respiratory Questionnaire (SGRQ) total score. RESULTS: Thirty-six studies (≥ 3 months) were included. Twenty-two studies (23,654 patients) with 49 treatment arms each contributing one data point provided SGRQ data. Change in trough FEV1 and change in SGRQ total score were negatively correlated (r = -0.46, p < 0.001); greater increases in FEV1 were associated with greater reductions (improvements) in SGRQ. The correlation strengthened with increasing study duration from 3 to 12 months. Regression modelling indicated that 100 mL increase in FEV1 (change at which patients are more likely to report improvement) was associated with a statistically significant reduction in SGRQ of 2.5 (95% CI 1.9, 3.1), while a clinically relevant SGRQ change (4.0) was associated with 160.6 (95% CI 129.0, 211.6) mL increase in FEV1. The association between change in FEV1 and other patient-reported outcomes was generally weak. CONCLUSIONS: Our analyses indicate, at a study level, that improvement in mean trough FEV1 is associated with proportional improvements in health status.

High-sensitivity troponin assays for early rule-out of acute myocardial infarction in people with acute chest pain: a systematic review and economic evaluation.

BACKGROUND: Early diagnosis of acute myocardial infarction is important, but only 20% of emergency admissions for chest pain will actually have an acute myocardial infarction. High-sensitivity cardiac troponin assays may allow rapid rule out of myocardial infarction and avoid unnecessary hospital admissions. OBJECTIVES: To assess the clinical effectiveness and cost-effectiveness of high-sensitivity cardiac troponin assays for the management of adults presenting with acute chest pain, in particular for the early rule-out of acute myocardial infarction. METHODS: Sixteen databases were searched up to September 2019. Review methods followed published guidelines. Studies were assessed for quality using appropriate risk-of-bias tools. The bivariate model was used to estimate summary sensitivity and specificity for meta-analyses involving four or more studies; otherwise, random-effects logistic regression was used. The health economic analysis considered the long-term costs and quality-adjusted life-years associated with different troponin testing methods. The de novo model consisted of a decision tree and a state-transition cohort model. A lifetime time horizon (of 60 years) was used. RESULTS: Thirty-seven studies (123 publications) were included in the review. The high-sensitivity cardiac troponin test strategies evaluated are defined by the combination of four factors (i.e. assay, number and timing of tests, and threshold concentration), resulting in a large number of possible combinations. Clinical opinion indicated a minimum clinically acceptable sensitivity of 97%. When considering single test strategies, only those using a threshold at or near to the limit of detection for the assay, in a sample taken at presentation, met the minimum clinically acceptable sensitivity criterion. The majority of the multiple test strategies that met this criterion comprised an initial rule-out step, based on high-sensitivity cardiac troponin levels in a sample taken on presentation and a minimum symptom duration, and a second stage for patients not meeting the initial rule-out criteria, based on presentation levels of high-sensitivity cardiac troponin and absolute change after 1, 2 or 3 hours. Two large cluster randomised controlled trials found that implementation of an early rule-out pathway for myocardial infarction reduced length of stay and rate of hospital admission without increasing cardiac events. In the base-case analysis, standard troponin testing was both the most effective and the most costly. Other testing strategies with a sensitivity of 100% (subject to uncertainty) were almost equally effective, resulting in the same life-year and quality-adjusted life-year gain at up to four decimal places. Comparisons based on the next best alternative showed that for willingness-to-pay values below £8455 per quality-adjusted life-year, the Access High Sensitivity Troponin I (Beckman Coulter, Brea, CA, USA) [(symptoms > 3 hours AND < 4 ng/l at 0 hours) OR (< 5 ng/l AND Δ < 5 ng/l at 0 to 2 hours)] would be cost-effective. For thresholds between £8455 and £20,190 per quality-adjusted life-year, the Elecsys® Troponin-T high sensitive (Roche, Basel, Switzerland) (< 12 ng/l at 0 hours AND Δ < 3 ng/l at 0 to 1 hours) would be cost-effective. For a threshold > £20,190 per quality-adjusted life-year, the Dimension Vista® High-Sensitivity Troponin I (Siemens Healthcare, Erlangen, Germany) (< 5 ng/l at 0 hours AND Δ < 2 ng/l at 0 to 1 hours) would be cost-effective. CONCLUSIONS: High-sensitivity cardiac troponin testing may be cost-effective compared with standard troponin testing. STUDY REGISTRATION: This study is registered as PROSPERO CRD42019154716. FUNDING: This project was funded by the National Institute for Health Research (NIHR) Evidence Synthesis programme and will be published in full in Health Technology Assessment; Vol. 25, No. 33. See the NIHR Journals Library website for further project information.

Heart disease is a leading cause of death in the UK, with myocardial infarction (heart attack) accounting for approximately 4% of all deaths recorded in 2018. Many people attend hospital with chest pain and suspected myocardial infarction, and chest pain has been reported as the most common cause of hospital admissions in the UK, accounting for approximately 5% of all emergency admissions in 2017­18. It is important to diagnose people who are suspected of having a myocardial infarction as early as possible to ensure quick and effective treatment. However, only around 20% of emergency admissions for chest pain will actually have an myocardial infarction and there are many other possible causes of chest pain (e.g. gastro-oesophageal disorders, muscle pain, anxiety or stable ischaemic heart disease). Current practice for ruling out myocardial infarction includes blood tests taken when the patient is first seen in the emergency department and repeated after 3­6 hours or 10­12 hours, depending on the test used. Tests that can quickly tell which patients do not have myocardial infarction could therefore avoid unnecessary hospital admissions and anxiety for many people. We aimed to assess the clinical effectiveness and cost-effectiveness of high-sensitivity troponin tests, used as single tests or repeated over a short time, for the early rule out of myocardial infarction in people who present to hospital with chest pain. We found that high-sensitivity troponin tests can safely rule out myocardial infarction within the 4-hour NHS emergency department target. Health economic analyses indicated that high-sensitivity tests may be considered value for money compared with standard troponin tests, which require repeat testing at 10­12 hours.

Cannabidiol for Adjuvant Treatment of Seizures Associated with Lennox-Gastaut Syndrome and Dravet Syndrome: An Evidence Review Group Perspective of a NICE Single Technology Appraisal.

GW Research Ltd. provided two separate, but similar, submissions to the National Institute for Health and Care Excellence (NICE) on the clinical and cost-effectiveness of cannabidiol (CBD) 10 mg/kg/day, trade name Epidyolex®, for the adjunctive treatment of seizures associated with Lennox-Gastaut syndrome (LGS) and Dravet syndrome (DS). This paper highlights important methodological issues related to the company submissions, the Evidence Review Group (ERG) reports, and the subsequent development of the NICE guidance by the Appraisal Committee (AC) for the use of CBD. The company identified four randomised controlled trials (RCTs) of CBD (GWPCARE1 and GWPCARE2 for DS, and GWPCARE3 and GWPCARE4 for LGS) and an ongoing open-label extension study (GWPCARE5) as relevant to both submissions. In these RCTs, CBD in addition to current clinical management (CCM) was compared to CCM without CBD (i.e. CCM plus placebo). GWPCARE2 and GWPCARE3 were three-arm studies and compared two dosages of CBD (10 mg/kg/day and 20 mg/kg/day) in addition to CCM and CCM plus placebo. GWPCARE1 and GWPCARE4 compared CBD (20 mg/kg/day) in addition to CCM and CCM plus placebo. Both DS patients in GWPCARE2 and LGS patients in GWPCARE3 who received 10 mg/kg/day CBD in addition to CCM achieved better seizure frequency outcomes than those who received CCM plus placebo. In the company's base case, use of CBD for LGS patients resulted in an incremental cost-effectiveness ratio (ICER) of £31,107 per quality-adjusted life year (QALY) gained and, for DS patients, £36,046 per QALY gained versus CCM. The ERG considered that these ICERs were extremely uncertain and suffered from validity issues concerning model structure (e.g. patients receiving CCM moved back to baseline drop seizure frequency), input (e.g. inclusion of caregivers' QALYs), and transparency issues (e.g. hidden worksheets and coding in Visual Basic for Applications), and hence incorporated adjustments to the original base case which increased the ICERs. During the process, the European Medicines Agency (EMA) licence granted marketing authorisation for CBD only in conjunction with clobazam. Hence, the company provided evidence from this subgroup in an additional submission, which resulted in an ICER of £33,721 per QALY gained for LGS and an ICER of £32,471 per QALY gained for DS. In this submission and clarifications, the ERG was able to verify and validate most of the company's responses to the ERG's concerns. However, some issues remained regarding the face validity of model assumptions on patient pathways after treatment discontinuation. Finally, the AC recommended CBD with clobazam as an option for treating seizures associated with LGS and DS in patients aged 2 years and older only if (1) the frequency of drop seizures is checked every 6 months and CBD is stopped if the frequency has not fallen by at least 30% compared with 6 months before starting treatment and (2) the company provides CBD according to the commercial arrangement.

Clinically inappropriate post hoc exclusion of study participants from test accuracy calculations: the ROMA score, an example from a recent NICE diagnostic assessment.

OBJECTIVE: To explore how the definition of the target condition and post hoc exclusion of participants can limit the usefulness of diagnostic accuracy studies. METHODS: We used data from a systematic review, conducted for a NICE diagnostic assessment of risk scores to inform secondary care decisions about specialist referral for women with suspected ovarian cancer, to explore how the definition of the target condition and post hoc exclusion of participants can limit the usefulness of diagnostic accuracy studies to inform clinical practice. RESULTS: Fourteen of the studies evaluated the ROMA score, nine used Abbott ARCHITECT tumour marker assays, five used Roche Elecsys. The summary sensitivity estimate (Abbott ARCHITECT) was highest, 95.1% (95% CI: 92.4 to 97.1%), where analyses excluded participants with borderline tumours or malignancies other than epithelial ovarian cancer and lowest, 75.0% (95% CI: 60.4 to 86.4%), where all participants were included. Results were similar for Roche Elecsys tumour marker assays. Although the number of patients involved was small, data from studies that reported diagnostic accuracy for both the whole study population and with post hoc exclusion of those with borderline or non-epithelial malignancies suggested that patients with borderline or malignancies other than epithelial ovarian cancer accounts for between 50 and 85% of false-negative ROMA scores. CONCLUSIONS: Our results illustrate the potential consequences of inappropriate population selection in diagnostic studies; women with non-epithelial ovarian cancers or non-ovarian primaries, and those borderline tumours may be disproportionately represented among those with false negative, 'low risk' ROMA scores. These observations highlight the importance of giving careful consideration to how the target condition has been defined when assessing whether the diagnostic accuracy estimates reported in clinical studies will translate into clinical utility in real-world settings.

The sensitivity and specificity of the mannitol bronchial challenge test to identify asthma in different populations: a systematic review.

OBJECTIVE: Asthma is associated with bronchial hyperresponsiveness, assessed by bronchial provocation tests such as the mannitol test. We aimed to assess the data on sensitivity and specificity of the mannitol test in diagnosing asthma. DATA SOURCES: We searched electronically the Medline, Embase and Central databases from 1997 to 2019. STUDY SELECTION: Inclusion criteria were the assessment of the validity of the mannitol test. Risk of bias was assessed using the Quality Assessment of Diagnostic Accuracy Studies tool (QUADAS-2). Data were extracted according to a prespecified list and analysed qualitatively. RESULTS: A total of 27 studies (4589 individuals, age 6–85 years, cross-sectional [n = 18] and case-controlled [n = 9] study design) were included. Overall sensitivity and specificity ranged from 8% (95% confidence interval [CI] 1–27) to 100% (95% CI 93–100) and 75% (95% CI 67–82) to 100% (95% CI 85–100). Excluding case-controlled design, studies conducted in a clinical setting showed a range from 19% (95% CI 14–27) to 91% (95% CI 59–100) for sensitivity and from 75% (95% CI 67–82) to 100% (95% CI 80–100) for specificity. Heterogeneity was high owing to differences in the populations examined and the methods used. CONCLUSIONS: Studies on the accuracy of the mannitol test were heterogeneous. Overall specificity was higher than sensitivity and therefore the mannitol test seems to be a suitable diagnostic tool to confirm asthma. However, the high level of heterogeneity among the included studies makes a conclusive statement on the accuracy of the mannitol test difficult and further research is needed. As bronchial provocation tests can be especially useful in patients with an intermediate probability of asthma diagnosis, further studies are needed that include subjects with asthma symptoms but intermediate probability of asthma diagnosis.