Assessing the Certainty of the Evidence in Systematic Reviews: Importance, Process, and Use.

When interpreting results and drawing conclusions, authors of systematic reviews should consider the limitations of the evidence included in their review. The Grading of Recommendations Assessment, Development, and Evaluation (GRADE) approach provides a framework for the explicit consideration of the limitations of the evidence included in a systematic review, and for incorporating this assessment into the conclusions. Assessments of certainty of evidence are a methodological expectation of systematic reviews. The certainty of the evidence is specific to each outcome in a systematic review, and can be rated as high, moderate, low, or very low. Because it will have an important impact, before conducting certainty of evidence, reviewers must clarify the intent of their question: are they interested in causation or association. Serious concerns regarding limitations in the study design, inconsistency, imprecision, indirectness, and publication bias can decrease the certainty of the evidence. Using an example, this article describes and illustrates the importance and the steps for assessing the certainty of evidence and drawing accurate conclusions in a systematic review.

Massage for rehabilitation after total knee arthroplasty: a systematic review and meta-analysis of randomized controlled trials.

OBJECTIVE: This study aimed to evaluate the effectiveness of massage for postoperative rehabilitation after total knee arthroplasty (TKA). DATA SOURCES: The PubMed, Web of Science, EMBASE, Cochrane Library, and China National Knowledge Infrastructure (CNKI) databases were systematically searched from inception to May 2024. STUDY SELECTION: Any randomized controlled trials on the use of massage for postoperative TKA rehabilitation were included. DATA EXTRACTION: A meta-analysis of outcomes, including postoperative pain, knee range of motion (ROM), postoperative D-dimer levels, and length of hospital stay, was performed. The Cochrane Risk of Bias Assessment Tool was used to assess the risk of bias, and the data for each included study were extracted independently by two researchers. DATA SYNTHESIS: Eleven randomized controlled clinical trials with 940 subjects were included. The results showed that compared with the control group, the massage group experienced more significant pain relief on the 7th, 14th and 21st days after the operation. Moreover, the improvement in knee ROM was more pronounced on postoperative days 7 and 14. In addition, the massage group reported fewer adverse events. However, there was no statistically significant difference in the reduction in postoperative D-dimer levels between the patients and controls. Subgroup analysis revealed that massage shortened the length of hospital stay for postoperative patients in China but not significantly for patients in other regions. Nevertheless, the heterogeneity of the studies was large. CONCLUSIONS: Increased massage treatment was more effective at alleviating pain and improving knee ROM in early post-TKA patients. However, massage did not perform better in reducing D-dimer levels in patients after TKA. Based on the current evidence, massage can be used as an adjunctive treatment for rehabilitation after TKA.

Enhancing the quality of evidence, comparability, and reproducibility in brain arteriovenous malformations treated with open surgery research: a systematic review and proposal of a reporting guideline for surgical and clinical outcomes.

Brain Arteriovenous Malformations (bAVMs) are rare but high-risk developmental anomalies of the vascular system. Microsurgery through craniotomy is believed to be the mainstay standard treatment for many grades of bAVMs. However, a significant challenge emerges in the existing body of clinical studies on open surgery for bAVMs: the lack of reproducibility and comparability. This study aims to assess the quality of studies reporting clinical and surgical outcomes for bAVMs treated by open surgery and develop a reporting guideline checklist focusing on essential elements to ensure comparability and reproducibility. This is a systematic literature review that followed the PRISMA guidelines with the search in Medline, Embase, and Web of Science databases, for studies published between January 1, 2018, and December 1, 2023. Included studies were scrutinized focusing on seven domains: (1) Assessment of How Studies Reported on the Baseline Characteristics of the Patient Sample; (2) Assessment and reporting on bAVMs grading, anatomical characteristics, and radiological aspects; (3) Angioarchitecture Assessment and Reporting; (4) Reporting on Pivotal Concepts Definitions; (5) Reporting on Neurosurgeon(s) and Staff Characteristics; (6) Reporting on Surgical Details; (7) Assessing and Reporting Clinical and Surgical Outcomes and AEs. A total of 47 studies comprising 5,884 patients were included. The scrutiny of the studies identified that the current literature in bAVM open surgery is deficient in many aspects, ranging from fundamental pieces of information of methodology to baseline characteristics of included patients and data reporting. Included studies demonstrated a lack of reproducibility that hinders building cumulative evidence. A bAVM Open Surgery Reporting Guideline with 65 items distributed across eight domains was developed and is proposed in this study aiming to address these shortcomings. This systematic review identified that the available literature regarding microsurgery for bAVM treatment, particularly in studies reporting clinical and surgical outcomes, lacks rigorous scientific methodology and quality in reporting. The proposed bAVM Open Surgery Reporting Guideline covers all essential aspects and is a potential solution to address these shortcomings and increase transparency, comparability, and reproducibility in this scenario. This proposal aims to advance the level of evidence and enhance knowledge regarding the Open Surgery treatment for bAVMs.

Wheel Replacing Pyramid: Better Paradigm Representing Totality of Evidence-Based Medicine.

Background: Evidence-based medicine (EBM), as originally conceived, used all types of peer-reviewed evidence to guide medical practice and decision-making. During the SARS-CoV-2 Coronavirus disease (COVID-19) pandemic, the standard usage of EBM, modeled by the Evidence-Based Medicine Pyramid, undermined EBM by incorrectly using pyramid levels to assign relative quality. The resulting pyramid-based thinking is biased against reports both in levels beneath randomized control trials (RCTs) and those omitted from the pyramid entirely. Thus, much of the evidence was ignored. Our desire for a more encompassing and effective medical decision-making process to apply to repurposed drugs led us to develop an alternative to the EBM Pyramid for EBM. Herein, we propose the totality of evidence (T-EBM) wheel. Objectives: To create an easily understood graphic that models EBM by incorporating all peer-reviewed evidence that applies to both new and repurposed medicines, and to demonstrate its potential utility using ivermectin as a case study. Methods: The graphics were produced using Microsoft Office Visio Professional 2003 except for part of the T-EBM wheel sunburst chart, which was produced using Microsoft 365 Excel. For the case study, PubMed® was used by searching for peer-reviewed reports containing "ivermectin" and either "covid" or "sars" in the title. Reports were filtered for those using ivermectin-based protocols in the treatment of COVID-19. The resulting 265 reports were evaluated for their study design types and treatment outcomes. The three-ringed graphical T-EBM wheel was composed of two inner rings showing all types of reports and an outer ring showing outcomes for each type. Findings-Conclusions: The T-EBM wheel avoids the biases of the EBM Pyramid and includes all types of reports in the pyramid along with reports such as population and mechanistic studies. In both early and late stages of medical emergencies, pyramid-based thinking may overlook indications of efficacy in regions of the T-EBM wheel beyond RCTs. This is especially true when searching for ways to prevent and treat a novel disease with repurposed therapeutics before RCTs, safety assessments, and mechanisms of action of novel therapeutics are established. As such, T-EBM Wheels should replace the EBM Pyramids in medical decision-making and education. T-EBM Wheels can be expanded upon by implementing multiple outer rings, one for each different kind of outcome (efficacy, safety, etc.). A T-EBM Wheel can be created for any proprietary or generic medicine. The ivermectin (IVM) T-EBM Wheel displays the efficacy of IVM-based treatments of COVID-19 in a color-coded graphic, visualizing each type of evidence and the proportions of each of their outcomes (positive, inconclusive, negative).

Rethinking the pros and cons of randomized controlled trials and observational studies in the era of big data and advanced methods: a panel discussion.

Randomized controlled trials (RCTs) have traditionally been considered the gold standard for medical evidence. However, in light of emerging methodologies in data science, many experts question the role of RCTs. Within this context, experts in the USA and Canada came together to debate whether the primacy of RCTs as the gold standard for medical evidence, still holds in light of recent methodological advances in data science and in the era of big data. The purpose of this manuscript, aims to raise awareness of the pros and cons of RCTs and observational studies in order to help guide clinicians, researchers, students, and decision-makers in making informed decisions on the quality of medical evidence to support their work. In particular, new and underappreciated advantages and disadvantages of both designs are contrasted. Innovations taking place in both of these research methodologies, which can blur the lines between the two, are also discussed. Finally, practical guidance for clinicians and future directions in assessing the quality of evidence is offered.

Evaluation of GRADE Clinical Research Evidence of Chinese Patent Medicine Combined with Western Medicine in Treatment of Hypertension with Dyslipidemia / 中国实验方剂学杂志

ObjectiveTo evaluate the effect of antihypertensive and lipid-regulating Chinese patent medicine combined with conventional Western medicine in the treatment of hypertension with dyslipidemia. To carry out the evidence synthesis of clinical research and provide evidence-based evidence support for clinical decision-making. MethodThe databases including China National Knowledge Infrastructure （CNKI），Wanfang Data Knowledge Service Platform （WF），VIP，SinoMed，Embase，PubMed，Web of Science （WOS），and the Cochrane Library were searched for randomized controlled trials （RCT） of all listed Chinese patent medicines in the treatment of hypertension with dyslipidemia from the establishment of the databases to April 15，2023. The literature was screened and extracted，and the risk of bias tool 2.0 （RoB2） was used to assess the quality and risk of bias of the methodology. Revman 5.4.1 software was used to analyze the outcome indicators. Grading of Recommendations Assessment，Development and Evaluation （GRADE） was applied to assess the quality of evidence formed by clinical research data. The inclusion and recommendation of Chinese patent medicines in the National Drug Catalogue for Basic Medical Insurance，Work-related Injury Insurance and Maternity Insurance （2022） and domestic guidelines and consensus were searched to form a bubble chart. ResultA total of 15 studies were included. The evaluation of the methodological quality of each study showed that the risk of bias stemmed from the lack of blinding and allocation concealment，and low sample size. The comprehensive analysis of clinical studies showed that Dengzhan Shengmai capsules combined with rosuvastatin and amlodipine besylate，Yindan Xinnaotong capsules combined with simvastatin and levamlodipine tablets，Xiaoshuan Tongluo capsules combined with nifedipine controlled release tablets and pravastatin sodium tablets，Xinshubao capsules combined with atorvastatin calcium tablets and irbesartan，Wenyading capsules combined with enalapril，and Jiangzhining tablets combined with conventional Western medicines were all superior to conventional Western medicines used in the control group in improving systolic blood pressure （SBP），diastolic blood pressure （DBP），cholesterol （TC），triglyceride （TG），low density lipoprotein cholesterol （LDL-C），and high density lipoprotein cholesterol （HDL-C）. There was no significant difference in the incidence of adverse reactions between the two groups. The GRADE evaluation of the main outcome indicators showed that the evidence quality of SBP and incidence of adverse reactions was graded as B，that of DBP as C，and that of total TC，TG，LDL-C，and HDL-C as D. The evaluation of Chinese patent medicines covered by medical insurance and recommended by guidelines and consensus showed that Yindan Xinnaotong soft capsules，Dengzhan Shengmai capsules and Xiaoshuan Tongluo capsules belonged to class B drugs of medical insurance，and were recommended for 7，6 and 3 times in the guidelines and consensus，respectively. ConclusionCompared with simple medicine treatment，Chinese patent medicine combined with conventional Western medicine has more advantages in improving blood pressure and blood lipid，and shows higher safety. Among them，Yindan Xinnaotong soft capsules，Dengzhan Shengmai capsules and Xiaoshuan Tongluo capsules have stronger clinical applicability and economy. All the trials included in this article adhered to the principle of randomization and reported the outcome measures. However，the quality of evidence in related clinical studies was low. In terms of trial design，large-sample，multi-center，blinded randomized controlled trials based on the consolidated standards of reporting trials （CONSORT） statement are still needed for comprehensive trial designs and reporting，to further improve the GRADE quality evaluation and guideline formulation under the guidance of evidence-based medicine，so as to provide higher quality evidence-based research evidence for clinical decision-making.

Effects of timing of umbilical cord clamping for mother and newborn: a narrative review.

OBJECTIVE: This narrative review was performed to evaluate the correct timing of umbilical cord clamping for term infants. It was intended to determine any advantages or disadvantages from early or delayed cord clamping for newborns, infants or mothers. METHODS: A systematic search on two databases was conducted using the PICO pattern to define a wide search. Out of 43 trials, 12 were included in this review. Three of the included studies are meta-analyses, nine are randomized controlled trials. RESULTS: Early or delayed cord clamping was defined differently in all the included trials. However, there are many advantages from delayed cord clamping of at least > 60 s for newborns and infants up to 12 months of age. The trials showed no disadvantages for newborns or mothers from delayed cord clamping, except for a lightly increased risk of jaundice or the need for phototherapy. CONCLUSION: Delayed umbilical cord clamping for term infants should be performed. Further research is needed to improve knowledge on physiological timing of umbilical cord clamping in term infants, which also leads to the same advantages as delayed cord clamping.

Efficacy of optometric phototherapy: a systematic review

PurposeTo analyse the scientific evidence about the efficacy of Syntonic phototherapy for producing changes in visual function.Material and methodsA systematic review was performed to obtain studies on the effects of Syntonic phototherapy on vision. A search in health science databases (Medline, Scopus, Web of Science and PsycINFO) for studies published between 1980 and 2022 was conducted in accordance with the principles of Cochrane approach. The search identified 197 articles. Only clinical studies which used the Syntonic phototherapy as a vision therapy for any visual condition were included. Clinical cases and case series were excluded. Following the inclusion criteria, 8 clinical studies met inclusion, 5 of them being pseudo-experimental studies with an equivalent control group and 3 pre-post pseudo-experimental studies. GRADE tool was used to assess the certainty of the evidence of the studies. The GRADE evidence profile for the studies through the Soft table was made to analyse data.ResultsThe studies analysed seven outcomes: visual symptoms, functional visual fields, visual acuity, contrast sensitivity, deviation (phoria/tropia), stereopsis and reading abilities. Finding table about results (Soft Table) showed that for all outcomes reviewed, all studies yielded very low certainty of evidence. Results revealed a lack of scientific evidence of the efficacy of Syntonic optometric phototherapy to produce changes in the visual function.ConclusionThis systematic review found no consistent evidence for the efficacy of Syntonic phototherapy to cause changes in visual function. There is no scientific evidence to support its clinical use for treating any type of visual anomalies. (AU)

Impact of Exercise Interventions on Sustained Brain Health Outcomes in Frail Older Individuals: A Comprehensive Review of Systematic Reviews.

Several systematic review studies highlight exercise's positive impact on brain health outcomes for frail individuals. This study adopts a Comprehensive Review of reviews (CRs) approach to amalgamate data from existing reviews, focusing on exercise's influence on brain health outcomes in older frail and pre-frail adults. The methodology involves a thorough search of Portuguese, Spanish, and English-indexed databases (i.e., Ebsco Health, Scielo, ERIC, LILACS, Medline, Web of Science, SportDiscus) from 1990 to 2022, with the AMSTAR-2 tool assessing evidence robustness. The search terms "physical exercise", "elderly frail", and "systematic review" were employed. Results: Out of 12 systematically reviewed studies, four presented high-quality (with metanalyses), while eight exhibit critically low quality. Positive trends emerge in specific cognitive and neuromotor aspects, yet challenges persist in psychosocial domains, complex cognitive tasks, and ADL outcomes. This study yields reasonable and promising evidence regarding exercise's influence on quality of life and depression in frail older individuals. However, the impact on biochemical markers remains inconclusive, emphasizing the need for standardized methodologies. Conclusions: The findings highlight the importance of acknowledging methodological nuances for clinicians and policymakers when translating these results into impactful interventions for aging populations. This emphasizes the necessity for a comprehensive and customized approach to exercise interventions aimed at fostering the sustainability of overall well-being in older individuals, aligning with United Nations Sustainable Development Goal 3.

Review time of oncology drugs and its underlying factors: an exploration in China.

Introduction: How the launch delay of drugs and other factors of interest can influence the length of the review period by drug agencies is still unknown, and understanding this can help better strike the trade-off related to review speed. Methods: We included all new oncology drug applications submitted to China's National Medical Product Administration (NMPA) between 1 January 2018 and 31 December 2021, and ultimately succeeded in achieving marketing approval. For each drug, the length of the NMPA review process and other major characteristics were collected, including the registration class, approval class, priority review designation, and launch delay relative to the United States, as well as the number of patients enrolled, comparator, and primary endpoint of the pivotal trials supporting the approval. Linear regression model was employed to analyze the effects of factors of interest on the NMPA review time. Results: From 2018 to 2021, NMPA received 137 oncology applications that were ultimately approved. Half of the approvals [76 (55.5%)] were first licensed in the US, leaving a median launch delay of 2.71 years (IQR, 1.03-5.59) in China. In the pivotal studies, the median enrollment was 361 participants (IQR, 131-682), and the use of control groups [90 (65.7%)] and surrogate endpoints [101 (73.7%)] was prevalent. The median review time was 304 days (IQR, 253-376). Multivariate analysis for log-transformed review time showed that larger enrollment (> 92) was associated with a drop of 20.55% in review time (coefficient = -0.230; 95% CI, -0.404 to -0.055; p = 0.010); and a short delay (0 < delay ≤ 1.95 years) was associated with a drop of 17.63% in review time (coefficient = -0.194; 95% CI, -0.325 to -0.062; p = 0.004). Discussion: The short launch delay relative to the US was one important driver to the review speed of NMPA, which might suggest its latent regulatory reliance on the other global regulator during the post-marketing period when new information on the drug's clinical benefit was still lacking.

Exploring the feasibility of using the ICER Evidence Rating Matrix for Comparative Clinical Effectiveness in assessing treatment benefit and certainty in the clinical evidence on orphan therapies for paediatric indications.

BACKGROUND: The evaluation of clinical evidence takes account of health benefit (efficacy and safety) and the degree of certainty in the estimate of benefit. In orphan indications practical and ethical challenges in conducting clinical trials, particularly in paediatric patients, often limit the available evidence, rendering structured evaluation challenging. While acknowledging the paucity of evidence, regulators and reimbursement authorities compare the efficacy and safety of alternative treatments for a given indication, often in the context of the benefits of other treatments for similar or different conditions. This study explores the feasibility of using the Institute for Clinical and Economic Review (ICER) Evidence Rating Matrix for Comparative Clinical Effectiveness in structured assessment of both the magnitude of clinical benefit (net health benefit, NHB) and the certainty of the effect estimate in a sample of orphan therapies for paediatric indications. RESULTS: Eleven systemic therapies with European Medicines Agency (EMA) orphan medicinal product designation, licensed for 16 paediatric indications between January 2017 and March 2020 were identified using OrphaNet and EMA databases and were selected for evaluation with the ICER Evidence Rating Matrix: burosumab; cannabidiol; cerliponase alfa; chenodeoxycholic acid (CDCA); dinutuximab beta; glibenclamide; metreleptin; nusinersen; tisagenlecleucel; velmanase alfa; and vestronidase alfa. EMA European Public Assessment Reports, PubMed, EMBASE, the Cochrane Library, Clinical Key, and conference presentations from January 2016 to April 2021 were searched for evidence on efficacy and safety. Two of the identified therapies were graded as "substantial" NHB: dinutuximab beta (neuroblastoma maintenance) and nusinersen (Type I SMA), and one as "comparable" NHB (CDCA). The NHB grade of the remaining therapies fell between "comparable" and "substantial". No therapies were graded as having negative NHB. The certainty of the estimate ranged from "high" (dinutuximab beta in neuroblastoma maintenance) to "low" (CDCA, metreleptin and vestronidase alfa). The certainty of the other therapies was graded between "low" and "high". The ICER Evidence Rating Matrix overall rating "A" (the highest) was given to two therapies, "B+" to 6 therapies, "C+" to five therapies, and "I" (the lowest) to three therapies. The scores varied between rating authors with mean agreement over all indications of 71.9% for NHB, 56.3% for certainty and 68.8% for the overall rating. CONCLUSIONS: Using the ICER Matrix to grade orphan therapies according to their treatment benefit and certainty is feasible. However, the assessment involves subjective judgements based on heterogenous evidence. Tools such as the ICER Matrix might aid decision makers to evaluate treatment benefit and its certainty when comparing therapies across indications.

Quality of athlete screening for high-risk cardiovascular conditions-A systematic review.

BACKGROUND: Sudden cardiac death (SCD) is the leading medical cause of death in athletes. To prevent SCD, screening for high-risk cardiovascular conditions (HRCC) is recommended. Screening strategies are based on a limited number of studies and expert consensus. However, evidence and efficacy of athlete HRCC screening is unclear. OBJECTIVE: To determine methodological quality and quality of evidence of athlete screening, and screening efficacy to detect HRCC in a systematic review. METHODS: We performed a systematic search of Medline, Embase, Scopus and Cochrane Library up to June 2021. We included articles containing original data of athlete cardiovascular screening, providing details of screening strategies, test results and HRCC detection. We assessed methodological quality of the included articles by QUADAS-2, quality of evidence of athlete HRCC screening by GRADE, and athlete HRCC screening efficacy by SWiM. RESULTS: Of 2720 citations, we included 33 articles (1991-2018), comprising 82 417 athletes (26.7% elite, 73.4% competitive, 21.7% women, 75.2% aged ≤35). Methodological quality was 'very low' (33 articles), caused by absence of data blinding and inappropriate statistical analysis. Quality of evidence was 'very low' (33 articles), due to observational designs and population heterogeneity. Screening efficacy could not be reliably established. The prevalence of HRCC was 0.43% with false positive rate (FPR) 13.0%. CONCLUSIONS: Methodological quality and quality of evidence on athlete screening are suboptimal. Efficacy could not be reliably established. The prevalence of screen detected HRCC was very low and FPR high. Given the limitations of the evidence, individual recommendations need to be prudent.

Grading of recommendations assessment, development, and evaluation concept article 5: addressing intransitivity in a network meta-analysis.

OBJECTIVES: This article describes considerations for addressing intransitivity when assessing the certainty of the evidence from network meta-analysis (NMA) using the Grading of Recommendations Assessment, Development, and Evaluation (GRADE) approach. Intransitivity is induced by effect modification, that is, when the magnitude of the effect between an intervention and outcome differs depending on the level of another factor. STUDY DESIGN AND SETTING: To develop this GRADE concept paper, the lead authors conducted iterative discussions, computer simulations, and presentations to the GRADE project group and at GRADE working group meetings. The GRADE Working Group formally approved the article in July 2022. RESULTS: NMA authors can have a higher or a lower threshold to rate down the certainty of the evidence due to intransitivity, which depends on the extent of their concerns regarding the trustworthiness of indirect comparisons, and their view of the relative problems with rating down excessively or insufficiently. NMA authors should consider three main factors when addressing intransitivity: the credibility of effect modification, the strength of the effect modification, and the distribution of effect modifiers across the direct comparisons. To avoid double counting limitations of the evidence, authors should consider the relationship between intransitivity and other GRADE domains. CONCLUSION: NMA authors face theoretic and pragmatic challenges and in most situations need to assess intransitivity without the availability of empirical data. Thus, explicitness regarding perspective is crucial.

Efficacy of optometric phototherapy: a systematic review.

PURPOSE: To analyse the scientific evidence about the efficacy of Syntonic phototherapy for producing changes in visual function. MATERIAL AND METHODS: A systematic review was performed to obtain studies on the effects of Syntonic phototherapy on vision. A search in health science databases (Medline, Scopus, Web of Science and PsycINFO) for studies published between 1980 and 2022 was conducted in accordance with the principles of Cochrane approach. The search identified 197 articles. Only clinical studies which used the Syntonic phototherapy as a vision therapy for any visual condition were included. Clinical cases and case series were excluded. Following the inclusion criteria, 8 clinical studies met inclusion, 5 of them being pseudo-experimental studies with an equivalent control group and 3 pre-post pseudo-experimental studies. GRADE tool was used to assess the certainty of the evidence of the studies. The GRADE evidence profile for the studies through the Soft table was made to analyse data. RESULTS: The studies analysed seven outcomes: visual symptoms, functional visual fields, visual acuity, contrast sensitivity, deviation (phoria/tropia), stereopsis and reading abilities. Finding table about results (Soft Table) showed that for all outcomes reviewed, all studies yielded very low certainty of evidence. Results revealed a lack of scientific evidence of the efficacy of Syntonic optometric phototherapy to produce changes in the visual function. CONCLUSION: This systematic review found no consistent evidence for the efficacy of Syntonic phototherapy to cause changes in visual function. There is no scientific evidence to support its clinical use for treating any type of visual anomalies.

The Composite Quality Score (CQS) as an Appraisal Tool for Prospective, Controlled Clinical Therapy Trials: Rationale and Current Evidence.

BACKGROUND: Current evidence appraisal concepts, such as the Assessment, Development and Evaluation (GRADE) approach and Cochrane's Risk of Bias (RoB) tool, rely on assumptions related to the classic problem of inductive reasoning and may suffer from insufficient inter-rater reliability. DISCUSSION: The Composite Quality Score (CQS) has emerged as a possible trial appraisal tool that does not rely on inductive assumptions and has been shown to be of potentially very high inter-rater reliability. CONCLUSION: Although the current CQS concept is still under development, its current evidence is encouraging and justifies further study. This article presents the rationale and currently available research concerning the CQS and shows where further research is required.

A Systematic Review on Navigation Programs for Persons Living With Dementia and Their Caregivers.

BACKGROUND AND OBJECTIVES: System navigation programs are becoming more available to meet the needs of patients with complex care needs. The aim of this review was to systematically assess the outcomes of navigation programs for persons with dementia and their family caregivers. RESEARCH DESIGN AND METHODS: A systematic review methodology was employed. Ten databases were searched for all relevant articles published until October 30, 2021. English-language full-text articles were included if they focused on implemented navigation program(s) that primarily supported persons with dementia who were aged 50 or older. Methodological quality was assessed by 2 independent raters using the Physiotherapy Evidence Database Scale, the STrengthening the Reporting of OBservational studies in Epidemiology checklist, and the Mixed Methods Appraisal Tool. RESULTS: Fourteen articles were included in the review. There was Level 1 evidence for the benefits of system navigation programs on delaying institutionalization, wherein benefits appeared to be specific to interventions that had an in-person component. There was Level 1 (n = 4) and Level 3 (n = 1) evidence on service use from time of diagnosis to continued management of dementia. Finally, Level 1 to Level 5 evidence indicated a number of benefits on caregiver outcomes. DISCUSSION AND IMPLICATIONS: There is strong evidence on the benefits of system navigation for people with dementia on delaying institutionalization and caregiver outcomes, but outcomes across other domains (i.e., functional independence) are less clear, which may be due to the varied approaches within system navigation models of care.

One-Third of Systematic Reviews in Rehabilitation Applied the Grading of Recommendations Assessment, Development, and Evaluation (GRADE) System to Evaluate Certainty of Evidence: A Meta-Research Study.

OBJECTIVE: To determine how many systematic reviews (SRs) of the literature in rehabilitation assess the certainty of evidence (CoE) and how many apply the Grading of Recommendations Assessment, Development and Evaluation (GRADE) system to do this. DATA SOURCES: For this meta-research study, we searched PubMed and Cochrane Database of Systematic Reviews databases for SRs on rehabilitation published in 2020. STUDY SELECTION AND DATA EXTRACTION: Two reviewers independently selected the SRs and extracted the data. Reporting characteristics and appropriate use of the GRADE system were assessed. DATA SYNTHESIS: The search retrieved 827 records: 29% (239/827) SRs evaluated CoE, 68% (163/239) of which applied the GRADE system. GRADE was used by SRs of randomized controlled trials (RCTs, 88%; 144/163), non-randomized intervention studies (NRIS, 2%; 3/163), and both RCT and NRIS (10%; 16/163). In the latter case, a separate GRADE assessment according to the study design was not provided in 75% (12/16). The reasons for GRADE judgment were reported in 82% (134/163) of SRs. CONCLUSIONS: One-third of SRs in rehabilitation assessed CoE with the GRADE system. GRADE assessment was presented transparently by most SRs. Journal editors and funders should encourage the uptake of the GRADE system when considering SRs in rehabilitation for publication. The authors should pre-define GRADE assessment in a registered and/or published protocol.

Cost-effectiveness of clinical interventions for delirium: A systematic literature review of economic evaluations.

OBJECTIVE: Little is known about the economic value of clinical interventions for delirium. This review aims to synthesise and appraise available economic evidence, including resource use, costs, and cost-effectiveness of interventions for reducing, preventing, and treating delirium. METHODS: Systematic review of published and grey literature on full and partial economic evaluations. Study quality was assessed using the Consolidated Health Economic Evaluation Reporting Standards (CHEERS). RESULTS: Fourteen economic evaluations (43% full, 57% partial) across nine multicomponent and nonpharmacological intervention types met inclusion criteria. The intervention costs ranged between US$386 and $553 per person in inpatient settings. Multicomponent delirium prevention intervention and the Hospital Elder Life Program (HELP) reported statistically significant cost savings or cost offsets somewhere else in the health system. Cost savings related to inpatient, outpatient, and out-of-pocket costs ranged between $194 and $6022 per person. The average CHEERS score was 74% (±SD 10%). CONCLUSION: Evidence on a joint distribution of costs and outcomes of delirium interventions was limited, varied and of generally low quality. Directed expansion of health economics towards the evaluation of delirium care is necessary to ensure effective implementation that meets patients' needs and is cost-effective in achieving similar or better outcomes for the same or lower cost.