The GIN-McMaster guideline tool extension for the integration of quality improvement and quality assurance in guidelines: a description of the methods for its development.

BACKGROUND AND OBJECTIVES: Our objective was to develop an extension of the widely used GIN-McMaster Guideline Development Checklist and Tool for the integration of quality assurance and improvement (QAI) schemes with guideline development. METHODS: We used a mixed-methods approach incorporating evidence from a systematic review, an expert workshop and a survey of experts to iteratively create an extension of the checklist for QAI through three rounds of feedback. As a part of this process, we also refined criteria of a good guideline-based quality indicator. RESULTS: We developed a 40-item checklist extension addressing steps for the integration of QAI into guideline development across the existing 18 topics and created one new topic specific to QAI. The steps span from 'organization, budget, planning and training', to updating of QAI and guideline implementation. CONCLUSION: The tool supports integration of QAI schemes with guideline development initiatives and it will be used in the forthcoming integrated European Commission Initiative on Colorectal Cancer. Future work should evaluate this extension and QAI items requiring additional support for guideline developers and links to QAI schemes.

Analytical frameworks in colorectal cancer guidelines: development of methods for systematic reviews, their application and practical guidance for their use.

OBJECTIVES: Analytical frameworks are graphical representation of the key questions answered by a systematic review and can support the development of guideline recommendations. Our objectives were to a) conduct a systematic review to identify, describe and compare all analytical frameworks published as part of a systematic and guideline development process related to colorectal cancer (CRC), and b) to use this case study to develop guidance on how to conduct systematic reviews of analytical frameworks. METHODS: We developed a search strategy to identify eligible studies in Medline and Embase from 1996 until December 2020. We also manually searched guideline databases and websites to identify all guidelines and systematic reviews in CRC that used an analytical framework. We assessed the quality of the guidelines using the Appraisal of Guidelines for Research and Evaluation II tool. The systematic review was registered in International Prospective Register of Systematic Reviews, registration CRD42020172117. RESULTS: We screened 34,505 records and identified 1,166 guidelines and 3,127 systematic reviews on CRC of which five met our inclusion criteria. These five publications included four analytical frameworks in colorectal cancer (one update). We also describe our methodological approach to systematic reviews for analytical frameworks and underlying concepts for developing analytical framework using a bottom-up or top-down approach. CONCLUSION: Few guidelines and systematic reviews are utilizing analytical frameworks in the development of recommendations. Development of analytical frameworks should begin with a systematic search for existing analytical frameworks and follow a structured conceptual approach for their development to support guideline recommendations. Our methods may be helpful in achieving these objectives.

Symptom- and chest-radiography screening for active pulmonary tuberculosis in HIV-negative adults and adults with unknown HIV status.

BACKGROUND: Systematic screening in high-burden settings is recommended as a strategy for early detection of pulmonary tuberculosis disease, reducing mortality, morbidity and transmission, and improving equity in access to care. Questioning for symptoms and chest radiography (CXR) have historically been the most widely available tools to screen for tuberculosis disease. Their accuracy is important for the design of tuberculosis screening programmes and determines, in combination with the accuracy of confirmatory diagnostic tests, the yield of a screening programme and the burden on individuals and the health service. OBJECTIVES: To assess the sensitivity and specificity of questioning for the presence of one or more tuberculosis symptoms or symptom combinations, CXR, and combinations of these as screening tools for detecting bacteriologically confirmed pulmonary tuberculosis disease in HIV-negative adults and adults with unknown HIV status who are considered eligible for systematic screening for tuberculosis disease. Second, to investigate sources of heterogeneity, especially in relation to regional, epidemiological, and demographic characteristics of the study populations. SEARCH METHODS: We searched the MEDLINE, Embase, LILACS, and HTA (Health Technology Assessment) databases using pre-specified search terms and consulted experts for unpublished reports, for the period 1992 to 2018. The search date was 10 December 2018. This search was repeated on 2 July 2021. SELECTION CRITERIA: Studies were eligible if participants were screened for tuberculosis disease using symptom questions, or abnormalities on CXR, or both, and were offered confirmatory testing with a reference standard. We included studies if diagnostic two-by-two tables could be generated for one or more index tests, even if not all participants were subjected to a microbacteriological reference standard. We excluded studies evaluating self-reporting of symptoms. DATA COLLECTION AND ANALYSIS: We categorized symptom and CXR index tests according to commonly used definitions. We assessed the methodological quality of included studies using the QUADAS-2 instrument. We examined the forest plots and receiver operating characteristic plots visually for heterogeneity. We estimated summary sensitivities and specificities (and 95% confidence intervals (CI)) for each index test using bivariate random-effects methods. We analyzed potential sources of heterogeneity in a hierarchical mixed-model. MAIN RESULTS: The electronic database search identified 9473 titles and abstracts. Through expert consultation, we identified 31 reports on national tuberculosis prevalence surveys as eligible (of which eight were already captured in the search of the electronic databases), and we identified 957 potentially relevant articles through reference checking. After removal of duplicates, we assessed 10,415 titles and abstracts, of which we identified 430 (4%) for full text review, whereafter we excluded 364 articles. In total, 66 articles provided data on 59 studies. We assessed the 2 July 2021 search results; seven studies were potentially eligible but would make no material difference to the review findings or grading of the evidence, and were not added in this edition of the review. We judged most studies at high risk of bias in one or more domains, most commonly because of incorporation bias and verification bias. We judged applicability concerns low in more than 80% of studies in all three domains. The three most common symptom index tests, cough for two or more weeks (41 studies), any cough (21 studies), and any tuberculosis symptom (29 studies), showed a summary sensitivity of 42.1% (95% CI 36.6% to 47.7%), 51.3% (95% CI 42.8% to 59.7%), and 70.6% (95% CI 61.7% to 78.2%, all very low-certainty evidence), and a specificity of 94.4% (95% CI 92.6% to 95.8%, high-certainty evidence), 87.6% (95% CI 81.6% to 91.8%, low-certainty evidence), and 65.1% (95% CI 53.3% to 75.4%, low-certainty evidence), respectively. The data on symptom index tests were more heterogenous than those for CXR. The studies on any tuberculosis symptom were the most heterogeneous, but had the lowest number of variables explaining this variation. Symptom index tests also showed regional variation. The summary sensitivity of any CXR abnormality (23 studies) was 94.7% (95% CI 92.2% to 96.4%, very low-certainty evidence) and 84.8% (95% CI 76.7% to 90.4%, low-certainty evidence) for CXR abnormalities suggestive of tuberculosis (19 studies), and specificity was 89.1% (95% CI 85.6% to 91.8%, low-certainty evidence) and 95.6% (95% CI 92.6% to 97.4%, high-certainty evidence), respectively. Sensitivity was more heterogenous than specificity, and could be explained by regional variation. The addition of cough for two or more weeks, whether to any (pulmonary) CXR abnormality or to CXR abnormalities suggestive of tuberculosis, resulted in a summary sensitivity and specificity of 99.2% (95% CI 96.8% to 99.8%) and 84.9% (95% CI 81.2% to 88.1%) (15 studies; certainty of evidence not assessed). AUTHORS' CONCLUSIONS: The summary estimates of the symptom and CXR index tests may inform the choice of screening and diagnostic algorithms in any given setting or country where screening for tuberculosis is being implemented. The high sensitivity of CXR index tests, with or without symptom questions in parallel, suggests a high yield of persons with tuberculosis disease. However, additional considerations will determine the design of screening and diagnostic algorithms, such as the availability and accessibility of CXR facilities or the resources to fund them, and the need for more or fewer diagnostic tests to confirm the diagnosis (depending on screening test specificity), which also has resource implications. These review findings should be interpreted with caution due to methodological limitations in the included studies and regional variation in sensitivity and specificity. The sensitivity and specificity of an index test in a specific setting cannot be predicted with great precision due to heterogeneity. This should be borne in mind when planning for and implementing tuberculosis screening programmes.

Do clinical practice guidelines consider evidence about diagnostic test consequences on patient-relevant outcomes? A critical document analysis.

RATIONALE, AIMS AND OBJECTIVES: Supporting evidence for diagnostic test recommendations in clinical practice guidelines (CPGs) should not only include diagnostic accuracy, but also downstream consequences of the test result on patient-relevant outcomes. The aim of this study is to assess the extent to which evidence-based CPGs about diagnostic tests cover all relevant test-treatment pathway components. METHODS: We performed a systematic document analysis and quality assessment of publicly accessible CPGs about three common diagnostic tests: C-reactive protein, colonoscopy and fractional exhaled nitric oxide. Evaluation of the impact of the full test-treatment pathway (diagnostic accuracy, burden of the test, natural course of target condition, treatment effectiveness, and link between test result and administration of treatment) on patient relevant outcomes was considered best practice for developing medical test recommendations. RESULTS: We retrieved 15 recommendations in 15 CPGs. The methodological quality of the CPGs varied from poor to excellent. Ten recommendations considered diagnostic accuracy. Four of these were funded on a systematic review and rating of the certainty in the evidence. None of the CPGs evaluated all steps of the test-treatment pathway. Burden of the test was considered in three CPGs, but without systematically reviewing the evidence. Natural course was considered in two CPGs, without a systematic review of the evidence. In three recommendations, treatment effectiveness was considered, supported with a systematic review and rating of the certainty in the evidence in one CPG. The link between test result and treatment administration was not considered in any CPG. CONCLUSIONS: The included CPGs hardly seem to consider evidence about test consequences on patient-relevant outcomes. This might be explained by reporting issues and challenging methodology. Future research is needed to investigate how to facilitate guideline developers in explicit reliable consideration of all steps of a test-treatment pathway when developing diagnostic test recommendations.

Preoperative breast magnetic resonance imaging in patients with ductal carcinoma in situ: a systematic review for the European Commission Initiative on Breast Cancer (ECIBC).

OBJECTIVE: To evaluate the impact of preoperative MRI in the management of Ductal carcinoma in situ (DCIS). METHODS: We searched the PubMed, EMBASE and Cochrane Library databases to identify randomised clinical trials (RCTs) or cohort studies assessing the impact of preoperative breast MRI in surgical outcomes, treatment change or loco-regional recurrence. We provided pooled estimates for odds ratios (OR), relative risks (RR) and proportions and assessed the certainty of the evidence using the GRADE approach. RESULTS: We included 3 RCTs and 23 observational cohorts, corresponding to 20,415 patients. For initial breast-conserving surgery (BCS), the RCTs showed that MRI may result in little to no difference (RR 0.95, 95% CI 0.90 to 1.00) (low certainty); observational studies showed that MRI may have no difference in the odds of re-operation after BCS (OR 0.96; 95% CI 0.36 to 2.61) (low certainty); and uncertain evidence from RCTs suggests little to no difference with respect to total mastectomy rate (RR 0.91; 95% CI 0.65 to 1.27) (very low certainty). We also found that MRI may change the initial treatment plans in 17% (95% CI 12 to 24%) of cases, but with little to no effect on locoregional recurrence (aHR = 1.18; 95% CI 0.79 to 1.76) (very low certainty). CONCLUSION: We found evidence of low to very low certainty which may suggest there is no improvement of surgical outcomes with pre-operative MRI assessment of women with DCIS lesions. There is a need for large rigorously conducted RCTs to evaluate the role of preoperative MRI in this population. KEY POINTS: • Evidence of low to very low certainty may suggest there is no improvement in surgical outcomes with pre-operative MRI. • There is a need for large rigorously conducted RCTs evaluating the role of preoperative MRI to improve treatment planning for DCIS.

Digital breast tomosynthesis compared to diagnostic mammographic projections (including magnification) among women recalled at screening mammography: a systematic review for the European Commission Initiative on Breast Cancer (ECIBC).

BACKGROUND: Diagnostic mammography projections (DxMM) have been traditionally used in the assessment of women recalled after a suspicious screening mammogram. Digital breast tomosynthesis (DBT) reduces the tissue overlap effect, thus improving image assessment. Some studies have suggested DBT might replace DxMM with at least equivalent performance. OBJECTIVE: To evaluate the replacement of DxMM with DBT in women recalled at screening. METHODS: We searched PubMed, EMBASE, and the Cochrane Library databases to identify diagnostic paired cohort studies or RCTs comparing DBT vs DxMM, published in English that: reported accuracy outcomes, recruited women recalled for assessment at mammography screening, and included a reference standard. Subgroup analysis was performed over lesion characteristics. We provided pooled accuracy estimates and differences between tests using a quadrivariate model. We assessed the certainty of the evidence using the GRADE approach. RESULTS: We included ten studies that reported specificity and sensitivity. One study included 7060 women while the remaining included between 52 and 738 women. DBT compared with DxMM showed a pooled difference for the sensitivity of 2% (95% CI 1%-3%) and a pooled difference for the specificity of 6% (95%CI 2%-11%). Restricting the analysis to the six studies that included women with microcalcification lesions gave similar results. In the context of a prevalence of 21% of breast cancer (BC) in recalled women, DBT probably detects 4 (95% CI 2-6) more BC cases and has 47 (95%CI 16-87) fewer false-positive results per 1000 assessments. The certainty of the evidence was moderate due to risk of bias. CONCLUSION: The evidence in the assessment of screen-recalled findings with DBT is sparse and of moderate certainty. DBT probably has higher sensitivity and specificity than DxMM. Women, health care providers and policymakers might value as relevant the reduction of false-positive results and related fewer invasive diagnostic procedures with DBT, without missing BC cases.

Recommendations from the European Commission Initiative on Breast Cancer for multigene testing to guide the use of adjuvant chemotherapy in patients with early breast cancer, hormone receptor positive, HER-2 negative.

BACKGROUND: Predicting the risk of recurrence and response to chemotherapy in women with early breast cancer is crucial to optimise adjuvant treatment. Despite the common practice of using multigene tests to predict recurrence, existing recommendations are inconsistent. Our aim was to formulate healthcare recommendations for the question "Should multigene tests be used in women who have early invasive breast cancer, hormone receptor-positive, HER2-negative, to guide the use of adjuvant chemotherapy?" METHODS: The European Commission Initiative on Breast Cancer (ECIBC) Guidelines Development Group (GDG), a multidisciplinary guideline panel including experts and three patients, developed recommendations informed by systematic reviews of the evidence. Grading of Recommendations Assessment, Development and Evaluation (GRADE) Evidence to Decision frameworks were used. Four multigene tests were evaluated: the 21-gene recurrence score (21-RS), the 70-gene signature (70-GS), the PAM50 risk of recurrence score (PAM50-RORS), and the 12-gene molecular score (12-MS). RESULTS: Five studies (2 marker-based design RCTs, two treatment interaction design RCTs and 1 pooled individual data analysis from observational studies) were included; no eligible studies on PAM50-RORS or 12-MS were identified and the GDG did not formulate recommendations for these tests. CONCLUSIONS: The ECIBC GDG suggests the use of the 21-RS for lymph node-negative women (conditional recommendation, very low certainty of evidence), recognising that benefits are probably larger in women at high risk of recurrence based on clinical characteristics. The ECIBC GDG suggests the use of the 70-GS for women at high clinical risk (conditional recommendation, low certainty of evidence), and recommends not using 70-GS in women at low clinical risk (strong recommendation, low certainty of evidence).

Guideline-based quality assurance: a conceptual framework for the definition of key elements.

BACKGROUND: In 2017, the European Commission's Joint Research Centre (JRC) started developing a methodological framework for a guideline-based quality assurance (QA) scheme to improve cancer quality of care. During the first phase of the work, inconsistency emerged about the use of terminology for the definition, the conceptual underpinnings and the way QA relates to health questions that are answered in guidelines. The objective of this final of three articles is to propose a conceptual framework for an integrated approach to guideline and QA development and clarify terms and definitions for key elements. This work will inform the upcoming European Commission Initiative on Colorectal Cancer (ECICC). METHODS: A multidisciplinary group of 23 experts from key organizations in the fields of guideline development, performance measurement and quality assurance participated in a mixed method approach including face-to-face dialogue and several rounds of virtual meetings. Informed by results of a systematic literature review that indicated absence of an existing framework and practical examples, we first identified the relations of key elements in guideline-based QA and then developed appropriate concepts and terminology to provide guidance. RESULTS: Our framework connects the three key concepts of quality indicators, performance measures and performance indicators integrated with guideline development. Quality indicators are constructs used as a guide to monitor, evaluate, and improve the quality of the structure, process and outcomes of healthcare services; performance measures are tools that quantify or describe measurable elements of practice performance; and performance indicators are quantifiable and measurable units or scores of practice, which should be guided by guideline recommendations. CONCLUSIONS: The inconsistency in the way key terms of QA are used and defined has confused the field. Our conceptual framework defines the role, meaning and interactions of the key elements for improving quality in healthcare. It directly builds on the questions asked in guidelines and answered through recommendations. These findings will be applied in the forthcoming ECICC and for the future updates of ECIBC. These are large-scale integrated projects aimed at improving healthcare quality across Europe through the development of guideline-based QA schemes; this will help in implementing and improving our approach.

Bringing two worlds closer together: a critical analysis of an integrated approach to guideline development and quality assurance schemes.

BACKGROUND: Although quality indicators are frequently derived from guidelines, there is a substantial gap in collaboration between the corresponding parties. To optimise workflow, guideline recommendations and quality assurance should be aligned methodologically and practically. Learning from the European Commission Initiative on Breast Cancer (ECIBC), our objective was to bring the key knowledge and most important considerations from both worlds together to inform European Commission future initiatives. METHODS: We undertook several steps to address the problem. First, we conducted a feasibility study that included a survey, interviews and a review of manuals for an integrated guideline and quality assurance (QA) scheme that would support the European Commission. The feasibility study drew from an assessment of the ECIBC experience that followed commonly applied strategies leading to separation of the guideline and QA development processes. Secondly, we used results of a systematic review to inform our understanding of methodologies for integrating guideline and QA development. We then, in a third step, used the findings to prepare an evidence brief and identify key aspects of a methodological framework for integrating guidelines QA through meetings with key informants. RESULTS: Seven key themes emerged to be taken into account for integrating guidelines and QA schemes: (1) evidence-based integrated guideline and QA frameworks are possible, (2) transparency is key in clearly documenting the source and rationale for quality indicators, (3) intellectual and financial interests should be declared and managed appropriately, (4) selection processes and criteria for quality indicators need further refinement, (5) clear guidance on retirement of quality indicators should be included, (6) risks of an integrated guideline and QA Group can be mitigated, and (7) an extension of the GIN-McMaster Guideline Development Checklist should incorporate QA considerations. DISCUSSION: We concluded that the work of guideline and QA developers can be integrated under a common methodological framework and we provided key findings and recommendations. These two worlds, that are fundamental to improving health, can both benefit from integration.

Routine laboratory testing to determine if a patient has COVID-19.

BACKGROUND: Specific diagnostic tests to detect severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) and resulting COVID-19 disease are not always available and take time to obtain results. Routine laboratory markers such as white blood cell count, measures of anticoagulation, C-reactive protein (CRP) and procalcitonin, are used to assess the clinical status of a patient. These laboratory tests may be useful for the triage of people with potential COVID-19 to prioritize them for different levels of treatment, especially in situations where time and resources are limited. OBJECTIVES: To assess the diagnostic accuracy of routine laboratory testing as a triage test to determine if a person has COVID-19. SEARCH METHODS: On 4 May 2020 we undertook electronic searches in the Cochrane COVID-19 Study Register and the COVID-19 Living Evidence Database from the University of Bern, which is updated daily with published articles from PubMed and Embase and with preprints from medRxiv and bioRxiv. In addition, we checked repositories of COVID-19 publications. We did not apply any language restrictions. SELECTION CRITERIA: We included both case-control designs and consecutive series of patients that assessed the diagnostic accuracy of routine laboratory testing as a triage test to determine if a person has COVID-19. The reference standard could be reverse transcriptase polymerase chain reaction (RT-PCR) alone; RT-PCR plus clinical expertise or and imaging; repeated RT-PCR several days apart or from different samples; WHO and other case definitions; and any other reference standard used by the study authors. DATA COLLECTION AND ANALYSIS: Two review authors independently extracted data from each included study. They also assessed the methodological quality of the studies, using QUADAS-2. We used the 'NLMIXED' procedure in SAS 9.4 for the hierarchical summary receiver operating characteristic (HSROC) meta-analyses of tests for which we included four or more studies. To facilitate interpretation of results, for each meta-analysis we estimated summary sensitivity at the points on the SROC curve that corresponded to the median and interquartile range boundaries of specificities in the included studies. MAIN RESULTS: We included 21 studies in this review, including 14,126 COVID-19 patients and 56,585 non-COVID-19 patients in total. Studies evaluated a total of 67 different laboratory tests. Although we were interested in the diagnotic accuracy of routine tests for COVID-19, the included studies used detection of SARS-CoV-2 infection through RT-PCR as reference standard. There was considerable heterogeneity between tests, threshold values and the settings in which they were applied. For some tests a positive result was defined as a decrease compared to normal vaues, for other tests a positive result was defined as an increase, and for some tests both increase and decrease may have indicated test positivity. None of the studies had either low risk of bias on all domains or low concerns for applicability for all domains. Only three of the tests evaluated had a summary sensitivity and specificity over 50%. These were: increase in interleukin-6, increase in C-reactive protein and lymphocyte count decrease. Blood count Eleven studies evaluated a decrease in white blood cell count, with a median specificity of 93% and a summary sensitivity of 25% (95% CI 8.0% to 27%; very low-certainty evidence). The 15 studies that evaluated an increase in white blood cell count had a lower median specificity and a lower corresponding sensitivity. Four studies evaluated a decrease in neutrophil count. Their median specificity was 93%, corresponding to a summary sensitivity of 10% (95% CI 1.0% to 56%; low-certainty evidence). The 11 studies that evaluated an increase in neutrophil count had a lower median specificity and a lower corresponding sensitivity. The summary sensitivity of an increase in neutrophil percentage (4 studies) was 59% (95% CI 1.0% to 100%) at median specificity (38%; very low-certainty evidence). The summary sensitivity of an increase in monocyte count (4 studies) was 13% (95% CI 6.0% to 26%) at median specificity (73%; very low-certainty evidence). The summary sensitivity of a decrease in lymphocyte count (13 studies) was 64% (95% CI 28% to 89%) at median specificity (53%; low-certainty evidence). Four studies that evaluated a decrease in lymphocyte percentage showed a lower median specificity and lower corresponding sensitivity. The summary sensitivity of a decrease in platelets (4 studies) was 19% (95% CI 10% to 32%) at median specificity (88%; low-certainty evidence). Liver function tests The summary sensitivity of an increase in alanine aminotransferase (9 studies) was 12% (95% CI 3% to 34%) at median specificity (92%; low-certainty evidence). The summary sensitivity of an increase in aspartate aminotransferase (7 studies) was 29% (95% CI 17% to 45%) at median specificity (81%) (low-certainty evidence). The summary sensitivity of a decrease in albumin (4 studies) was 21% (95% CI 3% to 67%) at median specificity (66%; low-certainty evidence). The summary sensitivity of an increase in total bilirubin (4 studies) was 12% (95% CI 3.0% to 34%) at median specificity (92%; very low-certainty evidence). Markers of inflammation The summary sensitivity of an increase in CRP (14 studies) was 66% (95% CI 55% to 75%) at median specificity (44%; very low-certainty evidence). The summary sensitivity of an increase in procalcitonin (6 studies) was 3% (95% CI 1% to 19%) at median specificity (86%; very low-certainty evidence). The summary sensitivity of an increase in IL-6 (four studies) was 73% (95% CI 36% to 93%) at median specificity (58%) (very low-certainty evidence). Other biomarkers The summary sensitivity of an increase in creatine kinase (5 studies) was 11% (95% CI 6% to 19%) at median specificity (94%) (low-certainty evidence). The summary sensitivity of an increase in serum creatinine (four studies) was 7% (95% CI 1% to 37%) at median specificity (91%; low-certainty evidence). The summary sensitivity of an increase in lactate dehydrogenase (4 studies) was 25% (95% CI 15% to 38%) at median specificity (72%; very low-certainty evidence). AUTHORS' CONCLUSIONS: Although these tests give an indication about the general health status of patients and some tests may be specific indicators for inflammatory processes, none of the tests we investigated are useful for accurately ruling in or ruling out COVID-19 on their own. Studies were done in specific hospitalized populations, and future studies should consider non-hospital settings to evaluate how these tests would perform in people with milder symptoms.

Development and use of health outcome descriptors: a guideline development case study.

BACKGROUND: During healthcare guideline development, panel members often have implicit, different definitions of health outcomes that can lead to misunderstandings about how important these outcomes are and how to balance benefits and harms. McMaster GRADE Centre researchers developed 'health outcome descriptors' for standardizing descriptions of health outcomes and overcoming these problems to support the European Commission Initiative on Breast Cancer (ECIBC) Guideline Development Group (GDG). We aimed to determine which aspects of the development, content, and use of health outcome descriptors were valuable to guideline developers. METHODS: We developed 24 health outcome descriptors related to breast cancer screening and diagnosis for the European Commission Breast Guideline Development Group (GDG). Eighteen GDG members provided feedback in written format or in interviews. We then evaluated the process and conducted two health utility rating surveys. RESULTS: Feedback from GDG members revealed that health outcome descriptors are probably useful for developing recommendations and improving transparency of guideline methods. Time commitment, methodology training, and need for multidisciplinary expertise throughout development were considered important determinants of the process. Comparison of the two health utility surveys showed a decrease in standard deviation in the second survey across 21 (88%) of the outcomes. CONCLUSIONS: Health outcome descriptors are feasible and should be developed prior to the outcome prioritization step in the guideline development process. Guideline developers should involve a subgroup of multidisciplinary experts in all stages of development and ensure all guideline panel members are trained in guideline methodology that includes understanding the importance of defining and understanding the outcomes of interest.

Role of patient preferences in clinical practice guidelines: a multiple methods study using guidelines from oncology as a case.

OBJECTIVE: Many treatment decisions are preference-sensitive and call for shared decision-making, notably when benefits are limited or uncertain, and harms impact quality of life. We explored if clinical practice guidelines (CPGs) acknowledge preference-sensitive decisions in how they motivate and phrase their recommendations. DESIGN: We performed a qualitative analysis of the content of CPGs and verified the results in semistructured interviews with CPG panel members. SETTING: Dutch oncology CPGs issued in 2010 or later, concerning primary treatment with curative intent. PARTICIPANTS: 14 CPG panel members. MAIN OUTCOMES: For treatment recommendations from six CPG modules, two researchers extracted the following: strength of recommendation in terms of the Grading of Recommendations Assessment, Development and Evaluation and its consistency with the CPG text; completeness of presentation of benefits and harms; incorporation of patient preferences; statements on the panel's benefits-harm trade-off underlying recommendation; and advice on patient involvement in decision-making. RESULTS: We identified 32 recommendations, 18 were acknowledged preference-sensitive decisions. Three of 14 strong recommendations should have been weak based on the module text. The reporting of benefits and harms, and their probabilities, was sufficiently complete and clear to inform the strength of the recommendation in one of the six modules only. Numerical probabilities were seldom presented. None of the modules presented information on patient preferences. CPG panel's preferences were not made explicit, but appeared to have impacted 15 of 32 recommendations. Advice to involve patients and their preferences in decision-making was given for 20 recommendations (14 weak). Interviewees confirmed these findings. Explanations for lack of information were, for example, that clinicians know the information and that CPGs must be short. Explanations for trade-offs made were cultural-historical preferences, compliance with daily care, presumed role of CPGs and lack of time. CONCLUSIONS: The motivation and phrasing of CPG recommendations do not stimulate choice awareness and a neutral presentation of options, thus hindering shared decision-making.

Systematic review of prognostic factors for work participation in patients with sciatica.

Sciatica impacts on the ability to work and may lead to a reduced return to work. This study reviewed and summarised prognostic factors of work participation in patients who received conservative or surgical treatment for clinically diagnosed sciatica. We searched MEDLINE, CINAHL, EMBASE and PsycINFO until January 2018. Cohort studies, using a measure of work participation as outcome, were included. Two independent reviewers performed study inclusion and used the Quality In Prognosis Studies tool for risk of bias assessment and GRADE to rate the quality of the evidence. Based on seven studies describing six cohorts (n=1408 patients) that assessed 21 potential prognostic factors, favourable factors for return to work (follow-up ranging from 3 months to 10 years) included younger age, better general health, less low back pain or sciatica bothersomeness, better physical function, negative straight leg raise-test, physician expecting surgery to be beneficial, better pain coping, less depression and mental stress, less fear of movement and low physical work load. Study results could not be pooled. Using GRADE, the quality of the evidence ranged from moderate to very low, with downgrading mainly for a high risk of bias and imprecision. Several prognostic factors like pain, disability and psychological factors were identified and reviewed, and these could be targeted using additional interventions to optimise return to work. PROSPERO registration number: CRD42016042497.

Prevalence of Gastroesophageal Reflux Disease Symptoms in Infants and Children: A Systematic Review.

OBJECTIVES: Gastroesophageal reflux disease (GERD) is defined as gastroesophageal reflux causing troublesome symptoms or complications. In this study we reviewed the literature regarding the prevalence of GERD symptoms in infants and children. METHODS: Databases of PubMed, EMBASE, and Cochrane were systematically searched from inception to June 26, 2018. English-written studies based on birth cohort, school-based, or general population samples of ≥50 children aged 0 to 21 years were included. Convenience samples were excluded. RESULTS: In total, 3581 unique studies were found, of which 25 studies (11 in infants and 14 in children) were included with data on the prevalence of GERD symptoms comprising a total population of 487,969 children. In infants (0-18 months), GERD symptoms are present in more than a quarter of infants on a daily basis and show a steady decline in frequency with almost complete disappearance of symptoms at the age of 12 months. In children older than 18 months, GERD symptoms show large variation in prevalence between studies (range 0%-38% of study population) and overall, are present in >10% and in 25% on respectively a weekly and monthly basis. Of the risk factors assessed, higher body mass index and the use of alcohol and tobacco were associated with higher GERD symptom prevalence. CONCLUSIONS: This systematic review demonstrates that the reported prevalence of GERD symptoms varies considerably, depending on method of data collection and criteria used to define symptoms. Nevertheless, the high reported prevalence rates support better investment of resources and educational campaigns focused on prevention.

GRADE guidelines: 22. The GRADE approach for tests and strategies-from test accuracy to patient-important outcomes and recommendations.

OBJECTIVES: This article describes the Grading of Recommendations Assessment, Development and Evaluation (GRADE) Working Group's framework of moving from test accuracy to patient or population-important outcomes. We focus on the common scenario when studies directly evaluating the effect of diagnostic and other tests or strategies on health outcomes are not available or are not providing the best available evidence. STUDY DESIGN AND SETTING: Using practical examples, we explored how guideline developers and other decision makers can use information from test accuracy to develop a recommendation by linking evidence that addresses downstream consequences. Guideline panels should develop an analytic framework that summarizes the actions that follow from applying a test and the consequences. RESULTS: We describe GRADE's current thinking about the overall certainty of the evidence (also known as quality of the evidence or confidence in the estimates) arising from consideration of the often complex pathways that involve multiple tests and management options. Each link in the evidence can-and often does-lower the overall certainty of the evidence required to formulate recommendations and make decisions about tests. The frequency with which an outcome occurs and its importance will influence whether or not a particular step in the linked evidence is critical to decision-making. CONCLUSIONS: Overall certainty may be expressed by the weakest critical step in the linked evidence. The linked approach to addressing optimal testing will often require the use of decision analytic approaches. We present an example that involves decision modeling in a GRADE Evidence to Decision framework for cervical cancer screening. However, because resources and time of guideline developers may be limited, we describe alternative, pragmatic strategies for developing recommendations addressing test use.

Incidence of invasive pneumococcal disease in immunocompromised patients: A systematic review and meta-analysis.

BACKGROUND: Invasive pneumococcal disease (IPD) is associated with high morbidity and mortality, with immunocompromised patients (ICPs) at particular risk. Therefore, guidelines recommend pneumococcal vaccination for these patients. However, guidelines are scarcely underpinned with references to incidence studies of IPD in this population. This, potentially results in unawareness of the importance of vaccination and low vaccination rates. The objective of this systematic review and meta-analysis was to assess the incidence of IPD in ICPs. METHODS: We systematically searched PubMed and Embase to identify studies in English published before December 6th, 2017 that included terms related to 'incidence', 'rate', 'pneumococcal', 'pneumoniae', 'meningitis', 'septicemia', or 'bacteremia'. We focused on patients with HIV, transplantation and chronic inflammatory diseases. RESULTS: We included 45 studies in the systematic review reporting an incidence or rate of IPD, defined as isolation of Streptococcus pneumoniae from a normally sterile site. Random effects meta-analysis of 38 studies showed a pooled IPD incidence of 331/100,000 person years in patients with HIV in the late-antiretroviral treatment era in non-African countries, and 318/100,000 in African countries; 696 and 812/100,000 in patients who underwent an autologous or allogeneic stem cell transplantation, respectively; 465/100,000 in patients with a solid organ transplantation; and 65/100,000 in patients with chronic inflammatory diseases. In healthy control cohorts, the pooled incidence was 10/100,000. DISCUSSION: ICPs are at increased risk of contracting IPD, especially those with HIV, and those who underwent transplantation. Based on our findings, we recommend pneumococcal vaccination in immunocompromised patients. PROSPERO REGISTRATION: ID: CRD42016048438.

Pediatric Gastroesophageal Reflux Clinical Practice Guidelines: Joint Recommendations of the North American Society for Pediatric Gastroenterology, Hepatology, and Nutrition and the European Society for Pediatric Gastroenterology, Hepatology, and Nutrition.

This document serves as an update of the North American Society for Pediatric Gastroenterology, Hepatology, and Nutrition (NASPGHAN) and the European Society for Pediatric Gastroenterology, Hepatology, and Nutrition (ESPGHAN) 2009 clinical guidelines for the diagnosis and management of gastroesophageal reflux disease (GERD) in infants and children and is intended to be applied in daily practice and as a basis for clinical trials. Eight clinical questions addressing diagnostic, therapeutic and prognostic topics were formulated. A systematic literature search was performed from October 1, 2008 (if the question was addressed by 2009 guidelines) or from inception to June 1, 2015 using Embase, MEDLINE, the Cochrane Database of Systematic Reviews and the Cochrane Central Register of Controlled Clinical Trials. The approach of the Grading of Recommendations Assessment, Development and Evaluation (GRADE) was applied to define and prioritize outcomes. For therapeutic questions, the quality of evidence was also assessed using GRADE. Grading the quality of evidence for other questions was performed according to the Quality Assessment of Studies of Diagnostic Accuracy (QUADAS) and Quality in Prognostic Studies (QUIPS) tools. During a 3-day consensus meeting, all recommendations were discussed and finalized. In cases where no randomized controlled trials (RCT; therapeutic questions) or diagnostic accuracy studies were available to support the recommendations, expert opinion was used. The group members voted on each recommendation, using the nominal voting technique. With this approach, recommendations regarding evaluation and management of infants and children with GERD to standardize and improve quality of care were formulated. Additionally, 2 algorithms were developed, 1 for infants <12 months of age and the other for older infants and children.

Facilitating healthcare decisions by assessing the certainty in the evidence from preclinical animal studies.

Laboratory animal studies are used in a wide range of human health related research areas, such as basic biomedical research, drug research, experimental surgery and environmental health. The results of these studies can be used to inform decisions regarding clinical research in humans, for example the decision to proceed to clinical trials. If the research question relates to potential harms with no expectation of benefit (e.g., toxicology), studies in experimental animals may provide the only relevant or controlled data and directly inform clinical management decisions. Systematic reviews and meta-analyses are important tools to provide robust and informative evidence summaries of these animal studies. Rating how certain we are about the evidence could provide important information about the translational probability of findings in experimental animal studies to clinical practice and probably improve it. Evidence summaries and certainty in the evidence ratings could also be used (1) to support selection of interventions with best therapeutic potential to be tested in clinical trials, (2) to justify a regulatory decision limiting human exposure (to drug or toxin), or to (3) support decisions on the utility of further animal experiments. The Grading of Recommendations, Assessment, Development, and Evaluation (GRADE) approach is the most widely used framework to rate the certainty in the evidence and strength of health care recommendations. Here we present how the GRADE approach could be used to rate the certainty in the evidence of preclinical animal studies in the context of therapeutic interventions. We also discuss the methodological challenges that we identified, and for which further work is needed. Examples are defining the importance of consistency within and across animal species and using GRADE's indirectness domain as a tool to predict translation from animal models to humans.