Methodological and users' surveys on the use of the LILACS database in Cochrane reviews identified desirable improvements to the database.

BACKGROUND: Latin American and Caribbean Health Sciences Literature (LILACS) is the main reference database in the region; however, the way in which this resource is used in Cochrane systematic reviews has not been studied. OBJECTIVES: To assess the search methods of Cochrane reviews that used LILACS as a source of information and explore the Cochrane community's perceptions about this resource. METHODS: We identified all Cochrane reviews of interventions published during 2019, which included LILACS as a source of information, and analysed their search methods and also ran a survey through the Cochrane Community. RESULTS: We found 133 Cochrane reviews that reported the full search strategies, identifying heterogeneity in search details. The respondents to our survey highlighted many areas for improvement in the use of LILACS, including the usability of the search platform for this purpose. DISCUSSION: The use and reporting of LILACS in Cochrane reviews demonstrate inconsistencies, as evidenced by the analysis of search reports from systematic reviews and surveys conducted among members of the Cochrane community. CONCLUSION: With better guidance on how LILACS database is structured, information specialists working on Cochrane reviews should be able to make more effective use of this unique resource.

How developing a point of need training tool for evidence synthesis can improve librarian support for researchers.

Medical and health sciences librarians who are involved in evidence synthesis projects will know that systematic reviews are intensely rigorous, requiring research teams to devote significant resources to the methodological process. As expert searchers, librarians are often identified as personnel to conduct the database searching portion and/or are approached as experts in the methodology to guide research teams through the lifecycle of the project. This research method has surged in popularity at our campus and demand for librarian participation is unsustainable. As a response to this, the library created self-directed learning objects in the form of roadmap to assist researchers in learning about the knowledge synthesis methodology in an expedient, self-directed manner. This paper will discuss the creation, implementation and feedback around our educational offering: Systematic & Scoping Reviews: Your Roadmap to Conducting an Evidence Synthesis.

Evidence surveillance for a living clinical guideline: Case study of the Australian stroke guidelines.

BACKGROUND: Continual evidence surveillance is an integral feature of living guidelines. The Australian Stroke Guidelines include recommendations on 100 clinical topics and have been 'living' since 2018. OBJECTIVES: To describe the approach for establishing and evaluating an evidence surveillance system for the living Australian Stroke Guidelines. METHODS: We developed a pragmatic surveillance system based on an analysis of the searches for the 2017 Stroke Guidelines and evaluated its reliability by assessing the potential impact on guideline recommendations. Search retrieval and screening workload are monitored monthly, together with the frequency of changes to the guideline recommendations. RESULTS: Evidence surveillance was guided by practical considerations of efficiency and sustainability. A single PubMed search covering all guideline topics, limited to systematic reviews and randomised trials, is run monthly. The search retrieves about 400 records a month of which a sixth are triaged to the guideline panels for further consideration. Evaluations with Epistemonikos and the Cochrane Stroke Trials Register demonstrated the robustness of adopting this more restrictive approach. Collaborating with the guideline team in designing, implementing and evaluating the surveillance is essential for optimising the approach. CONCLUSION: Monthly evidence surveillance for a large living guideline is feasible and sustainable when applying a pragmatic approach.

Development of a validated search filter for Ovid Embase for degenerative cervical myelopathy.

BACKGROUND: Degenerative cervical myelopathy (DCM) is a recently proposed umbrella term for symptomatic cervical spinal cord compression secondary to degeneration of the spine. Currently literature searching for DCM is challenged by the inconsistent uptake of the term 'DCM' with many overlapping keywords and numerous synonyms. OBJECTIVES: Here, we adapt our previous Ovid medline search filter for the Ovid embase database, to support comprehensive literature searching. Both embase and medline are recommended as a minimum for systematic reviews. METHODS: References contained within embase identified in our prior study formed a 'development gold standard' reference database (N = 220). The search filter was adapted for embase and checked against the reference database. The filter was then validated against the 'validation gold standard'. RESULTS: A direct translation was not possible, as medline indexing for DCM and the keywords search field were not available in embase. We also used the 'focus' function to improve precision. The resulting search filter has 100% sensitivity in testing. DISCUSSION AND CONCLUSION: We have developed a validated search filter capable of retrieving DCM references in embase with high sensitivity. In the absence of consistent terminology and indexing, this will support more efficient and robust evidence synthesis in the field.

Development and validation of search filters to retrieve medication discontinuation articles in Medline and Embase.

BACKGROUND: Medication discontinuation studies explore the outcomes of stopping a medication compared to continuing it. Comprehensively identifying medication discontinuation articles in bibliographic databases remains challenging due to variability in terminology. OBJECTIVES: To develop and validate search filters to retrieve medication discontinuation articles in Medline and Embase. METHODS: We identified medication discontinuation articles in a convenience sample of systematic reviews. We used primary articles to create two reference sets for Medline and Embase, respectively. The reference sets were equally divided by randomization in development sets and validation sets. Terms relevant for discontinuation were identified by term frequency analysis in development sets and combined to develop two search filters that maximized relative recalls. The filters were validated against validation sets. Relative recalls were calculated with their 95% confidences intervals (95% CI). RESULTS: We included 316 articles for Medline and 407 articles for Embase, from 15 systematic reviews. The Medline optimized search filter combined 7 terms. The Embase optimized search filter combined 8 terms. The relative recalls were respectively 92% (95% CI: 87-96) and 91% (95% CI: 86-94). CONCLUSIONS: We developed two search filters for retrieving medication discontinuation articles in Medline and Embase. Further research is needed to estimate precision and specificity of the filters.

A method for translating search strategies efficiently into HMIC and SPP.

BACKGROUND: Small databases, such as Health Management Information Consortium (HMIC) and Social Policy and Practice (SPP), can add value to systematic searches. Search strategies designed for large databases may not be appropriate in small sources. A different approach to translating strategies could ensure that small databases are searched efficiently. OBJECTIVES: To establish the contribution HMIC and SPP made to public health guidelines (PHGs); and to recommend an efficient method of translating search strategies. METHODS: Eight PHGs were analysed to establish how many included publications were retrieved from HMIC and SPP. Six options for translating strategies from MEDLINE, using variations of free text and subject terms, were compared. RESULTS: Health Management Information Consortium contributed 15 and SPP eight of the 483 publications cited in the PHGs. The free-text only search was the one option to miss an included publication. The heading word (with truncation) option was more precise than applying subject headings. DISCUSSION: There is a risk of missing relevant publications in free-text only searches and it is preferable to include subject terms efficiently. CONCLUSION: The heading word (with truncation) option did not miss the evidence included in the PHGs and was the most efficient method for translating MEDLINE to HMIC and SPP.

The National Institute for Health and Care Excellence information specialist development pathway: Developing the skills, knowledge and confidence to quality assure search strategies.

Quality assurance (QA) is an important process in ensuring that systematic reviews and other evidence syntheses are supported by a high-quality search. This paper describes how the National Institute for Health and Care Excellence (NICE) in the UK established a development pathway to ensure its information specialists had the skills, knowledge and confidence to undertake search QA. The key component of the pathway is that it blends technical knowledge with interpersonal skills. The pathway develops technical skills in the early steps before using peer support activities to build confidence while undertaking a range of searches. QA is effective when the search lead communicates the contextual information that has influenced search development. QA is treated as a collaboration to get the right search for the review. The key requirements for search QA, alongside technical knowledge, are communication, collaboration and negotiation skills.

A systematic review case study of urgent and emergency care configuration found citation searching of Web of Science and Google Scholar of similar value.

BACKGROUND: Supplementary search methods, including citation searching, are essential if systematic reviews are to avoid producing biased conclusions. Little evidence exists on how to prioritise databases for citation searching or to establish whether using multiple sources is beneficial. OBJECTIVES: A systematic review examining urgent and emergency care reconfiguration was used to investigate the utility of citation searching on Web of Science (WOS) and/or Google Scholar (GS). METHODS: This case study investigated numbers of studies, additional studies and unique studies retrieved from both sources. In addition, the time to search, the ease of adding references to reference management software and obtaining abstracts of studies for screening are briefly considered. RESULTS: WOS retrieved 62 references after deduplication of the results, 52 being additional references not retrieved during the database searching. GS retrieved 134 unique references with 63 additional references. WOS and GS retrieved the same three additional included studies. WOS was less time intensive to search given the facility to restrict to English language papers and availability of abstracts. CONCLUSIONS: In a single systematic review case study, citation searching was required to identify all included studies. Citation searching on WOS is more efficient, where a subscription is available. Both databases identified the same studies but GS required additional time to remove non-English language studies and locate abstracts.

An alternative screening approach for Google Search identifies an accurate and manageable number of results for a systematic review (case study).

BACKGROUND: A challenge when using Google Search to identify studies for a systematic review is managing the high number of results, which can number in the hundreds of thousands or even more. Studies and guidance on web searching suggest limiting the screening process, e.g. to the first 100 results. OBJECTIVES: Our objective in this case study is to demonstrate an alternative approach to screening the results retrieved by Google Search which is based on our experience that the viewable number of results is often far fewer than the estimated number calculated by the search engine. METHODS: We screened the results of three searches of Google Search using our approach, which involves increasing the number of results displayed per page from 10 to the maximum of 100. We then calculated the viewable number of results and compared this with the estimated number. RESULTS: The mean of the estimated number of results for the three searches was 569,454,000. The mean of the viewable number results was 463 (0.00008% of the mean of the estimated number of results). CONCLUSION: Our findings challenge the commonly reported view that the number of results retrieved when using Google Search is too high to screen in full.

Database selection in systematic reviews: an insight through clinical neurology.

BACKGROUND: Failure to perform a comprehensive search when designing a systematic review (SR) can lead to bias, reducing the validity of review's conclusions. OBJECTIVE: We examined the frequency and choice of databases used by reviewers in clinical neurology. METHODS: Ninety-five SRs and/or meta-analyses were located across five prominent neurology journals between 2008 and 2014. Methods sections were reviewed, and all bibliographic databases were coded. RESULTS: On average, 2.59 databases were used in SR searches. Seven reviews included an information specialist, and these reviews reported a greater number of information sources used during the search process. Thirty-nine databases were reported across studies. PubMed/MEDLINE® and EMBASE were cited most frequently. DISCUSSION: Searching too few databases may reduce the validity and generalisability of SR results. We found that the majority of systematic reviewers in clinical neurology do not search an adequate number of databases, which may yield a biased sample of primary studies and, thus, may influence the accuracy of summary effects. CONCLUSIONS: Systematic reviewers should aim to search a sufficient number of databases to minimise selection bias. Additionally, systematic reviewers should include information specialists in designing SR methodology, as this may improve systematic review quality.

Ten years of reviews.

The March 2017 issue of the Health Information and Libraries Journal marks the 10 year anniversary of the inaugural review published in the journal's review series. The review series was conceived to meet the growing appetite of health library and information workers to access synthesised evidence to inform their practice; something we'd already been doing to support medics in their practice. This editorial looks back on the 10 years and the inspiration which saw the development of a typology of review types and associated methodologies to address the lack of consistent guidelines on the features a review should incorporate.

Systematic searching for theory to inform systematic reviews: is it feasible? Is it desirable?

BACKGROUND: In recognising the potential value of theory in understanding how interventions work comes a challenge - how to make identification of theory less haphazard? OBJECTIVES: To explore the feasibility of systematic identification of theory. METHOD: We searched PubMed for published reviews (1998-2012) that had explicitly sought to identify theory. Systematic searching may be characterised by a structured question, methodological filters and an itemised search procedure. We constructed a template (BeHEMoTh - Behaviour of interest; Health context; Exclusions; Models or Theories) for use when systematically identifying theory. The authors tested the template within two systematic reviews. RESULTS: Of 34 systematic reviews, only 12 reviews (35%) reported a method for identifying theory. Nineteen did not specify how they identified studies containing theory. Data were unavailable for three reviews. Candidate terms include concept(s)/conceptual, framework(s), model(s), and theory/theories/theoretical. Information professionals must overcome inadequate reporting and the use of theory out of context. The review team faces an additional concern in lack of 'theory fidelity'. CONCLUSIONS: Based on experience with two systematic reviews, the BeHEMoTh template and procedure offers a feasible and useful approach for identification of theory. Applications include realist synthesis, framework synthesis or review of complex interventions. The procedure requires rigorous evaluation.

A comparison of searching the Cochrane library databases via CRD, Ovid and Wiley: implications for systematic searching and information services.

BACKGROUND: The Cochrane Library databases are available via different interfaces; evidence in the literature, together with anecdotal evidence, shows interfaces perform differently. To ensure the quality of searches, a study was undertaken to systematically explore the functionality of interfaces. OBJECTIVES: To demonstrate differences in functionality when searching the same databases across different interfaces; to discuss the implications this may have on searching; and in a wider context, to suggest a 'best match' for comparable searching. METHODS: Detailed cross-comparisons of a selection of search functions including MeSH terms, free text, proximity operators and truncation were undertaken in databases accessed via CRD, Wiley and Ovid. Up to three terms per function were selected and analysed. RESULTS: Differences were identified in the way searches for MeSH headings are executed, which fields are searched, how proximity operators perform, the word order searched and where terms are searched. This adds to a body of evidence demonstrating a lack of consistency in searching across different interfaces. CONCLUSIONS: A 'best match' for comparable searching is suggested. Differences between interfaces offering the same database content can have implications for the success of a search, on user education, and on database evaluation and purchasing decisions.

Use of deprescribing search filters in systematic review search strategies: A case study.

Two deprescribing search filters for MEDLINE and one deprescribing search filter for Embase have been recently developed, including objectively developed search filters. The objective of this case study was to implement these three deprescribing search filters in systematic review (SR) search strategies and to assess their effect on performances. SR that independently developed original search strategies (OSS) were selected. The deprescribing filters were implemented in each OSS, generating two implemented search strategies (ISS1 and ISS2) in MEDLINE and one ISS (ISS3) in Embase. OSS were re-run on the same date as ISS. The performances of ISS and OSS were calculated and compared. Two SR were included (SR1 and SR2). For MEDLINE, SR1 included 12 articles. The sensitivity was 50% for OSS, 58% for ISS1 and 42% for ISS2. SR2 included four articles. The sensitivity of OSS, ISS 1 and 2 was 25%. For Embase, SR1 included 12 articles. The sensitivity was 33% for OSS and 58% for ISS3. SR2 included four articles. None of the four included articles were retrieved with OSS or ISS3. While sensitivity of OSS was moderate, the objectively developed deprescribing filters maintained or slightly improved this sensitivity when implementing.

Online strategies to facilitate health-related knowledge transfer: a systematic search and review.

BACKGROUND: Health interventions and practices often lag behind the available research, and the need for timely translation of new health knowledge into practice is becoming increasingly important. OBJECTIVE: The objective of this study was to conduct a systematic search and review of the literature on online knowledge translation techniques that foster the interaction between various stakeholders and assist in the sharing of ideas and knowledge within the health field. METHODS: The search strategy included all published literature in the English language since January 2003 and used the medline, Cumulative Index to Nursing and Allied Health Literature (cinahl), embase and Inspec databases. RESULTS: The results of the review indicate that online strategies are diverse, yet all are applicable in facilitating online health-related knowledge translation. The method of knowledge sharing ranged from use of wikis, discussion forums, blogs, and social media to data/knowledge management tools, virtual communities of practice and conferencing technology - all of which can encourage online health communication and knowledge translation. CONCLUSIONS: Online technologies are a key facilitator of health-related knowledge translation. This review of online strategies to facilitate health-related knowledge translation can inform the development and improvement of future strategies to expedite the translation of research to practice.