Are journal clubs effective in supporting evidence-based decision making? A systematic review. BEME Guide No. 16.

BACKGROUND: Journal clubs (JCs) are a common form of interactive education in health care aiming to promote the uptake of research evidence into practice, but their effectiveness has not been established. OBJECTIVE: This systematic review aimed to determine whether the JC is an effective intervention in supporting clinical decision making. METHODS: We searched for studies which evaluated whether clubs promote changes in learner reaction, attitudes, knowledge, skills, behaviour or patient outcomes. We included undergraduate, postgraduate and practice JCs and excluded studies evaluating video/internet meetings or single meetings. RESULTS: Eighteen studies were included. Studies reported improvements in reading behaviour (N = 5/11), confidence in critical appraisal (N = 7/7), critical appraisal test scores (N = 5/7) and ability to use findings (N = 5/7). No studies reported on patient outcomes. Sixteen studies used self-reported measures, but only four studies used validated tests. Interventions were too heterogeneous to allow pooling. Realist synthesis identified potentially 'active educational ingredients', including mentoring, brief training in clinical epidemiology, structured critical appraisal tools, adult-learning principles, multifaceted teaching approaches and integration of the JC with other clinical and academic activities. CONCLUSION: The effectiveness of JCs in supporting evidence-based decision making is not clear. Better reporting of the intervention and a mixed methods approach to evaluating active ingredients are needed in order to understand how JCs may support evidence-based practice.

Does the current version of 'Tomorrow's Doctors' adequately support the role of evidence-based medicine in the undergraduate curriculum?

BACKGROUND: The evidence-based medicine (EBM) approach to clinical practice has been incorporated into medical training around the world. Whilst EBM is a component of the 'foundation years' (FY) programme, it appears to lack a firm foundation in the UK undergraduate curriculum. AIM: To identify whether the teaching of EBM is adequately supported by the guideline 'Tomorrow's Doctors' (TD-2003). METHODS: We mapped TD-2003 against the five steps of EBM and also reviewed the literature for reports concerning the introduction of EBM into undergraduate curricula. RESULTS: Whilst all five steps of EBM can be mapped against TD-2003, the guidance makes no explicit reference to EBM and a coherent framework is lacking. The focus of undergraduate EBM teaching should be on 'using' research evidence (rather than undertaking research). The current emphasis on 'therapy' should be expanded to include the EBM-related issues of 'diagnosis, prognosis and harm'. UK medical schools also need to exploit the NHS investment in 'national electronic libraries'.

Evidence-based medicine teaching in UK medical schools.

BACKGROUND: It is recognized that clinicians need training in evidence-based medicine (EBM), however there is considerable variation in the content and methods of the EBM curriculum in UK medical schools. AIMS: To determine current practice and variation in EBM undergraduate teaching in UK medical schools and inform the strategy of medical schools and the National Knowledge Service. METHODS: We contacted all 32 medical schools in the UK and requested that the person primarily responsible for EBM undergraduate teaching complete a short online survey and provide their EBM curriculum. RESULTS: The survey was completed by representatives from 20 (63%) medical schools and curriculum details were received from 5 (16%). There is considerable variation in the methods and content of the EBM curriculum. Although the majority of schools teach core EBM topics, relatively few allow students to practice the skills or assess such skills. EBM teaching is restricted by lack of curriculum time, trained tutors and teaching materials. CONCLUSIONS: Key elements to progress include the integration of EBM with clinical specialties, tutor training and the availability of high-quality teaching resources. The development of a national undergraduate EBM curriculum may help in promoting progress in EBM teaching and assessment in UK medical schools.

Assessing differential attrition in clinical trials: self-monitoring of oral anticoagulation and type II diabetes.

BACKGROUND: Analyzing drop out rates and when they occur may give important information about the patient characteristics and trial characteristics that affect the overall uptake of an intervention. METHODS: We searched Medline and the Cochrane library from the beginning of the databases to May 2006 for published systematic reviews that compared the effects of self-monitoring (self-testing) or self-management (self-testing and self-dosage) of oral anticoagulation or self-monitored blood glucose in type 2 diabetics who were not using insulin. We assessed all study withdrawals pre-randomization and post randomization and sought information on the reasons for discontinuation of all participants.To measure the differential between groups in attrition we used the relative attrition (RA), which is equivalent to relative risk but uses attrition as the outcome (i.e. attrition in intervention group/attrition in control group). We determined the percentage drop outs for control and intervention groups and used DerSimonian and Laird random effects models to estimate a pooled relative attrition. L'abbe type plots created in R (version 2.0.2) were used to represent the difference in the relative attrition among the trials with 95% confidence areas and weights derived from the random effects model. RESULTS: With self-monitoring of blood glucose in type 2 diabetes, attrition ranged from 2.3% to 50.0% in the intervention groups and 0% to 40.4% in the control groups. There was no significant difference between the intervention and control, with an overall RA of 1.18 [95% CI, 0.70-2.01]. With self-monitoring of oral anticoagulation attrition ranged from 0% to 43.2% in the intervention groups and 0% to 21.4% in the control group. The RA was significantly greater in the intervention group, combined RA, 6.05 [95% CI, 2.53-14.49]. CONCLUSION: This paper demonstrates the use of relative attrition as a new tool in systematic review methodology which has the potential to identify patient, intervention and trial characteristics which influences attrition in trials.

Using the Turning Research Into Practice (TRIP) database: how do clinicians really search?

OBJECTIVES: Clinicians and patients are increasingly accessing information through Internet searches. This study aimed to examine clinicians' current search behavior when using the Turning Research Into Practice (TRIP) database to examine search engine use and the ways it might be improved. METHODS: A Web log analysis was undertaken of the TRIP database-a meta-search engine covering 150 health resources including MEDLINE, The Cochrane Library, and a variety of guidelines. The connectors for terms used in searches were studied, and observations were made of 9 users' search behavior when working with the TRIP database. RESULTS: Of 620,735 searches, most used a single term, and 12% (n = 75,947) used a Boolean operator: 11% (n = 69,006) used "AND" and 0.8% (n = 4,941) used "OR." Of the elements of a well-structured clinical question (population, intervention, comparator, and outcome), the population was most commonly used, while fewer searches included the intervention. Comparator and outcome were rarely used. Participants in the observational study were interested in learning how to formulate better searches. CONCLUSIONS: Web log analysis showed most searches used a single term and no Boolean operators. Observational study revealed users were interested in conducting efficient searches but did not always know how. Therefore, either better training or better search interfaces are required to assist users and enable more effective searching.

Clonal relationships between invasive and carriage Streptococcus pneumoniae and serotype- and clone-specific differences in invasive disease potential.

By use of multilocus sequence typing, Streptococcus pneumoniae isolates causing invasive disease (n=150) were compared with those from nasopharyngeal carriage (n=351) among children in Oxford. The prevalence of individual clones (sequence types) and serotypes among isolates from invasive disease was related to their prevalence in carriage, and an odds ratio (OR) for invasive disease was calculated for the major clones and serotypes. All major carried clones and serotypes caused invasive disease, although their ability to do so varied greatly. Thus, 2 serotype 14 clones were approximately 10-fold overrepresented among disease isolates, compared with carriage isolates, whereas a serotype 3 clone was approximately 10-fold underrepresented. The lack of heterogeneity between the ORs of different clones of the same serotype, and analysis of isolates of the same genotype, but different serotype, suggested that capsular serotype may be more important than genotype in the ability of pneumococci to cause invasive disease.

Identification of multidrug-resistant Streptococcus pneumoniae strains isolated in Poland by multilocus sequence typing.

Multilocus sequence typing (MLST) of 35 isolates of multidrug-resistant Streptococcus pneumoniae recovered in Poland during 1995-1996 distinguished 10 different sequence types (ST). The majority of the isolates were assigned to two Polish clones of serotypes 6B and 23F, although the international clones, Spain23F-1 and Spain9V-3, were also identified. Similar results were obtained using pulsed-field gel electrophoresis (PFGE), providing a direct comparison of these two typing methods.

Characterization of encapsulated and noncapsulated Haemophilus influenzae and determination of phylogenetic relationships by multilocus sequence typing.

A multilocus sequence typing (MLST) scheme has been developed for the unambiguous characterization of encapsulated and noncapsulated Haemophilus influenzae isolates. The sequences of internal fragments of seven housekeeping genes were determined for 131 isolates, comprising a diverse set of 104 serotype a, b, c, d, e, and f isolates and 27 noncapsulated isolates. Many of the encapsulated isolates had previously been characterized by multilocus enzyme electrophoresis (MLEE), and the validity of the MLST scheme was established by the very similar clustering of isolates obtained by these methods. Isolates of serotypes c, d, e, and f formed monophyletic groups on a dendrogram constructed from the differences in the allelic profiles of the isolates, whereas there were highly divergent lineages of both serotype a and b isolates. Noncapsulated isolates were distinct from encapsulated isolates and, with one exception, were within two highly divergent clusters. The relationships between the major lineages of encapsulated H. influenzae inferred from MLEE data could not be discerned on a dendrogram constructed from differences in the allelic profiles, but were apparent on a tree reconstructed from the concatenated nucleotide sequences. Recombination has not therefore completely eliminated phylogenetic signal, and in support of this, for encapsulated isolates, there was significant congruence between many of the trees reconstructed from the sequences of the seven individual loci. Congruence was less apparent for noncapsulated isolates, suggesting that the impact of recombination is greater among noncapsulated than encapsulated isolates. The H. influenzae MLST scheme is available at www.mlst.net, it allows any isolate to be compared with those in the MLST database, and (for encapsulated isolates) it assigns isolates to their phylogenetic lineage, via the Internet.

Stability of serotypes during nasopharyngeal carriage of Streptococcus pneumoniae.

Serotype changes among natural isolates of Streptococcus pneumoniae are well documented and occur by recombinational exchanges at the capsular biosynthetic locus. However, the frequency with which this phenomenon occurs within the nasopharynx of children is not clear and is likely to be highest in the nasopharynx of children, who have high rates of pneumococcal carriage. A birth cohort of 100 infants was studied, and pneumococci were recovered from nasopharyngeal samples taken at monthly intervals during the first 6 months of life and then at 2-monthly intervals until the age of 2 years. Among the 1,353 nasopharyngeal samples were 523 that contained presumptive pneumococci, and three colonies from each were serotyped. A total of 333 isolates, including all isolates of differing serotypes from the same child, were characterized by multilocus sequence typing. Sixty-eight children carried multiple serotypes during the first 2 years of life. Two children carried a typeable and a nonserotypeable pneumococcus of identical genotype, and five children carried genetically indistinguishable isolates of serotypes 15B and 15C. These isolates were considered, respectively, to be due to loss of capsule expression and the known ability of serotype 15B and 15C pneumococci to interconvert by loss or gain of an acetyl group on the capsular polysaccharide. In all other cases, isolates from the same children that differed in serotype also differed in genotype, indicating the acquisition of a different pneumococcal strain rather than a change in capsular type. There was therefore no evidence in this study for any change of serotype due to recombinational replacements at the capsular locus among the pneumococci carried within the nasopharynges of the children.