Preferred Treatment Patterns of Retinopathy of Prematurity: An International Survey.

This paper assesses the preferred treatment patterns for retinopathy of prematurity (ROP) and examine trends in anti-vascular endothelial growth factor (VEGF) use for ROP. Methods: A retrospective survey consisting of 14 questions was distributed to paediatric ophthalmology interest groups internationally. Main outcome measures included treatment patterns, proportion of anti-VEGF use in different stages of ROP; and comparison of first-line treatments as well as repeat anti-VEGF treatments. Results: Fifty-four ophthalmologists from 11 different countries responded to the survey. The number of respondents per question, except one, ranged between 50-54. Per annum, there was an average number of 394 infants screened by each respondent. Anti-VEGF was the preferred treatment method for aggressive (A)-ROP (64.1%), Type 1 ROP in zone 1 (71.7%), and Type 1 ROP in posterior zone 2 (56.6%). The majority used laser as the first-line treatment of Type 1 ROP in anterior zone 2 (73.6%) and Type 1 ROP in zone 3 (79.2%). Laser was the preferred treatment modality utilised in infants requiring repeat treatment following anti-VEGF injection. The preferred anti-VEGF agent was bevacizumab administered at a dose of 0.625 mg. Conclusions: Anti-VEGF as first-line therapy has been increasing. Anti-VEGF appears to be the first-line treatment of choice for A-ROP, Type 1 ROP in zone 1 and posterior zone 2 and laser for Type 1 ROP in anterior zone 2 and zone 3.

Flipped Classrooms in Graduate Medical Education: A National Survey of Residency Program Directors.

PURPOSE: To begin to quantify and understand the use of the flipped classroom (FC)-a progressive, effective, curricular model-in internal medicine (IM) education in relation to residency program and program director (PD) characteristics. METHOD: The authors conducted a survey that included the Flipped Classroom Perception Instrument (FCPI) in 2015 regarding programs' use and PDs' perceptions of the FC model. RESULTS: Among the 368 IM residency programs, PDs at 227 (61.7%) responded to the survey and 206 (56.0%) completed the FCPI. Regarding how often programs used the FC model, 34 of the 206 PDs (16.5%) reported "never"; 44 (21.4%) reported "very rarely"; another 44 (21.4%) reported "somewhat rarely"; 59 (28.6%) reported "sometimes"; 16 (7.8%) reported "somewhat often"; and 9 (4.4%) reported "very often." The mean FCPI score (standard deviation [SD]) for the in-class application factor (4.11 [0.68]) was higher (i.e., more favorable) than for the preclass activity factor (3.94 [0.65]) (P < .001). FC perceptions (mean [SD]) were higher among younger PDs (≤ 50 years, 4.12 [0.62]; > 50 years, 3.94 [0.61]; P = .04) and women compared with men (4.28 [0.56] vs. 3.91 [0.62]; P < .001). PDs with better perceptions of FCs had higher odds of using FCs (odds ratio, 4.768; P < .001). CONCLUSIONS: Most IM programs use the FC model at least to some extent, and PDs prefer the interactive in-class components over the independent preclass activities. PDs who are women and younger perceived the model more favorably.

Conference presentation to publication: a retrospective study evaluating quality of abstracts and journal articles in medical education research.

BACKGROUND: There is little evidence regarding the comparative quality of abstracts and articles in medical education research. The Medical Education Research Study Quality Instrument (MERSQI), which was developed to evaluate the quality of reporting in medical education, has strong validity evidence for content, internal structure, and relationships to other variables. We used the MERSQI to compare the quality of reporting for conference abstracts, journal abstracts, and published articles. METHODS: This is a retrospective study of all 46 medical education research abstracts submitted to the Society of General Internal Medicine 2009 Annual Meeting that were subsequently published in a peer-reviewed journal. We compared MERSQI scores of the abstracts with scores for their corresponding published journal abstracts and articles. Comparisons were performed using the signed rank test. RESULTS: Overall MERSQI scores increased significantly for published articles compared with conference abstracts (11.33 vs 9.67; P < .001) and journal abstracts (11.33 vs 9.96; P < .001). Regarding MERSQI subscales, published articles had higher MERSQI scores than conference abstracts in the domains of sampling (1.59 vs 1.34; P = .006), data analysis (3.00 vs 2.43; P < .001), and validity of evaluation instrument (1.04 vs 0.28; P < .001). Published articles also had higher MERSQI scores than journal abstracts in the domains of data analysis (3.00 vs 2.70; P = .004) and validity of evaluation instrument (1.04 vs 0.26; P < .001). CONCLUSIONS: To our knowledge, this is the first study to compare the quality of medical education abstracts and journal articles using the MERSQI. Overall, the quality of articles was greater than that of abstracts. However, there were no significant differences between abstracts and articles for the domains of study design and outcomes, which indicates that these MERSQI elements may be applicable to abstracts. Findings also suggest that abstract quality is generally preserved from original presentation to publication.

Associations between teaching effectiveness and participant self-reflection in continuing medical education.

Effective medical educators can engage learners through self-reflection. However, little is known about the relationships between teaching effectiveness and self-reflection in continuing medical education (CME). We aimed to determine associations between presenter teaching effectiveness and participant self-reflection in conference-based CME. This cross-sectional study evaluated presenters and participants at a national CME course. Participants provided CME teaching effectiveness (CMETE) ratings and self-reflection scores for each presentation. Overall CMETE and CME self-reflection scores (five-point Likert scale with one as strongly disagree and five as strongly agree) were averaged for each presentation. Correlations were measured among self-reflection, CMETE, and presentation characteristics. In total, 624 participants returned 430 evaluations (response, 68.9%) for the 38 presentations. Correlation between CMETE and self-reflection was medium (Pearson correlation, 0.3-0.5) or large (0.5-1.0) for most presentations (n = 33, 86.9%). Higher mean (SD) CME reflection scores were associated with clinical cases (3.66 [0.12] vs. 3.48 [0.14]; p = 0.003) and audience response (3.66 [0.12] vs. 3.51 [0.14]; p = 0.005). To our knowledge, this is the first study to show a relationship between teaching effectiveness and participant self-reflection in conference-based CME. Presenters should consider using clinical cases and audience response systems to increase teaching effectiveness and promote self-reflection among CME learners.

Publication Rates of Abstracts Presented at the Society of General Internal Medicine Annual Meeting.

BACKGROUND: Abstracts accepted at scientific meetings are often not subsequently published. Data on publication rates are largely from subspecialty and surgical studies. OBJECTIVE: The aims of this study were to 1) determine publication rates of abstracts presented at a general internal medicine meeting; 2) describe research activity among academic general internists; 3) identify factors associated with publication and with the impact factor of the journal of publication; and 4) evaluate for publication bias. DESIGN: Retrospective cohort study. PARTICIPANTS: All scientific abstracts presented at the Society of General Internal Medicine 2009 Annual Meeting. MAIN MEASURES: Publication rates were determined by searching for full-text publications in MEDLINE. Data were abstracted regarding authors' institution, research topic category, number of study sites, sample size, study design, statistical significance (p value and confidence interval) in abstract and publication, journal of publication, publication date, and journal impact factor. KEY RESULTS: Of the 578 abstracts analyzed, 274 (47.4%) were subsequently published as a full article in a peer-reviewed journal indexed in MEDLINE. In a multivariable model adjusting for institution site, research topic, number of study sites, study design, sample size, and abstract results, publication rates for academic general internists were highest in the areas of medical education (52.5%, OR 5.05, 95% CI 1.57-17.25, reference group Veterans Affairs (VA)-based research, publication rate 36.7%), mental health/substance use (67.7%, OR 4.16, 95% CI 1.39-13.06), and aging/geriatrics/end of life (65.7%, OR 3.31, 95% CI 1.15-9.94, p = 0.01 across topics). Publication rates were higher for multicenter studies than single-institution studies (52.4% vs. 40.4%, OR 1.66, 95% CI 1.10-2.52, p = 0.04 across categories). Randomized controlled trials had higher publication rates than other study designs (66.7% vs. 45.9%, OR 2.72, 95% CI 1.30-5.94, p = 0.03 across study designs). Studies with positive results did not predict higher publication rates than negative studies (OR 0.89, 95% CI 0.6-1.31, p = 0.21). CONCLUSIONS: This study demonstrated that 47.4% of abstracts presented at a general internal medicine national conference were subsequently published in a peer-reviewed journal indexed in MEDLINE.

Use of the pause procedure in continuing medical education: A randomized controlled intervention study.

During lectures, a pause procedure (the presenter pauses so students can discuss content) can improve educational outcomes. We aimed to determine whether (1) continuing medical education (CME) presentations with a pause procedure were evaluated more favorably and (2) a pause procedure improved recall. In this randomized controlled intervention study of all participants (N = 214) at the Mayo Clinic Internal Medicine Board Review course, 48 lectures were randomly assigned to an intervention (pause procedure) or control (traditional lecture) group. The pause procedure was a 1-min pause at the middle and end of the presentation. Study outcomes were (1) presentation evaluation instrument scores and (2) number of recalled items per lecture. A total of 214 participants returned 145 surveys (response rate, 68%). Mean presentation evaluation scores were significantly higher for pause procedure than for traditional presentations (70.9% vs 65.8%; 95%CI for the difference, 3.5-6.7; p < .0001). Mean number of rapid recall items was higher for pause procedure presentations (0.68 vs 0.59; 95%CI for the difference, 0.02-0.14; p = .01). In a traditional CME course, presentations with a pause procedure had higher evaluation scores and more content was recalled. The pause procedure could arm CME presenters with an easy technique to improve educational content delivery.

Flipping the Quality Improvement Classroom in Residency Education.

PURPOSE: The flipped classroom (FC), in which instructional content is delivered before class with class time devoted to knowledge application, has the potential to engage residents. A Mayo Clinic Internal Medicine Residency Program study was conducted to validate an FC perception instrument (FCPI); determine whether participation improved FC perceptions; and determine associations between resident characteristics, change in quality improvement (QI) knowledge, and FC perception scores. METHOD: All 143 internal medicine residents at Mayo Clinic, Rochester participated from 2014 to 2015; some experienced a flipped QI curriculum and others completed the traditional nonflipped course. The FCPI was developed, and factor analysis revealed an intuitive two-factor structure: preclass activity and in-class application. Residents were surveyed before and after the monthlong curriculum to measure changes in perception, and the QI Knowledge Assessment Tool was employed to measure knowledge improvement. RESULTS: Postcourse FCPI scores significantly increased for three of the eight items. QI knowledge increased significantly among residents who experienced the FC compared with residents who completed the non-FC curriculum. Those without prior FC exposure demonstrated a significant increase in QI knowledge compared with those with previous FC experience. The FCPI had compelling validity evidence with improved scores after curriculum exposure and associations with greater engagement in online modules. CONCLUSIONS: Residents who participated in the FC demonstrated improved QI knowledge compared with the control group. Residents valued the in-class application sessions more than the online component. These findings have important implications for graduate medical education as residency training programs increasingly use FC models.

Measuring Participants' Attitudes Toward Mobile Device Conference Applications in Continuing Medical Education: Validation of an Instrument.

INTRODUCTION: Mobile device applications (apps) may enhance live CME courses. We aimed to (1) validate a measure of participant attitudes toward using a conference app and (2) determine associations between participant characteristics and attitudes toward CME apps with conference app usage. METHODS: We conducted a cross-sectional validation study of participants at the Mayo Clinic Selected Topics in Internal Medicine Course. A conference app was developed that included presentation slides, note-taking features, search functions, social networking with other attendees, and access to presenter information. The CME app attitudes survey instrument (CMEAPP-10) was designed to determine participant attitudes toward conference apps. RESULTS: Of the 602 participants, 498 (82.7%) returned surveys. Factor analysis revealed a two-dimensional model for CMEAPP-10 scores (Cronbach α, 0.97). Mean (SD) CMEAPP-10 scores (maximum possible score of five) were higher for women than for men (4.06 [0.91] versus 3.85 [0.92]; P = .04). CMEAPP-10 scores (mean [SD]) were significantly associated (P = .02) with previous app usage as follows: less than once per month, 3.73 (1.05); monthly, 3.41 (1.16); weekly, 4.03 (0.69); and daily or more, 4.06 (0.89). Scores were unrelated to participant age, specialty, practice characteristics, or previous app use. DISCUSSION: This is the first validated measure of attitudes toward CME apps among course participants. App usage was higher among younger participants who had previously used educational or professional apps. Additionally, attitudes were more favorable among women and those who had previously used apps. These findings have important implications regarding efforts to engage participants with portable and accessible technology.

Associations between resident physicians' publications and clinical performance during residency training.

BACKGROUND: Both research and clinical medicine requires similar attributes of efficiency, diligence and effective teamwork. Furthermore, residents must succeed at scholarship and patient care to be competitive for fellowship training. It is unknown whether research productivity among residents is related to broad measures of clinical achievement. Our goal was to examine associations between the quantity of internal medicine residents' publications and validated measures of their knowledge, skills and multi-source evaluations of performance. METHODS: This was a longitudinal study of 308 residents graduating from Mayo Clinic from 2006 to 2012. We identified peer-reviewed articles in Ovid MEDLINE between July of each resident's match year and the end of their graduation. Outcomes included American Board of Internal Medicine (ABIM) certification examination scores, mini clinical examination (mini-CEX) scores, and validated assessments of clinical performance by resident-peers, faculty and non-physicians. Performance assessments were averaged to form an overall score ranging from 1 to 5. Associations between quantity of resident publications--and ABIM, mini-CEX and performance assessment scores--were determined using multivariate linear regression. RESULTS: The residents published 642 papers, of which 443 (69.0%) were research papers, 198 (30.8%) were case reports, and 380 (59.2%) were first-authored. On adjusted analysis, multi-source clinical performance evaluations were significantly associated (beta; 99% CI; p-value) with the numbers of research articles (0.012; 0.001-0.024; 0.007), and overall publications (0.012; 0.002-0.022; 0.002). CONCLUSIONS: To our knowledge, this is the first study to demonstrate that scholarly productivity based on journal publication is associated with clinical performance during residency training. Our findings suggest that residents who invest substantial efforts in research are not compromised in their abilities to learn medicine and care for patients.

Flipping the Continuing Medical Education Classroom: Validating a Measure of Attendees' Perceptions.

INTRODUCTION: New teaching approaches for CME are needed. In flipped classrooms, coursework is completed beforehand and applied during class time. Studies of flipped classrooms and their potential benefits in CME have not been published. We sought to develop and validate an instrument measuring flipped classroom perceptions, identify whether participation changed perceptions, and determine which flipped classroom components were perceived as most effective. METHODS: In this cross-sectional validation study, 167 participants in the Mayo Clinic's 2015 Internal Medicine Board Review course received surveys. Online modules were developed to deliver content before flipped classroom courses on acid-base disorders and electrolyte disorders. A flipped classroom perception instrument (FCPI) was developed and validated. The FCPI, with eight items structured on 5-point Likert scales, was given to participants before and after their flipped classroom experiences. RESULTS: Of the 167 participants, 111 returned surveys. Flipped classroom perceptions improved, with mean (SD) FCPI scores increasing from 3.74 (0.75) to 3.94 (0.76) (P < .001). The percentage of participants who preferred flipped classrooms increased from 38% before the course to 53% after (P = .002). Positive changes in FCPI scores were unrelated to module completion. Most participants thought knowledge was enhanced by in-class sessions and online modules equally. DISCUSSION: The FCPI, the first validated measure of participants' perceptions of a CME flipped classroom, has strong validity evidence. Participants' perceptions of and preference for the flipped classroom improved after experiencing the flipped CME classroom. These findings support the need to further explore flipped classroom models in CME.

Encounter Decision Aid vs. Clinical Decision Support or Usual Care to Support Patient-Centered Treatment Decisions in Osteoporosis: The Osteoporosis Choice Randomized Trial II.

PURPOSE: Osteoporosis Choice, an encounter decision aid, can engage patients and clinicians in shared decision making about osteoporosis treatment. Its effectiveness compared to the routine provision to clinicians of the patient's estimated risk of fracture using the FRAX calculator is unknown. METHODS: Patient-level, randomized, three-arm trial enrolling women over 50 with osteopenia or osteoporosis eligible for treatment with bisphosphonates, where the use of Osteoporosis Choice was compared to FRAX only and to usual care to determine impact on patient knowledge, decisional conflict, involvement in the decision-making process, decision to start and adherence to bisphosphonates. RESULTS: We enrolled 79 women in the three arms. Because FRAX estimation alone and usual care produced similar results, we grouped them for analysis. Compared to these, use of Osteoporosis Choice increased patient knowledge (median score 6 vs. 4, p = .01), improved understanding of fracture risk and risk reduction with bisphosphonates (p = .01 and p<.0001, respectively), had no effect on decision conflict, and increased patient engagement in the decision making process (OPTION scores 57% vs. 43%, p = .001). Encounters with the decision aid were 0.8 minutes longer (range: 33 minutes shorter to 3.0 minutes longer). There were twice as many patients receiving and filling prescriptions in the decision aid arm (83% vs. 40%, p = .07); medication adherence at 6 months was no different across arms. CONCLUSION: Supporting both patients and clinicians during the clinical encounter with the Osteoporosis Choice decision aid efficiently improves treatment decision making when compared to usual care with or without clinical decision support with FRAX results. TRIAL REGISTRATION: clinical trials.gov NCT00949611.

Association Between Study Quality and Publication Rates of Medical Education Abstracts Presented at the Society of General Internal Medicine Annual Meeting.

BACKGROUND: Studies reveal that 44.5% of abstracts presented at national meetings are subsequently published in indexed journals, with lower rates for abstracts of medical education scholarship. OBJECTIVE: We sought to determine whether the quality of medical education abstracts is associated with subsequent publication in indexed journals, and to compare the quality of medical education abstracts presented as scientific abstracts versus innovations in medical education (IME). DESIGN: Retrospective cohort study. PARTICIPANTS: Medical education abstracts presented at the Society of General Internal Medicine (SGIM) 2009 annual meeting. MAIN MEASURES: Publication rates were measured using database searches for full-text publications through December 2013. Quality was assessed using the validated Medical Education Research Study Quality Instrument (MERSQI). KEY RESULTS: Overall, 64 (44%) medical education abstracts presented at the 2009 SGIM annual meeting were subsequently published in indexed medical journals. The MERSQI demonstrated good inter-rater reliability (intraclass correlation range, 0.77-1.00) for grading the quality of medical education abstracts. MERSQI scores were higher for published versus unpublished abstracts (9.59 vs. 8.81, p = 0.03). Abstracts with a MERSQI score of 10 or greater were more likely to be published (OR 3.18, 95% CI 1.47-6.89, p = 0.003). ). MERSQI scores were higher for scientific versus IME abstracts (9.88 vs. 8.31, p < 0.001). Publication rates were higher for scientific abstracts (42 [66%] vs. 37 [46%], p = 0.02) and oral presentations (15 [23%] vs. 6 [8%], p = 0.01). CONCLUSIONS: The publication rate of medical education abstracts presented at the 2009 SGIM annual meeting was similar to reported publication rates for biomedical research abstracts, but higher than publication rates reported for medical education abstracts. MERSQI scores were associated with higher abstract publication rates, suggesting that attention to measures of quality--such as sampling, instrument validity, and data analysis--may improve the likelihood that medical education abstracts will be published.

A systematic review for the screening for peripheral arterial disease in asymptomatic patients.

BACKGROUND: Peripheral arterial disease (PAD) is common and associated with significant morbidity and mortality. PAD can be detected through a noninvasive measurement of the ankle-brachial index (ABI). METHODS: We conducted a systematic review of several electronic bibliographic databases for studies that evaluated ABI as a screening test for PAD in asymptomatic individuals. We conducted random-effects meta-analysis, reporting pooled hazard ratios (HRs) when appropriate. RESULTS: We included 40 individual studies, 2 systematic reviews, and 1 individual-patient data meta-analysis. We found no studies comparing ABI screening with no screening in terms of patient-important outcomes (mortality, amputations). The yield of PAD screening averaged 17% (range, 1%-42%) and was 1% to 4% in lower risk populations. Patients with PAD had higher adjusted risk of all-cause mortality (HR, 2.99; 95% confidence interval, 2.16-4.12) and of cardiovascular mortality (HR, 2.35; 95% confidence interval, 1.91-2.89). Data on benefits, harms, and cost-effectiveness of screening were limited; however, ABI screening was associated with additional prognostic information and risk stratification for heart disease. The overall quality of evidence supporting screening was low. CONCLUSIONS: The current available evidence demonstrates that PAD is common in patients with multiple cardiovascular risk factors and is associated with significant morbidity and mortality, but it does not support the benefit of routine ABI screening.

Breast density and breast cancer risk: a practical review.

New legislation in several states requiring breast density notification in all mammogram reports has increased awareness of breast density. Estimates indicate that up to 50% of women undergoing mammography will have high breast density; thus, with increased attention and high prevalence of increased breast density, it is crucial that primary care clinicians understand the implications of dense breasts and are able to provide appropriate counseling. This review provides an overview of breast density, specifically by defining breast density, exploring the association between breast density and breast cancer risk, both from masking and as an independent risk factor, and reviewing supplemental screening options as part of a larger framework for counseling patients with dense breasts.

Impact of the 2009 US Preventive Services Task Force guidelines on screening mammography rates on women in their 40s.

BACKGROUND: The 2009 US Preventive Services Task Force breast cancer screening update recommended against routine screening mammography for women aged 40-49; confusion and release of conflicting guidelines followed. We examined the impact of the USPSTF update on population-level screening mammography rates in women ages 40-49. METHODS AND FINDINGS: We conducted a retrospective, interrupted time-series analysis using a nationally representative, privately-insured population from 1/1/2006-12/31/2011. Women ages 40-64 enrolled for ≥ 1 month were included. The primary outcome was receipt of screening mammography, identified using administrative claims-based algorithms. Time-series regression models were estimated to determine the effect of the guideline change on screening mammography rates. 5.5 million women ages 40-64 were included. A 1.8 per 1,000 women (p = 0.003) decrease in monthly screening mammography rates for 40-49 year-old women was observed two months following the guideline change; no initial effect was seen for 50-64 year-old women. However, two years following the guideline change, a slight increase in screening mammography rates above expected was observed in both age groups. CONCLUSIONS: We detected a modest initial drop in screening mammography rates in women ages 40-49 immediately after the 2009 USPSTF guideline followed by an increase in screening rates. Unfavorable public reactions and release of conflicting statements may have tempered the initial impact. Renewal of the screening debate may have brought mammography to the forefront of women's minds, contributing to the observed increase in mammography rates two years after the guideline change. This pattern is unlikely to reflect informed choice and underscores the need for improved translation of evidence-based care and guidelines into practice.

Adverse effects of the common treatments for polycystic ovary syndrome: a systematic review and meta-analysis.

CONTEXT: Polycystic ovary syndrome (PCOS) is common among women of childbearing age and the available pharmacological therapies have different side-effect profiles. OBJECTIVE: We summarized the evidence about the side effects of oral contraceptive pills, metformin, and anti-androgens in women with PCOS. DATA SOURCE: Sources included Ovid Medline, OVID EMBASE, OVID Cochrane Library, Web of Science, Scopus, PsycInfo, and CINAHL from inception through April 2011. STUDY SELECTION: We included comparative observational studies enrolling women with PCOS who received the agents of choice for at least 6 months and reported adverse effects. DATA EXTRACTION: Using a standardized, piloted, and Web-based data extraction form and working in duplicate, we abstracted data from each study and performed meta-analysis when possible. DATA SYNTHESIS: We found 22 eligible studies of which 20 were randomized. No study reported severe side effects (eg, lactic acidosis, thromboembolic episodes, liver toxicity, cancer incidence, or pregnancy loss). Meta-analysis demonstrated no significant change in weight in oral contraceptive pills or flutamide users. Indirect evidence from populations without PCOS demonstrated no increased risk of lactic acidosis with metformin, only case reports of liver toxicity with flutamide (no comparative evidence), and increased relative risk difference of venous thromboembolism with oral contraceptive pills but very low absolute risk. Evidence on mortality, cardiovascular mortality, and cancer was inconclusive. CONCLUSIONS: Drugs commonly used to treat PCOS appear to be associated with very low risk of severe adverse effects although data are extrapolated from other populations.

Patient outcomes in simulation-based medical education: a systematic review.

OBJECTIVES: Evaluating the patient impact of health professions education is a societal priority with many challenges. Researchers would benefit from a summary of topics studied and potential methodological problems. We sought to summarize key information on patient outcomes identified in a comprehensive systematic review of simulation-based instruction. DATA SOURCES: Systematic search of MEDLINE, EMBASE, CINAHL, PsychINFO, Scopus, key journals, and bibliographies of previous reviews through May 2011. STUDY ELIGIBILITY: Original research in any language measuring the direct effects on patients of simulation-based instruction for health professionals, in comparison with no intervention or other instruction. APPRAISAL AND SYNTHESIS: Two reviewers independently abstracted information on learners, topics, study quality including unit of analysis, and validity evidence. We pooled outcomes using random effects. RESULTS: From 10,903 articles screened, we identified 50 studies reporting patient outcomes for at least 3,221 trainees and 16,742 patients. Clinical topics included airway management (14 studies), gastrointestinal endoscopy (12), and central venous catheter insertion (8). There were 31 studies involving postgraduate physicians and seven studies each involving practicing physicians, nurses, and emergency medicine technicians. Fourteen studies (28 %) used an appropriate unit of analysis. Measurement validity was supported in seven studies reporting content evidence, three reporting internal structure, and three reporting relations with other variables. The pooled Hedges' g effect size for 33 comparisons with no intervention was 0.47 (95 % confidence interval [CI], 0.31-0.63); and for nine comparisons with non-simulation instruction, it was 0.36 (95 % CI, -0.06 to 0.78). LIMITATIONS: Focused field in education; high inconsistency (I(2) > 50 % in most analyses). CONCLUSIONS: Simulation-based education was associated with small-moderate patient benefits in comparison with no intervention and non-simulation instruction, although the latter did not reach statistical significance. Unit of analysis errors were common, and validity evidence was infrequently reported.

Cost: the missing outcome in simulation-based medical education research: a systematic review.

BACKGROUND: The costs involved with technology-enhanced simulation remain unknown. Appraising the value of simulation-based medical education (SBME) requires complete accounting and reporting of cost. We sought to summarize the quantity and quality of studies that contain an economic analysis of SBME for the training of health professions learners. METHODS: We performed a systematic search of MEDLINE, EMBASE, CINAHL, ERIC, PsychINFO, Scopus, key journals, and previous review bibliographies through May 2011. Articles reporting original research in any language evaluating the cost of simulation, in comparison with nonstimulation instruction or another simulation intervention, for training practicing and student physicians, nurses, and other health professionals were selected. Reviewers working in duplicate evaluated study quality and abstracted information on learners, instructional design, cost elements, and outcomes. RESULTS: From a pool of 10,903 articles we identified 967 comparative studies. Of these, 59 studies (6.1%) reported any cost elements and 15 (1.6%) provided information on cost compared with another instructional approach. We identified 11 cost components reported, most often the cost of the simulator (n = 42 studies; 71%) and training materials (n = 21; 36%). Ten potential cost components were never reported. The median number of cost components reported per study was 2 (range, 1-9). Only 12 studies (20%) reported cost in the Results section; most reported it in the Discussion (n = 34; 58%). CONCLUSION: Cost reporting in SBME research is infrequent and incomplete. We propose a comprehensive model for accounting and reporting costs in SBME.

Comparative effectiveness of instructional design features in simulation-based education: systematic review and meta-analysis.

BACKGROUND: Although technology-enhanced simulation is increasingly used in health professions education, features of effective simulation-based instructional design remain uncertain. AIMS: Evaluate the effectiveness of instructional design features through a systematic review of studies comparing different simulation-based interventions. METHODS: We systematically searched MEDLINE, EMBASE, CINAHL, ERIC, PsycINFO, Scopus, key journals, and previous review bibliographies through May 2011. We included original research studies that compared one simulation intervention with another and involved health professions learners. Working in duplicate, we evaluated study quality and abstracted information on learners, outcomes, and instructional design features. We pooled results using random effects meta-analysis. RESULTS: From a pool of 10,903 articles we identified 289 eligible studies enrolling 18,971 trainees, including 208 randomized trials. Inconsistency was usually large (I2 > 50%). For skills outcomes, pooled effect sizes (positive numbers favoring the instructional design feature) were 0.68 for range of difficulty (20 studies; p < 0.001), 0.68 for repetitive practice (7 studies; p = 0.06), 0.66 for distributed practice (6 studies; p = 0.03), 0.65 for interactivity (89 studies; p < 0.001), 0.62 for multiple learning strategies (70 studies; p < 0.001), 0.52 for individualized learning (59 studies; p < 0.001), 0.45 for mastery learning (3 studies; p = 0.57), 0.44 for feedback (80 studies; p < 0.001), 0.34 for longer time (23 studies; p = 0.005), 0.20 for clinical variation (16 studies; p = 0.24), and -0.22 for group training (8 studies; p = 0.09). CONCLUSIONS: These results confirm quantitatively the effectiveness of several instructional design features in simulation-based education.