Status of Entrustable Professional Activities (EPA) Implementation at Colleges of Osteopathic Medicine in the United States and Future Considerations.

CONTEXT: Competency-based medical education, developmental milestones for residency training, and the single graduate medical education (GME) accreditation system have emerged over the last decade, necessitating new ways to adequately prepare graduates to meet new standards in proficiency, including the 13 Core Entrustable Professional Activities (EPA) for Entering Residency. The American Association of Colleges of Osteopathic Medicine (AACOM) Entrustable Professional Activities (EPA) steering committee has implemented an information-gathering process to provide suggestions for supporting a variety of EPA-related implementation efforts at colleges of osteopathic medicine (COMs) across the country. OBJECTIVE: To review the status of EPA implementation at COMs nationally. METHODS: An explanatory mixed-methods design was used to guide information gathering and synthesis of a 41-question survey and interview feedback; the overarching premise of this design was to use qualitative data to build upon initial quantitative findings. This survey was delivered electronically through a link emailed to liaisons at each main, branch, and satellite campus of the 47 schools within the AACOM institutional database. After survey administration, follow-up structured interviews were conducted according to an 18-question script with a purposive sample of 16 institutions with EPA implementation levels ranging from "moderate implementation with reporting" to "full implementation with reporting." Post-interview, the interview notes were analyzed and results were aggregated for comparison with the original survey findings. RESULTS: Of the 47 schools surveyed, 42 responded (89.4%). To maintain uniformity in data coding and analysis, 36 of 47 (76.6%) of COMs with independently submitted survey responses were retained in the review. The majority of those respondents (23 of 36; 64%) indicated that their institution was above "somewhat knowledgeable" toward "expert" regarding knowledge of EPAs, but 23 (64%) also indicated "no confidence" or "somewhat confident" regarding EPA implementation. Postinterview results showed that the majority of schools were equally distributed across the "foundational implementation" (10; 28%), "slight implementation" (11; 31%), and "moderate implementation" (11, 31%) categories, with a few schools indicating "no implementation" (2; 5%) or "progressive implementation" (2; 5%). CONCLUSION: The results of this review indicate that most osteopathic medical schools are at the early stages of EPA implementation, with emphasis varying by program year in terms of the specific EPAs addressed. Many schools appear engaged in curricular change efforts that will support the advancement of EPA use within their institutions. Faculty development was identified as a continued critical need for a majority of institutions.

Assessment Considerations for Core Entrustable Professional Activities for Entering Residency.

CONTEXT: In the process of analyzing entrustable professional activities (EPAs) for use in medical education, ten Cate and others identified challenges, including the need for valid and reliable EPA assessment strategies. OBJECTIVE: To provide osteopathic medical schools with a database of assessment tools compiled from the literature to assist them with the development and implementation of robust, evidence-based assessment methods. METHODS: MEDLINE, ERIC, PubMed, and other relevant databases were searched using MeSH keywords for articles outlining robust, evidence-based assessment tools that could be used in designing assessments for EPAs 1 through 6. RESULTS: A total of 55 publications were included in content analysis and reporting. All but 2 of the assessment articles were conducted in an undergraduate or graduate medical education setting. The majority of the 55 articles related to assessment of competencies affiliated with EPA 2 (16 articles) and EPA 4 (15 articles). Four articles focused on EPA 3. CONCLUSION: Osteopathic medical schools can use this database of assessment tools to support the development of EPA-specific assessment plans that match the unique context and needs of their institution.

Institution-Specific Factors Associated With Family Medicine Residency Match Rates.

UNLABELLED: Phenomenon: Existing research provides little specific evidence regarding the association between public and private medical school curricular settings and the proportion of medical students matching into family medicine careers. Institutional differences have been inadequately investigated, as students who match into family medicine are often consolidated into the umbrella of primary care along with those matching in internal medicine and pediatrics. However, understanding medical school contexts in relation to career choice is critical toward designing targeted strategies to address the projected shortage of family physicians. This study examines factors associated with family medicine residency match rates and the extent to which such factors differ across medical school settings. APPROACH: We combined data from a survey of 123 departments of family medicine with graduate placement rates reported to the American Academy of Family Physicians over a 2-year period. Chi-square/Fisher's Exact texts, t tests, and linear regression analyses were used to identify factors significantly associated with average match rate percentages. FINDINGS: The resulting data set included 85% of the U.S. medical schools with Departments of Family Medicine that reported 2011 and 2012 residency match rates in family medicine. Match rates in family medicine were higher among graduates of public than private medical schools-11% versus 7%, respectively, t(92) = 4.00, p < .001. Using a linear regression model and controlling for institutional type, the results indicated 2% higher match rates among schools with smaller annual clerkship enrollments (p  = .03), 3% higher match rates among schools with clerkships lasting more than 3 to 4 weeks (p  = .003), 3% higher match rates at schools with at least 1 family medicine faculty member in a senior leadership role (p  = .04), and 8% lower match rates at private medical schools offering community medicine electives (p < .001, R(2) = .48), F(6, 64) = 9.95, p < .001. Three additional factors were less strongly related and varied by institutional type-informal mentoring, ambulatory primary care learning experiences, and institutional research focus. Insights: Educational opportunities associated with higher match rates in family medicine differ across private and public medical schools. Future research is needed to identify the qualitative aspects of educational programming that contribute to differences in match rates across institutional contexts. Results of this study should prove useful in mitigating physician shortages, particularly in primary care fields such as family medicine.

Development of Peer Tutoring Services to Support Osteopathic Medical Students' Academic Success.

CONTEXT: Peer tutoring can benefit both tutors and tutored students, but information is lacking regarding establishing and measuring outcomes of such a program at new medical schools. OBJECTIVE: To examine the outcomes of a pilot peer tutoring initiative and explore the implications for long-term program development. METHODS: Fifty-one osteopathic medical students who participated in a pilot peer tutoring program during the 2013-2014 academic year were surveyed regarding satisfaction with the program. Course grade means for the tutors (all courses) and tutored students (specific courses) were analyzed before and after participating in the tutoring experience. Data analyses were performed using frequency distributions, t tests, and qualitative assessment of emergent themes. RESULTS: The survey had a 76% response rate (39 of 51 students). Both tutored students and tutors were satisfied with the tutoring program. Statistically significant changes in course grades for the tutored courses were noted at 3 to 4 and 8 to 9 months among the tutored students who were most at risk for failure (P=.001). Tutor course grades showed no significant changes for any of the courses in which they were enrolled (P=.445). CONCLUSION: Learning gains were realized by the students at greatest academic risk. Additional research is needed to evaluate long-term outcomes.

Predictors of Depression Stigma in Medical Students: Potential Targets for Prevention and Education.

INTRODUCTION: Suicide rates are higher among U.S. physicians than the general population. Untreated depression is a major risk factor, yet depression stigma presents a barrier to treatment. This study aims to identify early career indications of stigma among physicians-in-training and to inform the design of stigma-reduction programs. METHODS: A cross-sectional student survey administered at a large, Midwestern medical school in fall 2009 included measures of depression symptoms, attitudes toward mental health, and potential sources of depression stigma. Principal components factor analysis and linear regression were used to examine stigma factors associated with depression in medical students. RESULTS: The response rate was 65.7%, with 14.7% students reporting a previous depression diagnosis. Most students indicated that, if depressed, they would feel embarrassed if classmates knew. Many believed that revealing depression could negatively affect professional advancement. Factor analyses revealed three underlying stigma constructs: personal weakness, public devaluation, and social/professional discrimination. Students associating personal weakness with depression perceived medication as less efficacious and the academic environment as more competitive. Those endorsing public stigma viewed medication and counseling as less efficacious and associated depression with an inability to cope. Race, gender, and diagnosis of past/current depression also related to beliefs about stigma. Depression measures most strongly predicted stigma associated with personal weakness and social/professional discrimination. CONCLUSIONS: Recommendations for decreasing stigma among physicians-in-training include consideration of workplace perceptions, depression etiology, treatment efficacy, and personal attributes in the design of stigma reduction programs that could facilitate help-seeking behavior among physicians throughout their career.

Resident Perceptions of Giving and Receiving Peer-to-Peer Feedback.

BACKGROUND: Peer feedback is increasingly being used by residency programs to provide an added dimension to the assessment process. Studies show that peer feedback is useful, uniquely informative, and reliable compared to other types of assessments. Potential barriers to implementation include insufficient training/preparation, negative consequences for working relationships, and a perceived lack of benefit. OBJECTIVE: We explored the perceptions of residents involved in peer-to-peer feedback, focusing on factors that influence accuracy, usefulness, and application of the information. METHODS: Family medicine residents at the University of Michigan who were piloting an online peer assessment tool completed a brief survey to offer researchers insight into the peer feedback process. Focus groups were conducted to explore residents' perceptions that are most likely to affect giving and receiving peer feedback. RESULTS: Survey responses were provided by 28 of 30 residents (93%). Responses showed that peer feedback provided useful (89%, 25 of 28) and unique (89%, 24 of 27) information, yet only 59% (16 of 27) reported that it benefited their training. Focus group participants included 21 of 29 eligible residents (72%). Approaches to improve residents' ability to give and accept feedback included preparatory training, clearly defined goals, standardization, fewer and more qualitatively oriented encounters, 1-on-1 delivery, immediacy of timing, and cultivation of a feedback culture. CONCLUSIONS: Residents perceived feedback as important and offered actionable suggestions to enhance accuracy, usefulness, and application of the information shared. The findings can be used to inform residency programs that are interested in creating a meaningful peer feedback process.

Opportunities for medical student engagement with family medicine.

BACKGROUND AND OBJECTIVES: Several factors have been linked to the decline in medical student choice of a career in primary care (eg, gender, race, family income, student debt), yet understanding remains limited regarding the availability of curricular and co-curricular experiences for medical students within family medicine that may play a role, particularly one-on-one opportunities such as faculty mentoring and advising. Our study sought to collect baseline data on family medicine learning experiences during predoctoral training. METHODS: An online 21-question survey was sent to family medicine departments at US allopathic medical schools between January and March 2012 (84.6% response rate) to capture institutional representation and experiences within family medicine. RESULTS: Most institutions reported offering family medicine interest groups (98.1%), electives (97.1%), and clerkships (90.4%). Career advising as an elective course component was available at 53.8% of schools and as part of a required course at 46.2%. Comparison of public versus private institutions revealed differences in rural medicine experiences, admissions preferences, and residency director involvement in hands-on and small- group teaching. Additional differences were noted by total enrollment, number of family medicine faculty in senior leadership positions, and proportion of full-time clinical faculty teaching family medicine. CONCLUSIONS: Availability of family medicine curricular programming, formal advising/mentoring opportunities, and full-time faculty as teachers and senior administrators differed across various characteristics of medical schools. Results can be used to direct future research on medical student engagement with family medicine educational experiences relative to recruitment.

A team-based approach to providing asthma action plans.

BACKGROUND: National guidelines for treatment of asthma include recommendations for providing written asthma action plans (AAPs) to improve outcomes through patient self-management. However, AAP completion rates remain limited in practice. METHODS: We developed a team-based approach for the delivery of care to asthma patients in a primary care setting that involved integration of an electronic clinical quality management system and provision of written AAPs by registered nurses. RESULTS: The percentage of patients with AAPs increased after implementation of clinical reminders and nurse-led provision of written AAPs. CONCLUSION: Proper training, use of an electronic clinical reminder system, and enhanced engagement of registered nurses can improve AAP completion rates in a team-based primary care setting.

Applying health information technology and team-based care to residency education.

BACKGROUND AND OBJECTIVES: Training physicians capable of practicing within the Patient-centered Medical Home (PCMH) is an emerging area of scholarly inquiry within residency education. This study describes an effort to integrate PCMH principles into teaching practices within a university-based residency setting and evaluates the effect on clinical performance. METHODS: Using participant feedback and clinical data extracted from an electronic clinical quality management system, we retrospectively examined performance outcomes at two family medicine residency clinics over a 7-year period. Instructional approaches were identified and clinical performance patterns analyzed. RESULTS: Alumni ratings of the practice-based curriculum increased following institution of the PCMH model. Clinical performance outcomes indicated improvements in the delivery of clinical care to patients. Implementation of instructional methodologies posed some challenges to residency faculty, particularly in development of consistent scheduling of individualized feedback sessions. Residents required the greatest support and guidance in managing point-of-care clinical reminders during patient encounters. CONCLUSIONS: Teaching practices that take into consideration the integration of team-based care and use of electronic health technologies can successfully be used to deliver residency education in the context of the PCMH model. Ongoing assessment provides important information to residency directors and faculty in support of improving the quality of clinical instruction.

Developing online learning modules in a family medicine residency.

BACKGROUND AND OBJECTIVES: Online modules offer an opportunity to overcome barriers to educational delivery. Such approaches can require significant investment dependent on the development model used. There is little in the literature on the formative assessment of design and development. Better understanding is needed to determine effective methods of training and supporting faculty authors. METHODS: The purpose of this study was to examine the effectiveness of Web-based modules developed by a Department of Family Medicine in delivering instruction to resident learners and to examine perceptions of the design and development process. Participants included 49 resident learners and 28 faculty and staff members as the development team. Data collection involved use of Web-based surveys, participant observation focus groups, and pretesting/posttesting. Frequency distributions and mean comparisons were used to analyze quantitative data. Participant comments were thematically analyzed. RESULTS: Residents felt that modules met their educational goals and contributed to understanding of core content. Pretest/posttest data showed statistical improvement for a majority of modules. The use of Web authoring software for Web-based learning and scheduling time to work on the modules posed the greatest challenges to module authors. CONCLUSIONS: Formative assessment methods can provide important information to module developers and support staff to shape training, content development, and improve module ease of use, navigation, and content for resident learners.

Depression, stigma, and suicidal ideation in medical students.

CONTEXT: There is a concerning prevalence of depression and suicidal ideation among medical students, a group that may experience poor mental health care due to stigmatization. OBJECTIVE: To characterize the perceptions of depressed and nondepressed medical students regarding stigma associated with depression. DESIGN, SETTING, AND PARTICIPANTS: Cross-sectional Web-based survey conducted in September-November 2009 among all students enrolled at the University of Michigan Medical School (N = 769). MAIN OUTCOME MEASURES: Prevalence of self-reported moderate to severe depression and suicidal ideation and the association of stigma perceptions with clinical and demographic variables. RESULTS: Survey response rate was 65.7% (505 of 769). Prevalence of moderate to severe depression was 14.3% (95% confidence interval [CI], 11.3%-17.3%). Women were more likely than men to have moderate to severe depression (18.0% vs 9.0%; 95% CI for difference, -14.8% to -3.1%; P = .001). Third- and fourth-year students were more likely than first- and second-year students to report suicidal ideation (7.9% vs 1.4%; 95% CI for difference, 2.7%-10.3%; P = .001). Students with moderate to severe depression, compared with no to minimal depression, more frequently agreed that "if I were depressed, fellow medical students would respect my opinions less" (56.0% vs 23.7%; 95% CI for difference, 17.3%-47.3%; P < .001), and that faculty members would view them as being unable to handle their responsibilities (83.1% vs 55.1%; 95% CI for difference, 16.1%-39.8%; P < .001). Men agreed more commonly than women that depressed students could endanger patients (36.3% vs 20.1%; 95% CI for difference, 6.1%-26.3%; P = .002). First- and second-year students more frequently agreed than third- and fourth-year students that seeking help for depression would make them feel less intelligent (34.1% vs 22.9%; 95% CI for difference, 2.3%-20.1%; P < .01). CONCLUSIONS: Depressed medical students more frequently endorsed several depression stigma attitudes than nondepressed students. Stigma perceptions also differed by sex and class year.

Integrating complementary and alternative medicine instruction into health professions education: organizational and instructional strategies.

A few years ago, the National Institutes of Health National Center for Complementary and Alternative Medicine funded a program called the Complementary and Alternative Medicine (CAM) Education Project. Grantees were 14 medical and nursing schools and the American Medical Student Association, which funded six additional medical schools. Grants were awarded in cohorts of five per year in 2000, 2001, and 2002-2003. The R25 grant recipients identified several major themes as crucial to the success of integrating CAM into health professions curricula. The rationale for integrating CAM curricula was in part to enable future health professionals to provide informed advice as patients dramatically increase the use of CAM. Success of new CAM education programs relied on leadership, including top-down support from institutions' highest administrators. Formal and informal engagement of key faculty and opinion leaders raised awareness, interest, and participation in programs. A range of faculty development efforts increased CAM-teaching capacity. The most effective strategies for integration addressed a key curriculum need and used some form of evidence-based practice framework. Most programs used a combination of instructional delivery strategies, including experiential components and online resources, to address the needs of learners while promoting a high level of ongoing interest in CAM topics. Institutions noted several benefits, including increased faculty development activities, the creation of new programs, and increased cross- and inter-university collaborations. Common challenges included the need for qualified faculty, crowded and changing curricula, a lack of defined best practices in CAM, and post-grant sustainability of programs.