Annual program review process: an enhanced process with outcomes.

The Accreditation Council for Graduate Medical Education's required Annual Program Review of Educational Effectiveness (APREE) has helped us improve our program and change its culture to one of continuous quality improvement. This report outlines our systematic process and describes specific outcomes it has produced over a 10-year period. We identified ways to enhance our APREE after reading articles that described various ways to conduct the process found in a PubMed and OvidSP search and relevant policies from our local Graduate Medical Education Office. After discussing options, we incorporated new ideas into our APREE and tasked our Program Evaluation Committee to track outcomes from objectives developed by faculty and residents during each APREE. Objectives from faculty and residents in 10 years of our APREE led to major improvements (e.g., increased board pass rate) in our program. In addition, the enhanced APREE process gradually changed our residency's culture to one that embraces continuous quality improvement. A systematic APREE process can engage residents and faculty in improving specific components of a residency. Besides providing outcomes for Web Ads and Self-Study items, the APREE models quality improvement techniques to residents, involves a wide array of stakeholders, and helps program stakeholders embrace continuous quality improvement.

The Electronic Health Record Objective Structured Clinical Examination: Assessing Student Competency in Patient Interactions While Using the Electronic Health Record.

PROBLEM: Because many medical students do not have access to electronic health records (EHRs) in the clinical environment, simulated EHR training is necessary. Explicitly training medical students to use EHRs appropriately during patient encounters equips them to engage patients while also attending to the accuracy of the record and contributing to a culture of information safety. APPROACH: Faculty developed and successfully implemented an EHR objective structured clinical examination (EHR-OSCE) for clerkship students at two institutions. The EHR-OSCE objectives include assessing EHR-related communication and data management skills. OUTCOMES: The authors collected performance data for students (n = 71) at the first institution during academic years 2011-2013 and for students (n = 211) at the second institution during academic year 2013-2014. EHR-OSCE assessment checklist scores showed that students performed well in EHR-related communication tasks, such as maintaining eye contact and stopping all computer work when the patient expresses worry. Findings indicated student EHR skill deficiencies in the areas of EHR data management including medical history review, medication reconciliation, and allergy reconciliation. Most students' EHR skills failed to improve as the year progressed, suggesting that they did not gain the EHR training and experience they need in clinics and hospitals. NEXT STEPS: Cross-institutional data comparisons will help determine whether differences in curricula affect students' EHR skills. National and institutional policies and faculty development are needed to ensure that students receive adequate EHR education, including hands-on experience in the clinic as well as simulated EHR practice.

A case-based approach for teaching professionalism to residents with online discussions.

INTRODUCTION: Programs must demonstrate that their residents are taught and assessed in professionalism. Most programs struggle with finding viable ways to teach and assess this critical competency. UTHSCSA Family and Community Medicine Residency developed an innovative option for interactive learning and assessment of residents in this competency which would be transferrable to other programs and specialties. METHODS: The innovative approach uses an asynchronous online format on Blackboard. Threaded discussions on Blackboard require thoughtful reflective writing after case assessment and critical evaluation of other resident posts. Participation, content and progress of all resident postings are monitored by administrative staff and faculty. Faculty can further engage the residents at any point to deepen the discussion and learning. RESULTS: 100% of all senior residents attained the required learning objectives. All were actively engaged in the assignments. Six cases have been developed using a Learning Matrix to demonstrate evaluation areas from the specialty specific competencies. Written feedback from residents verified the validity of case content in context of their current clinical practice. Postings by residents have provided value and insight for the faculty to access the professional development of our Family Medicine residents.  The Clinical Competency Committee evaluates all third year residents using this information specific to the professionalism milestones. By using an asynchronous online approach to case discussion, all residents are involved with all aspects of this curriculum. CONCLUSIONS: More specific measurable learning outcomes are possible using this approach. Resident participation and engagement is easier to track and monitor than a lecture-based format and easier to capture valuable data than relying on evaluation feedback. Our Annual Review process will identify areas for improvement in the existing cases and help create supplemental cases based on a needs assessment by the faculty.

Implementation of interprofessional education (IPE) in 16 U.S. medical schools: Common practices, barriers and facilitators.

BACKGROUND: Enhanced patient outcomes and accreditation criteria have led schools to integrate interprofessional education (IPE). While several studies describe IPE curricula at individual institutions, few examine practices across multiple institutions. PURPOSE: To examine the IPE integration at different institutions and determine gaps where there is potential for improvement. METHOD: In this mixed methods study, we obtained survey results from 16 U.S. medical schools, 14 of which reported IPE activities. RESULTS: The most common collaboration was between medical and nursing schools (93%). The prevalent format was shared curriculum, often including integrated modules (57%). Small group activities represented the majority (64%) of event settings, and simulation-based learning, games and role-play (71%) were the most utilized learning methods. Thirteen schools (81.3%) reported teaching IPE competencies, but significant variation existed. Gaps and barriers in the study include limitations of using a convenience sample, limited qualitative analysis, and survey by self-report. CONCLUSIONS: Most IPE activities focused on the physician role. Implementation challenges included scheduling, logistics and financial support. A need for effective faculty development as well as measures to examine the link between IPE learning outcomes and patient outcomes were identified.

Iatro-compliance: an unintended consequence of excessive autonomy in long term care facilities.

PURPOSE: Periodontal disease and caries remain the most prevalent preventable chronic diseases for seniors. Seniors transitioning into long term care facilities (LTCFs) often present with oral health challenges linked to systemic diseases, plaque control, psychomotor skills and oral health literacy. Many retain a discernible level of physical and cognitive ability, establishing considerable autonomy. This study examines the effect of autonomy on residents' ability to perform oral hygiene. METHODS: Descriptive data were developed utilizing mixed methodology on a convenience sample of 12 residents and 7 care staff of a LTCF. One-on-one interviews consisted of questions about demographics, and exploration of the influence of ageism, respect and time constraints on resident autonomy in oral care practices. RESULTS: Data suggests shortcomings, such as failure of the staff to ensure oral hygiene oversight and failure of the resident to ask for assistance. Autonomy, while laudable, was used by residents to resist staff assistance, partially motivated by residents' lack of confidence in care staff oral hygiene literacy and skills. In turn, by honoring resident's independence, the staff enabled excessive autonomy to occur creating an environment of iatro-compliance. CONCLUSION: While it is beneficial to encourage autonomy, oversight and education must remain an integral component of oral hygiene care in this population. Improved oral hygiene skills can be fostered in LTCFs by utilizing the current oral health care workforce. Registered dental hygienists (RDHs), under indirect supervision of a dentist, can fulfill the role of an oral health care director (OHCD) in LTCFs. A director's presence in a facility can decrease staff caused iatro-compliance and increase oral hygiene skills and literacy of the residents, while enhancing their autonomy through education and support.

Advanced primary care in San Antonio: linking practice and community strategies to improve health.

Improving health among people living in poverty often transcends narrowly focused illness care. Meaningful success is unlikely without confronting the complex social origins of illness. We describe an emerging community of solution to improve health outcomes for a population of 6000 San Antonio, Texas, residents enrolled in a county health care program. The community of solution comprises a county health system, a family medicine residency program, a metropolitan public health department, and local nonprofit organizations and businesses. Community-based activities responding to the needs of individuals and their neighborhoods are driven by a cohort of promotores (community health workers) whose mission encompasses change at both the individual and community levels. Centered on patients' functional goals, promotores mobilize family and community resources and consider what community-level action will address the social determinants of health. On the clinical side, care teams implement population-based risk assessment and nurse care management with a focus on care transitions as well as other measures to meet the needs of patients with high morbidity and high use of health care. Population-based outcome metrics include reductions in hospitalizations, emergency department and urgent care visits, and the associated charges. Promotores also assess patients' progress along the trajectory of their selected functional goals.

The annual program review of effectiveness: a process improvement approach.

BACKGROUND AND OBJECTIVES: All residencies and fellowships are required by the Accreditation Council for Graduate Medical Education (ACGME) and local institutional policy to conduct an annual program review of educational effectiveness. However, a number of family medicine residencies were cited for having an inadequate annual review or for failing to document the review in 2008. The ACGME and university offices of graduate medical education provide program directors some guidance on conducting and documenting annual program reviews, but few articles describe a detailed process for such a review. In this article, the authors describe the systematic process their program uses to conduct and document an annual program review and argue that the annual program review is an excellent way of modeling quality improvement to residents and showing residents and faculty that their input helps improve the residency and the residents' educational experiences. The article also describes metrics included in the process and tells how resident and faculty participation is integrated in the review. Specific outcomes of the process are also described. The authors believe that other residency programs and fellowship programs can adapt this process to conduct annual reviews that improve educational and clinical outcomes.

Smiles for Life: A National Oral Health Curriculum for Family Medicine. A model for curriculum development by STFM groups.

The Society of Teachers of Family Medicine Group on Oral Health released Smiles for Life: A National Oral Health Curriculum for Family Medicine in October 2005 to address a need for high-quality residency and medical school curricula in an area of documented physician knowledge deficit. This article describes the background, planning, fund-raising, development, dissemination, and impact of the curriculum. Lessons learned, particularly in the areas of long-distance collaboration, fund-raising, and marketing are reviewed with a goal of serving as a model for future curriculum development efforts.

Using a modified nominal group technique as a curriculum evaluation tool.

The modified nominal group technique (NGT) is a useful and practical course evaluation tool that complements existing methods such as evaluation forms, surveys, pretests and posttests, focus groups, and interviews. The NGT's unique contribution to the evaluation process is the semi-quantitative, rank-ordered feedback data obtained on learners' perceptions of a course's strengths and weaknesses. In this paper, we demonstrate through a worked example how to use a modified NGT as a course evaluation tool in medical education.

The BELIEF Instrument: a preclinical teaching tool to elicit patients' health beliefs.

PURPOSE: The BELIEF Instrument is a cultural interviewing tool for preclinical medical students that does not require diagnostic or therapeutic skills. METHODS: An expert panel developed and taught the instrument to 200 first-year medical students in (1) a didactic session, (2) standardized patient interviews, and (3) clinical correlation sessions with community physicians and third-year medical students. Standardized patients evaluated students on the BELIEF questions in a graded interview. RESULTS: A total of 93.5% (range 86% to 97%) of 197 students elicited information on each of the BELIEF items. CONCLUSIONS: The BELIEF instrument works as a cultural interviewing tool. It is unknown if students' interviewing behavior generalizes to real patients in clinical settings.

Developing and evaluating ambulatory care: problem-based learning cases.

Medical educators have raised concerns about the quality of teaching and learning in busy ambulatory care settings. Problem-based learning (PBL), which allows students to learn to diagnose and manage common ambulatory care problems as they discuss patients away from the clinical setting, is one possible solution for addressing these concerns. This article describes a process for developing realistic and well-written PBL cases for an ambulatory care clerkship. The process details specific steps for writing and evaluating cases to ensure they contain relevant learning issues students often encounter in outpatient training sites. Faculty at other institutions can adapt this process to develop and evaluate PBL cases reflecting the common presenting problems and patient issues at their sites.

Guidelines for constructing a survey.

Many researchers in family medicine use surveys to gather data from colleagues, learners, and patients on their demographics, personal histories, knowledge, behaviors, and attitudes. Well-written surveys are easy for respondents to complete, gather information accurately and consistently, and obtain data that can be analyzed to answer research questions. All levels of family medicine researchers can follow eight steps to develop surveys that produce useful and publishable results: (1) state the problem or need, (2) plan the project, (3) state the research question, (4) review the literature, (5) develop or adapt existing survey items, (6) construct the survey, (7) conduct pilot tests, and (8) administer the survey. After completing this article, readers should be able to (1) state the appropriate uses of survey instruments as research tools and (2) construct and administer a well-designed survey instrument.