Practical strategies to enhance resident engagement in clinical quality improvement.

BACKGROUND: Engaging residents in meaningful quality improvement (QI) is difficult. Challenges include competing demands, didactics which lack connection to meaningful work, suboptimal experiential learning, unclear accountability, absence of timely and relevant data, and lack of faculty coaches and role models. Various strategies to address these challenges for engagement have been described, but not as a unified approach. This paper describes a bundle of practical strategies to address common challenges to resident engagement in QI, illustrated through the experience of one residency education program. METHODS: 62 categorical residents in the University of Missouri Internal Medicine residency participated in a longitudinal QI curriculum integrated into residency clinic assignments with dedicated QI work sessions and brief just-in-time didactics with mentorship from faculty coaches. Residents completed at least two PDSA (Plan-Do-Study-Act) cycles for their projects. The experience included clear expectations and tools for accountability. Project criteria included importance to patients, residents, and the institution. Residents had access to data related to their own practice. A pre-post survey asked residents to self-assess their level of interest and engagement in QI on a 5-point Likert scale, with 1 = least desired and 5 = most desired result. Data were analyzed by paired t-test. RESULTS: All 62 residents participated in the program as members of ten QI teams. 40/62 residents completed both pre- and post-surveys. Items related to self-assessment of QI in clinical work all changed in the desired direction: likelihood of participation (3.7 to 4.1, p = 0.03), frequency of QI use (3.3 to 3.9, p = 0.001), and opinion about using QI in clinical work (3.9 to 4.0, p = 0.21). Resident assessment of QI priority in clinical work did not change. CONCLUSIONS: We implemented a practical strategies bundle to overcome common challenges to successfully engaging residents in clinical quality improvement. These strategies included QI work integrated into routine clinical assignments, just-in-time didactics, experiential learning with clear expectations and strategic project selection, timely and pertinent data from the residents' own practice, and real-time faculty coaching.

Application of continuous quality improvement to medical education.

CONTEXT: The explicit, intentional and systematic application of continuous quality improvement (QI) in medical education practice and research can improve medical education and help it achieve its goals. Quality improvement and medical education share a foundation centred on learning-experiencing, reflecting, thinking and acting in continuous cycles that spiral to sustained advancement. This suggests that a QI mindset can be brought to bear on various aspects of medical education research and practice. DISCUSSION: To explore this possibility, we turn to W. Edwards Deming's System of Profound Knowledge, widely regarded as one of the foundational frameworks in quality improvement, where he argues strongly that there are four highly interrelated elements that are required for improvement: Appreciation of a System, Theory of Knowledge, Knowledge about Variation and Knowledge of Psychology. In this article, we define and explore each of the four domains and their application in medical education, highlighting both opportunities and challenges. CONCLUSION: Medical educators who utilise QI in their educational practices can help create learning environments that imprint positively on learners and contribute to better outcomes in their clinical learning environments. We provide recommendations for how educators' informed use of QI can improve medical education and help it achieve its ultimate goal of improved health and health care.

Systems and Complexity Thinking to Master Leadership Challenges in Interprofessional Health Professionals Education.

The purpose of this article is to propose that knowledge, understanding, and application of systems and complexity thinking can improve assessment, implementation, and evaluation of interprofessional education (IPE). Using a case story, the authors describe and explain a meta-model of systems and complexity thinking to support leaders in implementing and evaluating IPE initiatives. The meta-model incorporates the use of several important, interrelated frameworks that tackle issues of sense making, systems, and complexity thinking as well as polarity management at different levels of scale in an organization. Combined, these theories and frameworks support recognition and management of cross-scale interactions and help leaders make sense of distinctions among simple, complicated, complex, and chaotic situations among IPE issues associated with healthcare disciplines within institutions. The application and use of Liberating Structures and polarity management practices enable leaders to engage people and gain insight into the complexities involved in successful implementation of IPE programs.

Building the Bridge to Quality: An Urgent Call to Integrate Quality Improvement and Patient Safety Education With Clinical Care.

Current models of quality improvement and patient safety (QIPS) education are not fully integrated with clinical care delivery, representing a major impediment toward achieving widespread QIPS competency among health professions learners and practitioners. The Royal College of Physicians and Surgeons of Canada organized a 2-day consensus conference in Niagara Falls, Ontario, Canada, called Building the Bridge to Quality, in September 2016. Its goal was to convene an international group of educational and health system leaders, educators, frontline clinicians, learners, and patients to engage in a consensus-building process and generate a list of actionable strategies that individuals and organizations can use to better integrate QIPS education with clinical care.Four strategic directions emerged: prioritize the integration of QIPS education and clinical care, build structures and implement processes to integrate QIPS education and clinical care, build capacity for QIPS education at multiple levels, and align educational and patient outcomes to improve quality and patient safety. Individuals and organizations can refer to the specific tactics associated with the 4 strategic directions to create a road map of targeted actions most relevant to their organizational starting point.To achieve widespread change, collaborative efforts and alignment of intrinsic and extrinsic motivators are needed on an international scale to shift the culture of educational and clinical environments and build bridges that connect training programs and clinical environments, align educational and health system priorities, and improve both learning and care, with the ultimate goal of achieving improved outcomes and experiences for patients, their families, and communities.

Linking health professional learners and health care workers on action-based improvement teams.

BACKGROUND AND METHODS: Medical students, nursing students, and other health care professionals in training were integrated with health care workers on interprofessional quality improvement (QI) teams at our academic health center. Teams received training in QI, accompanied by expert QI mentoring, with dual goals of increasing expertise in improvement while improving care. RESULTS: Eighty-six learners and health system workers participated in 12 improvement teams in 2 years. Upon completion of the training, participants expressed that the program enhanced QI and teamwork skills and increased understanding of other health care professions. At the end of the program, fourth-year medical students showed greater ability to apply QI skills, as measured by the QI Knowledge Assessment Tool than did control students who did not participate in the program (P < .0001 in 2006-2007 and P < .0005 in 2007-2008). Many teams were successful in improving care processes. CONCLUSION: The design of "learning QI by doing," accompanied by just-in-time training and ongoing expert mentoring in QI, was identified by faculty as the most important factor contributing to success. This model successfully improved application of QI skills by learners while improving care within our academic health center. Testing of the model at other academic health centers and in other training environments is warranted.

Uncovering differences among health professions trainees exposed to an interprofessional patient safety curriculum.

In response to the Institute of Medicine challenge to improve patient safety and quality of care, an office directing patient safety/quality of care at an academic medical center and faculty from health professions schools collaborated on design, delivery, and evaluation of an interprofessional student curriculum on patient safety, quality, and teamwork. Annually for 6 years, second-year medical students, senior baccalaureate nursing students, second-year masters in health administration students, and junior baccalaureate respiratory therapy students participated. A pre-/postsurvey assessing students' attitudes about quality, safety, and teamwork was developed and modified to reflect course revisions. Survey items were grouped into 1 of the 6 subscales: human fallibility, disclosure, teamwork/communication, error reporting, systems of care, and curricular time spent with other professionals. At pretest, there were significant professional group differences in all the 6 subscales. At completion, differences in 4 subscales were resolved with the exception of human fallibility (P < .001) and curricular time spent together (P < .001). Interprofessional exercises within our curriculum mediated most differences among student groups. As more interprofessional curricular experiences are designed, examining baseline group differences is essential to optimize learning outcomes.

Exemplary Learning Environments for the Health Professions: A Vision.

In this article, the authors propose a vision for exemplary learning environments in which everyone involved in health professions education and health care collaborates toward optimal health for individuals, populations, and communities. Learning environments in the health professions can be conceptualized as complex adaptive systems, defined as a collection of individual agents whose actions are interconnected and follow a set of shared "simple rules." Using principles from complex adaptive systems as a guiding framework for the proposed vision, the authors postulate that exemplary learning environments will follow four such simple rules: Health care and health professions education share a goal of improving health for individuals, populations, and communities; in exemplary learning environments, learning is work and work is learning; exemplary learning environments recognize that collaboration with integration of diverse perspectives is essential for success; and the organizations and agents in the learning environments learn about themselves and the greater system they are part of in order to achieve continuous improvement and innovation. For each of the simple rules, the authors describe the details of the vision and how the current state diverges from this vision. They provide actionable ideas about how to reach the vision using specific examples from the literature. In addition, they identify potential targets for assessment to monitor the success of learning environments, including outcome measures at the individual, team, institutional, and societal levels. Such measurements can ensure optimal alignment between health professions education and health care and inform ongoing improvement of learning environments.

Teaching residents about practice-based learning and improvement.

BACKGROUND: The Accreditation Council for Graduate Medical Education has endorsed practice-based learning and improvement (PBLI) as a core competency for residents. Health professions educators have sought since the early 1990s to incorporate quality improvement principles, methods, and skills into training programs. A literature review indicates that questions remain regarding how to best train physicians to lead the improvement of patient care. The efficacy of two PBLI educational interventions was examined by comparing the performance of participating residents with that of controls. INTERVENTIONS: Personal improvement projects (PIPs) and a workshop were implemented to teach PBLI to internal medicine residents. Residents in an ambulatory block rotation were required to complete a PIP. All residents were invited to attend the workshop. Those participating in neither served as controls. EVALUATION: An instrument was used to assess applied improvement knowledge for PIP participants at project completion and all residents six to eight months later. Analysis of variance showed no difference between the performance of PIP participants at project completion and PIP participants and controls six to eight months later. A second analysis compared six- to eight-month follow-up data for residents doing PIP only, workshop only, both PIP and workshop, and controls. No significant differences were detected among groups. Interrater reliability for the tool was good. DISCUSSION: No difference was found between intervention residents and controls in the assessment of their ability to apply improvement knowledge. This suggests that workshops and PIPs alone will not lead to competence in PBLI. Building this competency likely will require more emphasis on experiential learning and resident participation in health care improvement projects.

Getting it right: educating professionals to work together in improving health and health care.

This paper is based on a lecture given by LAH as the 2nd John Horder lecture at Imperial College, London on 11 April 2006. Dr. Horder has been influential in improving patient outcomes in multiple ways, including his contributions to professional education. He was instrumental in the development of the Royal College of General Practitioners, serving as president from 1979-1982 and acting as a key leader in establishing post-graduate training for general practitioners in the United Kingdom. Dr Horder went on to found the Centre for the Advancement of Interprofessional Education, in part because of what he observed about the power of interprofessional collaboration in his own primary care practice. It was an honor to give a lecture in tribute to Dr John Horder. It was an opportunity to reflect on what we know about educating health professionals in training about the improvement of health care, including work I've helped to lead in the United States (where I now serve as the Senior Associate Dean for Education at the University of Missouri-Columbia School of Medicine). This paper also is dedicated to Dr. Horder.

Changing and sustaining medical students' knowledge, skills, and attitudes about patient safety and medical fallibility.

PURPOSE: To study the effects of a patient safety and medical fallibility curriculum on second-year medical students at the University of Missouri-Columbia School of Medicine in 2003-2004. METHOD: Students completed a knowledge, skills, and attitudes questionnaire before the curriculum, after the final learning experience, and one year later. A 95% confidence interval (CI) for paired differences assessed change over time. At one year, students also responded to items about their use of the curriculum, error reporting, and disclosure experiences. RESULTS: Fifty three of 92 students (55%) completed the questionnaire at all three assessment points. Students' eight items and the calculated knowledge score improved after the curriculum but only seven of these improvements were sustained one year. Responses to seven items did not change and five changed in an undesired direction after the curriculum and/or after one year. Seventy two students completed the self-reported behavior questions at one year. More than half reported using what they learned in the curriculum. Although 76% of students reported observing an error, 71% of these disclosed an error to their peers, 56% to a resident, and 46% to faculty. Only 7% reported an error using our electronic error reporting system. CONCLUSIONS: The curriculum led to changes in second-year medical students' knowledge, skills, and attitudes, but not all of the changes were sustained at one year, were in the desired direction, or were supported by their self-reported behaviors. The extent to which other informal or hidden curriculum experiences reversed the gains and affected the changes at one year is unknown.

Exemplary Care and Learning Sites: A Model for Achieving Continual Improvement in Care and Learning in the Clinical Setting.

PROBLEM: Current models of health care quality improvement do not explicitly describe the role of health professions education. The authors propose the Exemplary Care and Learning Site (ECLS) model as an approach to achieving continual improvement in care and learning in the clinical setting. APPROACH: From 2008-2012, an iterative, interactive process was used to develop the ECLS model and its core elements--patients and families informing process changes; trainees engaging both in care and the improvement of care; leaders knowing, valuing, and practicing improvement; data transforming into useful information; and health professionals competently engaging both in care improvement and teaching about care improvement. In 2012-2013, a three-part feasibility test of the model, including a site self-assessment, an independent review of each site's ratings, and implementation case stories, was conducted at six clinical teaching sites (in the United States and Sweden). OUTCOMES: Site leaders reported the ECLS model provided a systematic approach toward improving patient (and population) outcomes, system performance, and professional development. Most sites found it challenging to incorporate the patients and families element. The trainee element was strong at four sites. The leadership and data elements were self-assessed as the most fully developed. The health professionals element exhibited the greatest variability across sites. NEXT STEPS: The next test of the model should be prospective, linked to clinical and educational outcomes, to evaluate whether it helps care delivery teams, educators, and patients and families take action to achieve better patient (and population) outcomes, system performance, and professional development.

A framework for teaching medical students and residents about practice-based learning and improvement, synthesized from a literature review.

PURPOSE: To create a framework for teaching the knowledge and skills of practice-based learning and improvement to medical students and residents based on proven, effective strategies. METHOD: The authors conducted a Medline search of English-language articles published between 1996 and May 2001, using the term "quality improvement" (QI), and cross-matched it with "medical education" and "health professions education." A thematic-synthesis method of review was used to compile the information from the articles. Based on the literature review, an expert panel recommended educational objectives for practice-based learning and improvement. RESULTS: Twenty-seven articles met the inclusion criteria. The majority of studies were conducted in academic medical centers and medical schools and 40% addressed experiential learning of QI. More than 75% were qualitative case reports capturing educational outcomes, and 7% included an experimental study design. The expert panel integrated data from the literature review with the Dreyfus model of professional skill acquisition, the Institute for Healthcare Improvement's (IHI) knowledge domains for improving health care, and the ACGME competencies and generated a framework of core educational objectives about teaching practice-based learning and improvement to medical students and residents. CONCLUSION: Teaching the knowledge and skills of practice-based learning and improvement to medical students and residents is a necessary and important foundation for improving patient care. The authors present a framework of learning objectives-informed by the literature and synthesized by the expert panel-to assist educational leaders when integrating these objectives into a curriculum. This framework serves as a blueprint to bridge the gap between current knowledge and future practice needs.

Guidelines for appraisal and publication of PDSA quality improvement.

Plan-do-study-act (PDSA) quality improvement is the application of the scientific method to implement and test the effects of change ideas on the performance of the health care system. Users of quality improvement could benefit with markers to gauge the "best" science. Four core questions can determine the value of a quality improvement study: Is the quality improvement study pertinent and relevant? Are the results valid? Are appropriate criteria used to interpret the results? Will the study help you with your practice or organization of care? A set of guidelines is provided to help answer these questions. Similar guidelines exist for randomized clinical trials and clinical-epidemiologic observational studies. Analogous to these existing research guidelines, the PDSA quality improvement guidelines will provide researchers and reviewers with succinct standards of methodological rigor to assist in critical appraisal of quality improvement protocols and publications.

Mr. Young's doctor: how must physicians be prepared for practice?

What will the practice of medicine be like when people use publicly-available performance data to choose their physicians, own their own medical records and therefore exercise more control over medical decision making than has ever been seen in the past? What do these changes mean for the preparation of physicians? The Institute of Medicine has set forth six aims for health care in the United States, that it be safe, effective, patient-centered, timely, efficient and equitable. Achieving this requires new rules for our work in health care and new goals for medical education. The University of Missouri-Columbia School of Medicine has identified eight key characteristics of its graduating students and residents. We believe these are the qualities required for future physicians to deliver the care that their patients need and deserve.

The Quality Improvement Knowledge Application Tool Revised (QIKAT-R).

PURPOSE: Quality improvement (QI) has been part of medical education for over a decade. Assessment of QI learning remains challenging. The Quality Improvement Knowledge Application Tool (QIKAT), developed a decade ago, is widely used despite its subjective nature and inconsistent reliability. From 2009 to 2012, the authors developed and assessed the validation of a revised QIKAT, the "QIKAT-R." METHOD: Phase 1: Using an iterative, consensus-building process, a national group of QI educators developed a scoring rubric with defined language and elements. Phase 2: Five scorers pilot tested the QIKAT-R to assess validity and inter- and intrarater reliability using responses to four scenarios, each with three different levels of response quality: "excellent," "fair," and "poor." Phase 3: Eighteen scorers from three countries used the QIKAT-R to assess the same sets of student responses. RESULTS: Phase 1: The QI educators developed a nine-point scale that uses dichotomous answers (yes/no) for each of three QIKAT-R subsections: Aim, Measure, and Change. Phase 2: The QIKAT-R showed strong discrimination between "poor" and "excellent" responses, and the intra- and interrater reliability were strong. Phase 3: The discriminative validity of the instrument remained strong between excellent and poor responses. The intraclass correlation was 0.66 for the total nine-point scale. CONCLUSIONS: The QIKAT-R is a user-friendly instrument that maintains the content and construct validity of the original QIKAT but provides greatly improved interrater reliability. The clarity within the key subsections aligns the assessment closely with QI knowledge application for students and residents.

Aligning academic continuing medical education with quality improvement: a model for the 21st century.

The recent health care quality improvement (QI) movement has called for significant changes to the way that health care is delivered and taught in academic medical centers (AMCs). This movement also has affected academic continuing medical education (CME). In January 2011, to better align the CME and QI efforts of AMCs, the Association of American Medical Colleges (AAMC) launched a pilot initiative called Aligning and Educating for Quality (ae4Q). The goal of this pilot was to assist 11 AMCs as they moved to a more integrated model of continuous performance improvement by aligning their quality measurement and improvement with their continuing education endeavors. In this article, the authors describe the development of the ae4Q pilot and the resulting outcomes that have led to ongoing improvements.During the 18-month pilot, AAMC consultants conducted readiness assessments and on-site visits and provided consultation services and Web-based resources based on the AMC's needs. Following these interventions at each site, they then conducted both interviews with participants and postintervention assessment surveys to measure the impact of the pilot. Findings included demonstrated increases in the alignment of CME and QI, a greater use of quality data in CME design and delivery, and a greater use of CME as an intervention for clinical improvement. Two sites also attributed measureable improved clinical outcomes to their participation in the ae4Q pilot. The AAMC has used these findings to create resources and ongoing services to support AMCs as they pursue efforts to align QI and CME.