Using a boundary crossing lens to understand basic science educator and clinical educator collaboration in instructional design.

PURPOSE: Collaborations between basic science educators (BE) and clinical educators (CE) in medical education are common and necessary to create integrated learning materials. However, few studies describe experiences of or processes used by educators engaged in interdisciplinary teamwork. We use the lens of boundary crossing to explore processes described by BE and CE that support the co-creation of integrated learning materials, and the impact that this work has on them. MATERIALS AND METHODS: We conducted qualitative content analysis on program evaluation data from 27 BE and CE who worked on 12 teams as part of a multi-institutional instructional design project. RESULTS: BE and CE productively engaged in collaboration using boundary crossing mechanisms. These included respecting diverse perspectives and expertise and finding efficient processes for completing shared work that allow BE and CE to build on each other's contributions. BE and CE developed confidence in connecting clinical concepts with causal explanations, and willingness to engage in and support such collaborations at their own institutions. CONCLUSIONS: BE and CE report the use of boundary crossing mechanisms that support collaboration in instructional design. Such practices could be harnessed in future collaborations between BE and CE.

Thinking Slow More Quickly: Development of Integrated Illness Scripts to Support Cognitively Integrated Learning and Improve Clinical Decision-Making.

Illness scripts describe the mental model used by experienced clinicians to store and recall condition-specific knowledge when making clinical decisions. Studies demonstrate that novice clinicians struggle to develop and apply strong illness scripts. We developed the Integrated Illness Script and Mechanism of Disease (IIS-MOD) map framework to address this challenge.

Doctor coach: a deliberate practice approach to teaching and learning clinical skills.

PROBLEM: The rapidly evolving medical education landscape requires restructuring the approach to teaching and learning across the continuum of medical education. The deliberate practice strategies used to coach learners in disciplines beyond medicine can also be used to train medical learners. However, these deliberate practice strategies are not explicitly taught in most medical schools or residencies. APPROACH: The authors designed the Doctor Coach framework and competencies in 2007-2008 to serve as the foundation for new faculty development and resident-as-teacher programs. In addition to teaching deliberate practice strategies, the programs model a deliberate practice approach that promotes the continuous integration of newly developed coaching competencies by participants into their daily teaching practice. OUTCOMES: Early evaluation demonstrated the feasibility and efficacy of implementing the Doctor Coach framework across the continuum of medical education. Additionally, the Doctor Coach framework has been disseminated through national workshops, which have resulted in additional institutions applying the framework and competencies to develop their own coaching programs. NEXT STEPS: Design of a multisource evaluation tool based on the coaching competencies will enable more rigorous study of the Doctor Coach framework and training programs and provide a richer feedback mechanism for participants. The framework will also facilitate the faculty development needed to implement the milestones and entrustable professional activities in medical education.

Adoption of computer-assisted learning in medical education: the educators' perspective.

CONTEXT: Computer-assisted learning (CAL) in medical education has been shown to be effective in the achievement of learning outcomes, but requires the input of significant resources and development time. This study examines the key elements and processes that led to the widespread adoption of a CAL program in undergraduate medical education, the Computer-assisted Learning in Paediatrics Program (CLIPP). It then considers the relative importance of elements drawn from existing theories and models for technology adoption and other studies on CAL in medical education to inform the future development, implementation and testing of CAL programs in medical education. METHODS: The study used a mixed-methods explanatory design. All paediatric clerkship directors (CDs) using CLIPP were recruited to participate in a self-administered, online questionnaire. Semi-structured interviews were then conducted with a random sample of CDs to further explore the quantitative results. RESULTS: Factors that facilitated adoption included CLIPP's ability to fill gaps in exposure to core clinical problems, the use of a national curriculum, development by CDs, and the meeting of CDs' desires to improve teaching and student learning. An additional facilitating factor was that little time and effort were needed to implement CLIPP within a clerkship. The quantitative findings were mostly corroborated by the qualitative findings. CONCLUSIONS: This study indicates issues that are important in the consideration and future exploration of the development and implementation of CAL programs in medical education. The promise of CAL as a method of enhancing the process and outcomes of medical education, and its cost, increase the need for future CAL funders and developers to pay equal attention to the needs of potential adopters and the development process as they do to the content and tools in the CAL program. Important questions that remain on the optimal design, use and integration of CAL should be addressed in order to adequately inform future development. Support is needed for studies that address these critical areas.

A collaborative model for developing and maintaining virtual patients for medical education.

There is great interest in using computer-assisted instruction in medical education, but getting computer-assisted instruction materials used broadly is difficult to achieve. We describe a successful model for the development and maintenance of a specific type of computer-assisted instruction - virtual patients - in medical education. The collaborative model's seven key components are described and compared to other models of diffusion of innovation and curriculum development. The collaborative development model that began in one medical discipline is now extended to two additional disciplines, through partnerships with their respective clerkship director organizations. We believe that the ability to achieve broad use of virtual patients, and to transition the programs from successfully relying on grant funding to financially self-sustaining, resulted directly from the collaborative development and maintenance process. This process can be used in other learning environments and for the development of other types of computer-assisted instruction programs.

Integration strategies for using virtual patients in clinical clerkships.

PURPOSE: To explore students' perceptions of virtual patient use in the clinical clerkship and develop a framework to evaluate effects of different integration strategies on students' satisfaction and perceptions of learning effectiveness with this innovation. METHOD: A prospective, multiinstitutional study was conducted at six schools' pediatric clerkships to assess the impact of integrating Web-based virtual patient cases on students' perceptions of their learning during 2004-2005 and 2005-2006. Integration strategies were designed to meet the needs of each school, and integration was scored for components of virtual patient use and elimination of other teaching methodologies. A student survey was developed, validated, and administered at the end of the clerkship to 611 students. Data were analyzed using confirmatory factor analysis and structural equation modeling. RESULTS: A total of 545 students (89%) completed the survey. Overall student satisfaction with the virtual patients was high; students reported that they were more effective than traditional methods. The structural model demonstrated that elimination of other teaching methodologies was directly associated with perceived effectiveness of the integration strategies. A higher use score had a significant negative effect on perceived integration, but a positive effect on perceived knowledge and skills gain. Students' positive perceptions of integration directly affected their satisfaction and perception of the effectiveness of their learning. CONCLUSIONS: Integration strategies balancing the use of virtual patients with elimination of some other requirements were significantly associated with students' satisfaction and their perceptions of improved knowledge and skills.

Computer-assisted instruction in clinical education: a roadmap to increasing CAI implementation.

This reflection is based on the premise that clinical education can be improved by more widespread use of computer-assisted instruction (CAI) and that a roadmap will enable more medical educators to begin using CAI. The rationale for CAI use includes many of its inherent features such as incorporation of multimedia and interactivity yet the use of CAI remains limited, apparently because educators are not convinced about the role for CAI. Barriers to CAI use are discussed including misinterpretation of the literature for CAI effectiveness; a disconnect between CAI developers and the educators who make decisions about CAI use; and the paucity of knowledge regarding how to integrate CAI effectively into clinical education. Specific roles for CAI in undergraduate and graduate medical education can include improving uniformity of instruction, providing documentation of exposure or competence, improving the learners' educational experience or outcomes, and assessment that is matched to learning. Funding for CAI remains an important barrier but the authors believe that this will be overcome when use of CAI becomes more widespread.

Multi-institutional development and utilization of a computer-assisted learning program for the pediatrics clerkship: the CLIPP Project.

Computer-assisted instruction (CAI) holds significant promise for meeting the current challenges of medical education by providing consistent and quality teaching materials regardless of training site. The Computer-assisted Learning in Pediatrics Project (CLIPP) was created over three years (2000-2003) to meet this potential through multi-institutional development of interactive Internet-based patient simulations that comprehensively teach the North American core pediatrics clerkship curriculum. Project development adhered to four objectives: (1) comprehensive coverage of the core curriculum; (2) uniform approach to CAI pedagogy; (3) multi-institutional development by educators; and (4) extensive evaluation by users. Pediatrics clerkship directors from 30 institutions worked in teams to develop a series of 31 patient case simulations. An iterative process of case content and pedagogy development, case authoring, peer review, and pilot-testing ensured that the needs of clerkship directors and medical students were met. Fifty medical schools in the United States and Canada are presently using CLIPP. More than 8,000 students have completed over 98,000 case sessions, with an average of 2,000 case sessions completed per week at this time. Each CLIPP case has been completed by more than 3,000 students. The current cost of CLIPP development is approximately $70 per student user, or $6 per case session. The project's success demonstrates that multi-institutional development and implementation of a peer-reviewed comprehensive CAI learning program by medical educators is feasible and provides a useful model for other organizations to develop similar programs. Although CAI development is both time-consuming and costly, the initial investment decreases significantly with broad use over time.

Collaborating to integrate curriculum in primary care medical education: successes and challenges from three US medical schools.

BACKGROUND AND OBJECTIVES: Traditional medical school department-based clerkship structures can lead to redundancy and/or gaps in curriculum, inefficient administrative systems, and academic isolation for clerkship directors. This paper describes the approaches, successes, and challenges three institutions experienced when implementing an interdepartmental collaboration to create an integrated primary care clerkship experience. METHODS: Each school combined family medicine, ambulatory pediatrics, and ambulatory medicine into contiguous clerkship blocks. In all institutions, each clerkship maintained certain distinct features while the integrated aspects contained longitudinal curriculum of certain primary care topics. RESULTS: Evaluations by students demonstrated favorable responses to the new content and integrated methods of teaching, as did results of the Association of American Medical Colleges graduation survey. Faculty at each institution reported that their multidisciplinary approach has stimulated important educational collaborations, many of which require an economy of scale not often achievable within a single clerkship. These included innovative evaluation/documentation efforts; centralization of administrative tasks; enhanced recruitment, retention, and development of community-based faculty; an increase in the active core group of local and national primary care leaders; and an increase in scholarly activities. The collaborations have not occurred without challenges, primarily in the need for identifying sustainable resources for these and future collaborative educational endeavors. CONCLUSIONS: The benefits involved in developing an integrated primary care experience include expansion of curriculum content and methods, as well as enhancement of collegial support and resources to community-based and academic faculty. These integrations do, however, bring added challenges, time, and costs to traditional independent clerkships.

Development of a handheld computer documentation system to enhance an integrated primary care clerkship.

Documentation systems are used by medical schools and residency programs to record the clinical experiences of their learners. The authors developed a system for their school's (Dartmouth's) multidisciplinary primary care clerkship (family medicine, internal medicine, pediatrics) that documents students' clinical and educational experiences and provides feedback designed to enhance clinical training utilizing a timely data-reporting system. The five critical components of the system are (1) a valid, reliable and feasible data-collection instrument; (2) orientation of and ongoing support for student and faculty users; (3) generation and distribution of timely feedback reports to students, preceptors, and clerkship directors; (4) adequate financial and technical support; and (5) a database design that allows for overall evaluation of educational outcomes. The system, whose development began in 1997, generated and distributed approximately 150 peer-comparison reports of clinical teaching experiences to students, preceptors, and course directors during 2001, in formats that are easy to interpret and use to individualize learning. The authors present report formats and annual cost estimate comparisons of paper- and computer-based system development and maintenance, which range from $35,935 to $53,780 for the paper-based system and from $46,820 to $109,308 for the computer-based system. They mention ongoing challenges in components of the system. They conclude that a comprehensive documentation and feedback system provides an essential infrastructure for the evaluation and enhancement of community-based teaching and learning in primary care ambulatory clerkships, whether separate or integrated.

A collaborative model for supporting community-based interdisciplinary education.

Development and support of community-based, interdisciplinary ambulatory medical education has achieved high priority due to on-site capacity and the unique educational experiences community sites contribute to the educational program. The authors describe the collaborative model their school developed and implemented in 2000 to integrate institution- and community-based interdisciplinary education through a centralized office, the strengths and challenges faced in applying it, the educational outcomes that are being tracked to evaluate its effectiveness, and estimates of funds needed to ensure its success. Core funding of $180,000 is available annually for a centralized office, the keystone of the model described here. With this funding, the office has (1) addressed recruitment, retention, and quality of educators for UME; (2) promoted innovation in education, evaluation, and research; (3) supported development of a comprehensive curriculum for medical school education; and (4) monitored the effectiveness of community-based education programs by tracking product yield and cost estimates needed to generate these programs. The model's Teaching and Learning Database contains information about more than 1,500 educational placements at 165 ambulatory teaching sites (80% in northern New England) involving 320 active preceptors. The centralized office facilitated 36 site visits, 22% of which were interdisciplinary, involving 122 preceptors. A total of 98 follow-up requests by community-based preceptors were fulfilled in 2000. The current submission-to-funding ratio for educational grants is 56%. Costs per educational activity have ranged from $811.50 to $1,938, with costs per preceptor ranging from $101.40 to $217.82. Cost per product (grants, manuscripts, presentations) in research and academic scholarship activities was $2,492. The model allows the medical school to balance institutional and departmental support for its educational programs, and to better position itself for the ongoing changes in the health care system.

An analysis of students' clinical experiences in an integrated primary care clerkship.

PURPOSE: Combining complementary clinical content into an integrated clerkship curriculum should enhance students' abilities to develop skills relevant to multiple disciplines, but how educational opportunities in primary care ambulatory settings complement each other is unknown. The authors conducted an observational analytic study to explore where opportunities exist to apply clinical skills during a 16-week integrated primary care clerkship (eight weeks of family medicine, four weeks of ambulatory pediatrics, and four weeks of ambulatory internal medicine). METHOD: Using handheld computers, students recorded common problems, symptoms, and diagnoses they saw. The students also recorded information about the educational process of the clerkship. Two data files were created from the database. Descriptive statistics were used to characterize the students' clerkship experiences, and ANOVA was used to evaluate differences among these blocks within the clerkship. RESULTS: Students encountered different frequencies of presenting symptoms, the majority of which occurred in pediatrics (23.2 per student per week versus 16.3 in medicine and 16.8 in family medicine; p =.01). Students provided more behavioral change counseling in family medicine (5.2 episodes per student per week versus 4.2 and 2.0 in internal medicine and pediatrics, respectively; p =.01), and they performed more clinical procedures in family medicine (1.9 per student per week versus 0.6 and 1.1 in pediatrics and internal medicine, respectively; p =.001). Students were more likely to encounter specific conditions in internal medicine (35.3 per student per week versus 30.0 and 21.4 in family medicine and pediatrics, respectively; p =.01). Elements of the teaching and learning processes also differed by clerkship. CONCLUSIONS: Very little overlap was found in symptoms, conditions, procedures, and other educational opportunities in the ambulatory pediatrics, internal medicine, and family medicine blocks that constitute the integrated primary care clerkship. The blocks provided different and complementary learning opportunities for students. These findings will assist in clerkship planning and in guiding students to seek opportunities that will ensure educational excellence.