Finding the right combination for self-directed learning: A focus group study of residents' choice and use of digital resources to support their learning.

BACKGROUND: There has been a shift in postgraduate medical education towards digital educational resources-podcasts, videos, social media and other formats consumed asynchronously and apart from formal curricula. It is unclear what drives residents to select and use these resources. Understanding how and why residents choose digital resources can aid programme directors, faculty and residents in optimising residents' informal learning time. METHOD: This focus group study was conducted with residents at two US internal medicine residency programmes. The authors used the framework approach to content analysis using self-determination theory as guide for deductive coding and iteratively assessing connections among codes and identifying themes. Trustworthiness was addressed through use of analytic memos, reflexive practice and member checking. RESULTS: The authors conducted eight virtual focus groups (n = 23) from 5/27/20 to 6/11/20. Residents described that a feeling of 'should know' drove initial choices towards self-directed learning outside of work. Regular use of a resource was influenced by how the resource fit into a resident's lifestyle, the personal cognitive energy and the perceived 'activation energy' of using a particular resource. Familiarity, increased confidence and in-person social networks gained from digital resources served to reinforce and further guide resource choice. CONCLUSIONS: The selection of digital resources for self-directed learning is driven by multiple factors, suggesting an interdependent relationship between the learning environment and a residents' cognitive capacity. Understanding these interconnections can help residents and clinical educators explicitly choose resources that fit their lifestyle and learning needs.

Viewing Readiness-for-Residency through Binoculars: Mapping Competency-Based Assessments to the AAMC's 13 Core Entrustable Professional Activities (EPAs).

Construct: The construct being assessed is readiness-for-residency of graduating medical students, as measured through two assessment frameworks. Background: Readiness-for-residency of near-graduate medical students should be but is not consistently assessed. To address this, the Association of American Medical Colleges (AAMC), in 2014, identified and described 13 core Entrustable Professional Activities (EPAs), which are tasks that all residents should be able to perform unsupervised upon entering residency. However, the AAMC did not initially provide measurement guidelines or propose standardized assessments. We designed Night-onCall (NOC), an immersive simulation for our near-graduating medical students to assess and address their readiness-for-residency, framed around tasks suggested by the AAMC's core EPAs. In adopting this EPA assessment framework, we began by building upon an established program of competency-based clinical skills assessments, repurposing competency-based checklists to measure components of the EPAs where possible, and designing new checklists, when necessary. This resulted in a blended suite of 14 checklists, which theoretically provide substantive assessment of all 13 core EPAs. In this paper, we describe the consensus-based mapping process conducted to ensure we understood the relationship between competency and EPA-based assessment lenses and could therefore report meaningful feedback on both to transitioning students in the NOC exercise. Approach: Between January-November 2017, five clinician and two non-clinician health professions educators at NYU Grossman School of Medicine conducted a rigorous consensus-based mapping process, which included each rater mapping each of the 310 NOC competency-based checklist items to lists of entrustable behaviors expected of learners according to the AAMC 13 core EPAs. Findings: All EPAs were captured to varying degrees by the 14 NOC checklists (overall Intraclass Correlation Coefficient (ICC) = 0.77). Consensus meetings resolved discrepancies and improved ICC values for three (EPA-9, EPA-10, EPA-12) of the four EPAs that initially showed poor reliability. Conclusions: Findings suggest that with some limitations (e.g., EPA-7 "form clinical questions/retrieve evidence") established competency-based assessments can be repurposed to measure readiness-for-residency through an EPA lens and both can be reported to learners and faculty.

Desirable Difficulty: Theory and application of intentionally challenging learning.

CONTEXT: Health professions trainees must acquire a vast amount of clinical knowledge and skills, and a deliberate instructional design approach is needed to provide trainees with effective learning strategies. One powerful yet counterintuitive strategy that facilitates long-term learning is incorporating intentional difficulties during the learning process. Difficulties that require more effort from learners may impede short-term learning but are ultimately beneficial for long-term learning and are therefore termed Desirable Difficulties. OBJECTIVES: In this cross-cutting edge paper, we describe the Desirable Difficulty effect from three theoretical perspectives originating in different fields, discuss common evidence-based Desirable Difficulty strategies used in Health Professions Education and explore emerging research that could further optimise Desirable Difficulty-enhanced learning for health professions trainees. METHODS: We synthesise theory and research from psychology, cognitive science and Health Professions Education literatures to further the understanding and application of Desirable Difficulties. We introduce three theoretical perspectives that provide a comprehensive overview of the theoretical underpinnings of the Desirable Difficulty effect: the New Theory of Disuse, the Challenge Point Framework and Cognitive Load Theory. We then illustrate how three common Desirable Difficulty strategies in medical education research-retrieval practice, spaced practice and interleaved practice-can be understood through these theoretical lenses. Finally, we provide relevant examples from the literature and explore emerging research in this area. CONCLUSIONS: This paper summarises the theory and empirical research on Desirable Difficulties during the learning process, from explaining what they are and why they may be effective to how they have been applied in different contexts. We argue that providing educators and trainees with a comprehensive theoretical and applied understanding of Desirable Difficulty will promote deliberate instructional design decisions and lead to more effective learning.

Combining desirable difficulty learning strategies to address the amount-to-learn vs. time-to-learn imbalance in residency training.

PURPOSE: Residents have limited time and much to learn. Mounting evidence shows that Desirable Difficulty (DD) learning strategies can ease that imbalance, but few studies have specifically studied combinations of these strategies. METHODS: We tested two different combinations of DD strategies: a double combination of distributed practice and retrieval practice and a triple combination additionally including interleaved practice. We compared residents' annual In-Training Exam (ITE) scores and graduates' board certification performance between both DD curricula and a historical baseline. RESULTS: Average ITE scores rose from 149.06 in the historical baseline to 160.04 under the combined DD curricula (p < 0.001). Average ITE scores fell from 162.50 under the double combination to 155.11 under the triple combination (p = 0.03). There were no significant changes in graduates' board performance between any of the curricula. CONCLUSIONS: These results add to the evidence that DD strategies can enhance residents' learning. The drop in ITE scores under the triple DD combination may suggest that it pushed learners past beneficial desirable difficulty into detrimental overwhelming difficulty. Further research should apply this framework in larger and more diverse settings to clarify how these DD strategies can be optimally used to enhance residents' learning.

The Transition From Medical Student to Resident: A Qualitative Study of New Residents' Perspectives.

PURPOSE: To understand the learner's perspective on the transition from medical school to residency and to develop a conceptual model for how learners experience the transition from student to resident. METHOD: This prospective qualitative study explored the experience of first-year residents using semistructured, one-on-one telephone interviews. Ten first-year residents who participated in the Transition to Residency elective as fourth-year students at the New York University Grossman School of Medicine in April 2018 participated from December 2018 to April 2019. Using a 3-phase coding process and grounded theory methodology, the authors identified categories, which they organized into broader themes across interview transcripts and used to develop a conceptual model. RESULTS: From the perspective of new residents, developing professional identity is the core construct of the transition experience. The residents focused on individual aspects of the experience-professional identity, self-awareness, professional growth, approach to learning, and personal balance-and external aspects-context of learning, professional relationships, and challenges in the context of their new role. Across these 8 categories, 5 broader themes emerged to describe an abrupt change in educational environment, an immersive experience of learning as a resident, ambivalence and tensions around the new role, navigation of professional relationships, and balance and integration of working in medicine with personal lives and goals. A conceptual model illustrates this phenomenon as a cell where professional identity and growth (the nucleus) is surrounded by interactions with patients and other members of the medical team (in the cytoplasm) that create a substrate for learning and development. CONCLUSIONS: This study suggests that being immersed in the residency experience is how medical students transition to resident physicians. Educational interventions that allow learners to acclimate to the experience of being a doctor through gradual exposure to authentic interactions have the potential to bridge the abrupt transition.

Theory-guided teaching: Implementation of a clinical reasoning curriculum in residents.

Introduction: Educators have theorized that interventions grounded in dual process theory (DPT) and script theory (ST) may improve the diagnostic reasoning process of physicians but little empirical evidence exists. Methods: In this quasi-experimental study, we assessed the impact of a clinical reasoning (CR) curriculum grounded in DPT and ST on medicine residents participating in one of three groups during a 6-month period: no, partial, or full intervention. Residents completed the diagnostic thinking inventory (DTI) at baseline and 6 months. At 6 months, participants also completed a post-survey assessing application of concepts to cases. Results: There was a significant difference between groups in application of concepts (no intervention 1.6 (0.65) compared to partial 2.3 (0.81) and full 2.2 (0.91), p = 0.05), as well as describing cases in problem representation format (no intervention 1.2 (0.38) and partial 1.5 (0.55) compared to full 2.1 (0.93), p = 0.004). There was no significant difference in change in DTI scores (no intervention 7.0 (16.3), partial 8.8 (9.8), full 7.8 (12.0)). Conclusions: Residents who participated in a CR curriculum grounded in DPT and ST were effective in applying principles of CR in cases from their practice. To our knowledge, this is the first workplace-based CR educational intervention study showing differences in the reasoning process residents apply to patients.

A simulated "Night-onCall" to assess and address the readiness-for-internship of transitioning medical students.

Transitioning medical students are anxious about their readiness-for-internship, as are their residency program directors and teaching hospital leadership responsible for care quality and patient safety. A readiness-for-internship assessment program could contribute to ensuring optimal quality and safety and be a key element in implementing competency-based, time-variable medical education. In this paper, we describe the development of the Night-onCall program (NOC), a 4-h readiness-for-internship multi-instructional method simulation event. NOC was designed and implemented over the course of 3 years to provide an authentic "night on call" experience for near graduating students and build measurements of students' readiness for this transition framed by the Association of American Medical College's Core Entrustable Professional Activities for Entering Residency. The NOC is a product of a program of research focused on questions related to enabling individualized pathways through medical training. The lessons learned and modifications made to create a feasible, acceptable, flexible, and educationally rich NOC are shared to inform the discussion about transition to residency curriculum and best practices regarding educational handoffs from undergraduate to graduate education.

On the Role of Error in Motor Learning.

The authors report 5 experiments that explored the role of error in motor learning. Participants practiced 4 distinct keypress sequences that varied in the amounts of advance information (i.e., choice) about which key to press next in the sequence. The amount of advance information resulted in differing levels of error during practice, which in general, was inversely related to retention performance. Although these findings support a beneficial role of error in motor learning, they also suggest that not all errors are equal in the learning process. Rather, we make a distinction between factors that induce errors that have desirable influences on learning compared to those that have undesirable effects.

Crossing the arms confuses the clocks: sensory feedback and the bimanual advantage.

The bimanual advantage refers to the finding that tapping with two fingers on opposite hands exhibits reduced timing variability, as compared with tapping with only one finger. Two leading theories propose that the bimanual advantage results from the addition of either sensory (i.e., enhanced feedback) or cognitive (i.e., multiple timekeeper) processes involved in timing. Given that crossing the arms impairs perception of tactile stimuli and modulates cortical activation following tactile stimulation, we investigated the role of crossing the arms in the bimanual advantage. Participants tapped unimanually or bimanually with their arms crossed or uncrossed on a tabletop or in the air. With arms crossed, we expected increased interval timing variance. Similarly, for air tapping, we expected reduced bimanual advantage, due to reduced sensory feedback. A significant bimanual advantage was observed for the uncrossed, but not the crossed posture in tabletop tapping. Furthermore, removing tactile feedback from taps eliminated the bimanual advantage for both postures. Together, these findings suggest that crossing the arms likely impairs integration of internal (i.e., effector-specific) and external (i.e., environment-specific) information and that this multisensory integration is crucial to reducing timing variability during repetitive coordinated bimanual tasks.