Development and evaluation of a writing retreat program to build community and promote productivity in academic hospital medicine.

BACKGROUND: Scientific writing is a core component of academic hospital medicine, and yet finding time to engage in deeply focused writing is difficult in part due to the highly clinical, 24/7 nature of the specialty that can limit opportunities for writing-focused collaboration and mentorship. OBJECTIVE: Our objective was to develop and evaluate an academic writing retreat program. METHODS: We drafted a set of key retreat features to guide implementation of a 3-day, 2-night retreat program held within a 2 h radius of our hospital. Agendas included writing blocks ranging from 45 to 90 min interspersed with breaks and opportunities for feedback, exercise, and preparing meals together. After each retreat, we distributed an evaluation with multiple choice and free text response options to characterize retreat helpfulness and later gathered data on the status of each paper and grant worked on. RESULTS: We held 4 retreats between September 2022 and October 2023, engaging 18 faculty and fellows at a cost of $296 per attendee per retreat. In evaluations, nearly 80% reported that the retreat was extremely helpful, and comments praised the highly mentored environment, enriching community of colleagues, and release from commitments that get in the way of writing. Of the 24 papers attendees worked on, 12 have been accepted and 6 are under review. Of the 4 grant proposals, 2 are under review. CONCLUSIONS: We implemented a low-cost, productive writing retreat program that attendees reported was helpful in supporting deep work and represented a meaningful step toward building a community centered around academic writing.

Promotion Criteria for Medical Educators: Are We Climbing a Ladder with Invisible Rungs?

OBJECTIVE: In 2006 the Association of American Medical Colleges recommended standardization of documentation of the contributions of medical educators and guidelines for their academic promotion. The authors characterized current United States (US) medical school promotion guidelines for medical educators. METHODS: Authors collected publicly available data from medical school promotion websites from March through July 2022 after determining categories by traditional-set domains as well as peer-reviewed standards. Extracted data were analyzed using descriptive and inferential statistics, and frequencies were calculated for nominal and categorical data. RESULTS: Of 155 medical schools identified, promotion criteria were publicly available for 143 (92%) schools. Ninety-one (64%) schools identified a distinct educator track. Of those with a defined educator track, 44 (48%) schools consider workshops or other media when evaluating candidates for promotion, and only 52 (57%) of schools with a specified educational track require additional documentation of teaching or education as part of their promotion process. Notably, 34 (37%) of the 91 schools with an educator track specifically require an Educational Portfolio, compared to 27 (52%) of the 52 schools that do not have a specific educator track for promotion. CONCLUSION: This study describes the current lack of clarity and consistency of the promotion criteria for medical educators and indicates that the guidelines proposed by the Association of American Medical Colleges over 15 years ago have not been widely adopted. These data amplify previous calls for a more objective set of criteria for evaluating and recognizing the contributions of medical educators.

A Qualitative Exploration of Pediatric Resident Perceptions of Autonomy in the Era of Pediatric Hospital Medicine Fellowship.

OBJECTIVE: Some pediatric residents report experiencing less autonomy when working clinically with pediatric hospital medicine (PHM) fellows than with attendings alone. We sought to explore pediatric senior resident (SR) experiences working clinically with PHM fellows, with a focus on characterizing fellow behaviors that could impact perceived resident autonomy. METHODS: In this qualitative study, we conducted virtual semistructured interviews with pediatric SRs. We recorded, deidentified, and transcribed interviews for codebook thematic analysis, making iterative adjustments to our codebook and themes until reaching thematic sufficiency. RESULTS: We conducted 17 interviews. A subanalysis identified key components of the resident mental model of autonomy, including independent clinical decision-making with 3 core qualifiers: 1) plan follow-through, 2) availability of a safety net, and 3) ownership. Our primary analysis identified 4 key themes (with a total of 7 contributory subthemes) describing resident experiences of autonomy, scaffolded based on an organizing framework adapted from Bronfenbrenner's ecological model including 1) microsystem factors (based on direct resident-fellow or resident-leadership team interactions), 2) mesosystem factors (based on fellow-attending interactions), 3) exosystem factors (based on fellow-intrinsic characteristics), and 4) macrosystem factors (cultural values, norms, and policies governing academic pediatrics). CONCLUSIONS: Many factors impact perceived resident autonomy on PHM fellow-inclusive teams. Although some are related to direct resident-fellow interactions, many others are more complex and may reflect resident interactions with the leadership team, attending-fellow dynamics, and the influence of cultural context. Based on our analysis, we propose several best-practice recommendations directed at fellows, attendings, the fellow-attending dyad, and Graduate Medical Education programs overall.

What Do Pediatric Subinterns Say About Their Learning and Assessment? A Qualitative Analysis of Individual Learning Plans.

OBJECTIVE: To perform a qualitative content analysis of learning and assessment strategies that pediatric subinterns describe in Individualized Learning Plans (ILPs) and to explore barriers and facilitators to their learning. METHODS: We analyzed ILPs from medical students enrolled in pediatric subinternships at 10 US medical schools that utilized a standardized curriculum and were recruited to reflect diversity in geographic location, funding, and enrollment. Students used an ILP to record 3 or more selected learning objectives, rationale for selection, and reflection on learning and assessment strategies. Investigators used the constant comparative method to perform a content analysis of the ILPs, grouping codes into themes, and verifying relationships between codes within themes. RESULTS: Two hundred and four ILPs that included student reflections on 850 learning objectives were analyzed. Content was analyzed in 5 categories: rationale for selecting objectives, learning strategies, assessment strategies, challenges to learning, and facilitators of learning. Students showed strong commitment to individualized, self-directed learning, developed a wide range of creative learning strategies, and relied heavily on self-reflection to assess their progress. The learning environment both helped and hindered students' ability to make and assess progress on their selected learning objectives. CONCLUSIONS: Through ILP-guided reflection and a formal curriculum, students can choose well-justified learning objectives and demonstrate resourcefulness and independence in developing self-directed learning and assessment strategies. The strategies that students identified in this study provide a menu of learning and assessment options for subinterns. Identified challenges and facilitators of learning provide guidance for educators who seek to enhance the clinical learning environment.

Communication Experiences of Caregivers Using a Language Other Than English on Inpatient Services.

OBJECTIVES: Individuals who prefer to communicate about health care in a language other than English (LOE) experience poorer quality medical care and challenges when communicating with health care providers. The objective of this study was to elucidate how caregivers who prefer an LOE perceive communication with their physicians on an inpatient general pediatrics service. METHODS: Caregivers of patients admitted to the general pediatrics service at our urban freestanding children's hospital whose preferred language for medical care was Spanish, Arabic, Brazilian Portuguese, or Mandarin were eligible for this qualitative study. Semistructured interviews using video interpreter services were conducted to explore the participants' experiences communicating with their physicians. Interview transcripts were analyzed using conventional content analysis. RESULTS: We interviewed 15 participants representing 7 countries of origin and 4 non-English languages: Spanish, Arabic, Brazilian Portuguese, and Mandarin. Three main domains emerged, including: (1) use of interpreter services, (2) overall communication experience with physician providers, and (3) suggestions for improvement in physician communication. Salient themes included early identification of the need for an interpreter is essential and physicians' use of body language in combination with an interpreter enhances successful communication. CONCLUSIONS: This project fills a gap in existing literature by describing the perspectives of caregivers who prefer an LOE, including those speaking languages other than Spanish, as they communicate with inpatient pediatricians. In addition to ensuring appropriate use of interpreter services, physicians can focus on using plain language and gestures during encounters, helping to facilitate communication and provide culturally competent care for this population.

Impact of hospitalists' social identities on perceptions of teamwork.

Interprofessional teamwork provides unique opportunities for improving patient care. This study used Social Identity Theory as a conceptual framework to characterize the relationships between the social identities of pediatric hospitalists and their perceptions of interprofessional teamwork. We used qualitative methods including free-listing and semi-structured interviews to examine these relationships. We identified five key themes: (a) Pediatric hospitalists' identities fall along a spectrum ranging from profession-centered to team-centered; (b) Familiarity is conducive to formation of team identity; (c) Co-creation of a shared vision and practice of creating shared mental models strengthens sense of team; (d) Institutional culture acts as both a facilitator for and barrier to formation of team identity; (e) High-functioning teams often epitomize the concept of "flexible leadership." We conclude that Social Identity Theory can be a useful theoretical lens for examining interprofessional teamwork in healthcare settings, including among pediatric hospitalists.

Planning for Happenstance: Helping Students Optimize Unexpected Career Developments.

Introduction: Planning for and responding to happenstance is an important but rarely discussed part of the professional development of medical students. We noted this gap while conducting a study of career inflection points of 24 physicians who frequently mentioned how luck had shaped their unfolding careers. A review of the career counseling literature led us to a body of work known as Planned Happenstance Learning Theory (PHLT). PHLT focuses on the attitudes and skills to make happenstance a positive force in one's life. We found no reference to this work in the medical education literature and resolved to address this gap. Methods: We created resources for an interactive, 90-minute faculty development workshop. In the workshop, the facilitator used a PowerPoint presentation, vignettes of happenstance, a student testimonial, and a reflection worksheet. We presented and formally evaluated the workshop at three national meetings for health science educators. Results: Workshop participants, mostly faculty (N = 45), consistently expressed positive regard for the workshop content, organization, and instructional methods, especially the opportunity for guided reflection. A retrospective pre/postevaluation revealed a meaningful increase in knowledge about PHLT attitudes and skills, as well as a commitment to use these skills in promoting professional development. Discussion: The skills and attitudes of PHLT are relevant to students' career development. A workshop designed to introduce PHLT skills and attitudes to faculty advisors and mentors can help prepare faculty to promote students' awareness and use of these attitudes and skills.

Teaching about children with medical complexity: A blueprint for curriculum design.

Children with medical complexity make up a small portion of the pediatric population but utilize a large percentage of health care time and spending. The medical needs of children with medical complexity are highly variable and the education of healthcare providers in the care of these children has taken on more significance. Designing curricula and educational innovations related to the care of children with medical complexity can be challenging. Familiarity with the sociocultural theory, the zone of proximal development, Kolb's experiential learning model, and the educational resources that already exist allow for more ease in developing a curriculum that fits the needs of learners who may have a wide range of exposure to children with medical complexity. Flipped classroom models, simulations, asynchronous modules, and home and community experiences are all useful learning modalities to provide a varied and important curriculum. Taking advantage of the knowledge and skills of the many different members of the multi-disciplinary team caring for children with medical complexity is an important educational strategy that provides benefits to the learners and can enhance interprofessional education.

The Decline in Community Preceptor Teaching Activity: Exploring the Perspectives of Pediatricians Who No Longer Teach Medical Students.

PURPOSE: Difficulty in recruiting and retaining community preceptors for medical student education has been described in the literature. Yet little, if any, information is known about community outpatient preceptors who have stopped or decreased teaching time with students. This study aimed to examine these preceptors' perspectives about this phenomenon. METHOD: Using a phenomenology framework, this multi-institutional qualitative study used semistructured interviews with community pediatric preceptors who had stopped or reduced teaching time with medical students. Interviews were conducted between October 2017 and January 2018 and transcribed verbatim. Interviews explored factors for engaging in teaching, or decreasing or ceasing teaching, that would enable future teaching. An initial code book was developed and refined as data were analyzed to generate themes. RESULTS: Twenty-seven community pediatricians affiliated with 10 institutions participated. Thirty-seven codes resulted in 4 organizing themes: evolution of health care, personal barriers, educational system, and ideal situations to recruit and retain preceptors, each with subthemes. CONCLUSIONS: From the viewpoints of physicians who had decreased or stopped teaching students, this study more deeply explores previously described reasons contributing to the decline of community preceptors, adds newly described barriers, and offers strategies to help counter this phenomenon based on preceptors' perceptions. These findings appear to be manifestations of deeper issues including the professional identify of clinical educators. Understanding the barriers and strategies and how they relate to preceptors themselves should better inform education leaders to more effectively halt the decline of community precepting and enhance the clinical precepting environment for medical students.

A Pediatric Preintern Boot Camp: Program Development and Evaluation Informed by a Conceptual Framework.

OBJECTIVE: Boot camps are being developed and implemented by a growing number of medical schools to facilitate medical students' transition to internship. However, there is limited conceptual understanding of how this facilitation occurs. METHODS: We developed and piloted a 1-week pediatric boot camp in 2015, then significantly revised and evaluated the program in 2016-2017 using a conceptual framework of self-efficacy. Consistent with this framework, the revised boot camp focuses on enhancing practical skills that can ease medical students' transition to internship. Observations and course evaluations informed process evaluation, whereas learner assessments immediately after and at 6 months after the boot camp informed outcomes evaluation in terms of both perceived self-efficacy and confidence. RESULTS: Medical students valued sessions that were "hands on," and program improvements were made to include a variety of interactive curricular activities. Data from course evaluations provided evidence of increased perceived self-efficacy. Learner assessment showed a medium to large effect size for confidence in nearly all specific skills that were queried and a positive, albeit attenuated, effect on perceived self-efficacy at 6 months. CONCLUSIONS: Program evaluation of a pediatric boot camp informed by a conceptual framework of self-efficacy shed light on how it might facilitate medical students' transition to internship. A similar conceptual framework may be useful for other trainee preparatory courses.

Development and Evaluation of High-Value Pediatrics: A High-Value Care Pediatric Resident Curriculum.

Low-value health care is pervasive in the United States, and clinicians need to be trained to be stewards of health care resources. Despite a mandate by the Accreditation Council for Graduate Medical Education to educate trainee physicians on cost awareness, only 10% of pediatric residency programs have a high-value care (HVC) curriculum. To meet this need, we set out to develop and evaluate the impact of High-Value Pediatrics, an open-access HVC curriculum. High-Value Pediatrics is a 3-part curriculum that includes 4 standardized didactics, monthly interactive morning reports, and an embedded HVC improvement project. Curriculum evaluation through an anonymous, voluntary survey revealed an improvement in the self-reported knowledge of health care costs, charges, reimbursement, and value (P < .05). Qualitative results revealed self-reported behavior changes, and HVC improvement projects resulted in higher-value patient care. The implementation of High-Value Pediatrics is feasible and reveals improved knowledge and attitudes about HVC. HVC improvement projects augmented curricular knowledge gains and revealed behavior changes. It is imperative that formal high-value education be taught to every pediatric trainee to lead the culture change that is necessary to turn the tide against low-value health care. In addition, simultaneous work on faculty education and attention to the hidden curriculum of low-value care is needed for sustained and long-term improvements.

Influence of simulation on electronic health record use patterns among pediatric residents.

Objective: Electronic health record (EHR) simulation with realistic test patients has improved recognition of safety concerns in test environments. We assessed if simulation affects EHR use patterns in real clinical settings. Materials and Methods: We created a 1-hour educational intervention of a simulated admission for pediatric interns. Data visualization and information retrieval tools were introduced to facilitate recognition of the patient's clinical status. Using EHR audit logs, we assessed the frequency with which these tools were accessed by residents prior to simulation exposure (intervention group, pre-simulation), after simulation exposure (intervention group, post-simulation), and among residents who never participated in simulation (control group). Results: From July 2015 to February 2017, 57 pediatric residents participated in a simulation and 82 did not. Residents were more likely to use the data visualization tool after simulation (73% in post-simulation weeks vs 47% of combined pre-simulation and control weeks, P <. 0001) as well as the information retrieval tool (85% vs 36%, P < .0001). After adjusting for residents' experiences measured in previously completed inpatient weeks of service, simulation remained a significant predictor of using the data visualization (OR 2.8, CI: 2.1-3.9) and information retrieval tools (OR 3.0, CI: 2.0-4.5). Tool use did not decrease in interrupted time-series analysis over a median of 19 (IQR: 8-32) weeks of post-simulation follow-up. Discussion: Simulation was associated with persistent changes to EHR use patterns among pediatric residents. Conclusion: EHR simulation is an effective educational method that can change participants' use patterns in real clinical settings.

Efficacy of a Web-Based Oral Case Presentation Instruction Module: Multicenter Randomized Controlled Trial.

OBJECTIVE: Effective self-directed educational tools are invaluable. Our objective was to determine whether a self-directed, web-based oral case presentation module would improve medical students' oral case presentations compared to usual curriculum, and with similar efficacy as structured oral presentation faculty feedback sessions. METHODS: We conducted a pragmatic multicenter cluster randomized controlled trial among medical students rotating in pediatric clerkships at 7 US medical schools. In the clerkship's first 14 days, subjects were instructed to complete an online Computer-Assisted Learning in Pediatrics Program (CLIPP) oral case presentation module, an in-person faculty-led case presentation feedback session, or neither (control). At the clerkship's end, evaluators blinded to intervention status rated the quality of students' oral case presentations on a 10-point scale. We conducted intention-to-treat multivariable analyses clustered on clerkship block. RESULTS: Study participants included 256 CLIPP (32.5%), 263 feedback (33.3%), and 270 control (34.2%) subjects. Only 51.1% of CLIPP subjects completed the assigned presentation module, while 98.5% of feedback subjects participated in presentation feedback sessions. Compared to controls, oral presentation quality was significantly higher in the feedback group (adjusted difference in mean quality, 0.28; 95% confidence interval, 0.08, 0.49) and trended toward being significantly higher in the CLIPP group (0.19; 95% confidence interval, -0.006, 0.38). The quality of presentations in the CLIPP and feedback groups was not significantly different (-0.10; 95% confidence interval, -0.31, 0.11). CONCLUSIONS: The quality of oral case presentations delivered by students randomized to complete the CLIPP module did not differ from faculty-led presentation feedback sessions and was not statistically superior to control.

Positive Change in Feedback Perceptions and Behavior: A 10-Year Follow-up Study.

BACKGROUND: Providing and learning from feedback are essential components of medical education, and typically described as resistant to change. But given a decade of change in the clinical context in which feedback occurs, the authors asked if, and how, perceptions of feedback and feedback behaviors might have changed in response to contextual affordances. METHODS: In 2017, the authors conducted a follow-up, ethnographic study on 2 general pediatric floors at the same children's hospital where another ethnographic study on a general pediatric floor was conducted in 2007. Data sources included (1) 21 and 34 hours of observation in 2007 and 2017, respectively, (2) 35 and 25 interviews with general pediatric attending physicians and residents in 2007 and 2017, respectively, and (3) a review of 120 program documents spanning 2007 to 2017. Data were coded and organized around 3 recommendations for feedback that were derived from 2007 data and served as standards for assessing change in 2017. RESULTS: Data revealed progress in achieving each recommendation. Compared with 2007, participants in 2017 more clearly distinguished between feedback and evaluation; residents were more aware of in-the-moment feedback, and they had shifted their orientation from evaluation and grades to feedback and learning. Explanations for progress in achieving recommendations, which were derived from the data, pointed to institutional and national influences, namely, the pediatric milestones. CONCLUSIONS: On the basis of follow-up, ethnographic data, changes in the clinical context of pediatric education may afford positive change in perceptions of feedback and feedback behavior and point to influences within and beyond the institution.

Validity Evidence From Ratings of Pediatric Interns and Subinterns on a Subset of Pediatric Milestones.

PURPOSE: To investigate evidence for validity of faculty members' pediatric milestone (PM) ratings of interns (first-year residents) and subinterns (fourth-year medical students) on nine subcompetencies related to readiness to serve as a pediatric intern in the inpatient setting. METHOD: The Association of Pediatric Program Directors Longitudinal Educational Assessment Research Network (APPD LEARN) and the National Board of Medical Examiners collaborated to investigate the utility of assessments of the PMs for trainees' performance. Data from 32 subinterns and 179 interns at 17 programs were collected from July 2012 through April 2013. Observers used several tools to assess learners. At each site, a faculty member used these data to make judgments about the learner's current developmental milestone in each subcompetency. Linear mixed models were fitted to milestone judgments to examine their relationship with learner's rank and subcompetency. RESULTS: On a 5-point developmental scale, mean milestone levels for interns ranged from 3.20 (for the subcompetency Work effectively as a member of a team) to 3.72 (Humanism) and for subinterns from 2.89 (Organize and prioritize care) to 3.61 (Professionalization). Mean milestone ratings were significantly higher for the Professionalism competency (3.59-3.72) for all trainees compared with Patient Care (2.89-3.24) and Personal and Professional Development (3.33-3.51). Mean intern ratings were significantly higher than mean subintern ratings for all nine subcompetencies except Professionalization, Humanism, and Trustworthiness. CONCLUSIONS: The PMs had a coherent internal structure and could distinguish between differing levels of trainees, which supports their validation for documenting developmental progression of pediatric trainees.

Recruiting and Retaining Community-Based Preceptors: A Multicenter Qualitative Action Study of Pediatric Preceptors.

PURPOSE: The recruitment and retention of community preceptors to teach medical students is difficult. The authors sought to characterize the underlying motivational factors for becoming a preceptor and to identify strategies for recruiting and retaining community-based pediatric preceptors. METHOD: This multicenter qualitative action study included semistructured interviews with community-based pediatric preceptors affiliated with 12 institutions from August to December 2015. Only active preceptors were included, and participating institutions were diverse with respect to geographic location and class size. Interviews were conducted over the telephone and transcribed verbatim. Six investigators used deidentified transcripts to develop a codebook. Through a constant comparative method, codes were revised as data were analyzed and disagreements were resolved through discussion. All investigators organized the themes into dimensions. RESULTS: Fifty-one preceptors were interviewed. Forty-one themes coalesced into four dimensions: (1) least liked aspects of teaching, (2) preparation to teach, (3) inspiration to teach, and (4) ways to improve recruitment and retention. Time constraints and patient care demands were the most commonly cited deterrents to teaching. Successful preceptors balanced their clinical demands with their desire to teach using creative scheduling. External rewards (e.g., recognition, continuing medical education credit) served as incentives. Internal motivation inspired participants to share their enthusiasm for pediatrics and to develop longitudinal relationships with their learners. CONCLUSIONS: Changes in health care delivery have imposed more time constraints on community-based preceptors. However, this study identified underlying factors motivating physicians to volunteer as preceptors. Strategies to recruit new and retain current preceptors must be collaborative.

Developing the Capacity for Rapid-Cycle Improvement at a Large Freestanding Children's Hospital.

BACKGROUND: To develop the capacity for rapid-cycle improvement at the unit level, a large freestanding children's hospital designated 2 inpatient units with normal patient loads and workforce as pilot "Innovation Units" where frontline staff was trained to lead rigorous improvement portfolios. METHODS: Frontline staff received improvement training, and interdisciplinary teams brainstormed ideas for tests of change. Ideas were prioritized using an impact-effort evaluation and an assessment of how they aligned with high-level goals. A template for each test summarized the following: the opportunity for improvement, the test being conducted, dates for the tests, driver diagrams, metrics to measure effects, baseline data, results, findings, and next steps. Successful interventions were implemented and disseminated to other units. RESULTS: Multidisciplinary staff generated 150 improvement ideas and Innovation Units collectively ran >40 plan-do-study-act cycles. Of the 10 distinct improvement projects, elements of all 10 were deemed "successful" and fully implemented on the unit, and elements from 8 were spread to other units. More than 3 years later, elements of all of the successful improvements are still in practice in some form on the units, and each unit has tested >20 additional improvement ideas, using multiple plan-do-study-act cycles to refine them. CONCLUSIONS: The Innovation Unit model successfully engaged frontline staff in improvement work and established a sustainable system and framework for managing rigorous improvement portfolios at the unit level. Other hospitals and health care delivery settings may find our quality improvement approach helpful, especially because it is rooted in the microsystem of care delivery.

Gunner Goggles: Implementing Augmented Reality into Medical Education.

There is evidence that both smartphone and tablet integration into medical education has been lacking. At the same time, there is a niche for augmented reality (AR) to improve this process through the enhancement of textbook learning. Gunner Goggles is an attempt to enhance textbook learning in shelf exam preparatory review with augmented reality. Here we describe our initial prototype and detail the process by which augmented reality was implemented into our textbook through Layar. We describe the unique functionalities of our textbook pages upon augmented reality implementation, which includes links, videos and 3D figures, and surveyed 24 third year medical students for their impression of the technology. Upon demonstrating an initial prototype textbook chapter, 100% (24/24) of students felt that augmented reality improved the quality of our textbook chapter as a learning tool. Of these students, 92% (22/24) agreed that their shelf exam review was inadequate and 19/24 (79%) felt that a completed Gunner Goggles product would have been a viable alternative to their shelf exam review. Thus, while students report interest in the integration of AR into medical education test prep, future investigation into how the use of AR can improve performance on exams is warranted.

The Pediatrics Milestones Assessment Pilot: Development of Workplace-Based Assessment Content, Instruments, and Processes.

PURPOSE: To report on the development of content and user feedback regarding the assessment process and utility of the workplace-based assessment instruments of the Pediatrics Milestones Assessment Pilot (PMAP). METHOD: One multisource feedback instrument and two structured clinical observation instruments were developed and refined by experts in pediatrics and assessment to provide evidence for nine competencies based on the Pediatrics Milestones (PMs) and chosen to inform residency program faculty decisions about learners' readiness to serve as pediatric interns in the inpatient setting. During the 2012-2013 PMAP study, 18 U.S. pediatric residency programs enrolled interns and subinterns. Faculty, residents, nurses, and other observers used the instruments to assess learner performance through direct observation during a one-month rotation. At the end of the rotation, data were aggregated for each learner, milestone levels were assigned using a milestone classification form, and feedback was provided to learners. Learners and site leads were surveyed and/or interviewed about their experience as participants. RESULTS: Across the sites, 2,338 instruments assessing 239 learners were completed by 630 unique observers. Regarding end-of-rotation feedback, 93% of learners (128/137) agreed the assessments and feedback "helped me understand how those with whom I work perceive my performance," and 85% (117/137) agreed they were "useful for constructing future goals or identifying a developmental path." Site leads identified several benefits and challenges to the assessment process. CONCLUSIONS: PM-based instruments used in workplace-based assessment provide a meaningful and acceptable approach to collecting evidence of learner competency development. Learners valued feedback provided by PM-based assessment.

Use of simulation-based education: a national survey of pediatric clerkship directors.

OBJECTIVE: To document the prevalence of simulation-based education (SBE) for third- and fourth-year medical students; to determine the perceived importance of SBE; to characterize the barriers associated with establishing SBE. METHODS: A 27-item survey regarding simulation was distributed to members of the Council on Medical Student Education in Pediatrics (COMSEP) as part of a larger survey in 2012. RESULTS: Seventy-one (48%) of 147 clerkship directors (CD) at COMSEP institutions responded to the survey questions regarding the use of SBE. Eighty-nine percent (63 of 71) of CDs reported use of SBE in some form: 27% of those programs (17 of 63) reported only the use of the online-based Computer-Assisted Learning in Pediatrics Program, and 73% (46 of 63) reported usage of other SBE modalities. Fifty-four percent of CDs (38 of 71) agreed that SBE is necessary to meet the requirements of the Liaison Committee on Medical Education (LCME). Multiple barriers were reported in initiating and implementing an SBE program. CONCLUSIONS: SBE is commonly used for instruction during pediatric undergraduate medical education in North American medical schools. Barriers to the use of SBE remain despite the perception that it is needed to meet requirements of the LCME.