Integrating simulation and interpretive description to explore operating room leadership: critical event continuing education.

In Obstetrics and Gynecologic operating room emergencies, the surgeon cannot both operate and lead a suddenly expanded and redirected team response. However, one of the most often used approaches to interprofessional continuing education designed to improve teams' ability to respond to unanticipated critical events still emphasizes surgeon leadership. We developed Explicit Anesthesia and Nurse Distributed (EXPAND) Leadership to imagine a workflow that might better distribute emergency leadership task responsibilities and practices. The purpose of this exploratory study was to investigate teams' responses to distributing leadership during an interprofessional continuing education simulated obstetrical emergency. We used interpretive descriptive design in a secondary analysis of teams' post-simulation reflective debriefings. One-hundred sixty providers participated, including OB-Gyn surgeons, anesthesiologists, CRNAs, scrub technicians, and nurses. Using reflective thematic analysis, we identified three core themes: 1) The surgeon is focused on the surgical field, 2) Explicit leadership initiates a nurse transition from follower to leader in a hierarchical environment, and 3) Explicit distributed leadership enhances teamwork and taskwork. Continuing education which uses distributed leadership to improve teams' ability to respond to an obstetric emergency is perceived to enhance team members' response to the critical event . The potential for nurses' career growth and professional transformation was an unexpected finding associated with this continuing education which used distributed leadership. Our findings suggest that healthcare educators should consider ways in which distributed leadership may improve teams' response to critical events in the operating room.

Multi-level longitudinal learning curve regression models integrated with item difficulty metrics for deliberate practice of visual diagnosis: groundwork for adaptive learning.

Visual diagnosis of radiographs, histology and electrocardiograms lends itself to deliberate practice, facilitated by large online banks of cases. Which cases to supply to which learners in which order is still to be worked out, with there being considerable potential for adapting the learning. Advances in statistical modeling, based on an accumulating learning curve, offer methods for more effectively pairing learners with cases of known calibrations. Using demonstration radiograph and electrocardiogram datasets, the advantages of moving from traditional regression to multilevel methods for modeling growth in ability or performance are demonstrated, with a final step of integrating case-level item-response information based on diagnostic grouping. This produces more precise individual-level estimates that can eventually support learner adaptive case selection. The progressive increase in model sophistication is not simply statistical but rather brings the models into alignment with core learning principles including the importance of taking into account individual differences in baseline skill and learning rate as well as the differential interaction with cases of varying diagnosis and difficulty. The developed approach can thus give researchers and educators a better basis on which to anticipate learners' pathways and individually adapt their future learning.

Medical student perspectives on conducting patient experience debrief interviews with hospitalized children and their families.

PURPOSE: To explore how medical students completing a pediatric clerkship viewed the benefits and barriers of debrief interviews with hospitalized patients and families. METHODS: In this study, focus groups were conducted with pediatric clerkship students after completion of a debrief interview. The constant comparative method was used with Mezirow's transformative learning theory as a lens to explore perceptions of the benefits and challenges of performing the interview. RESULTS: Focus groups revealed five benefits and two challenges. The benefits were that the debrief interviews helped students (1) humanize patients and appreciate social and environmental influences on patient health, (2) assess caregiver/patient understanding about care to correct misunderstandings, (3) actively involve caregivers/patients in treatment plan development, (4) engage patients in active expression of questions/concerns, and (5) recognize the value of their own role on the healthcare team. The challenges were that students felt (1) a lack of knowledge to answer caregivers'/patients' questions about diagnoses and (2) discomfort responding to caregiver/patient frustration, anxiety, or sadness. Student feedback on feasibility and implementation led to guidelines for selecting patients and conducting small group discussions after the debrief interviews. CONCLUSIONS: Debrief interviews offer a unique approach for learners to explore patient perspectives during hospitalization through direct patient engagement and dialogue, contributing to professional development, empathy, and potentially more positive patient care experiences.

The Fundamentals of Endoscopic Surgery (FES) skills test: factors associated with first-attempt scores and pass rate.

BACKGROUND: The Fundamentals of Endoscopic Surgery (FES) program became required for American Board of Surgery certification as part of the Flexible Endoscopy Curriculum (FEC) for residents graduating in 2018. This study expands prior psychometric investigation of the FES skills test. METHODS: We analyzed de-identified first-attempt skills test scores and self-reported demographic characteristics of 2023 general surgery residents who were required to pass FES. RESULTS: The overall pass rate was 83%. "Loop Reduction" was the most difficult sub-task. Subtasks related to one another only modestly (Spearman's ρ ranging from 0.11 to 0.42; coefficient α = .55). Both upper and lower endoscopic procedural experience had modest positive association with scores (ρ = 0.14 and 0.15) and passing. Examinees who tested on the GI Mentor Express simulator had lower total scores and a lower pass rate than those tested on the GI Mentor II (pass rates = 73% vs. 85%). Removing an Express-specific scoring rule that had been applied eliminated these differences. Gender, glove size, and height were closely related. Women scored lower than men (408- vs. 489-point averages) and had a lower first-attempt pass rate (71% vs. 92%). Glove size correlated positively with score (ρ = 0.31) and pass rate. Finally, height correlated positively with score (r = 0.27) and pass rate. Statistically controlling for glove size and height did not eliminate gender differences, with men still having 3.2 times greater odds of passing. CONCLUSIONS: FES skills test scores show both consistencies with the assessment's validity argument and several remarkable findings. Subtasks reflect distinct skills, so passing standards should perhaps be set for each subtask. The Express simulator-specific scoring penalty should be removed. Differences seen by gender are concerning. We argue those differences do not reflect measurement bias, but rather highlight equity concerns in surgical technology, training, and practice.

Experts' responses in script concordance tests: a response process validity investigation.

CONTEXT: The script concordance test (SCT), designed to measure clinical reasoning in complex cases, has recently been the subject of several critical research studies. Amongst other issues, response process validity evidence remains lacking. We explored the response processes of experts on an SCT scoring panel to better understand their seemingly divergent beliefs about how new clinical data alter the suitability of proposed actions within simulated patient cases. METHODS: A total of 10 Argentine gastroenterologists who served as the expert panel on an existing SCT re-answered 15 cases 9 months after their original panel participation. They then answered questions probing their reasoning and reactions to other experts' perspectives. RESULTS: The experts sometimes noted they would not ordinarily consider the actions proposed for the cases at all (30/150 instances [20%]) or would collect additional data first (54/150 instances [36%]). Even when groups of experts agreed about how new clinical data in a case affected the suitability of a proposed action, there was often disagreement (118/133 instances [89%]) about the suitability of the proposed action before the new clinical data had been introduced. Experts reported confidence in their responses, but showed limited consistency with the responses they had given 9 months earlier (linear weighted kappa = 0.33). Qualitative analyses showed nuanced and complex reasons behind experts' responses, revealing, for example, that experts often considered the unique affordances and constraints of their varying local practice environments when responding. Experts generally found other experts' alternative responses moderately compelling (mean ± standard deviation 2.93 ± 0.80 on a 5-point scale, where 3 = moderately compelling). Experts switched their own preferred responses after seeing others' reasoning in 30 of 150 (20%) instances. CONCLUSIONS: Expert response processes were not consistent with the classical interpretation and use of SCT scores. However, several fruitful and justifiable alternatives for the use of SCT-like methods are proposed, such as to guide assessments for learning.

How well is each learner learning? Validity investigation of a learning curve-based assessment approach for ECG interpretation.

Learning curves can support a competency-based approach to assessment for learning. When interpreting repeated assessment data displayed as learning curves, a key assessment question is: "How well is each learner learning?" We outline the validity argument and investigation relevant to this question, for a computer-based repeated assessment of competence in electrocardiogram (ECG) interpretation. We developed an on-line ECG learning program based on 292 anonymized ECGs collected from an electronic patient database. After diagnosing each ECG, participants received feedback including the computer interpretation, cardiologist's annotation, and correct diagnosis. In 2015, participants from a single institution, across a range of ECG skill levels, diagnosed at least 60 ECGs. We planned, collected and evaluated validity evidence under each inference of Kane's validity framework. For Scoring, three cardiologists' kappa for agreement on correct diagnosis was 0.92. There was a range of ECG difficulty across and within each diagnostic category. For Generalization, appropriate sampling was reflected in the inclusion of a typical clinical base rate of 39% normal ECGs. Applying generalizability theory presented unique challenges. Under the Extrapolation inference, group learning curves demonstrated expert-novice differences, performance increased with practice and the incremental phase of the learning curve reflected ongoing, effortful learning. A minority of learners had atypical learning curves. We did not collect Implications evidence. Our results support a preliminary validity argument for a learning curve assessment approach for repeated ECG interpretation with deliberate and mixed practice. This approach holds promise for providing educators and researchers, in collaboration with their learners, with deeper insights into how well each learner is learning.

Simulation-based mastery learning significantly reduces gender differences on the Fundamentals of Endoscopic Surgery performance exam.

BACKGROUND: Analysis of the Fundamentals of Endoscopic Surgery (FES) performance exam showed higher scores for men than women. Gender differences have been reduced with task-specific practice. We assessed the effect of simulation-based mastery learning (SBML) on FES performance exam differences by gender. METHODS: Forty-seven surgical trainees [29 men (m), 18 women (w)] completed a SBML curriculum and were assessed by FES. Fourteen trained on the GI Mentor 2, 18 on the Endoscopy Training System, and 15 using the Surgical Training for Endoscopic Proficiency curriculum. Performance of male and female trainees was compared. RESULTS: On the pre-training assessment, there were large differences between genders in FES pass rates (m 77%, w 15%, p < 0.001), total scores (m 69 ± 11, w 50 ± 12; p < 0.001), and in four of five FES sub-task scores (Navigation, m 73 ± 19, w 55 ± 22, p = 0.02; Loop reduction, m 34 ± 29, w 14 ± 22, p = 0.02; Retroflexion, m 81 ± 17, w 47 ± 27, p < 0.001; Targeting, m 89 ± 10, w 66 ± 23, p = 0.002). No differences were discernible post training (Pass rate, m 100%, w 94%, p = 0.4; Total score, m 77 ± 8, w 72 ± 12, p = 0.2; Navigation, m 91 ± 13, w 80 ± 13, p = 0.009; Loop reduction, m 49 ± 26, w 46 ± 36, p = 0.7; Retroflexion, m 82 ± 18, w 81 ± 15, p = 0.9; Targeting, m 92 ± 15, w 86 ± 12, p = 0.12). Time needed to complete curricula was not discernably different by gender (m 3.8 ± 1.7 h, w 5.0 ± 2.6 h, p = 0.17). CONCLUSIONS: Gender-based differences are nearly eliminated through task-specific SBML training. This lends further evidence to the validity argument for the FES performance exam as a measure of basic endoscopic skills.

Development and Evaluation of a Student-Initiated Test Preparation Program for the USMLE Step 1 Examination.

PROBLEM: Studies have documented performance on the United States Medical Licensing Examination® (USMLE) Step 1 exam as an important factor that residency program directors consider when deciding which applicants to interview and rank. Therefore, success on this exam, though only one aspect of applicant evaluation, is important in determining future career prospects for medical students. Unfortunately, mean test scores at the University of Illinois College of Medicine at Chicago (UIC) have historically been below the national average. INTERVENTION: This retrospective and quasi-experimental mixed-methods study describes the development, evaluation, and effects of a student-initiated USMLE Step 1 preparatory program at UIC. The program provided second year students with First Aid for the USMLE Step 1 at the beginning of the academic year, as well as a six month subscription to the USMLE World question bank midyear. In addition, optional peer review sessions covering basic sciences and organ systems were taught by high-performing upperclassmen. The goals of the program were to raise mean USMLE Step 1 exam scores and increase the percentage of students passing the exam on their first time. CONTEXT: The program premiered during the 2012-13 academic year. Data from this cohort as well as four others (N = 830; 2010-2014 examinees) were gathered. Performances between preintervention (2010-12 examinees) and postintervention (2013-14 examinees) cohorts of students were compared. Focus groups and interviews with staff and students were conducted, recorded, and analyzed to investigate the impact that the program had on student interactions and perceptions of the learning environment. OUTCOME: There was a significant difference in exam performance pre- versus postintervention, with average USMLE Step 1 scores improving by 8.82 points following the implementation of the student-initiated program, t(5.61) = 828, p < .001. The average first-attempt pass rate also increased significantly by 8%, χ2(1) = 23.13, p < .001. Taking age, sex, Medical College Admission Test® scores, and undergraduate grade point average into account, students who participated in the program scored 6.57 points higher than students who did not participate in the program (R2 = 0.3), F(5, 886) = 76.71, p < .01, and had higher odds of passing USMLE Step 1 (odds ratio = 3.08, SE = 1.07, p < .01). Students and staff commented on the sense of community and empowerment the program created as well as the unique student-driven nature of the program. LESSONS LEARNED: This study demonstrates the efficacy of a student-initiated curriculum and provides guidance for development and implementation of examination preparatory efforts at other institutions.

Development, administration, and validity evidence of a subspecialty preparatory test toward licensure: a pilot study.

BACKGROUND: Trainees in medical subspecialties lack validated assessment scores that can be used to prepare for their licensing examination. This paper presents the development, administration, and validity evidence of a constructed-response preparatory test (CRPT) administered to meet the needs of nephrology trainees. METHODS: Learning objectives from the licensing examination were used to develop a test blueprint for the preparatory test. Messick's unified validity framework was used to gather validity evidence for content, response process, internal structure, relations to other variables, and consequences. Questionnaires were used to gather data on the trainees' perception of examination preparedness, item clarity, and curriculum adequacy. RESULTS: There were 10 trainees and 5 faculty volunteers who took the test. The majority of trainees passed the constructed-response preparatory test. However, many scored poorly on items assessing renal pathology and physiology knowledge. We gathered the following five sources of validity evidence: (1) Content: CRPT mapped to the licensing examination blueprint, with items demonstrating clarity and range of difficulty; (2) Response process: moderate rater agreement (intraclass correlation = .58); (3) Internal structure: sufficient reliability based on generalizability theory (G-coefficient = .76 and Φ-coefficient = .53); (4) Relations to other variables: CRPT scores reflected years of exposure in nephrology and clinical practice; (5) Consequences: post-assessment survey revealed that none of the test takers felt "poorly prepared" for the upcoming summative examination and that their studying would increase in duration and be adapted in terms of content focus. CONCLUSIONS: Preparatory tests using constructed response items mapped to licensure examination blueprint can be developed and used at local program settings to help prepare learners for subspecialty licensure examinations. The CRPT and questionnaire data identified shortcomings of the nephrology training program curriculum. Following the preparatory test, trainees expressed an improved sense of preparedness for their licensing examination.

Psychometric properties of the Fundamentals of Endoscopic Surgery (FES) skills examination.

BACKGROUND: The Fundamentals of Endoscopic Surgery (FES) manual skills examination is a simulation-based assessment of five foundational skills in endoscopic surgery. With the FES skills exam becoming part of the board certification process in general surgery, continual investigation is needed to determine the validity with which the exam is supporting inferences and decision-making about examinees, as well as how it might be improved. METHODS: The present study retrospectively analyzed performance and demographic details for the initial 344 examinees completing the FES skills exam. RESULTS: The five tasks showed distinct degrees of difficulty, with Loop Reduction being especially difficult for examinees. Tasks related to one another positively but moderately, suggesting that the exam assesses both general and task-specific skills. The number of lower-endoscopic cases completed by an examinee strongly predicted performance, while upper endoscopy experience and career level (e.g., resident vs. fellow vs. practicing) did not. Hand dominance and the type of simulator used were not found to be related to scores. However, three demographic variables that related to one another-gender, glove size, and height-were also related to performance and pass/fail status. CONCLUSIONS: This study's results generally support the validity argument for the FES skills exam while pointing to additional investigations to be undertaken as the exam is applied more broadly.

Educational interventions for international medical graduates: a review and agenda.

CONTEXT: International medical graduates (IMGs) play key roles in the health systems of their host countries, but face unique challenges, which makes the provision of effective, tailored support for IMGs essential. OBJECTIVES: Research on the effectiveness of educational interventions for IMGs was reviewed to characterise current knowledge and guide future research and education. METHODS: PubMed, Web of Science and EMBASE were searched for relevant articles published to October 2014, describing a systematic evaluation of educational interventions designed for IMGs that included at least one post-intervention outcome. Articles were coded independently by two or more researchers for content and methodology, and discussed to reach consensus. RESULTS: Twenty-two articles were identified, describing a wide variety of interventions, content and durations of intervention. Clinical topics and general principles of cross-cultural competency were the most common content areas included in curricula (13 and 12 articles, respectively). All studies deemed the interventions evaluated to be successful. However, only one study drew from theory on cross-cultural differences to guide either the curriculum or evaluation. Additionally, study designs were generally weak; no studies featured random assignment to treatment versus control groups, most studies did not use control groups at all, and no studies compared the effectiveness of different interventions. CONCLUSIONS: Research into education for IMGs is critically important but currently underdeveloped. An abundance of justification studies and lack of clarification studies parallel other areas of medical education. Academic fields outside medical education, such as those of cross-cultural psychology and expatriate management, are highly relevant; researchers from these areas should be sought for collaboration. Future research should employ conceptual frameworks in order to facilitate a broader, more nuanced consideration of the diversity of individual IMGs, educational and medical contexts, interventions and outcomes. Rigorous comparative effectiveness research is lacking, but represents a promising avenue for future scholarship.

The red hat - designating leadership using visual and verbal cues: a mixed-methods study.

BACKGROUND: During a critical event in the labor and delivery operating room, it is crucial for team members responding to the situation to be aware of the designated leaders. Visual and verbal cues have been utilized to designate leadership in various healthcare settings; however, previous research has indicated mixed results using visual cues for role designation. METHODS: The purpose of this study was to explore the use of the red surgical hat as a visual cue of leadership during obstetric emergency simulation training. We used a mixed-methods design to analyze simulation-based education video and debriefing transcripts. RESULTS: There was a statistically significant difference in the proportion of participants who declared leadership vs. those who donned the red hat. Participants were more likely to visually declare leadership utilizing a red surgical bouffant hat than to verbally declare leadership. Most participants indicated that observing the red hat to detect leadership in the operating room was more effective than when leaders used a verbal declaration to inform others who was leading. CONCLUSIONS: Our findings suggest that utilizing a visual cue of leadership with the red surgical bouffant hat improves participant perceptions of communication of the surgical team during an obstetrical critical event in a simulation environment.

Threats to validity in the use and interpretation of script concordance test scores.

CONTEXT: Recent reviews have claimed that the script concordance test (SCT) methodology generally produces reliable and valid assessments of clinical reasoning and that the SCT may soon be suitable for high-stakes testing. OBJECTIVES: This study is intended to describe three major threats to the validity of the SCT not yet considered in prior research and to illustrate the severity of these threats. METHODS: We conducted a review of SCT reports available through the Web of Science database. Additionally, we reanalysed scores from a previously published SCT administration to explore issues related to standard SCT scoring practice. RESULTS: Firstly, the predominant method for aggregate and partial credit scoring of SCTs introduces logical inconsistencies in the scoring key. Secondly, our literature review shows that SCT reliability studies have generally ignored inter-panel, inter-panellist and test-retest measurement error. Instead, studies have focused on observed levels of coefficient alpha, which is neither an informative index of internal structure nor a comprehensive index of reliability for SCT scores. As such, claims that SCT scores show acceptable reliability are premature. Finally, SCT criteria for item inclusion, in concert with a statistical artefact of the SCT format, cause anchors at the extremes of the scale to have less expected credit than anchors near or at the midpoint. Consequently, SCT scores are likely to reflect construct-irrelevant differences in examinees' response styles. This makes the test susceptible to bias against candidates who endorse extreme scale anchors more readily; it also makes two construct-irrelevant test taking strategies extremely effective. In our reanalysis, we found that examinees could drastically increase their scores by never endorsing extreme scale points. Furthermore, examinees who simply endorsed the scale midpoint for every item would still have outperformed most examinees who used the scale as it is intended. CONCLUSIONS: Given the severity of these threats, we conclude that aggregate scoring of SCTs cannot be recommended. Recommendations for revisions of SCT methodology are discussed.

Integrative Literature Review on Cognitive Science to Reconsider Failure to Rescue in Nursing: A Call to Action.

BACKGROUND: When current workload demands exceed the cognitive capacity of nurses, tasks that are critical to early detection of clinical deterioration may be omitted. In many high-risk industries that require vigilance over sustained periods, such as the military, the cognitive resource theory of vigilance heavily guides systematic approaches. Yet, in research and policy on nursing failure to rescue, that same application of a cognitive science framework has been overlooked. METHOD: The nursing literature on failure to rescue was reviewed through the lens of the cognitive resource theory of vigilance. Fifteen articles met the inclusion criteria. RESULTS: Four themes emerged: relationship between clinical judgment and failure to rescue, implicit reference to the cognitive resource theory of vigilance, benefits of simulation-based education, and caregiver fatigue. CONCLUSION: The use of cognitive science to target advancement of patient management strategies has the potential to lead to a decrease in failure to rescue and an increase in nursing cognitive task efficiency. [J Contin Educ Nurs. 2023;54(6):253-260.].

Putting the "learning" in "pre-learning": effects of a self-directed study hall on skill acquisition in a simulation-based central line insertion course.

BACKGROUND: Opportunities to practice procedural skills in the clinical learning environment are decreasing, and faculty time to coach skills is limited, even in simulation-based training. Self-directed learning with hands-on practice early in a procedural skill course might help maximize the benefit of later faculty coaching and clinical experience. However, it may also lead to well-learned errors if learners lack critical guidance. The present study sought to investigate the effects of a hands-on, self-directed "study hall" for central line insertion among first-year residents. METHODS: Learner cohorts before vs. after introduction of the study hall (n = 49) were compared on their pre- and post-test performance of key procedural behaviors that were comparable across cohorts, with all learners receiving traditional instructor-led training between tests. RESULTS: Study hall participants spent a median of 116 min in hands-on practice (range 57-175). They scored higher at pre-test (44% vs. 27%, p = .00; Cohen's d = 0.95) and at post-test (80% vs. 72%, p = .02; Cohen's d = 0.69). A dose-response relationship was found, such that 2 h of study hall were roughly equivalent to the performance improvement seen with four clinical observations or supervised insertions of central lines. CONCLUSIONS: Self-directed, hands-on "study hall" supported improved procedural skill learning in the context of limited faculty availability. Potential additional benefits make the approach worth further experimentation and evaluation.

Modeling Diagnostic Expertise in Cases of Irreducible Uncertainty: The Decision-Aligned Response Model.

PURPOSE: Assessing expertise using psychometric models usually yields a measure of ability that is difficult to generalize to the complexity of diagnoses in clinical practice. However, using an item response modeling framework, it is possible to create a decision-aligned response model that captures a clinician's decision-making behavior on a continuous scale that fully represents competing diagnostic possibilities. In this proof-of-concept study, the authors demonstrate the necessary statistical conceptualization of this model using a specific electrocardiogram (ECG) example. METHOD: The authors collected a range of ECGs with elevated ST segments due to either ST-elevation myocardial infarction (STEMI) or pericarditis. Based on pilot data, 20 ECGs were chosen to represent a continuum from "definitely STEMI" to "definitely pericarditis," including intermediate cases in which the diagnosis was intentionally unclear. Emergency medicine and cardiology physicians rated these ECGs on a 5-point scale ("definitely STEMI" to "definitely pericarditis"). The authors analyzed these ratings using a graded response model showing the degree to which each participant could separate the ECGs along the diagnostic continuum. The authors compared these metrics with the discharge diagnoses noted on chart review. RESULTS: Thirty-seven participants rated the ECGs. As desired, the ECGs represented a range of phenotypes, including cases where participants were uncertain in their diagnosis. The response model showed that participants varied both in their propensity to diagnose one condition over another and in where they placed the thresholds between the 5 diagnostic categories. The most capable participants were able to meaningfully use all categories, with precise thresholds between categories. CONCLUSIONS: The authors present a decision-aligned response model that demonstrates the confusability of a particular ECG and the skill with which a clinician can distinguish 2 diagnoses along a continuum of confusability. These results have broad implications for testing and for learning to manage uncertainty in diagnosis.

The Purpose, Design, and Promise of Medical Education Research Labs.

Medical education researchers are often subject to challenges that include lack of funding, collaborators, study subjects, and departmental support. The construct of a research lab provides a framework that can be employed to overcome these challenges and effectively support the work of medical education researchers; however, labs are relatively uncommon in the medical education field. Using case examples, the authors describe the organization and mission of medical education research labs contrasted with those of larger research team configurations, such as research centers, collaboratives, and networks. They discuss several key elements of education research labs: the importance of lab identity, the signaling effect of a lab designation, required infrastructure, and the training mission of a lab. The need for medical education researchers to be visionary and strategic when designing their labs is emphasized, start-up considerations and the likelihood of support for medical education labs is considered, and the degree to which department leaders should support such labs is questioned.

Publication Inaccuracies Listed in General Surgery Residency Training Program Applications.

BACKGROUND: Professionalism is a core competency that is difficult to assess. We examined the incidence of publication inaccuracies in Electronic Residency Application Service applications to our training program as potential indicators of unprofessional behavior. STUDY DESIGN: We reviewed all 2019-2020 National Resident Matching Program applicants being considered for interview. Applicant demographic characteristics recorded included standardized examination scores, gender, medical school, and medical school ranking (2019 US News & World Report). Publication verification by a medical librarian was performed for peer-reviewed journal articles/abstracts, peer-reviewed book chapters, and peer-reviewed online publications. Inaccuracies were classified as "nonserious" (eg incorrect author order without author rank promotion) or "serious" (eg miscategorization, non-peer-reviewed journal, incorrect author order with author rank promotion, nonauthorship of cited existing publication, and unverifiable publication). Multivariate logistic regression analysis was performed for demographic characteristics to identify predictors of overall inaccuracy and serious inaccuracy. RESULTS: Of 319 applicants, 48 (15%) had a total of 98 inaccuracies; after removing nonserious inaccuracies, 37 (12%) with serious inaccuracies remained. Seven publications were reported in predatory open access journals. In the regression model, none of the variables (US vs non-US medical school, gender, or medical school ranking) were significantly associated with overall inaccuracy or serious inaccuracy. CONCLUSIONS: One in 8 applicants (12%) interviewing at a general surgery residency program were found to have a serious inaccuracy in publication reporting on their Electronic Residency Application Service application. These inaccuracies might represent inattention to detail or professionalism transgressions.