Your browser doesn't support javascript.
loading
Mostrar: 20 | 50 | 100
Resultados 1 - 20 de 40
Filtrar
Más filtros

Banco de datos
País/Región como asunto
Tipo del documento
País de afiliación
Intervalo de año de publicación
1.
Can J Surg ; 66(5): E458-E466, 2023.
Artículo en Inglés | MEDLINE | ID: mdl-37673438

RESUMEN

BACKGROUND: Job competition and underemployment among surgeons emphasize the importance of equitable hiring practices. The purpose of this study was to describe some of the demographic characteristics of academic general surgeons and to evaluate the gender and visible minority (VM) status of those recently hired. METHODS: Demographic information about academic general surgeons across Canada including gender, VM status, practice location and graduate degree status was collected. Location of residency was collected for recently hired general surgeons (hired between 2013 and 2020). Descriptive statistics were performed on the demographic characteristics at each institution. Pearson correlation coefficients and hypothesis testing were used to determine the correlation between various metrics and gender and VM status. RESULTS: A total of 393 general surgeons from 30 academic hospitals affiliated with 14 universities were included. The percentage of female general surgeons ranged from 0% to 47.4% and the percentage of VM general surgeons ranged from 0% to 66.7% at the hospitals. This heterogeneity did not correlate with city population (gender: r = 0.06, p = 0.77; VM: r = 0.04, p = 0.83). The percentage of VM general surgeons at each hospital did not correlate with the percentage of VM population in the city (r = 0.13, p = 0.49). Only 34 of 120 recently hired academic general surgeons (28.3%) did not have a graduate degree. The percentage of recently hired academic general surgeons who did not have a graduate degree was approximately 1.5 times higher among male hirees than female hirees. With respect to academic promotion, the percentage of female full professors ranged from 0% to 40.0% and did not correlate with the percentage of female general surgeons at each institution (r = 0.11, p = 0.70). The percentage of VM full professors ranged from 0% to 44.4% and was moderately correlated with the percentage of VM surgeons at each institution (r = 0.40, p = 0.16). CONCLUSION: The academic general surgery workforce appears to be somewhat diverse. However, there was substantial heterogeneity in diversity between hospitals, leaving room for improvement. We must be willing to examine our hiring processes and be transparent about them to build an equitable surgical workforce.


Asunto(s)
Cirujanos , Humanos , Femenino , Masculino , Canadá , Hospitales , Benchmarking , Empleo
2.
J Surg Res ; 273: 155-160, 2022 05.
Artículo en Inglés | MEDLINE | ID: mdl-35091273

RESUMEN

INTRODUCTION: Selecting medical students for residency is a competitive process, with a narrow range of scores separating middle-ranked applicants. Self-assessment is a fundamental skill for any competent physician with a demonstrated correlation to diagnostic ability, examination scores, and technical skills, but has yet to be investigated in residency selection. The objective of this study was to investigate the relationship between self-assessment and interview performance as a potential adjunct to discriminate between applicants. METHODS: At the University of Ottawa in 2020, 55 applicants completed a 9-station interview circuit assessing different characteristics or skills important for a career in general surgery, followed by a self-assessment questionnaire evaluating their perceived performance at each station. Pearson's correlation was used to determine the relationship between self-assessment scores (SASs) and interviewer scores (ISs). RESULTS: There was a negative correlation between SASs and ISs for all interview stations. High performers underestimated their interview performance, and low performers overestimated their performance. Seven of the nine stations reached statistical significance (r = 0.60-0.73, P < 0.001). There was significant variability in the SAS of middle-ranked applicants, with a range three times greater than the range of ISs and demonstrating distinct self-assessment skills in candidates with very similar scores. CONCLUSIONS: Although we strive to select applicants who will succeed in residency to become competent physicians, self-assessment skills may be a useful adjunct during the interview process to assist in discriminating between applicants with similar scores.


Asunto(s)
Cirugía General , Internado y Residencia , Médicos , Estudiantes de Medicina , Cirugía General/educación , Humanos , Autoevaluación (Psicología) , Encuestas y Cuestionarios
3.
J Surg Res ; 265: 265-271, 2021 09.
Artículo en Inglés | MEDLINE | ID: mdl-33964636

RESUMEN

OBJECTIVE: The Script Concordance Test (SCT) is a test of clinical decision-making that relies on an expert panel to create its scoring key. Existing literature demonstrates the value of specialty-specific experts, but the effect of experience among the expert panel is unknown. The purpose of this study was to explore the role of surgeon experience in SCT scoring. DESIGN: An SCT was administered to 29 general surgery residents and 14 staff surgeons. Staff surgeons were stratified as either junior or senior experts based on years since completing residency training (<15 versus >25 years). The SCT was scored using the full expert panel, the senior panel, the junior panel, and a subgroup junior panel in practice <5 years. A one-way ANOVA was used to compare the scores of first (R1) and fifth (R5) year residents using each scoring scheme. Cognitive interviews were analyzed for differences between junior and senior expert panelist responses. RESULTS: There was no statistically significant difference between the mean score of six R1s and five R5s using the full expert panel (R1 69.08 versus R5 67.06, F1,9 = 0.10, P = 0.76), the junior panel (R1 66.73 versus R5 62.50, F1,9 = 0.35, P = 0.57), or the subgroup panel in practice <5 years (R1 61.07 versus R5 58.79, F1,9 = 0.18, P = 0.75). However, the average score of R1s was significantly lower than R5s when using the senior faculty panel (R1 52.04 versus R5 63.26, F1,9 = 26.90, P = 0.001). Cognitive interview data suggests that some responses of junior experts demonstrate less confidence than those of senior experts. CONCLUSIONS: SCT scores are significantly affected by the responses of the expert panel. Expert differences between first and fifth year residents were only demonstrated when using an expert panel consisting of senior faculty members. Confidence may play a role in the response selections of junior experts. When constructing an SCT expert panel, consideration must be given to the experience of panel members.


Asunto(s)
Competencia Clínica , Toma de Decisiones Clínicas/métodos , Cirujanos/psicología , Femenino , Humanos , Masculino
4.
Med Educ ; 55(3): 354-364, 2021 03.
Artículo en Inglés | MEDLINE | ID: mdl-33185303

RESUMEN

INTRODUCTION: The script concordance test (SCT) is a test of clinical decision-making (CDM) that compares the thought process of learners to that of experts to determine to what extent their cognitive 'scripts' align. Without understanding test-takers' cognitive process, however, it is unclear what influences their responses. The objective of this study was to gather response process validity evidence by studying the cognitive process of test-takers to determine whether the SCT tests CDM and what cognitive processes may influence SCT responses. METHODS: Cases from an SCT used in a national validation study were administered and semi-structured cognitive interviews were conducted with ten residents and five staff surgeons. A retrospective verbal probing technique was used. Data was independently analysed and coded by two analysts. Themes were identified as factors that influence SCT responses during the cognitive interview. RESULTS: Cognitive interviews demonstrated variability in CDM among test-takers. Consistent with dual process theory, test-takers relied on scripts formed through past experiences, when available, to make decisions and used conscious deliberation in the absence of experience. However, test-takers' response process was also influenced by their comprehension of specific terms, desire for additional information, disagreement with the planned management, underlying knowledge gaps and desire to demonstrate confidence or humility. CONCLUSION: The rationale behind SCT answers may be influenced by comprehension, underlying knowledge and social desirability in addition to formed scripts and/or conscious deliberation. Having test-takers verbalise their rationale for responses provides a depth of assessment that is otherwise lost in the SCT's current format. With the improved ability to standardise CDM assessment using the SCT, consideration of test-makers improving the SCT construction process and combining the SCT question format with verbal responses may improve the use of the SCT for CDM assessment.


Asunto(s)
Competencia Clínica , Evaluación Educacional , Toma de Decisiones Clínicas , Cognición , Humanos , Estudios Retrospectivos
5.
Med Educ ; 54(4): 337-347, 2020 04.
Artículo en Inglés | MEDLINE | ID: mdl-31912562

RESUMEN

CONTEXT: Clinical decision making (CDM) skills are important to learn and assess in order to establish competence in trainees. A common tool for assessing CDM is the script concordance test (SCT), which asks test takers to indicate how a new clinical finding influences a proposed plan using a Likert-type scale. Most criticisms of the SCT relate to its rating scale but are largely theoretical. The cognitive process of test takers when selecting their responses using the SCT rating scale remains understudied, but is essential to gathering validity evidence for use of the SCT in CDM assessment. METHODS: Cases from an SCT used in a national validation study were administered to 29 residents and 14 staff surgeons. Semi-structured cognitive interviews were then conducted with 10 residents and five staff surgeons based on the SCT results. Cognitive interview data were independently coded by two data analysts, who specifically sought to elucidate how participants mapped their internally generated responses to any of the rating scale options. RESULTS: Five major issues were identified with the response matching cognitive process: (a) the meaning of the '0' response option; (b) which response corresponds to agreement with the planned management; (c) the rationale for picking '±1' versus '±2'; (d) which response indicates the desire to undertake the planned management plus an additional procedure, and (e) the influence of time on response selection. CONCLUSIONS: Studying how test takers (experts and trainees) interpret the SCT rating scale has revealed several issues related to inconsistent and unintended use. Revising the scale to address the variety of interpretations could help to improve the response process validity of the SCT and therefore improve the SCT's ability to be used in CDM skills assessments.


Asunto(s)
Competencia Clínica , Cognición , Evaluación Educacional , Habilidades para Tomar Exámenes , Adulto , Toma de Decisiones Clínicas , Educación de Postgrado en Medicina , Femenino , Humanos , Entrevistas como Asunto , Masculino , Estudios Prospectivos , Investigación Cualitativa
6.
Can J Surg ; 63(3): E302-E305, 2020 05 25.
Artículo en Inglés | MEDLINE | ID: mdl-32449850

RESUMEN

Summary: Surgical programs are facing major and fluctuating changes to the resident workforce because of decreased elective volumes and high exposure risk during the coronavirus disease 2019 pandemic. Rapid restructuring of a residency program to protect its workforce while maintaining educational value is imperative. We describe the experience of the Division of General Surgery at the University of Ottawa in Ontario, Canada. The residency program was restructured to feature alternating "on" and "off" weeks, maintaining a healthy resident cohort in case of exposure. Teams were restructured and subdivided to maximize physical distancing and minimize resident exposure to pathogens. Educational initiatives doubled, with virtual sessions targeting every resident year and incorporating intraoperative teaching. The divisional research day and oral exams proceeded uninterrupted, virtually. A small leadership team enabled fast and flexible restructuring of a system for patient care while prioritizing resident safety and maintaining a commitment to resident education in a pandemic.


Asunto(s)
Betacoronavirus/patogenicidad , Infecciones por Coronavirus/prevención & control , Cirugía General/educación , Control de Infecciones/organización & administración , Internado y Residencia/organización & administración , Pandemias/prevención & control , Neumonía Viral/prevención & control , COVID-19 , Infecciones por Coronavirus/transmisión , Infecciones por Coronavirus/virología , Evaluación Educacional , Cirugía General/organización & administración , Cirugía General/estadística & datos numéricos , Fuerza Laboral en Salud/organización & administración , Fuerza Laboral en Salud/estadística & datos numéricos , Humanos , Control de Infecciones/estadística & datos numéricos , Internado y Residencia/estadística & datos numéricos , Oncología Médica/educación , Oncología Médica/organización & administración , Oncología Médica/estadística & datos numéricos , Ontario/epidemiología , Seguridad del Paciente , Admisión y Programación de Personal/organización & administración , Admisión y Programación de Personal/estadística & datos numéricos , Neumonía Viral/transmisión , Neumonía Viral/virología , SARS-CoV-2 , Universidades/organización & administración , Universidades/estadística & datos numéricos
7.
J Surg Res ; 240: 1-16, 2019 08.
Artículo en Inglés | MEDLINE | ID: mdl-30909061

RESUMEN

BACKGROUND: Recent limits imposed on autonomy have raised concern regarding the quality of medical training. The impact of autonomy on medical education has not been comprehensively reviewed. A scoping review was performed to understand the significance of autonomous practice in medical training. METHODS: The MEDLINE and Embase databases were searched for all studies on the role of autonomy in medical training. Articles were included that referenced the medical profession or trainees, and "autonomy," "independence," or "supervision". Data were qualitatively synthesized and analyzed. RESULTS: The search yielded 3649 articles of which 189 were included. Fourteen studies specifically investigated the role of autonomy: 10 surveys on resident perception, and four studies comparing the effect of supervision on learning outcomes. The remaining 175 publications described participant (88) or author (87) opinions regarding the benefits of autonomy as an educational strategy. One quarter (48) of the publications specifically pertained to surgical disciplines, of which one specifically investigated the role of autonomy. Common themes associated autonomy with increased confidence, readiness for independent practice, the development of clinical decision-making skills, and professional identity. CONCLUSIONS: The current literature primarily represents the opinions of medical educators and trainees. A better understanding of the role of autonomy could inform the development of strategies to compensate for the gap left by the current context of decreased autonomy in medical training.


Asunto(s)
Competencia Clínica , Internado y Residencia/métodos , Autonomía Personal , Especialidades Quirúrgicas/educación , Cirujanos/psicología , Toma de Decisiones Clínicas , Humanos , Aprendizaje , Cirujanos/educación
8.
J Surg Res ; 235: 315-321, 2019 03.
Artículo en Inglés | MEDLINE | ID: mdl-30691812

RESUMEN

PROBLEM: A predicted shortage of surgeons and attrition among surgical residents has highlighted the need to attract well-suited medical students to surgical specialties. Literature suggests that early exposure may increase interest by addressing misconceptions and allowing students more time to make an informed career decision. APPROACH: The Surgical Exploration and Discovery (SEAD) program was created in 2012 with the goal of providing medical students with comprehensive and multifaceted exposure to surgical specialties to develop their knowledge and skills, and in turn positively influence their interest in pursuing a surgical career. The purpose of this innovation report is to describe the challenges, successes, and evolution of the SEAD program. OUTCOMES: Since its inception, SEAD has expanded to include 5 North American institutions and has educated nearly 400 participants in 5 y. Through a replication strategy, SEAD has maintained its basic curriculum, while accommodating the constraints and innovative approaches unique to each institution. Short-term results have demonstrated improved knowledge of curricular objectives, student perception of significant value of the program, and the generation of interest in a career in surgery. CONCLUSIONS: Future directions include the evaluation of long-term impact on pursuing a career in surgery and continuing further expansion using the current replication model, while maintaining a high-quality surgical education program.


Asunto(s)
Educación de Pregrado en Medicina/organización & administración , Especialidades Quirúrgicas/educación , Educación de Pregrado en Medicina/economía , Especialidades Quirúrgicas/organización & administración
12.
J Surg Educ ; 81(11): 1637-1644, 2024 Sep 14.
Artículo en Inglés | MEDLINE | ID: mdl-39277957

RESUMEN

OBJECTIVE: Over half of junior learners (JL) feel pressure to work independently and report rarely calling their supervisor. It is unclear how JL decide whether or not to call their supervisor. The study aims to identify factors that JL consider when responding to clinical scenarios and deciding whether to call senior residents (SR) and compare them to factors identified by SR. METHODS: Fifteen cognitive interviews were conducted with SR and JL. Participants were given 8 to 15 sample pages and probed regarding the factors they considered when triaging the page and deciding whether to inform a SR. De-identified interview transcripts were inductively coded using an interpretative phenomenological analysis (IPA) approach. SETTING: Department of Surgery, Faculty of medicine at the University of Ottawa in Canada. PARTICIPANT: Five general surgery SR and ten JL, which included 5 senior medical students and 5 general surgery junior residents. RESULTS: JL and SR indicated a clear need to call SR when managing high acuity pages, which included hemodynamic instability, decreased level of consciousness, or codes (ie, trauma, cardiac arrest). In the absence of high acuity findings, JL judged whether to call SR based on 10 patient and learner-related factors. Patient-related factors include: 1) time since surgery, 2) patient appearance, 3) patient requires intervention, and 4) lack of improvement after initial independent management attempt. Learner-related factors were categorized into clinical (5-8) and social factors (9-10): 5) nurse's level of concern, 6) familiarity with the patient, 7) gut feeling, 8) prior experience managing this presentation, 9) time of day, and 10) interpersonal dynamic with SR. While SR identified all patient-related and clinical factors, they did not cite the 2 social factors JL considered. CONCLUSION: When pages lack high-acuity findings, JL consider various patient and learner factors when deciding whether to inform SR. Discussing these factors may help guide new JL regarding when they should call their supervisor. Understanding social factors is important to create a culture that minimizes their influence on JL's decision-making and promotes patient safety.

13.
Am J Surg ; 237: 115924, 2024 Aug 22.
Artículo en Inglés | MEDLINE | ID: mdl-39208503

RESUMEN

BACKGROUND: Disparities exist in underrepresented in medicine (URiM) resident representation. This review examines recent trends in resident diversity, URiM recruitment strategies, and identifies research gaps in equity, diversity, and inclusion (EDI) for URiM residents. METHODS: MEDLINE, EMBASE, Web of Science, and ERIC databases were searched for studies published from 2017 to 2022 on URiM resident prevalence and recruitment initiatives. RESULTS: 3634 abstracts were reviewed, and 52 articles were included. 35 (67 â€‹%) studies reported on prevalence of URiM residents, demonstrating URiM resident composition is lower than residency applicant demographics, particularly in surgery. Seventeen (33 â€‹%) studies reported on URiM recruitment interventions, such as visiting clerkship programs, holistic review, and targeted outreach, and demonstrated success in increasing recruitment of URiM candidates to programs. CONCLUSIONS: URiM residents remain disproportionately underrepresented, and markedly so among surgical residency programs. Further research should focus on implementing EDI interventions in surgery and assess URiM resident attrition post-matriculation.

14.
J Contin Educ Health Prof ; 43(2): 117-125, 2023 04 01.
Artículo en Inglés | MEDLINE | ID: mdl-36215166

RESUMEN

INTRODUCTION: Up to 85% of newly qualified physicians report loss or illness in themselves or a loved one. These experiences can intensify feelings of grief in the professional setting, but the range of formal training that addresses personal illness or loss is unknown. This study aimed to explore interventions that teach health care providers and trainees about personal illness experience. METHODS: A scoping review was conducted by searching three bibliographic databases using the terms "illness," "personal," "education," and synonyms. Article screening was performed in duplicate to identify studies that described an intervention that included teaching or learning on personal experiences with illness or loss for health care providers and trainees. RESULTS: The search yielded 4168 studies, of which 13 were included. Education most often targeted medical students (54%), resident or attending physicians (31%), and nurses (31%). Other participants included social workers and psychologists. Personal illness was most frequently taught for reflection in the context of palliative care curricula (54%). Only two studies' primary purpose was to teach about coping with grief related to personal experiences. No studies within the scope of our defined methodology described training on how to support colleagues or trainees facing personal illness or loss. Reported outcomes included improved coping skills, decreased stress, and better ability to support bereaving patients. DISCUSSION: Specific training on personal illness experience is limited, with gaps in continuity of learning, particularly for continuing medical education. Future curricula can equip providers with coping strategies while enabling improved resilience and patient care.


Asunto(s)
Personal de Salud , Médicos , Humanos , Personal de Salud/educación , Aprendizaje , Adaptación Psicológica , Cuidados Paliativos
15.
Surg Open Sci ; 16: 162-164, 2023 Dec.
Artículo en Inglés | MEDLINE | ID: mdl-37954190

RESUMEN

Proficiency in nontechnical skills (NTS) contributes to reduction in critical safety incidents and improvement in patient safety outcomes. Despite evidence demonstrating the importance of NTS in patient safety, there remains limited NTS specific curricula and formal teaching in Canadian surgical programs. We propose a three-stage longitudinal approach to education surrounding NTS using the Nontechnical skills for surgeons (NOTSS) framework.

16.
Am J Surg ; 225(2): 260-265, 2023 02.
Artículo en Inglés | MEDLINE | ID: mdl-35637019

RESUMEN

BACKGROUND: Residency interviewer scores are greatly variable and seems to be influenced by personal characteristics of assessors, although factors contributing to variability remain unclear. The study sought to determine how different professional backgrounds influence assessors' scores. METHODS: Fifty-five general surgery applicants rotated through an interview station assessing teamwork. They were scored by surgeons, human-resource managers, pilots, athletes. Pearson's correlation and a repeated-measures ANOVA were used to determine correlations between professions. Structured interviews were used to probe for scoring rationale. RESULTS: Interview scores differed significantly between professions (F (3, 159) = 11.12, p < 0.001. Qualitative analysis revealed that due to the challenge of distinguishing between similarly performing candidates, assessors rely on global impressions informed by personal values. CONCLUSION: Assessor variability is ubiquitous, in part due to the subjective nature of interviews and is associated with personal values. When selecting assessors, programs should choose diverse assessors to assess to ensure a reliable selection process.


Asunto(s)
Internado y Residencia , Cirujanos , Humanos
17.
J Card Surg ; 27(1): 1-5, 2012 Jan.
Artículo en Inglés | MEDLINE | ID: mdl-22118686

RESUMEN

BACKGROUND: The strategy of bilateral mammary artery grafting is often not considered for elderly patients due to perceived concerns of increased morbidity and mortality. The objective of this study is to explore the safety of bilateral mammary in elderly patients. METHODS: Out of 7746 patients who underwent coronary artery bypass grafting using at least one internal thoracic artery (ITA), there were 3940 patients aged 65 years or greater, and of those, 3581 patients had a single ITA (SITA) and 359 patients had bilateral ITAs (BITAs). The primary outcome was the incidence of major adverse cardiac or cerebrovascular events (MACCEs). Secondary outcomes included re-exploration for bleeding, blood transfusions, sternal wound infections, and intensive care unit and hospital length of stay. RESULTS: The incidence of mortality and MACCE were similar in both groups (mortality BITA 2.6%, SITA 3.6%, p = 0.25, MACCE BITA 8.5%, SITA 6.1%, p = 0.13). Superficial and deep sternal site infections were significantly more prevalent in the BITA group than the SITA group [superficial OR 0.42, 95% CI [0.23-0.75] (p = 0.003) and deep OR 0.29, 95% CI [0.14-0.58 (p = 0.0005)]. CONCLUSION: Use of BITA is safe in the elderly with respect to mortality and early cardiovascular outcome. BITA use in the elderly is associated with an increased risk of sternal wound infection. Our experience in this situation suggests that there is a maximum age (approximately 74 years) beyond which the combined risk of MACCE and wound complications supersedes the benefits in terms of sternal infections.


Asunto(s)
Enfermedad de la Arteria Coronaria/cirugía , Anastomosis Interna Mamario-Coronaria/métodos , Factores de Edad , Anciano , Enfermedad de la Arteria Coronaria/mortalidad , Femenino , Humanos , Incidencia , Anastomosis Interna Mamario-Coronaria/mortalidad , Anastomosis Interna Mamario-Coronaria/tendencias , Tiempo de Internación/estadística & datos numéricos , Masculino , Análisis Multivariante , Complicaciones Posoperatorias/epidemiología , Estudios Retrospectivos , Resultado del Tratamiento
18.
J Grad Med Educ ; 14(3): 289-294, 2022 Jun.
Artículo en Inglés | MEDLINE | ID: mdl-35754644

RESUMEN

Background: Residency selection integrates objective and subjective data sources. Interviews help assess characteristics like insight and communication but have the potential for bias. Structured multiple mini-interviews may mitigate some elements of bias; however, a halo effect is described in assessments of medical trainees, and degree of familiarity with applicants may remain a source of bias in interviews. Objective: To investigate the extent of interviewer bias that results from pre-interview knowledge of the applicant by comparing file review and interview scores for known versus unknown applicants. Methods: File review and interview scores of applicants to the University of Ottawa General Surgery Residency Training Program from 2019 to 2021 were gathered retrospectively. Applicants were categorized as "home" if from the institution, "known" if they completed an elective at the institution, or "unknown." The Kruskal-Wallis H test was used to compare median interview scores between groups and Spearman's rank-order correlation (rs) to determine the correlation between file review and interview scores. Results: Over a 3-year period, 169 applicants were interviewed; 62% were unknown, 31% were known, and 6% were home applicants. There was a statistically significant difference (P=.01) between the median interview scores of home, known, and unknown applicants. Comparison of groups demonstrated higher positive correlations between file review and interview scores (rs=0.15 vs 0.36 vs 0.55 in unknown, known, and home applicants) with increasing applicant familiarity. Conclusions: There is an increased positive correlation between file review and interview scores with applicant familiarity. The interview process may carry inherent bias insufficiently mitigated by the current structure.


Asunto(s)
Internado y Residencia , Comunicación , Humanos , Estudios Retrospectivos , Confianza
19.
Can Med Educ J ; 13(6): 36-45, 2022 Nov.
Artículo en Inglés | MEDLINE | ID: mdl-36440072

RESUMEN

Background: Competence by design (CBD) residency programs increasingly depend on tools that provide reliable assessments, require minimal rater training, and measure progression through the CBD milestones. To assess intraoperative skills, global rating scales and entrustability ratings are commonly used but may require extensive training. The Competency Continuum (CC) is a CBD framework that may be used as an assessment tool to assess laparoscopic skills. The study aimed to compare the CC to two other assessment tools: the Global Operative Assessment of Laparoscopic Skills (GOALS) and the Zwisch scale. Methods: Four expert surgeons rated thirty laparoscopic cholecystectomy videos. Two raters used the GOALS scale while the remaining two raters used both the Zwisch scale and CC. Each rater received scale-specific training. Descriptive statistics, inter-rater reliabilities (IRR), and Pearson's correlations were calculated for each scale. Results: Significant positive correlations between GOALS and Zwisch (r = 0.75, p < 0.001), CC and GOALS (r = 0.79, p < 0.001), and CC and Zwisch (r = 0.90, p < 0.001) were found. The CC had an inter-rater reliability of 0.74 whereas the GOALS and Zwisch scales had inter-rater reliabilities of 0.44 and 0.43, respectively. Compared to GOALS and Zwisch scales, the CC had the highest inter-rater reliability and required minimal rater training to achieve reliable scores. Conclusion: The CC may be a reliable tool to assess intraoperative laparoscopic skills and provide trainees with formative feedback relevant to the CBD milestones. Further research should collect further validity evidence for the use of the CC as an independent assessment tool.


Contexte: Les programmes de résidence structurés autour de la compétence par conception (CPC) dépendent de plus en plus d'outils qui fournissent des évaluations fiables, nécessitent une formation minimale des évaluateurs et mesurent la progression dans les étapes de la CPC. Pour évaluer les compétences peropératoires, les échelles d'évaluation globale et de confiance sont couramment utilisées mais peuvent nécessiter une formation approfondie. Le Continuum des compétences (CC) est un cadre de la CPC qui peut être utilisé comme outil d'évaluation des compétences laparoscopiques. L'étude visait à comparer le CC à deux autres outils d'évaluation : l'évaluation globale opératoire des compétences laparoscopiques (GOALS) et l'échelle de Zwisch. Méthodes: Quatre chirurgiens experts ont évalué trente vidéos de cholécystectomie laparoscopique. Deux évaluateurs ont utilisé l'échelle GOALS tandis que les deux autres ont utilisé l'échelle Zwisch et le CC. Chacun d'eux avait reçu une formation spécifique à l'échelle utilisée. Des statistiques descriptives, la fiabilité inter-évaluateurs (FIÉ) et des corrélations de Pearson ont été calculées pour chaque échelle. Résultats: Des corrélations positives significatives ont été trouvées entre les échelles GOALS et Zwisch (r=0.75, p<0.001), CC et GOALS (r=0.79, p<0.001), et CC et Zwisch (r=0.90, p<0.001). Le CC avait une fiabilité inter-évaluateurs de 0,74 tandis que les échelles GOALS et Zwisch avaient des fiabilités inter-évaluateurs de 0,44 et 0,43, respectivement. Par rapport aux échelles GOALS et Zwisch, le CC avait la fiabilité inter-évaluateurs la plus élevée et ne nécessitait qu'une formation minimale des évaluateurs pour obtenir des scores fiables. Conclusion: Le CC constituerait un outil fiable pour évaluer les compétences laparoscopiques peropératoires et pour fournir aux stagiaires une rétroaction formatrice pertinente pour les étapes de la CPC. Des recherches supplémentaires devraient être entreprises pour recueillir plus de preuves de validité pour l'utilisation du CC comme outil d'évaluation indépendant.

20.
J Grad Med Educ ; 13(2): 240-245, 2021 Apr.
Artículo en Inglés | MEDLINE | ID: mdl-33897958

RESUMEN

BACKGROUND: The residency selection process relies on subjective information in applications, as well as subjective assessment of applications by reviewers. This inherent subjectivity makes residency selection prone to poor reliability between those reviewing files. OBJECTIVES: We compared the interrater reliability of 2 assessment tools during file review: one rating applicant traits (ie, leadership, communication) and the other using a global rating of application elements (ie, curriculum vitae, reference letters). METHODS: Ten file reviewers were randomized into 2 groups, and each scored 7 general surgery applications from the 2019-2020 cycle. The first group used an element-based (EB) scoring tool, while the second group used a trait-based (TB) scoring tool. Feedback was collected, discrimination capacities were measured using variation in scores, and interrater reliability (IRR) was calculated using intraclass correlation (ICC) in a 2-way random effects model. RESULTS: Both tools identified the same top-ranked and bottom-ranked applicants; however, discrepancies were noted for middle-ranked applicants. The score range for the 5 middle-ranked applicants was greater with the TB tool (6.43 vs 3.80), which also demonstrated fewer tie scores. The IRR for TB scoring was superior to EB scoring (ICC [2, 5] = 0.82 vs 0.55). The TB tool required only 2 raters to achieve an ICC ≥ 0.70. CONCLUSIONS: Using a TB file review strategy can facilitate file review with improved reliability compared to EB, and a greater spread of candidate scores. TB file review potentially offers programs a feasible way to optimize and reflect their institution's core values in the process.


Asunto(s)
Internado y Residencia , Humanos , Reproducibilidad de los Resultados
SELECCIÓN DE REFERENCIAS
DETALLE DE LA BÚSQUEDA