Gender differences in self-assessed performance and stress level during training of basic interventional radiology maneuvers.

OBJECTIVES: Gender differences have been reported to influence medical training. We investigated gender differences encountered during training in interventional radiology maneuvers. METHODS: Catheter handling was analyzed under standardized conditions in 64 participants naïve to endovascular procedures (26 women, 38 men). Objective (e.g., catheter pathway, catheter movements, required time) and subjective parameters (stress level) were recorded. The NASA-Task Load Index (NASA-TLX; 1-20 points) was used to assess participants' stress levels and perceived workload. RESULTS: In the easier tasks, no significant differences between male and female participants regarding catheter handling were observed. In the most complex task, female participants took themselves more time (688 ± 363 vs. 501 ± 230 s; p = 0.02), asked for help more frequently (n = 19 vs. n = 8) and earlier than men (203 ± 94 vs. 305 ± 142 s; p = 0.049), whereas men stood out by more agitated catheter handling (6.0 ± 1.8 vs. 4.8 ± 1.6 movements/s; p = 0.005). Overall, female participants perceived tasks to be more difficult (11.5 ± 4.2 vs. 9.6 ± 3.3; p = 0.016), perceived higher stress levels (8.9 ± 4.9 vs. 6.3 ± 4.4; p = 0.037), and rated their own performance lower (9.12 ± 3.3 vs. 11.3 ± 3.3; p = 0.009). However, female participants were able to correlate self-assessed with objective parameters correctly (r between -0.555 and -0.469; p = 0.004-0.018), whereas male participants failed to correctly rate their performance (p between 0.34 and 0.73). Stress levels correlated with objective parameters in males (r between 0.4 and 0.587; p < 0.005), but not in female participants. CONCLUSION: Perceived stress levels, self-evaluation skills, and catheter handling differ greatly between untrained male and female participants trying to solve interventional radiological tasks. These gender-specific differences should be considered in interventional radiology training. CLINICAL RELEVANCE STATEMENT: As psychological aspects may influence individual working strategies gender-specific differences in self-perception while learning interventional radiology maneuvers could be essential regarding success in teaching and treatment outcomes. KEY POINTS: • After performing standardized training, 38 male and 26 female volunteers showed significant differences regarding objective and self-assessed performance, as well as in perceived workload while performing simulated endovascular catheter maneuvers. • After solving simulated endovascular radiological tasks, female participants were able to self-assess their objective performance much more accurately than male participants. • Women took more time to solve simulated endovascular tasks and asked earlier and more frequently for help than men.

Impact of a university teaching of integrative medicine on the social representations of undergraduate medical students.

Integrative medicine, need to be inoffensive, effective, and of quality (World Health Organization). In 2010, the American Society of Teachers of Family Medicine approved 19 competencies for teaching integrative medicine to residents. In 2018, the University of Rennes created a course: "Integrative Medicine and Complementary Therapies". Up until then, the only feedback from the courses was the students' opinions. We investigated the impact on medical students' social representation.We performed a sociological analysis of students' social representations before and after the course. The social representation is based on the way an individual creates his or her universe of beliefs and ideas. After hearing, "What word or group of words comes to mind when you hear people speak of integrative medicine and complementary therapies?", students were asked to provide 5 words/phrases, rank their importance, and show their attitude towards these words/phrases. The frequency and importance of these words/phrases were used to construct social representations (with central cores, and primary and secondary peripheries) before and after the course.Among the 101 students registered, 59 provided complete responses before and 63 after the course. Before, the central core comprised "hypnosis" and "alternative medicine", while after: "complementary care" and "global care". We only identified first periphery before the course: "acupuncture" and "homeopathy". 4 new contrasting elements: "integration with conventional treatment", "patient's choice", "personalisation of care", and "caring relationship of trust".This teaching course positively affected students' social representation of integrative medicine, and might promote their use during future practices.

Interrater reliability in neurology objective structured clinical examination across specialties.

PURPOSE: To assess interrater reliability and examiners' characteristics, especially specialty, associated with scoring of neurology objective structured clinical examination (OSCE). MATERIAL AND METHODS: During a neurology mock OSCE, five randomly chosen students volunteers were filmed while performing 1 of the 5 stations. Video recordings were scored by physicians from the Lyon and Clermont-Ferrand university teaching hospitals to assess students performance using both a checklist scoring and a global rating scale. Interrater reliability between examiners were assessed using intraclass coefficient correlation. Multivariable linear regression models including video recording as random effect dependent variable were performed to detect factors associated with scoring. RESULTS: Thirty examiners including 15 (50%) neurologists participated. The intraclass correlation coefficient of checklist scores and global ratings between examiners were 0.71 (CI95% [0.45-0.95]) and 0.54 (CI95% [0.28-0.91]), respectively. In multivariable analyses, no factor was associated with checklist scores, while male gender of examiner was associated with lower global rating (ß coefficient = -0.37; CI 95% [-0.62-0.11]). CONCLUSIONS: Our study demonstrated through a video-based scoring method that agreement among examiners was good using checklist scoring while moderate using global rating scale in neurology OSCE. Examiner's specialty did not affect scoring whereas gender was associated with global rating scale.

Twelve tips to aid interpretation of post-assessment psychometric reports.

Post-assessments psychometric reports are a vital component of the assessment cycle to ensure that assessments are reliable, valid and fair to make appropriate pass-fail decisions. Students' scores can be summarised by examination of frequency distributions, central tendency measures and dispersion measures. Item discrimination indicies to assess the quality of items, and distractors that differentiate between students achieving or not achieving the learning outcomes are key. Estimating individual item reliability and item validity indices can maximise test-score reliability and validity. Test accuracy can be evaluated by assessing test reliability, consistency and validity and standard error of measurement can be used to measure the variation. Standard setting, even by experts, may be unreliable and reality checks such as the Hofstee method, P values and correlation analysis can improve validity. The Rasch model of student ability and item difficulty assists in modifying assessment questions, pinpointing areas for additional instruction. We propose 12 tips to support test developers in interpreting structured psychometric reports, including analysis and refinement of flawed items and ensuring fair assessments with accurate and defensible marks.

Relationship of emotional intelligence and capability of answering higher-order knowledge questions in physiology among first-year medical students.

Emotional intelligence (EI) has a positive correlation with the academic performance of medical students. However, why there is a positive correlation needs further exploration. We hypothesized that the capability of answering higher-order knowledge questions (HOQs) is higher in students with higher EI. Hence, we assessed the correlation between EI and the capability of medical students to answer HOQs in physiology. First-year undergraduate medical students (n = 124) from an Indian medical college were recruited as a convenient sample. EI was assessed by the Schutte Self-Report Emotional Intelligence Test (SSEIT), a 33-item self-administered validated questionnaire. A specially designed objective examination with 15 lower-order and 15 higher-order multiple-choice questions was conducted. The correlation between the examination score and the EI score was tested by Pearson's correlation coefficient. Data from 92 students (33 females and 59 males) with a mean age of 20.14 ± 1.87 yr were analyzed. Overall, students got a percentage of 53.37 ± 14.07 in the examination, with 24.46 ± 9.1 in HOQs and 28.91 ± 6.58 in lower-order knowledge questions (LOQs). They had a mean score of 109.58 ± 46.2 in SSEIT. The correlation coefficient of SSEIT score with total marks was r = 0.29 (P = 0.0037), with HOQs was r = 0.41 (P < 0.0001), and with LOQs was r = 0.14 (P = 0.19). Hence, there is a positive correlation between EI and the capability of medical students to answer HOQs in physiology. This study may be the foundation for further exploration of the capability of answering HOQs in other subjects.NEW & NOTEWORTHY This study assessed the correlation between emotional intelligence (EI) and the capability of medical students to answer higher-order knowledge questions (HOQs) in the specific context of physiology. The finding reveals one of the multifaceted dimensions of the relationship between EI and academic performance. This novel perspective opens the door to further investigations to explore the relationship in other subjects and other dimensions to understand why students with higher EI have higher academic performance.

The progress test as a structuring initiative for programmatic assessment.

BACKGROUND: The Progress Test is an individual assessment applied to all students at the same time and on a regular basis. The test was structured in the medical undergraduate education of a conglomerate of schools to structure a programmatic assessment integrated into teaching. This paper presents the results of four serial applications of the progress test and the feedback method to students. METHODS: This assessment comprises 120 items offered online by means of a personal password. Items are authored by faculty, peer-reviewed, and approved by a committee of experts. The items are classified by five major areas, by topics used by the National Board of Medical Examiners and by medical specialties related to a national Unified Health System. The correction uses the Item Response Theory with analysis by the "Rasch" model that considers the difficulty of the item. RESULTS: Student participation increased along the four editions of the tests, considering the number of enrollments. The median performances increased in the comparisons among the sequential years in all tests, except for test1 - the first test offered to schools. Between subsequent years of education, 2nd-1st; 4th-3rd and 5th-4th there was an increase in median scores from progress tests 2 through 4. The final year of undergraduate showed a limited increase compared to the 5th year. There is a consistent increase in the median, although with fluctuations between the observed intervals. CONCLUSION: The progress test promoted the establishment of regular feedback among students, teachers and coordinators and paved the road to engagement much needed to construct an institutional programmatic assessment.

Pilot implementation of a telehealth course for health professions students.

OBJECTIVES: This study examined the level of technology proficiency amongst healthcare professions students. Additionally, the study provides an evaluation of the pilot implementation, as well as the effect of a 7-module telehealth course on the level of adoption and future use of telehealth amongst future Australian healthcare workforce. METHODS: Students from four health-sciences departments at the University of Melbourne, Australia, participated in this pilot study by completing the course and an online questionnaire, which included both structured and open-ended questions. The questionnaire included: 12-items on socio-demographic and Internet utilization; 34-items about acceptance and use of telehealth adapted from the Unified Theory of Acceptance and Use of Technology (UTAUT2) questionnaire; and 22-items about confidence in using the Internet and ICT, adapted from Technology Proficiency Self-Assessment Questionnaire for 21st Century Learning (TPSA-C-21). RESULTS: The evaluation included 26 students who expressed confidence in their Internet/ICT skills They showed enthusiasm for telehealth and recognized its potential benefits, but also emphasized the value of face-to-face interactions. They requested information on legal and aspects and additional learning. Post-test assessments indicated improvements in overall acceptance and use attitudes towards telehealth and on six dimensions of the UTAUT2 instrument. Participation in the course indicated improvements in students' overall acceptance and use attitudes and on six of the ten dimensions of the UTAUT2 instrument (p < 0.05). CONCLUSION: This preliminary evaluation indicated that the telehealth course was a positive and enjoyable learning experience for students with appropriate structure and information. The course was successful in improving students' acceptance and use of health technology. The study identified areas in which further development might be required. As such, the course represents a helpful approach for telehealth training among health professions students. Further evaluation with larger samples is required.

Application of AI-empowered scenario-based simulation teaching mode in cardiovascular disease education.

BACKGROUND: Cardiovascular diseases present a significant challenge in clinical practice due to their sudden onset and rapid progression. The management of these conditions necessitates cardiologists to possess strong clinical reasoning and individual competencies. The internship phase is crucial for medical students to transition from theory to practical application, with an emphasis on developing clinical thinking and skills. Despite the critical need for education on cardiovascular diseases, there is a noticeable gap in research regarding the utilization of artificial intelligence in clinical simulation teaching. OBJECTIVE: This study aims to evaluate the effect and influence of AI-empowered scenario-based simulation teaching mode in the teaching of cardiovascular diseases. METHODS: The study utilized a quasi-experimental research design and mixed-methods. The control group comprised 32 students using traditional teaching mode, while the experimental group included 34 students who were instructed on cardiovascular diseases using the AI-empowered scenario-based simulation teaching mode. Data collection included post-class tests, "Mini-CEX" assessments, Clinical critical thinking scale from both groups, and satisfaction surveys from experimental group. Qualitative data were gathered through semi-structured interviews. RESULTS: Research shows that compared with traditional teaching models, AI-empowered scenario-based simulation teaching mode significantly improve students' performance in many aspects. The theoretical knowledge scores(P < 0.001), clinical operation skills(P = 0.0416) and clinical critical thinking abilities of students(P < 0.001) in the experimental group were significantly improved. The satisfaction survey showed that students in the experimental group were more satisfied with the teaching scene(P = 0.008), Individual participation(P = 0.006) and teaching content(P = 0.009). There is no significant difference in course discussion, group cooperation and teaching style of teachers(P > 0.05). Additionally, the qualitative data from the interviews highlighted three themes: (1) Positive new learning experience, (2) Improved clinical critical thinking skills, and (3) Valuable suggestions and concerns for further improvement. CONCLUSION: The AI-empowered scenario simulation teaching Mode plays an important role in the improvement of clinical thinking and skills of medical undergraduates. This study believes that the AI-empowered scenario simulation teaching mode is an effective and feasible teaching model, which is worthy of promotion in other courses.

Translation and validation of the Persian version of the perception to care in acute situations (PCAS-P) scale in novice nurses.

BACKGROUND: Novice nurses providing care in acute conditions should have satisfactory performance. Accurate and appropriate evaluation of the performance of novice nurses in providing care in acute situations is essential for planning interventions to improve the quality of patient care. This study was conducted to translate and evaluate the psychometric properties of the Persian version of the Perception to Care in Acute Situations (PCAS-P) scale in novice nurses. METHODS: In this methodological study, 236 novice nurses were selected by the convenience sampling method. 17-item scale PCAS-P was translated into Persian by the forward-backward process. Then, this version was used for psychometric evaluation. For this purpose, face validity, content validity, and construct validity were assessed using confirmatory factor analysis. Internal consistency and stability reliability were calculated. The data were analyzed using SPSS and AMOS software. RESULTS: The PCAS-P scale maintained the meaning of the original English version and was clear, explicit, and understandable for novice nurses. Confirmatory factor analysis showed that this Persian version is consistent with the proposed model and confirmed the fit of the three-factor model. The values of Cronbach's alpha coefficient, McDonald's omega, Coefficient H, and average inter-item correlation were excellent for the overall scale and its dimensions, and the three latent factors had good convergent and discriminant validity. Additionally, the average measurement size was 0.944 ICC (95% CI 0.909 to 0.969). CONCLUSION: The PCAS-P scale is valid and reliable for measuring novice nurses' perception of acute situations.

Linking essay-writing tests using many-facet models and neural automated essay scoring.

For essay-writing tests, challenges arise when scores assigned to essays are influenced by the characteristics of raters, such as rater severity and consistency. Item response theory (IRT) models incorporating rater parameters have been developed to tackle this issue, exemplified by the many-facet Rasch models. These IRT models enable the estimation of examinees' abilities while accounting for the impact of rater characteristics, thereby enhancing the accuracy of ability measurement. However, difficulties can arise when different groups of examinees are evaluated by different sets of raters. In such cases, test linking is essential for unifying the scale of model parameters estimated for individual examinee-rater groups. Traditional test-linking methods typically require administrators to design groups in which either examinees or raters are partially shared. However, this is often impractical in real-world testing scenarios. To address this, we introduce a novel method for linking the parameters of IRT models with rater parameters that uses neural automated essay scoring technology. Our experimental results indicate that our method successfully accomplishes test linking with accuracy comparable to that of linear linking using few common examinees.

Using the Delphi method to develop a clinical skills assessment tool for advanced practice nurses in psychiatry and mental health / Élaboration d'un outil d'évaluation des compétences en stage des étudiants infirmiers en pratique avancée, mention psychiatrie et santé mentale à partir d'une méthode Delphi

Introduction: In France, advanced practice for psychiatric and mental health nurses has been developing since 2019. The acquisition of clinical skills by advanced practice nursing students requires monitoring and evaluation. This article outlines the process for creating an internship logbook. Objective: To develop and verify a tool for assessing the skills of advanced practice nursing students specializing in psychiatry and mental health during the internship stage. Method: The Delphi method described by Hasson was used, with the aim of obtaining a consensus of over 80% of the experts consulted. Results: A panel of ten experts, all internship tutors at partner healthcare establishments of Aix Marseille University, was consulted twice. The internship logbook was composed of 68 items. Discussion: This tool is the product of a multidisciplinary process including nurses and psychiatric nurses. It can be adapted to a variety of learning environments and helps tutors track the acquisition of clinical skills during the internships, both through external and self-assessment. Conclusion: A new Delphi consultation will foster uptake of this tool. Advanced practice nurses in psychiatry and mental health will be included in the group of experts.

Current Landscape of Surgical Assessment Models in Urology Residency Training.

PURPOSE: Assessing trainees' surgical proficiency is an important aspect of urological surgical training. The current standard is the Urology Milestone Project, initially implemented in 2013. This evaluation is limited in that it contains only 3 questions on surgical competency per surgical modality with assessments occurring semi-annually without real-time operative feedback. However, since the Urology Milestones Project's inception a plethora of competency-based surgical assessment tools have been described. We aim to perform a comprehensive review of the literature of these available tools and analyze their strengths and weaknesses as a way of providing a repository of available assessment strategies for further development of a more comprehensive and standardized assessment tool. MATERIALS AND METHODS: A review of the primary literature was performed using key words such as "surgical assessment tools urology," "surgical assessment tools prostate," "bladder surgical assessment tools," "renal surgical assessment tools urology," and "surgical assessment tools urology task specific." Technical and nontechnical skill assessments were included. One reviewer identified and analyzed studies that published assessment tools for use in surgical and urological training. RESULTS: A total of 1,497 articles published between 1997-2022 were identified. Of these, 34 met the inclusion criteria. Eighteen (52.9%) were specialty nonspecific and 16 (47.1%) were specific for urological training. Of the 18 tools developed for general surgical principles, 12 (66.7%) had some form of validity, 9 (50.0%) were significantly reliable, and 2 (11.1%) were externally validated. Of the 16 tools developed specifically for use in urology training, 13 (81.3%) had some form of validity, 7 (43.8%) were significantly reliable, and none were externally validated. Of these 16 tools, 12 (75.0%) were procedure-specific and 4 (25.0%) were developed for general use in endourological procedures. CONCLUSIONS: Surgical training is evolving toward a competency-based model, as evidenced by the increase in assessment tools created within the past 10 years. These instruments not only provide objective feedback to trainees, but also monitor progression. However, they are heterogeneous in construct and utilization. There remains a need for the adoption of a standardized, valid, and reliable tool, ie, both procedure-specific and generalizable across multiple procedures for use in urology training.

Communicating bad news to patients and families in African oncology settings.

AIMS: To assess clinicians' self-reported knowledge of current policies in African oncology settings, of their personal communication practices around sharing bad news with patients, and to identify barriers to the sharing of serious news in these settings. METHODS: A cross-sectional study of cancer care providers in African oncology settings (N = 125) was conducted. Factor analysis was used to assess cross-cultural adaptation and uptake of an evidence-based protocol for disclosing bad news to patients with cancer and of providers' perceived barriers to disclosing bad news to patients with cancer. Analysis of Various (ANOVA) was used to assess strength of association with each dimension of these two measurement models by various categorical variables. RESULTS: Providers from Nigeria, Kenya, Ghana, and Rwanda represented 85% of survey respondents. Two independent, psychometrically reliable, multi-dimensional measurement models were derived to assess providers' personal communication practices and providers' perceived barriers to disclosing a cancer diagnosis. Forty percent (40%) of respondent nurses but only 20% of respondent physicians had had formal communications skills training. Approximately 20%-25% of respondent physicians and nurses reported having a consistent plan or strategy for communicating bad news to their cancer patients. CONCLUSIONS: Results show that effective communication about cancer diagnosis and prognosis requires an appreciation and clinical skill set that blends an understanding of cancer-related internalized stigmas harbored by patient and family, dilemmas posed by treatment affordability, and the need to navigate family wishes about cancer-related diagnoses in the context of African oncology settings. Findings underscore the need for culturally grounded communications research and program design.

Bridging Validity Frameworks in Assessment: Beyond Traditional Approaches in Health Professions Education.

Construct: High-stakes assessments measure several constructs, such as knowledge, competencies, and skills. In this case, validity evidence for test scores' uses and interpretations is of utmost importance, because of the consequences for everyone involved in their development and implementation. Background: Educational assessment requires an appropriate understanding and use of validity frameworks; however, health professions educators still struggle with the conceptual challenges of validity, and frequently validity analyses have a narrow focus. Important obstacles are the plurality of validity frameworks and the difficulty of grounding these abstract concepts in practice. Approach: We reviewed the validity frameworks literature to identify the main elements of frequently used models (Messick and Kane's) and proposed linking frameworks including Russell's recent overarching proposal. Examples are provided with commonly used assessment instruments in health professions education. Findings: Several elements in these frameworks can be integrated into a common approach, matching and aligning Messick's sources of validity with Kane's four inference types. Conclusions: This proposal to contribute evidence for assessment inferences may provide guidance to understanding the use of validity evidence in applied settings. The evolving field of validity research provides opportunities for its integration and practical use in health professions education.

Educators as Judges: Applying Judicial Decision-Making Principles to High-Stakes Education Assessment Decisions.

Phenomenon: Programmatic assessment and competency-based education have highlighted the need to make robust high-stakes assessment decisions on learner performance from evidence of varying types and quality. Without guidance, lengthy deliberations by decision makers and competence committees can end inconclusively with unresolved concerns. These decisional dilemmas are heightened by their potential impacts. For learners, erroneous decisions may lead to an unjustified exit from a long-desired career, or premature promotion to clinical responsibilities. For educators, there is the risk of wrongful decision-making, leading to successful appeals and mistrust. For communities, ill-prepared graduates risk the quality and safety of care. Approaches such as psychometric analyses are limited when decision-makers are faced with seemingly contradictory qualitative and quantitative evidence about the same individual. Expertise in using such evidence to make fair and defensible decisions is well established in judicial practice but is yet to be practically applied to assessment decision-making. Approach: Through interdisciplinary exchange, we investigated medical education and judicial perspectives on decision-making to explore whether principles of decision-making in law could be applied to educational assessment decision-making. Using Dialogic Inquiry, an iterative process of scholarly and mutual critique, we contrasted assessment decision making in medical education with judicial practice to identify key principles in judicial decision-making relevant to educational assessment decisions. We developed vignettes about common but problematic high-stakes decision-making scenarios to test how these principles could apply. Findings: Over 14 sessions, we identified, described, and applied four principles for fair, reasonable, and transparent assessment decision-making. These were: The person whose interests are affected has a right to know the case against them, and to be heard.Reasons for the decision should be given.Rules should be transparent and consistently applied.Like cases should be treated alike and unlike cases treated differently.Reflecting our dialogic process, we report findings by separately presenting the medical educator and judicial perspectives, followed by a synthesis describing a preferred approach to decision-making in three vignettes. Insights: Judicial principles remind educators to consider both sides of arguments, to be consistent, and to demonstrate transparency when making assessment decisions. Dialogic Inquiry is a useful approach for generating interdisciplinary insights on challenges in medical education by critiquing difference (e.g., the meaning of objectivity) and achieving synthesis where possible (e.g., fairness is not equal treatment of all cases). Our principles and exemplars provide groundwork for promoting good practice and furthering assessment research toward fairer and more robust decisions that will assist learning.

Adolescent Cannabis Misuse Scale: Longitudinal Associations with Substance Use, Mental Health, and Social Determinants of Health in Early Adulthood.

BACKGROUND: Some patterns of cannabis use may presage risk for long-term negative effects. We examined associations between a novel adolescent cannabis misuse scale and early-adult life course outcomes. METHODS: We performed a secondary data analysis of a cohort of Los Angeles, CA high school students from grade 9 through age 21. Participants reported baseline individual demographic and family characteristics at grade 9, adolescent cannabis misuse (8-items) and alcohol misuse (12-items) at grade 10, and outcomes at age 21. We used multivariable regression to model the associations of cannabis misuse scale score with problem substance use (defined as any of: 30-day illegal drug use, 30-day use of another's prescription to get high, hazardous drinking) and several secondary outcomes (behavioral, mental health, academic, social determinants of health), adjusting for covariates. Parallel analyses were conducted for alcohol misuse. RESULTS: The 1,148 participants (86% retention) were 47% male, 90% Latinx, 87% US born, and 40% native English speakers. Approximately 11.4% and 15.9% of participants reported at least one item on the cannabis and alcohol misuse scales, respectively. At age 21, approximately 6.7% of participants reported problem substance use, which was associated with both Cannabis and Alcohol Misuse Scales (OR 1.31, 95%CI[1.16, 1.49] and OR 1.33, 95%CI[1.18, 1.49], respectively). Both scales were similarly associated with outcomes in all four categories. CONCLUSIONS: The Adolescent Cannabis Misuse Scale is a promising tool for identifying early patterns of substance use that predict future negative outcomes and enabling early intervention at a critical period in youth development.

Remote vs. face-to-face activities in the teaching of renal pathophysiology in the context of social isolation during the early phase of the COVID-19 pandemic.

The advent of the COVID-19 pandemic forced medical schools around the world to adopt emergency remote learning as a resort to avoid interruption of courses. However, the effectiveness of online classes as an educational strategy has been questioned by medical educators and students. In a prospective observational study design, students enrolled in a renal physiology and pathophysiology course were exposed to either face-to-face or remote synchronous classes. Students taught online obtained significantly higher mean scores than the group who had in-person classes, both groups assessed with identical exams. Appropriate screening tests suggested that fraud is unlikely to have significantly influenced these results and that the observed differences in performance reflected increased learning by the remote group. These observations suggest that online classes can help to maintain the continuity of physiology and pathophysiology courses during periods of social isolation and may contribute to improving learning under normal conditions.NEW & NOTEWORTHY In this study, we were able to make a rare direct comparison of face-to-face and remote strategies for the teaching of undergraduate medical students in a specific area, namely, renal pathophysiology. Unexpectedly, students who attended the remote course had significantly higher grades than those who had mostly in-person classes.

Adaptation of the professionalism mini-evaluation exercise instrument into Turkish: a validity and reliability study.

BACKGROUND: There is an ongoing search for standardized scales appropriate for each culture to evaluate professionalism, which is one of the basic competencies of a physician. The Professionalism Mini-evaluation Exercise (P-MEX) instrument was originally developed in Canada to meet this need. In this study, it was aimed to adapt the P-MEX to Turkish and to evaluate the validity and reliability of the Turkish version. METHODS: A total of 58 residents at Bakirkoy Dr. Sadi Konuk Training and Research Hospital were assessed with the Turkish version of P-MEX by 24 raters consisting of faculty members, attending physicians, peer residents, and nurses during patient room visits, outpatient clinic and group practices. For construct validity, the confirmatory factor analysis was performed. For reliability, Cronbach's alpha scores were calculated. Generalizibility and decision studies were undertaken to predict the reliability of the validated tool under different conditions. After the administration of P-MEX was completed, the participants were asked to provide feedback on the acceptability, feasibility, and educational impact of the instrument. RESULTS: A total of 696 forms were obtained from the administration of P-MEX. The content validity of P-MEX was found to be appropriate by the faculty members. In the confirmatory factor analysis of the original structure of the 24-item Turkish scale, the goodness-of-fit parameters were calculated as follows: CFI = 0.675, TLI = 0.604, and RMSEA = 0.089. In the second stage, the factors on which the items loaded were changed without removing any item, and the model was modified. For the modified model, the CFI, TLI, and RMSEA values were calculated as 0.857, 0.834, and 0.057, respectively. The decision study on the results obtained from the use of P-MEX in a Turkish population revealed the necessity to perform this evaluation 18 times to correctly evaluate professionalism with this instrument. Cronbach's alpha score was 0.844. All the faculty members provided positive feedback on the acceptability, feasibility, and educational impact of the adapted P-MEX. CONCLUSION: The findings of this study showed that the Turkish version of P-MEX had sufficient validity and reliability in assessing professionalism among residents. Similarly, the acceptability and feasibility of the instrument were found to be high, and it had a positive impact on education. TRIAL REGISTRATION: 2020/249, Bakirkoy Dr. Sadi Konuk Training and Research Hospital.

The effectiveness of simulation-based education combined with peer-assisted learning on clinical performance of first-year medical residents: a case-control study.

BACKGROUND: Simulation-based education and peer-assisted learning (PAL) are both known as useful educational methods. Previous research has reported that combining these two methods are effective for training medical residents in short-term evaluation. This study was aimed to evaluate the middle- to long-term effects of simulation-based education combined with PAL on the performance of medical residents during emergency department duties. METHODS: This study was designed as a case-control study and conducted over three years at Okayama University Hospital in Japan. Postgraduate-year-one medical residents were assigned to three groups: a simulation group that received simulation-based education, a lecture group that received traditional lecture-based education, and a control group that received no such prior trainings. Prior training in emergency department duties using PAL was performed as an educational intervention for the simulation and lecture groups during the clinical orientation period. The residents' medical knowledge was assessed by written examinations before and after the orientation. The performance of residents during their emergency department duties was assessed by self-evaluation questionnaires and objective-assessment checklists, following up with the residents for three months after the orientation period and collecting data on their 1st, 2nd, and 3rd emergency department duties. All the datasets collected were statistically analyzed and compared by their mean values among the three groups. RESULTS: A total of 75 residents were included in the comparative study: 27 in the simulation group, 24 in the lecture group, and 24 in the control group. The simulation and lecture groups obtained significantly higher written examination scores than the control group. From the self-evaluation questionnaires, the simulation group reported significantly higher satisfaction in their prior training than the lecture group. No significant differences were found in the emergency department performance of the residents among the three groups. However, when evaluating the improvement rate of performance over time, all three groups showed improvement in the subjective evaluation, and only the simulation and lecture groups showed improvement in the objective evaluation. CONCLUSION: Simulation-based education combined with PAL is effective in improving the knowledge and satisfaction of medical residents, suggesting the possibility of improving work performance during their emergency department duties.

Effectiveness of a question formulation rubric with second-year medical students: a randomized controlled trial.

Objective: The FAC (Focus, Amplify, Compose) rubric for assessing medical students' question formulation skills normally accompanies our Evidence Based Practice (EBP) training. The combined training and assessment rubric have improved student scores significantly. How much does the rubric itself contribute to improved student scores? This study sought to measure student improvement using the rubric either with or without a linked 25-minute training session. Methods: Randomized Controlled Trial. The authors tested the hypothesis that a 25-minute training session combined with use of a rubric would lead to higher scores than a brief explanation of this rubric alone. All 72 participating second-year medical students had a question formulation rubric briefly explained to them following a pre-test. Students in the intervention groups were taught how to formulate EBP questions for 25 minutes using the rubric followed with another 30 minutes of EBP search training. Students in the control group only received the 30 minutes of EBP search training in their small group labs. All 72 students took the post-test in which they formulated a question in response to a clinical vignette. Statistical analysis to test the hypothesis consisted of a two-sample paired t-test to measure between-group differences. Discussion: Both the intervention and control groups performed significantly better on the post-test for question formulation skills than on the pre-test. When analyzed by extent of individual improvement between pre- and post-tests using a two-sample paired t-test for between group differences, the control group students receiving only a brief explanation of the rubric performed the same statistically (intervention 37.7 versus 37.4 control) as the intervention group students who received the same brief explanation followed by a 25-minute active learning training session. Thus, the results provided no support of the hypothesis that the extra 25-minute training improved post-test scores. The rubric itself contributed similarly to the intervention groups students' improvement as the combined rubric and training for control group students. This finding could potentially save scarce curricular time. Key Messages: The FAC question formulation rubric and training significantly improves medical students' EBP question quality. The FAC rubric coupled with only a 5-minute explanation can be effective. In a crowded medical school curriculum, the rubric and brief explanation might save valued time for other purposes.