Analysis of ChatGPT Responses to Ophthalmic Cases: Can ChatGPT Think like an Ophthalmologist?

Objective: Large language models such as ChatGPT have demonstrated significant potential in question-answering within ophthalmology, but there is a paucity of literature evaluating its ability to generate clinical assessments and discussions. The objectives of this study were to (1) assess the accuracy of assessment and plans generated by ChatGPT and (2) evaluate ophthalmologists' abilities to distinguish between responses generated by clinicians versus ChatGPT. Design: Cross-sectional mixed-methods study. Subjects: Sixteen ophthalmologists from a single academic center, of which 10 were board-eligible and 6 were board-certified, were recruited to participate in this study. Methods: Prompt engineering was used to ensure ChatGPT output discussions in the style of the ophthalmologist author of the Medical College of Wisconsin Ophthalmic Case Studies. Cases where ChatGPT accurately identified the primary diagnoses were included and then paired. Masked human-generated and ChatGPT-generated discussions were sent to participating ophthalmologists to identify the author of the discussions. Response confidence was assessed using a 5-point Likert scale score, and subjective feedback was manually reviewed. Main Outcome Measures: Accuracy of ophthalmologist identification of discussion author, as well as subjective perceptions of human-generated versus ChatGPT-generated discussions. Results: Overall, ChatGPT correctly identified the primary diagnosis in 15 of 17 (88.2%) cases. Two cases were excluded from the paired comparison due to hallucinations or fabrications of nonuser-provided data. Ophthalmologists correctly identified the author in 77.9% ± 26.6% of the 13 included cases, with a mean Likert scale confidence rating of 3.6 ± 1.0. No significant differences in performance or confidence were found between board-certified and board-eligible ophthalmologists. Subjectively, ophthalmologists found that discussions written by ChatGPT tended to have more generic responses, irrelevant information, hallucinated more frequently, and had distinct syntactic patterns (all P < 0.01). Conclusions: Large language models have the potential to synthesize clinical data and generate ophthalmic discussions. While these findings have exciting implications for artificial intelligence-assisted health care delivery, more rigorous real-world evaluation of these models is necessary before clinical deployment. Financial Disclosures: The author(s) have no proprietary or commercial interest in any materials discussed in this article.

Você está pensando, refletindo, analisando o que você vê e o que você faz o tempo todo: percepção de residentes de Medicina de Família e Comunidade sobre vídeo feedback / You are thinking, reflecting, analysing what you see and what you do all the time: perception of General Practice trainees about video feedback / Estás pensando, reflexionando, analizando lo que ves y lo que haces todo el tiempo: percepción de los residentes de Medicina Familiar y Comunitaria sobre vídeo feedback

Introdução: A comunicação é reconhecida como uma habilidade central por vários órgãos reguladores internacionais da educação médica. O ensino específico de habilidades de comunicação é fundamental para melhorar a comunicação dos médicos. As técnicas experienciais mostraram superioridade em comparação com os modelos tradicionais. A utilização de consultas reais ajuda os estudantes a visualizar melhor as suas competências de entrevista e a refletir sobre elas. Com os avanços da tecnologia, o uso de consultas médicas gravadas em vídeo tornou-se a abordagem padrão para o ensino da comunicação. No entanto, a eficácia dessa técnica depende do envolvimento ativo dos estudantes. As suas contribuições e comentários dos pares sobre a consulta gravada são essenciais para a aprendizagem. Contudo, a perspectiva do estudante sobre a utilidade dessa abordagem educativa recebeu pouca atenção. Objetivos: Compreender a percepção da aprendizagem dos residentes de medicina de família e comunidade resultante da atividade de vídeo feedback na sua formação profissional. Métodos: Estudo exploratório, qualitativo, realizado com residentes do primeiro ano de medicina de família e comunidade de um programa de residência estabelecido em São Paulo, Brasil. Os participantes foram entrevistados após as sessões educativas, que foram analisadas por meio de análise temática reflexiva. Resultados: A autopercepção de sua prática, o aprendizado de habilidades de comunicação e os ganhos afetivos foram identificados pelos participantes como pontos de aprendizado derivados da atividade de vídeo feedback. Além disso, sobre o aprendizado de habilidades específicas de comunicação, eles mencionaram comunicação não-verbal e verbal, conexões entre teoria e prática, estrutura de consulta e oportunidades para cristalizar conhecimentos. Os ganhos afetivos incluíram sentir-se parte de um grupo, melhora da autoestima, superação de inseguranças, percepção de consultas mais efetivas, reforço do gosto pelo trabalho e reconhecer a necessidade de mais aprendizado. Conclusões: Os ganhos de aprendizagem identificados em nosso estudo levaram a uma experiência de humanidade compartilhada, que permite aos participantes serem mais efetivos técnica e afetivamente com seus pacientes. Além disso, identificamos que a atividade educativa de vídeo feedback pode ser utilizada para outros possíveis fins educacionais além do ensino da comunicação.

Introduction: Communication is recognized as a central skill by various international medical education regulatory bodies. Specific teaching on communication skills is important to enhance doctors' communication. Experiential techniques appear to be superior compared to traditional models. Real-life consultation helps trainees visualize their interview skills and reflect on them. Upgraded by technology, the use of video-recorded medical visits became the standard approach for communication teaching. However, the effectiveness pf this technique relies on trainees' active involvement. Their inputs and peer feedback on the recorded consultation are essential to learning. Despite its importance, their perspective on the usefulness of video feedback in medical education has received limited attention. Objective: To understand the perception of learning among general practice trainees as a result of the video feedback activity in their vocational training. Methods: An exploratory, qualitative study, conducted with first-year general practice trainees from an established training program in São Paulo, Brazil. Participants were interviewed after educational session, which were analyzed using reflexive thematic analysis. Results: Self-perception of their practice, communication skills learning, and affective gains were identified by participants as learning points derived from the video feedback activity. Furthermore, for specific communication skills learning, they mentioned nonverbal and verbal communication, theory and practice connections, consultation structure and opportunities for crystallizing knowledge. Affective gains included feeling part of a group, improving self-esteem, overcoming insecurities, perception of more effective consultations, reinforcing fondness for their work, and need for more learning. Conclusions: The learning gains identified in our study led to an experience of common humanity, which allowed participants to be more technically and affectively effective with their patients. Also, we identified that the video feedback educational activity can be used for other possible educational purposes, beyond the teaching of communication.

Introducción: La comunicación es reconocida como una habilidad fundamental por varios organismos reguladores internacionales de educación médica. La enseñanza específica de habilidades de comunicación es importante para mejorar la comunicación de los médicos. Las técnicas experienciales parecen ser superiores a los modelos tradicionales. El uso de consultas reales ayuda a los estudiantes a visualizar y reflexionar mejor sobre sus habilidades de entrevista. Actualizado por la tecnología, el uso de consultas médicas grabadas en video se ha convertido en el enfoque estándar para la enseñanza de la comunicación. Sin embargo, para que la técnica funcione, la participación de los estudiantes es crucial. Sus contribuciones y comentarios de los compañeros sobre la consulta grabada son esenciales para el aprendizaje. Sin embargo, la perspectiva de los estudiantes sobre la utilidad de este enfoque educativo ha recibido poca atención. Objetivos: Comprender la percepción del aprendizaje por parte de los residentes de medicina de familia y comunitaria como resultado de la actividad de vídeo feedback en su formación profesional. Métodos: Estudio cualitativo exploratorio realizado con residentes de primer año de medicina familiar y comunitaria de un programa de residencia establecido en São Paulo, Brasil. Los participantes fueron entrevistados después de una sesión educativa, que fueron analizados mediante análisis temático reflexivo. Resultados: La autopercepción de su práctica, el aprendizaje de habilidades comunicativas y las ganancias afectivas fueron identificadas por los participantes como puntos de aprendizaje derivados de la actividad de vídeo feedback. Además, sobre el aprendizaje de habilidades comunicativas específicas, mencionaron la comunicación verbal y no verbal, las conexiones entre la teoría y la práctica, la estructura de consulta y las oportunidades para cristalizar conocimientos. En cuanto a las ganancias afectivas, relataron sentirse parte de un grupo, mejora de la autoestima, superación de las inseguridades, percepción de consultas más efectivas, refuerzo del gusto por el trabajo y necesidad de más aprendizaje. Conclusión: Los logros de aprendizaje identificados en nuestro estudio llevaron a una experiencia de humanidad compartida, que permite a los participantes ser técnica y afectivamente más efectivos con sus pacientes. Además, identificamos que la actividad educativa de vídeo feedback puede ser utilizada para otros posibles fines educativos, además de la enseñanza de la comunicación.

Aprendizagem baseada em projeto e a formação médica: relato de experiência introduzindo questões para o debate interprofissional / Project-based learning and medical education: experience report introducing issues for interprofessional debate / El aprendizaje basado en proyecto y la formación médica: informe de experiencia que introduce cuestiones para el debate interprofesional

A aprendizagem baseada em projeto orientada pelos fundamentos da educação interprofissional é um modelo que pode contribuir para a formação de relacionamentos interpessoais, criatividade, empatia e colaboração na educação médica, por meio de uma colaboração mútua com profissionais de saúde da rede. Muito se fala da efetividade desse método no campo do ensino e aprendizagem médica, mas há a necessidade de incluir a importância do desenvolvimento de habilidades interprofissionais, com equipes colaborativas, em ações extensionistas, diante das necessidades locais no contexto da atenção primária, pensando na melhoria dos resultados de saúde. O objetivo deste trabalho é apresentar um relato de experiência de aprendizagem baseada em projeto de estudantes de Medicina no contexto da Estratégia Saúde da Família. Participaram deste trabalho estudantes do Módulo Integração Ensino, Serviço e Comunidade da Faculdade de Medicina da Universidade Federal dos Vales do Jequitinhonha e Mucuri que executaram, em colaboração com uma equipe interprofissional o projeto sobre a saúde do homem. Como resultado da análise qualitativa do feedback entre os integrantes, observaram-se mudanças no comportamento dos estudantes, com melhorias na comunicação, empatia e nas relações interpessoais, por meio do trabalho colaborativo com a equipe interprofissional. Esta experiência poderá ser adaptada para implementar o ensino e aprendizagem no projeto pedagógico orientado pela educação interprofissional na atenção primária.

Project-based learning guided by the fundamentals of interprofessional education is a model that can contribute to the formation of interpersonal relationships, creativity, empathy and collaboration within medical education, through mutual collaboration with health professionals in the health network. Much has been said about the effectiveness of this method in medical teaching and learning, but there is a need to include the importance of developing interprofessional skills, with collaborative teams, within extension actions, in view of local needs in the context of primary care, thinking about the improved health outcomes. The objective of this work was to present a report of a project-based learning experience of medical students in Family Health Strategy. Students from the Teaching, Service and Community Integration Module of the Faculty of Medicine of Universidade Federal dos Vales do Jequitinhonha e Mucuri participated in this work, executing in collaboration with an interprofessional team a project about men's health. As a result of the qualitative analysis of the feedback among the members, changes in student behavior were observed with improvements in communication, empathy and interpersonal relationships through collaborative work with the interprofessional team. This experience can be adapted to implement teaching and learning in the pedagogical project guided by interprofessional education in primary care.

El aprendizaje basado en proyectos y guiado por los fundamentos de la educación interprofesional es un modelo que puede contribuir a la formación de relaciones interpersonales, creatividad, empatía y colaboración dentro de la educación médica, a través de la colaboración mutua con los profesionales de la salud en la red de salud. Mucho se habla de la efectividad de este método dentro de la enseñanza y el aprendizaje médico, pero es necesario incluir la importancia del desarrollo de habilidades interprofesionales, con equipos colaborativos, dentro de las acciones de extensión, frente a las necesidades locales en el contexto de la atención primaria, pensando sobre los mejores resultados de salud. El objetivo de este trabajo es presentar un informe de experiencia de aprendizaje basado en proyectos de estudiantes de medicina en la Estrategia de Salud Familiar. Participaron en este trabajo estudiantes del Módulo Integración Enseñanza, Servicio y Comunidad de la Facultad de Medicina de la Universidade Federal dos Vales do Jequitinhonha e Mucuri que ejecutaron en colaboración con un equipo interprofesional el proyecto sobre la salud del hombre. Como resultado del análisis cualitativo de la retroalimentación entre los integrantes, se observaron cambios en el comportamiento de los estudiantes con mejoras en la comunicación, la empatía y las relaciones interpersonales a través del trabajo colaborativo con el equipo interprofesional. Esta experiencia puede adaptarse para implementar la enseñanza y el aprendizaje en el proyecto pedagógico guiado por la educación interprofesional en atención primaria.

Medical faculty's perception of students' mental health: a qualitative survey study / Percepción de los profesores de medicina sobre la salud mental de los estudiantes: un estudio cualitativo / Percepção dos docentes de medicina sobre a saúde mental dos estudantes: um estudo qualitativo

This study sought to explore the perspective of medical faculty on the mental health of their students. This qualitative study based on a focus group is part of a longitudinal research that studied the mental health of Brazilian students. One group was conducted with faculty employed at a medical school. Topics discussed covered the concept of mental health and medical education. Six professors participated in one group. The mental health of medical students is a construct that encompasses emotional aspects, ability to solve problems and multiple facets of a human being, according to the participants. Artistic practices, moments of socialization and leisure were perceived as stimulating students' good mental health. Excessive demands generate competitiveness and the teacher's expectation of the student's good performance based on their own experience can harm the student's mental health. Participants also highlighted that a pedagogical reformulation that makes sense for the student's learning process is necessary to update traditional curricula. Medical students' mental health is influenced by experiences and exchanges during the medical school, mainly between professor and student, understood as necessary and inherent to the process of becoming physician. The findings of this study show the need for curriculum changes in the medical education process and updating teacher training for good practices that reinforce good mental health.

Este estudio buscó explorar la perspectiva de los profesores de medicina sobre la salud mental de sus estudiantes. Este estudio cualitativo basado en un grupo focal es parte de una investigación longitudinal que estudió la salud mental de estudiantes brasileños. Un grupo se llevó a cabo con profesores empleados en una escuela de medicina. Los temas tratados abarcaron el concepto de salud mental y educación médica. Seis docentes participaron en un grupo. La salud mental de los estudiantes de medicina es un constructo que abarca aspectos emocionales, capacidad de resolución de problemas y múltiples facetas del ser humano, según los participantes. Las prácticas artísticas, los momentos de socialización y el ocio fueron percibidos como estimulantes de la buena salud mental de los estudiantes. Las exigencias excesivas generan competitividad y la expectativa del docente sobre el buen desempeño del estudiante basándose en su propia experiencia puede perjudicar la salud mental del estudiante. Los participantes también resaltaron que es necesaria una reformulación pedagógica que tenga sentido para el proceso de aprendizaje del estudiante para actualizar los currículos tradicionales. La salud mental de los estudiantes de medicina está influenciada por las experiencias y los intercambios durante la carrera de medicina, principalmente entre profesor y estudiante, entendidos como necesarios e inherentes al proceso de convertirse en médico. Los hallazgos de este estudio muestran la necesidad de cambios curriculares en el proceso de formación médica y de actualización de la formación docente hacia buenas prácticas que refuercen la buena salud mental.

Este estudo buscou explorar a perspectiva dos docentes de medicina sobre a saúde mental de seus alunos. Este estudo qualitativo baseado em grupo focal faz parte de uma pesquisa longitudinal que estudou a saúde mental de estudantes brasileiros. Um grupo foi conduzido com professores empregados em uma faculdade de medicina. Os temas discutidos abrangeram o conceito de saúde mental e educação médica. Seis professores participaram de um grupo. A saúde mental dos estudantes de medicina é um construto que engloba aspectos emocionais, capacidade de resolução de problemas e múltiplas facetas do ser humano, segundo os participantes. As práticas artísticas, os momentos de socialização e de lazer foram percebidos como estimuladores da boa saúde mental dos estudantes. Exigências excessivas geram competitividade e a expectativa do professor pelo bom desempenho do aluno com base na própria experiência pode prejudicar a saúde mental do aluno. Os participantes destacaram também que é necessária uma reformulação pedagógica que faça sentido para o processo de aprendizagem do aluno para atualizar os currículos tradicionais. A saúde mental dos estudantes de medicina é influenciada pelas experiências e trocas durante o curso de medicina, principalmente entre professor e aluno, entendidas como necessárias e inerentes ao processo de tornar-se médico. Os achados deste estudo mostram a necessidade de mudanças curriculares no processo de formação médica e de atualização da formação docente para boas práticas que reforcem a boa saúde mental.

Out-BREAK!: An IDWeek 2023 Escape Room to Break Out of the Educational Mold.

Background: An escape room is a cooperative game that has been adapted into medical education and major academic conferences. Methods: We describe the design, development, and implementation of an educational ID-themed escape room activity entitled "Out-BREAK!" at an international conference, IDWeek 2023. An anonymous survey was conducted to collect demographic data, assess participant satisfaction with the escape room puzzles, and gauge participant interest in game-based learning. Results: Thirty escape room sessions were held over 3 days and included 201 participants. Escape room survey respondents (n = 132) were younger and more likely to be trainees compared with in-person IDWeek attendants. Among 131 responses, all respondents enjoyed the experience and would recommend the escape room activity to friends. Survey respondents enjoyed the puzzle solving (93%), medical content (92%), and team building (79%) components. Only 35% of the respondents had ever previously participated in game-based learning; 95% thought the escape room was a valuable teaching method. Among the 72 survey respondents involved in medical education, almost all (90%) said they were interested in incorporating escape rooms into medical education. Conclusions: The Out-BREAK! escape room at IDWeek 2023 was successfully implemented and well received. Despite only a third of participants having prior experience with game-based learning, almost all respondents perceived the escape room to be an effective teaching method.

Benefits and Drawbacks of International Medical Elective Databases in Abroad Elective Research: A Narrative Review.

Background: International medical electives (IMEs) are considered high-impact practice in global health education. Nevertheless, international medical elective (IME) research remains scarce, with only a few new publications appearing each year. The discrepancy between the many unanswered questions regarding IMEs and the lack of opportunities to perform research in this field has been further aggravated by the COVID-19 pandemic. Elective databases cataloguing structured IME reports/testimonies could offer a viable solution here. This narrative review provides a balanced and objective evaluation of the strengths and weaknesses of elective databases, summarizing their potential usefulness in IME research. Methods: The methodology employed was a multidisciplinary narrative review of the published and grey literature on databases cataloguing IME testimonies. Results: Elective databases offer numerous benefits to the IME researcher. Their size allows for large analyses, built on hundreds of equally structured elective testimonies. Pre-defined outcomes, such as the elective destination, elective discipline or duration, are queried in a standardized way, allowing for a broad set of research questions. Elective databases are usually open-access, not confined to a single university, and free to use. Most databases also offer user-friendly filter functions, permitting targeted analyses centered around a particular outcome. A major drawback is that reports are rarely verified. Subject to several forms of bias (eg, recall and reporting bias), elective databases may not be suitable for all types of research questions, and the report quality is often inhomogeneous. Above all, they rarely allow for an informational depth that may result from qualitative face-to-face interviews. Conclusion: Elective databases could be a valuable supplement to interview-based elective research, potentially allowing for larger and broader analyses not confined to single institutions.

Impact of a Nutrition and Diabetes Continuing Education Program on Primary Care Provider's Knowledge, Attitude, and Clinical Practice.

Purpose: Diet/nutrition is the first-line non-pharmacological therapy in the treatment of diabetes. Diet/nutrition counseling is infrequently provided by primary care providers (PCPs), who have limited nutrition education in both medical and advanced practice provider curricula. This quality improvement project aimed to improve knowledge and attitude, and frequency of diet/nutrition counseling by PCPs among patients with uncontrolled diabetes (glycosylated hemoglobin A1c ≥8%), by providing an online continuing medical education (CME) program on diabetes diet/nutrition. Methods: At a community health center in New England, PCPs attended a live 50-minute online CME program that was developed internally, which taught PCPs current diet/nutrition guidelines and recommendations related to diabetes. Knowledge was assessed prior to and two weeks following the program, utilizing a 10-question tool, the Nutrition Management of Diabetes Assessment (NMDA). Similarly, attitude was evaluated using two subscales of the Nutrition in Patient Care Survey (NIPS): Nutrition in routine care and Physician efficacy. Chart audits of patients with uncontrolled diabetes were evaluated to assess PCPs documentation of diet/nutrition counseling four weeks prior to and six weeks following the CME program. Results: In September 2023, PCPs (n = 29) completed the CME program. There was an improvement in knowledge in the NMDA amongst PCPs (36% difference, p < 0.001). Attitude scores from two subscales of the NIPS were evaluated and both showed improvement, however only physician efficacy was significant (15% difference, p < 0.01). There was a positive difference in the trend of diet/nutrition counseling after the education program (p < 0.05). Conclusion: An online CME program improved diabetes diet/nutrition knowledge and attitude of PCPs and improved counseling practices for patients living with uncontrolled diabetes. The education program provided PCPs current standards of care guidelines/recommendations, which they can utilize when counseling patients with diabetes. PCPs would benefit from dedicated continuing education programs regarding diet/nutrition therapy for chronic illnesses.

Academic Health System Framework for Health Services Transformation: A Perspective View from West Java, Indonesia.

Although the field of medicine has made significant progress in recent decades, low and middle-income countries continue to face significant difficulties in addressing the unprecedented obstacles to improving health. Medical schools should play a critical role in driving health services reform and take on a new leadership role in strengthening the health system. This paper discusses a conceptual framework and outlines the Academic Health Systems (AHS) agenda in Indonesia. A comprehensive analysis was conducted on the existing literature and frameworks regarding AHS, applying the system thinking method, which engages stakeholders actively. The findings and interpretations from interviews, focus groups, and collaborative workshops were consolidated and a set of proposed frameworks, fundamental principles, and a route for enhancing the health system in Indonesia were put forward. Our recommendations include transformative learning, community engagement, and translational research as pillar principles of AHS program. These recommendations have the potential to be modified and implemented in other low- and middle-income countries.

Subjective learning gain from a simulation-based health management course: a mixed methods study.

Objectives: Simulations are increasingly being offered as part of the educational experience of healthcare students. We used a Health Management Scenario Simulation system to create a course. This study aimed to evaluate learning gains before and after the course. Methods: Based on the learning strategies of framing, simulation, and debriefing, the Health Management Scenario Simulation course lasted 4 weeks and was conducted online. Learning gain was assessed using a comparative self-assessment questionnaire administered electronically at the beginning and end of the course. We organized focus group interviews and collected quantitative data after students completed the simulations and the questionnaire. These data were subjected to descriptive statistical analysis and thematic grouping using frequency counting. Results: There were 195 health management students enrolled in the course. In total, 265 anonymously completed questionnaires were received, 141 (72.31%) on the pre-simulation and 124 (63.59%) on the post-simulation. All questionnaire item gain values were positive, except the item "I can identify common health risk factors," which showed no change. The skills domain showed the highest learning gain, ranging from 16 to 22%. Six students participated in the focus-group study. The main themes that emerged from students' reflections were learner-centeredness, competencies, and career development. Conclusion: Students acquired health management skills through the simulation, which contributed to the development of basic attitudes and skills in their professional careers. Students' comments highlighted the value of practicing health management skills in a simulated environment.

Recommendations for reviewing manuscripts of the article types "project report" and "how to" for the GMS Journal for Medical Education.

Objective: This position paper of the Committee on Methodology in Educational Research sets out the criteria for the acceptance, revision, or rejection of manuscripts of the article types project report and how to in the GMS Journal for Medical Education, as well as outlining the development of these criteria. Methods: In a workshop with writers, reviewers, and editors, we formulated and discussed common core elements for articles. We did this by consulting the journal's editorial board on the basis of guidelines for authors and reviewers from other journals and by using examples of articles considered less or more successful. From this, we derived specific aspects to be addressed and rejection criteria for the respective article types. Results: We have identified the target group, relevance, justification, and implication as the common core elements for both article types. We have also derived specific aspects to be addressed and rejection criteria from these core elements for each article type. Conclusion: A manuscript lacking core elements will be rejected. If aspects are not described sufficiently or are not clearly comprehensible, the manuscript must be revised.

Self-directed learning in post-graduate medical education: Self-judgement and supervisor judgement of competence development in Austrian nine-month basic training.

Background: Self-directed learning in the workplace should lead to the mastery of predefined learning objectives, with subjective competence judgements steering learning and promoting acceptance of feedback. Rotations should support self-directed learning in basic training by allowing junior physicians (JPs) to apply basic clinical competencies in various internal medicine and surgical departments. Aim: The study hypothesises that rotations support self-directed learning, as measured by self-judgements and supervisor judgements. Additionally, it describes JPs' willingness to reflect on their learning needs at the end of their basic training. Methods: This longitudinal study comprises 147 pseudonymised logbooks completed by JPs from three Vienna healthcare group (WIGEV) clinics. The logbook accompanies JPs' training, requiring them and their supervising specialist physicians to rate their training goal completion (10-level % scale) in training months 2, 3, 5, 6, 8 and 9. In addition, in months 3, 6 and 9, the JPs document the level of competence (knowledge, experience and proficiency) they feel they have achieved for each learning objective specified by the Austrian medical association (ÖÄK). Results: The self-judged level of training goal completion demonstrates a multi-peaked distribution with an increasing trend; the supervisors' judgement of JPs' level of training goal completion is almost parallel. The share of learning objectives where the required level of competence is seen as not yet mastered decreases throughout the training. In the 9th month of training, approximately » of the JPs indicated a need to learn in ≥10% of the learning objectives, independent of the training clinic. Conclusions: After switching departments, JPs downgraded their rating of training goal completion. Rotation supports realistic self-judgement, as competencies must be applied and reassessed in a new context. Most JPs consider the required level of competence per learning objective to be mastered at the end of basic training, yet they remain prepared to reflect critically on their learning needs.

Insights into the meaning of medical students' studies. An online survey at two medical faculties.

Objective: The aim of the study was to investigate how medical students' deal with their own questions of meaning during their studies, how they cope with patients' questions of meaning or crises of meaning, to what extent their experience of meaning changes during their studies, and what role medical studies play in this. Methods: In 2022, we conducted an exploratory cross-sectional study in the form of an online survey at two German universities with students in the clinical part of their studies. Quantitative data were analyzed descriptively, and group differences were analyzed using Mann-Whitney U tests. Free-text comments were analyzed using thematic analysis. Results: Of the 111 participants (response rate 12%), 92% had addressed questions of meaning. 64% of the students felt that their studies were meaningful, and 45% felt that their clinical internships were meaningful. 59% reported that they had been confronted with questions of meaning in their contact with patients, although many of them felt that they had been inadequately prepared for this (56%). This impression was stronger among respondents at the beginning of the clinical phase compared to respondents at the end (U(56,34)=660, p=0.012). According to the students, strategies for dealing with questions of meaning were active engagement with topics of meaning, tolerance of uncertainties, or avoidance. In addition to the basic requirement of openness to all topics of meaning, students expressed the wish to be better prepared for professional questions of meaning and for follow-up work on stressful events. A wide range of critical experiences with training and the healthcare system had an inhibiting effect on the experience of meaning. Conclusion: Since a higher sense of purpose can be associated with improved health and motivation, university programs might have the potential to support students' sense of purpose and, in the long term, improve their capacities to support patients who grapple with questions of meaning.

Student supervision by trainee doctors in GP teaching practices: Win-win situation or additional burden? An interview study on current practices and acceptance.

Objective: Teaching by trainee doctors is also established practice in general practice in English-speaking countries. This study examines the involvement of trainee doctors in the supervision of students in German general practices and the acceptance of trainee doctors as teachers from the perspective of physicians with a license for post-graduate training (PLT) and the trainee doctors themselves. Methodology: Semi-structured qualitative interviews were conducted with 9 PLTs and 9 trainees. The interview guide was developed based on the Theoretical Framework of Acceptance. Interviews were recorded, transcribed and evaluated using Kuckartz's qualitative analysis. Results: Trainee doctors are involved in student supervision in GP teaching practices to varying degrees and often in unstructured ways. Supervision by trainees is considered advantageous as they are closer in terms of hierarchy, possess more up-to-date knowledge and are less far ahead in terms of knowledge and function as role models. However, professional uncertainty or revealing knowledge gaps to patients and students is experienced as difficult by some trainees. Competing for time with patient care is seen as a challenge. Better time planning and didactic preparation could avoid pressure in this area. Teaching is seen as part of the GP profession, especially by trainee doctors. However, a potential obligation to teach is seen as more of a hindrance to encouraging the next generation of doctors by both trainee doctors and PLTs. Conclusion: The inclusion of trainee doctors in student teaching is frequently practiced by those surveyed, which suggests a high level of acceptance but is not consistently implemented. Structured organization of teaching in real life, didactic qualifications and offering credits for teaching activities might further improve inclusion and acceptance.

Research designs for cardiothoracic surgeons: part 1 - a primer for evidence-based practice.

Understanding research designs is crucial for cardiothoracic surgeons to enhance their clinical practice and decision-making. This article provides a comprehensive overview of different research study types, including observational and experimental studies, and their relevance to cardiothoracic surgery. Detailed explanations of cohort, case-control, and cross-sectional studies, as well as various types of randomized controlled trials, are presented. Key terms and concepts like bias, validity, and reliability are discussed. Practical case examples from the literature illustrate the application of these research designs, aiding clinicians in selecting the appropriate study design for their research questions.

Medical education during the COVID-19 pandemic: An online-only course can achieve good to medium psychomotor skill level of basic head and neck examination.

Background/Objectives: New teaching methods are warranted to meet the demand for increased flexibility in medical education while making optimal use of the limited resources of educators. The COVID-19 pandemic forced universities to resort to online-only teaching, even for training of psychomotor skills. The objectives of this study were: (I) to investigate the performance of students without previous experience in ear, nose and throat (ENT) examination after completing an asynchronous online teaching course in an objective standardized clinical examination (OSCE) and (II) to evaluate the degree of over- and underestimation of their abilities. Methods: The study was designed as a prospective, single-institution medical education cohort study. Medical students (n = 54; 3rd/4th year, no previous head and neck examination skills) completed a comprehensive online training for basic head and neck examination skills 1-14 days before undergoing an OSCE on 5 different examination items (cervical lymph node examination, oral/oropharyngeal examination, otoscopy, Weber/Rinne hearing test, anterior rhinoscopy). Expert-evaluated theoretical knowledge and practical abilities were measured using Likert scales (1 = high proficiency to 5 = low proficiency). Participants self-evaluated their own skills before and after the OSCE (5-point Likert scales). Results: Students achieved an overall good to medium skill level in basic head and neck examination after online training. Increased psychomotor complexity of tasks contributed to worse performance. Expert evaluation of practical skills was better in male participants and those who rated their preparation as thorough. Low/no misjudgment (discrepancy between self- and expert-evaluation) was observed in most participants, while high discrepancy levels (strong misjudgment) were mainly attributable to the students' underestimation of their own abilities. Conclusions: Online training of head and neck examination skills is a cost- and resource-efficient introduction to skill training and was inevitable during the pandemic. However, it cannot replace practical hands-on training, especially in tasks with high psychomotor requirements. Refresher-courses could compensate for cancelled skill training during the pandemic.

Utilization and perceptions of language assistance services by medical trainees: a pathway to language certification.

Background: Access to language assistance is a patient's right under federal law. Despite this, underuse of language services persists. Objective: The aim of this study was to explore the interest in obtaining bilingual certification and to describe perspectives on language services by resident physicians. Methods: Between May and August 2021, we conducted a cross-sectional survey of residents at a public, urban hospital serving mostly patients with limited English proficiency (LEP). We assessed resident perspectives on language services, exposure to language-related trainings, non-English language (NEL) skills, and interest in bilingual certification. Results: A total of 214 residents of 289 completed the survey (a 74% response rate). Of the 95 residents who used their NEL for patient care, 65 (68%) would be interested in bilingual certification. Sixty-nine (33%), 65 (31%), and 95 (45%) residents disagreed or strongly disagreed with being satisfied with the language services available, convenience, and sufficient equipment, respectively. Furthermore, 28 (13%) disagreed or strongly disagreed that they could achieve bi-directional communication with LEP patients. Conclusions: Over a quarter of the residents expressed interest in bilingual certification and were likely to pass the certification exam. Many reported using their own NEL skills without certification and held negative views on services and trainings.

Post competency training in standardized training of resident physicians and integrated postgraduates.

We focus on the importance and necessity of post-competency-based training in medical education alongside its current challenges and opportunities. Integrating post competency training into standardized educational frameworks is increasingly recognized as a critical component of preparing residents and postgraduates for real-world clinical practice. Post competency training represents a commitment to excellence in medical education, striving to produce competent, skilled practitioners to meet the challenges of modern healthcare.

Gathering Validity Evidence for a Simulation-Based Test of Otoscopy Skills.

OBJECTIVE: Otoscopy is a key clinical examination used by multiple healthcare providers but training and testing of otoscopy skills remain largely uninvestigated. Simulator-based assessment of otoscopy skills exists, but evidence on its validity is scarce. In this study, we explored automated assessment and performance metrics of an otoscopy simulator through collection of validity evidence according to Messick's framework. METHODS: Novices and experienced otoscopists completed a test program on the Earsi otoscopy simulator. Automated assessment of diagnostic ability and performance were compared with manual ratings of technical skills. Reliability of assessment was evaluated using Generalizability theory. Linear mixed models and correlation analysis were used to compare automated and manual assessments. Finally, we used the contrasting groups method to define a pass/fail level for the automated score. RESULTS: A total of 12 novices and 12 experienced otoscopists completed the study. We found an overall G-coefficient of .69 for automated assessment. The experienced otoscopists achieved a significantly higher mean automated score than the novices (59.9% (95% CI [57.3%-62.6%]) vs. 44.6% (95% CI [41.9%-47.2%]), P < .001). For the manual assessment of technical skills, there was no significant difference, nor did the automated score correlate with the manually rated score (Pearson's r = .20, P = .601). We established a pass/fail standard for the simulator's automated score of 49.3%. CONCLUSION: We explored validity evidence supporting an otoscopy simulator's automated score, demonstrating that this score mainly reflects cognitive skills. Manual assessment therefore still seems necessary at this point and external video-recording is necessary for valid assessment. To improve the reliability, the test course should include more cases to achieve a higher G-coefficient and a higher pass/fail standard should be used.

Development of the "LAser Surgical skills Evaluation for Residents" (LASER) Scale Through a Modified Delphi Method.

BACKGROUND: The CO2 laser is frequently used during microlaryngeal surgery (MLS) for a variety of pathology including laryngeal malignancy and stenosis. Learning how to use the laser safely is part of the curriculum for every otolaryngology resident. However, assessment of laryngoscopy technical skills can be challenging for supervisors, making it difficult to adequately provide feedback to trainees. OBJECTIVES: "LAser Surgical skills Evaluation for Residents" (LASER) Scale aims to facilitate the evaluation of residents' performance and promote constructive feedback. METHODS: The initial evaluation grid was based on a literature review of CO2 laser laryngoscopy (with an emphasis on indications, technique, safety, and efficacy) using Covidence systematic review software (Veritas Health Innovation). The final version was produced after 4 rounds of Delphi surveys. RESULTS: This study was an international collaboration including 15 otolaryngologists with either laryngology or head and neck surgery subspecialties. Panelists were based in Canada (8), the United States (3), France (1), Spain (1), Belgium (1), and Lebanon (1). The process involved 4 rounds of Delphi surveys. Assessment categories included: anesthesia considerations, pre- and perioperative laser safety measures, and surgical technique. Consensus was reached on final survey completion. CONCLUSIONS: Through a modified Delphi method, a novel scale was developed through an international collaborative effort that evaluates resident skillset in CO2 laser MLS. Future studies are warranted to validate this assessment tool.

Pay-to-Play: The Rising Cost of Subspecialty Conference Attendance for Surgical Residents.

OBJECTIVE: Surgical society conferences play a vital role in academic medicine, offering exposure to subspecialties, networking, and research presentation opportunities for surgical residents. However, the rising costs of attendance pose financial challenges, potentially deterring participation. We aimed to assess changes in conference costs, travel policies, and expenses for general surgery residents in North Carolina (NC) and South Carolina (SC) general surgery residency programs. DESIGN, SETTING, AND PARTICIPANTS: We collected registration data for major surgical society conferences in 2009 and 2019. Airfare estimates were derived from U.S. Department of Transportation data, while hotel costs were calculated based on negotiated rates for conference dates. Miscellaneous expenses were approximated using a per diem rate. Statistical analyses compared costs using paired T-tests (p < 0.05). RESULTS: There was a significant increase in registration costs from 2009 to 2019 (mean: $103 vs. $213; p = 0.04), outpacing inflation. However, there were no statistically significant changes in hotel costs or total attendance expenses over the same period. Flight costs decreased slightly, but not significantly (p = 0.18). CONCLUSION: While this study highlights a notable rise in conference registration fees, total attendance costs remained stable. Nevertheless, the financial burden on residents and programs remains considerable. We recommend surgical societies reassess their registration policies to alleviate costs and enhance access, potentially through increased scholarship opportunities, ensuring conferences remain accessible to all residents.