Surgical Residents' Perception of Feedback on Their Education: Protocol for a Scoping Review.

BACKGROUND: Feedback is an essential tool for learning and improving performance in any sphere of education, including training of resident physicians. The learner's perception of the feedback they receive is extremely relevant to their learning progress, which must aim at providing qualified care for patients. Studies pertinent to the matter differ substantially with respect to methodology, population, context, and objective, which makes it even more difficult to achieve a clear understanding of the topic. A scoping review on this theme will unequivocally enhance and organize what is already known. OBJECTIVE: The aim of this study is to identify and map out data from studies that report surgical residents' perception of the feedback received during their education. METHODS: The review will consider studies on the feedback perception of resident physicians of any surgical specialty and age group, attending any year of residency, regardless of the type of feedback given and the way the perceptions were measured. Primary studies published in English, Spanish, and Portuguese since 2017 will be considered. The search will be carried out in 6 databases and reference lists will also be searched for additional studies. Duplicates will be removed, and 2 independent reviewers will screen the selected studies' titles, abstracts, and full texts. Data extraction will be performed through a tool developed by the researchers. Descriptive statistics and qualitative analysis (content analysis) will be used to analyze the data. A summary of the results will be presented in the form of diagrams, narratives, and tables. RESULTS: The findings of this scoping review were submitted to an indexed journal in July 2024, currently awaiting reviewer approval. The search was executed on March 15, 2024, and resulted in 588 articles. After the exclusion of the duplicate articles and those that did not meet the eligibility criteria as well as the inclusion of articles through a manual search, 13 articles were included in the review. CONCLUSIONS: Conducting a scoping review is the best way to map what is known about a subject. By focusing on the feedback perception more than the feedback itself, the results of this study will surely contribute to gaining a deeper understanding of how to proceed to enhance internal feedback and surgical residents' learning progress. TRIAL REGISTRATION: Open Science Framework yexb; https://osf.io/yexkb. INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID): PRR1-10.2196/56727.

An online training and feedback module enhances the musculoskeletal examination performance of medical interns.

BACKGROUND: Pathologies of the locomotor system are frequent and can cause disability and impact the quality of life of the people affected. In recent years, online training and feedback have emerged as learning tools in many fields of medicine. OBJECTIVE: This study aims to evaluate medical interns' musculoskeletal examination performance after completing an online training and feedback module. METHODS: This study employed a quasi-experimental design. Medical interns were invited to complete a 4-week musculoskeletal physical examination training and feedback module via an e-learning platform. The course included written and audiovisual content pertaining to medical history, physical examination, and specific tests for the diagnosis of the most common knee, spine, shoulder, ankle, and foot conditions. Before and after completing the module, their ability to perform the physical examination was evaluated using an objective structured clinical examination (OSCE) with simulated patients that took place face-to-face. A control group of experts was assessed using the OSCE, and their performance was compared to that of the interns before and after the training. At the end of the module feedback on the OSCE was provided to participants through the platform asynchronously and two evaluation questions about the user experience were conducted at the end of the study. RESULTS: A total of 35 subjects were assessed using the OSCE, including 29 interns and 6 experts. At the beginning of the training module, the group of interns obtained an average score of 50.6 ± 15.1. At the end of the module, 18 interns retook the OSCE, and their performance increased significantly to an average of 76.6 ± 12.8 (p < 0.01). Prior to the training, the experts performed significantly better than the interns (71.2 vs. 50.6; p = 0.01). After the interns received the training and feedback, there were no significant differences between the two groups (71.2 vs. 76.6; p = 0.43). Two evaluation questions were conducted at the end of the study, revealing that 93% of the participants affirm that the training module will be useful in their clinical practice, and 100% of the participants would recommend the training module to a colleague. CONCLUSION: The online training and feedback module enhances the musculoskeletal examination performance of medical interns.

[Development of the capacity to communicate risks related to childhood exposure to fluorides through an online educational strategy]. / Desarrollo de la capacidad de comunicar riesgos relacionados con la exposición infantil a fluoruros, a través de una estrategia educativa en línea.

Fluorides are contaminants that occur frequently and, generally, naturally in groundwater, affecting countries that depend on these waters for irrigation and human consumption. Chronic exposure to fluorides generates various health effects; therefore, this research was based on education and risk communication to contribute to the resolution of the problem of fluoride exposure in the population. The objective was to develop the capacity to design risk communication programs for personnel involved in the response and management of environmental health risks, with emphasis on fluoride exposure. An online pilot training course on risk communication and fluoride exposure was designed and implemented. For the analysis of the risk perception and knowledge of the participants, before and after the course, a questionnaire was applied and a focus group was conducted. In addition, the participants carried out a series of activities and designed a risk communication program to assess the degree to which the capacity to develop risk communication programs was achieved. To improve the pilot course, two satisfaction surveys were designed and implemented, and a SWOT (Strengths, Weaknesses, Opportunities, and Threats) analysis was conducted. The results showed an increase in the level of knowledge and changes in the participants' perception; regarding the ability to design risk communication programs, two participants were able to design them excellently. Previous experience, motivation, commitment to learn and the feedback provided during the course influenced the development of this ability.

Los fluoruros son contaminantes presentes con frecuencia y generalmente de forma natural en aguas subterráneas, y afectan a países que dependen de estas aguas para el riego y el consumo humano. La exposición crónica a fluoruros genera diversos efectos a la salud; por lo anterior, esta investigación se basó en la educación y la comunicación de riesgos para contribuir a la resolución del problema de exposición a fluoruros en la población. El objetivo fue desarrollar la capacidad de diseñar programas de comunicación de riesgos del personal involucrado en la respuesta y manejo de los riesgos ambientales para la salud, con énfasis en la exposición a fluoruros. Se diseñó e implementó un curso piloto de formación en línea sobre comunicación de riesgos y exposición a fluoruros. Para el análisis de la percepción de riesgos y conocimientos de los participantes, antes y después del curso, se aplicó un cuestionario y se llevó a cabo un grupo focal. Además, los asistentes realizaron una serie de actividades y diseñaron un programa de comunicación de riesgos con el que se valoró el grado en que se alcanzó la capacidad de desarrollar programas de comunicación de riesgos. Para mejorar el curso piloto se diseñaron y aplicaron dos encuestas de satisfacción y se realizó un análisis FODA (Fortalezas, Oportunidades, Debilidades, Amenazas). Los resultados mostraron un incremento en el nivel de conocimientos y cambios en la percepción de los participantes; en cuanto a la capacidad de diseñar programas de comunicación de riesgos, dos participantes lograron diseñarlo de manera excelente. La experiencia previa, la motivación, el compromiso para aprender y la retroalimentación brindada durante el curso, influyeron en el desarrollo de esta capacidad.

Os fluoretos são contaminantes que ocorrem com frequência e, geralmente, de forma natural nas águas subterrâneas, afetando os países que dependem dessas águas para irrigação e consumo humano. A exposição crônica aos fluoretos gera vários efeitos à saúde; portanto, esta pesquisa baseou-se na educação e na comunicação de riscos para contribuir com a solução do problema da exposição ao fluoreto na população. O objetivo foi desenvolver a capacidade de elaborar programas de comunicação de risco para o pessoal envolvido na resposta e no gerenciamento de riscos ambientais à saúde, com ênfase na exposição à fluoretos. Foi elaborado e implementado um curso piloto de treinamento online sobre comunicação de riscos e exposição. Para a análise da percepção de risco e do conhecimento dos participantes antes e depois do curso, foi aplicado um questionário e aplicado um grupo de foco. Além disso, os participantes realizaram uma série de atividades e elaboraram um programa de comunicação de riscos para avaliar até que ponto a capacidade de desenvolver programas de comunicação de riscos foi alcançada. Para aprimorar o curso piloto, foram duas pesquisas de satisfação foram desenvolvidas e implementadas e uma análise FOFA (Forças, Oportunidades, Fraquezas e Ameaças) foi aplicada. Os resultados mostraram um aumento no nível de conhecimento e mudanças nas percepções dos participantes; em termos da capacidade de elaborar programas de comunicação de riscos, dois participantes conseguiram elaborar excelentes programas de comunicação de riscos. A experiência prévia, a motivação, o compromisso com o aprendizado e o feedback fornecido durante o curso influenciaram o desenvolvimento dessa capacidade.

Surgeons vs ChatGPT: Assessment and Feedback Performance Based on Real Surgical Scenarios.

INTRODUCTION: Artificial intelligence tools are being progressively integrated into medicine and surgical education. Large language models, such as ChatGPT, could provide relevant feedback aimed at improving surgical skills. The purpose of this study is to assess ChatGPT´s ability to provide feedback based on surgical scenarios. METHODS: Surgical situations were transformed into texts using a neutral narrative. Texts were evaluated by ChatGPT 4.0 and 3 surgeons (A, B, C) after a brief instruction was delivered: identify errors and provide feedback accordingly. Surgical residents were provided with each of the situations and feedback obtained during the first stage, as written by each surgeon and ChatGPT, and were asked to assess the utility of feedback (FCUR) and its quality (FQ). As control measurement, an Education-Expert (EE) and a Clinical-Expert (CE) were asked to assess FCUR and FQ. RESULTS: Regarding residents' evaluations, 96.43% of times, outputs provided by ChatGPT were considered useful, comparable to what surgeons' B and C obtained. Assessing FQ, ChatGPT and all surgeons received similar scores. Regarding EE's assessment, ChatGPT obtained a significantly higher FQ score when compared to surgeons A and B (p = 0.019; p = 0.033) with a median score of 8 vs. 7 and 7.5, respectively; and no difference respect surgeon C (score of 8; p = 0.2). Regarding CE´s assessment, surgeon B obtained the highest FQ score while ChatGPT received scores comparable to that of surgeons A and C. When participants were asked to identify the source of the feedback, residents, CE, and EE perceived ChatGPT's outputs as human-provided in 33.9%, 28.5%, and 14.3% of cases, respectively. CONCLUSION: When given brief written surgical situations, ChatGPT was able to identify errors with a detection rate comparable to that of experienced surgeons and to generate feedback that was considered useful for skill improvement in a surgical context performing as well as surgical instructors across assessments made by general surgery residents, an experienced surgeon, and a nonsurgeon feedback expert.

Designing feedback processes in the workplace-based learning of undergraduate health professions education: a scoping review.

BACKGROUND: Feedback processes are crucial for learning, guiding improvement, and enhancing performance. In workplace-based learning settings, diverse teaching and assessment activities are advocated to be designed and implemented, generating feedback that students use, with proper guidance, to close the gap between current and desired performance levels. Since productive feedback processes rely on observed information regarding a student's performance, it is imperative to establish structured feedback activities within undergraduate workplace-based learning settings. However, these settings are characterized by their unpredictable nature, which can either promote learning or present challenges in offering structured learning opportunities for students. This scoping review maps literature on how feedback processes are organised in undergraduate clinical workplace-based learning settings, providing insight into the design and use of feedback. METHODS: A scoping review was conducted. Studies were identified from seven databases and ten relevant journals in medical education. The screening process was performed independently in duplicate with the support of the StArt program. Data were organized in a data chart and analyzed using thematic analysis. The feedback loop with a sociocultural perspective was used as a theoretical framework. RESULTS: The search yielded 4,877 papers, and 61 were included in the review. Two themes were identified in the qualitative analysis: (1) The organization of the feedback processes in workplace-based learning settings, and (2) Sociocultural factors influencing the organization of feedback processes. The literature describes multiple teaching and assessment activities that generate feedback information. Most papers described experiences and perceptions of diverse teaching and assessment feedback activities. Few studies described how feedback processes improve performance. Sociocultural factors such as establishing a feedback culture, enabling stable and trustworthy relationships, and enhancing student feedback agency are crucial for productive feedback processes. CONCLUSIONS: This review identified concrete ideas regarding how feedback could be organized within the clinical workplace to promote feedback processes. The feedback encounter should be organized to allow follow-up of the feedback, i.e., working on required learning and performance goals at the next occasion. The educational programs should design feedback processes by appropriately planning subsequent tasks and activities. More insight is needed in designing a full-loop feedback process, in which specific attention is needed in effective feedforward practices.

Self-regulated learning microanalysis feedback for developing clinical skills: A pilot study.

INTRODUCTION: The development of clinical skills requires the appropriate use of self-regulated learning (SRL). Students' use of key SRL processes as they perform a clinical skill can be identified by SRL microanalysis and used to provide feedback. SRL-microanalysis feedback only on students' key SRL processes has not been previously researched for developing clinical skills. The aim of this study was to investigate whether SRL-microanalysis feedback only on students' key SRL processes can improve both their use of SRL and their clinical skill performance. METHODS: Twenty-three final year medical students with no experience in the clinical skill required for mechanical ventilation participated in this study. Key SRL processes and clinical skill performance were measured before and after SRL microanalysis feedback. RESULTS: Overall, we found an improvement in the key SRL processes of planning and monitoring of performance, with a significant difference in monitoring. We also found an increase in students' clinical skill performance. DISCUSSION: This study, which is the first in clinical skills, demonstrated that SRL microanalysis feedback only on key SRL processes can improve both students' SRL and their clinical skill performance. studies are recommended with a great number of students and across a variety of clinical skills.

Una revisión sistemática del uso de la inteligencia artificial en la educación / A systematic review of the use of artificial intelligence in education

Introducción. El uso de la inteligencia artificial (IA) en la educación ha sido objeto de una creciente atención en los últimos años. La IA se ha utilizado para mejorar la personalización del aprendizaje, la retroalimentación y la evaluación de los estudiantes. Sin embargo, también hay desafíos y limitaciones asociados. El objetivo de este trabajo fue identificar las principales tendencias y áreas de aplicación de la inteligencia artificial en la educación, así como analizar los beneficios y limitaciones de su uso en este ámbito. Métodos. Se llevó a cabo una revisión sistemática que exploró el empleo de la inteligencia artificial en el ámbito educativo. Esta revisión siguió una metodología de investigación basada en la búsqueda de literatura, compuesta por cinco etapas. La investigación se realizó utilizando Scopus como fuente de consulta primaria y se empleó la herramienta VOSviewer para analizar los resultados obtenidos. Resultados. Se encontraron numerosos estudios que investigan el uso de la IA en la educación. Los resultados sugieren que la IA puede mejorar significativamente la personalización del aprendizaje, proporcionando recomendaciones de actividades y retroalimentación adaptadas a las necesidades individuales de cada estudiante. Conclusiones. A pesar de las ventajas del uso de la IA en la educación, también hay desafíos y limitaciones que deben abordarse, como la calidad de los datos utilizados por la IA, la necesidad de capacitación para educadores y estudiantes, y las preocupaciones sobre la privacidad y la seguridad de los datos de los estudiantes. Es importante seguir evaluando los efectos del uso de la IA en la educación para garantizar su uso efectivo y responsable.

Introduction. The use of artificial intelligence (AI) in education has been the subject of increasing attention in recent years. AI has been used to improve personalized learning, feedback, and student assessment. However, there are also challenges and limitations. The aim of this study was to identify the main trends and areas of application of artificial intelligence in education, as well as to analyze the benefits and limitations of its use in this field. Methods. A systematic review was carried out on the use of artificial intelligence in education, using a literature search research methodology with five stages, based on the Scopus query and the tool for analyzing results with VOSviewer. Results. Numerous studies investigating the use of AI in education were found. The results suggest that AI can significantly improve personalized learning by providing activity recommendations and feedback tailored to the individual needs of each student. Conclusions. Despite the advantages of using AI in education, there are also challenges and limitations that need to be addressed, such as the quality of data used by AI, the need for training for educators and students, and concerns about the privacy and security of student data. It is important to continue evaluating the effects of AI use in education to ensure its effective and responsible use.

Aprendizaje en investigación clínica: experiencia de enseñanza híbrida con estudiantes de medicina / Learning in Clinical Research: Hybrid Teaching Experience with Medical Students

Introducción: la pandemia de COVID-19 indujo un cambio en nuestro sistema de salud y de educación. Los programas formativos también tuvieron que adaptarse y exigieron un cambio rápido. Objetivos: describir una experiencia educativa de enseñanza virtual/híbrida en investigación clínica, entre docentes del Servicio de Clínica de un hospital universitario y estudiantes de Medicina de una institución privada, que participaron del Programa ESIN (EStudiantes en INvestigación). Metodología: los contenidos y las estrategias educativas incluyeron las clases teóricas audiograbadas o videograbadas (asincrónicas y autoadministradas), el aprendizaje basado en proyectos, los talleres prácticos (encuentros sincrónicos virtuales y grupales), mediante la adopción de modelos de aprendizaje como el aula invertida, y la tutoría individual entre docente-estudiante. Los datos se recopilaron mediante la observación en contextos académicos, y basándonos en elementos de encuestas anónimas de satisfacción, previo consentimiento informado de los participantes. Resultados: participaron 14 estudiantes, 6 durante el año 2021 y 8 durante 2022. Todas mujeres y estudiantes de medicina (50% de cuarto año, 35% de sexto año y 15% de quinto año). Las técnicas implementadas favorecieron la participación y promovieron el aprendizaje activo, basado en proyectos. Mencionaron aspectos positivos como el enfoque académico práctico, la disponibilidad del equipo docente para atender cualquier duda, el tiempo y el entusiasmo por enseñar y fomentar la participación. Los videos teóricos resultaron útiles como herramientas de repaso, y los encuentros grupales fueron especialmente valorados, si bien los encuentros individuales fueron destacados como ayuda y apoyo previo a los congresos científicos. En general, manifestaron que fue una experiencia enriquecedora que demostró que se puede lograr lo que se creía imposible. Todas participaron activamente de al menos un congreso científico, y el 50% resultó coautora de una publicación académica. Conclusión: los estudiantes asumieron compromisos y responsabilidades, e incorporaron competencias y habilidades en la implementación y en la difusión de los proyectos. Esta experiencia educativa facilitó que el tiempo de clase pudiera optimizarse para intercambio, discusión y dudas. Los recursos producidos, las actividades desarrolladas y los contenidos abordados quedan disponibles a nivel institución. (AU)

Introduction: the COVID-19 pandemic brought about a change in our health and education system. Training programs also had to adapt and required rapid change. Objectives: to describe an educational experience of virtual/hybrid teaching in clinical research between teachers of the Clinical Service of a university hospital and medical students of a private institution who participated in the ESIN Program (Students in Research). Methodology: the contents and educational strategies included audio or videotaped lectures (asynchronous and self-administered), project-based learning, practical workshops (virtual and group synchronous meetings) by adopting learning models such as the inverted classroom, and individual tutoring between teacher and student. We gathered the data through observation in academic contexts and based on elements of anonymous satisfaction surveys, with prior informed consent of participants. Results: fourteen students participated, six in 2021 and eight in 2022. All were women and medical students (50% fourth year, 35% sixth year, and 15% fifth year). The techniques implemented favored participation and promoted active, project-based learning. They mentioned positive aspects such as the practical academic approach, the availability of the teaching team for any doubts, the time and enthusiasm for teaching, and encouraging participation. The theory videos were a valuable review tool, and team meetings received high praise even if the one-on-one meetings received much attention as help and support before the scientific congresses. In general, they stated that it was an enriching experience that showed that you can achieve what you thought impossible. All of them actively participated in at least one scientific congress, and 50% were co-authors of an academic publication. Conclusion: the students assumed commitments and responsibilities and incorporated competencies and skills in project implementation and dissemination. This educational experience helped to optimize class time for exchange, discussion, and doubts. The resources produced, the activities developed, and the contents addressed are now available at the institutional level. (AU)

Evaluación del uso de equipo de protección personal (EPP) en personal de salud de un Hospital Universitario mediante las curvas CUSUM / Evaluation of the use of personal protective equipment (PPE) in health personnel of a University Hospital using the CUSUM curves

INTRODUCTION: Health personnel who care for patients with COVID-19 are at great risk of contagión, unless they learn and properly implement the procedure for donning and doffing personal protective equipment (PPE). OBJECTIVES: To evalúate the use of PPE (donning and doffing) using the CUSUM method in health personnel who care for hospitalized patients with a pre- sumptive or confirmed diagnosis of COVID-19. Use the CUSUM curves as an appropriate method for the meaningful learning and psychomotor skills of these professionals. MATERIALS AND METHODS: Cross-sectional study carried out in 10 health profes- sionals from the National University Hospital. Measurements were made for one hour per participant from July 13 to 29, 2020, and in each one checklists were used to evaluate compliance with the protocol. In the formative evaluation using the CUSUM, an acceptable failure rate of 20% (Po) was considered and an unacceptable one of 40% (P1), with an error parameter a and p of 10%. RESULTS: 40% reached H0, the goal; 20% approached the target and 40% and 20% were distanced from the target with regard to donning and doffing the PPE. CONCLUSIONS: Proper use of PPE is a strategy for the prevention of contagion of COVID-19 in health personnel; The study found that less than half demonstrated adequate use, so training these professionals in the placement and removal of PPE according to an institutional protocol based on constant feedback and strict monitoring is essential to achieve the acquisition of skills, which will considerably reduce your risk of infection in clinical practice.

INTRODUCCIÓN: El personal de salud que atiende a pacientes con COVID-19 está en un gran riesgo de contagio, a menos que aprenda e implemente apropiadamente el procedimiento de colocación y retiro de los elementos de protección personal (EPP). OBJETIVOS: Evaluar el uso de EPP (colocación y retiro) mediante el método CUSUM en personal de la salud que presta atención a pacientes hospitalizados con diagnóstico presuntivo o confirmado de COVID-19. Utilizar las curvas CUSUM como método apropiado para el aprendizaje significativo y las habilidades psicomotoras de estos profesionales. MATERIALES Y MÉTODOS: Estudio transversal realizado en 10 profesionales de la salud del Hospital Universitario Nacional. Las mediciones se realizaron por dos horas por participante del 13 al 29 de julio de 2020, y en cada una se utilizaron listas de chequeo para la evaluación del cumplimiento del protocolo. En la evaluación formativa mediante las CUSUM, se consideró un porcentaje de fallo aceptable del 20% (P0) y uno inaceptable del 40% (P1), con un parámetro de error a y p del 10%. RESULTADOS: 40% alcanzó el H0 el objetivo; 20% se acercó al objetivo y 40% y 20% estuvieron distanciados del objetivo con respecto a la colocación y retiro del EPP. CONCLUSIONES: El uso apropiado de EPP es una estrategia de prevención de contagio de COVID-19 en personal de la salud; el estudio encontró que menos de la mitad demostraron un uso adecuado, por lo que la capacitación de estos profesionales en la colocación y retiro de PPE según un protocolo institucional basado en la retroalimentación constante y un seguimiento estricto, es fundamental para lograr la adquisición de las habilidades, lo que reducirá considerablemente su riesgo de contagio en la práctica clínica.

Instructor-led oral debriefing technique in clinical nursing simulation: integrative review.

OBJECTIVE: To analyze available scientific evidence in literature pertaining to the elements that make the instructor-led oral debriefing technique in clinical nursing simulation feasible. METHODS: An Integrative literature review along the following information sources: PubMed®, Scopus, Web of Science, Literatura Latino-Americana e do Caribe em Ciências da Saúde (LILACS) [Latin American and Caribbean Health Sciences Literature], Cumulative Index to Nursing and Allied Health Literature (CINAHL), and Educational Resources Information Centre (ERIC). RESULTS: 284 studies were identified, and 5 composed the sample. Four elements constitute oral debriefing: characteristics of the instructor; discussion format, debriefing structure; and time frame. The main benefit was to develop cognitive and psychomotor skills; and the challenge was to establish training for instructors. The studies showed high methodological quality. FINAL CONSIDERATIONS: The scientific deepening as to the elements, benefits, and challenges of oral debriefing enables its execution and offers quality to the nursing process.

Feedback formativo e aprendizagem do aluno de Medicina no contexto pediátrico: uma revisão narrativa da literatura / Formative feedback and medical student learning in pediatrics: a narrative literature review / Feedback formativo y aprendizaje del alumno de medicina en el contexto pediátrico: una revisión narrativa de la literatura

O feedback formativo é central na educação médica. Contudo, estudos sobre a aplicação da estratégia na Pediatria são escassos. Objetivando compreender como o feedback pode ser incorporado ao aprendizado do estudante de Medicina no contexto pediátrico, conduziu-se uma revisão narrativa da literatura. A partir da consulta às bases de dados Medline, Lilacs, SciELO, Embase e Scopus e Web of Science, selecionaram-se 13 artigos, publicados entre 1986 e 2020, focados em feedback de alunos de Pediatria na graduação. A análise da literatura evidenciou a utilidade do feedback de múltiplas fontes e a importância de ferramentas como formulários e cartões de encontro clínico para fornecer feedback quanto às habilidades necessárias ao bom exercício da Pediatria. Os trabalhos pouco exploraram o feedback com auxílio da internet, o que deve ser tema de pesquisas futuras. (AU)

Formative feedback is central to medical education. However, studies on the application of the technique in pediatrics are scarce. We conducted a narrative literature review to understand how feedback can be incorporated into medical student training in pediatrics. Searches of the MEDLINE, LILACS, SciELO, Embase, Scopus and Web of Science databases resulted in the selection of 13 articles focusing on feedback and pediatrics graduate students published between 1986 and 2020. The findings highlight the usefulness of multiple-source feedback and importance of tools such as forms and clinical meeting cards for providing feedback on necessary pediatrician skills. The articles paid little attention to feedback with the help of the internet, which should be the theme of future studies. (AU)

El feedback formativo es central en la Educación Médica; sin embargo, son escasos los estudios sobre la aplicación de la estrategia en la Pediatría. Con el objetivo de comprender cómo el feedback puede incorporarse al aprendizaje del estudiante de medicina en el contexto pediátrico, se realizó una revisión narrativa de la literatura. A partir de la consulta a la base de datos de MEDLINE, Lilacs, SciELO, EMBASE, Scopus y Web of Science, se seleccionaron 13 artículos, publicados entre 1986 y 2020, enfocados en feedback y alumnos de Pediatría en la graduación. El análisis de la literatura puso en evidencia la utilidad del feedback de múltiples fuentes y la importancia de herramientas como formularios y tarjetas de encuentro clínico para proporcionar feedback con relación a las habilidades necesarias para el buen ejercicio de la Pediatría. Los trabajos exploraron poco el feedback con el auxilio de internet, lo que debe ser tema de investigaciones futuras. (AU)

Teachers and students' perceptions about feedback in clinical internships in medical school / Percepções de docentes e discentes sobre feedback em estágios práticos no curso de medicina

Abstract: Introduction: In medical education, feedback is considered one of the main types of formative assessment. Feedback can be defined as the transmission of information by observing students in action aiming to provide improvement for the acquisition of medical skills that constitute medical professionalism. Objective: The aim of this study was to assess if there are difficulties in transmitting and receiving feedback by preceptors and students during the practical stages of medical training. Methods: This qualitative / quantitative design study involved all students who completed the internship from March 2018 to August 2019 (n = 50), as well as all preceptors responsible for the internships (n = 9) at Universidade Municipal de São Caetano do Sul. Knowledge about feedback, according to the viewpoint of students and preceptors, was assessed using adapted questionnaires with categorical and open questions. Descriptive analyses were used for the quantitative data and the content technique for the qualitative data. Results: The preceptors report that the objectives of providing feedback are to point out improvement, critical reflection, and opportunity for adjustments. Meanwhile, students report: clarification of doubts, planning for improvements and knowledge of positive points. Half of the preceptors claim to provide very frequent feedback, but students would like to receive feedback more often. Students want feedback to be constructive and private. Half of the preceptors find it difficult to give negative feedback; however, 60% of the students report handling criticism well. Conclusion: The preceptors declare to have knowledge of and know about the objectives of giving feedback; however, they have difficulties communicating it, especially when it involves criticisms for the correction of behaviors and attitudes. The students accept criticism and would like feedback to be conveyed more often in the practical stages. It is necessary to improve the process of providing and receiving feedback.

Resumo: Introdução: No ensino médico, feedback - ou devolutiva - é um dos componentes principais da avaliação formativa. Feedback pode ser definido como transmissão de uma informação quando se observam os estudantes em ação, a fim de propiciar melhorias para aquisição de competências médicas que compõem o profissionalismo médico. Objetivo: Este estudo teve como objetivo avaliar se há dificuldades de transmissão e recepção de feedback pelos preceptores e estudantes durante os estágios práticos do curso de Medicina. Método: Este estudo de delineamento misto qualitativo/ quantitativo envolveu todos os discentes que concluíram os estágios no período de março de 2018 a agosto de 2019 (n = 50), assim como todos os preceptores responsáveis pelos estágios práticos (n = 9) da Universidade Municipal de São Caetano do Sul. O conhecimento sobre feedback, na visão dos discentes e preceptores, foi avaliado por meio de questionários adaptados com perguntas categóricas e abertas. Utilizaram-se análise descritiva nos dados quantitativos e técnica de conteúdo nos dados qualitativos. Resultado: Os preceptores relataram que os objetivos de fornecer feedback são: apontamento de melhoria, reflexão crítica e oportunidade de adequações. Por sua vez, os estudantes relataram: esclarecimento de dúvidas, planejamento de melhorias e conhecimento de pontos positivos. Metade dos preceptores afirmou fornecer feedback, porém os estudantes gostariam de recebê-lo de forma mais contínua. Os estudantes desejam que o feedback seja construtivo e feito em local privado. Metade dos preceptores tem dificuldade em dar feedback negativo, porém 60% dos estudantes relataram lidar bem com críticas. Conclusão: Os preceptores afirmaram ter conhecimento dos objetivos do feedback. Porém, eles têm dificuldades para transmiti-lo, principalmente quando envolve críticas para correções de comportamentos ou atitudes. Os estudantes aceitam críticas e requerem que o feedback seja transmitido com mais frequência nos estágios práticos. Há a necessidade de melhorar o processo de fornecer e receber feedback.

Registro Clínico Baseado em Problemas como instrumento para desenvolver competências em programa de residência médica / Problem-based clinical record as an instrument to develop competences in a medical residency program

Resumo: Introdução: As competências relevantes ao ensino médico atual são divididas em sete dimensões: cognitiva, técnica, contextual, integrativa, afetiva, relacional e hábitos da mente. No presente estudo, um instrumento de aprendizagem nomeado Registro Clínico Baseado em Problemas (RBP), composto por uma lista de problemas on-line dos pacientes com suas respectivas investigações e intervenções, foi desenvolvido e aplicado em um programa de residência médica em clínica médica. Objetivo: Este estudo teve como objetivo investigar a percepção dos médicos residentes e preceptores sobre a utilização do RBP no processo ensino-aprendizagem e no desenvolvimento de competências em suas várias dimensões. Método: Participaram do estudo 21 residentes e oito preceptores de uma enfermaria de clínica médica, distribuídos em três grupos focais, em que dialogaram sobre a utilização do RBP no serviço. Para a interpretação da fala dos participantes, utilizou-se a análise de conteúdo de Bardin. Resultados: Na percepção dos residentes, o RBP influenciou na organização do conhecimento e na motivação dentro da dimensão cognitiva. A dimensão integrativa foi a mais citada pelos participantes, visto que o RBP levou à reflexão e à estruturação do raciocínio por problemas, atuando positivamente na organização do conhecimento e na definição dos problemas mais relevantes. Na dimensão contextual, não houve consenso entre os residentes sobre o impacto na solicitação racional de exames, e os preceptores relacionaram a falta de impacto do RBP à falta de feedback. Na dimensão relacional, preceptores e residentes relataram que o RBP trabalhou a síntese e organização do pensamento. No discurso dos residentes, o RBP influenciou os hábitos da mente relacionados à capacidade do médico de autoavaliação e reflexão sobre sua prática. Conclusão: O RBP atuou como instrumento de aprendizagem, principalmente por estar associado a fatores psicopedagógicos relacionados à facilitação da aprendizagem. As dimensões de competências cognitiva, integrativa, contextual, relacional e hábitos da mente foram desenvolvidas pelo RBP. A visão dos residentes e preceptores sobre a relevância do RBP para a aprendizagem de competências foi divergente. As dimensões cognitiva, integrativa e hábitos da mente tiveram maior diferença entre os participantes. Para que o RBP gere um aprendizado mais eficaz, os preceptores precisam interagir mais com o instrumento e realizar regularmente o feedback com os residentes.

Abstract: Introduction: Competencies relevant to current medical education are classified into cognitive, technical, contextual, integrative, affective, relational, and habits of mind. In the present study, a learning instrument, called Problem-Based Clinical Record (RBP), composed of a list of patients' online problems with their respective investigations and interventions was developed and applied in a Medical Residency Program in internal medicine. Objectives: To investigate the perception of resident physicians and tutors on the use of RBP in the teaching-learning process and the development of skills in its various dimensions. Method: 21 residents and 8 preceptors of a Medical Clinic ward participated in the study, distributed into 3 focus groups, where they discussed the use of RBP in the service. The participants' oral accounts were interpreted using Bardin's content analysis. Results: In the residents' view, RBP influenced the organization of knowledge and motivation within the cognitive dimension. The integrative dimension was the most cited by the participants, since RBP led to reflection and the structuring of reasoning by problems, acting positively in the organization of knowledge and definition of relevant problems. In the contextual dimension, no consensus was found among residents regarding impact on the rational request for exams and the preceptors related to the lack of impact of RBP to the lack of feedback. In the relational dimension, preceptors and residents reported that RBP worked on the synthesis and organization of thought. The residents argued that RBP influenced habits of the mind, related to the physician's ability to self-assess and reflect on his practice. Conclusion: RBP acted as a learning tool, mainly because it is associated with psycho-pedagogical factors related to the facilitation of learning. The dimensions of cognitive, integrative, contextual, relational, and habits of the mind were developed by the RBP. The view of residents and tutors on the relevance of RBP for learning skills was divergent. The cognitive, integrative, and habits of the mind dimensions had a greater difference between the participants. For RBP to generate more effective learning, preceptors need to interact more with the instrument and regularly provide feedback to residents.

Eureka: um programa de mentoria de alunos de Medicina com engajamento e alta adesão / Eureka: a mentoring program for medical students with high levels of commitment and attendance

Resumo: Introdução: A mentoria vem sendo utilizada como instrumento para o desenvolvimento profissional e pessoal de estudantes de medicina. Relatamos a evolução do grupo de mentoria de alunos de graduação em medicina da Universidade Federal da Grande Dourados (UFGD), que perdura por longo tempo, com excelente aderência e amplo aproveitamento, e satisfação dos participantes com o processo. Relato de experiência: O programa de mentoria de alunos de medicina da UFGD se iniciou no quinto ano de existência do curso, encontrando-se em contínua atividade por mais de 15 anos. Há três anos, tornou-se projeto de extensão universitária. São realizadas discussões semanais sobre assuntos práticos, morais e éticos relacionados à profissão médica. Os participantes são mentorados por tempo variável, eventualmente até alguns anos após a graduação. A atividade é voluntária para mentora e mentorados. Muito raramente ocorrem faltas aos encontros, e semanalmente os participantes escrevem sobre suas reflexões advindas das sessões de mentoria, recebendo respostas individuais. Também assumem as responsabilidades pela realização operacional das reuniões e pela indicação de novos participantes. Sessões adicionais de mentoria individual são frequentes. Discussão: Programas de mentoria pequenos ou informais, se bem executados, podem ser bem-sucedidos, obtendo resultados positivos significativos, sem custo para as instituições. Os alunos que participam do programa Eureka sentem-se acolhidos e atendidos em suas necessidades de orientação, e se mostram comprometidos e satisfeitos com o processo. Não observamos nesse grupo problemas de assiduidade, de engajamento, nem de falta de feedback. Conclusão: O programa Eureka, com regras de funcionamento claras e constantes, mentoria adequada e alunos bem selecionados, constitui eficiente ferramenta em nossa universidade, contribuindo, assim, para a formação de estudantes e médicos mais motivados, preparados, realizados e úteis à sociedade.

Abstract: Introduction: Mentorship has been used as an instrument for professional and personal development of medical students. This article reports on the development of the medical student mentorship program at the Federal University of Grande Dourados (UFGD), which has been active for many years with excellent adherence and high levels of satisfaction and progress of the participants. Experience report: The UFGD medical student mentorship program began in the fifth year of the medical course's existence and has been continuously active for over 15 years. Three years ago, it became a university extension project. Weekly discussions regarding practical, moral and ethical aspects of the medical profession take place. The participants are mentored for varying periods of time, possibly up to a few years after undergraduate training. The activity is voluntary for both mentor and mentees. Absences from the meetings are very rare and the mentees write a weekly log about their reflections from the mentoring sessions, to which the mentor replies individually. They also take on the responsibilities of organizing the meetings and of indicating new participants. Additional individual mentoring sessions are frequent. Discussion: Small or informal mentorship programs, if well executed, can be successful, obtaining positive results at no cost to the institution. The students who take part in the Eureka program feel welcome, guided and show commitment and satisfaction with the process. We have not observed in this group any issues with engagement and attendance, or lack of feedback. Conclusion: The Eureka program, with its clear and constant rules, adequate mentoring and well selected students, constitutes an efficient tool in our university, therefore, contributing to the education of more motivated, prepared and self-fulfilled students and physicians.

Clinical skills assessment and feedback in pediatric residency / Avaliação de habilidades clínicas e feedback na residência médica em Pediatria

Abstract: Introduction: A medical residency is the specialization par excellence in medical training and the program is responsible for ensuring that the recently graduated doctor reaches the established level of competence. A well-prepared assessment system with feedback is an effective tool to enhance the performance of future specialists and guarantee their qualification. Objective: To analyze the assessment system for pediatric residents at a university hospital, aiming to promote teaching training in assessment methods. Methodology: educational action research (research-teaching), conducted with teachers and preceptors in the pediatric residency of a university hospital. The stages consisted of: a) the application of a questionnaire on participant profile and assessment methods used to evaluate the medical residents; b) intervention (workshop) on the assessment of clinical skills and feedback; c) immediate assessment after the workshop, by applying another questionnaire based on level 1 of the Kirkpatrick model. Simple statistical analysis was used for the objective data and the content analysis, according to recommendations by Malheiros (2011) and Bardin (2013), for the qualitative part. Result: Ten (48%) of the 21 participants declared not being formally trained in assessment and that they applied the more traditional methods learned from personal experience. Regarding the assessment methods, 81% (17/21) of the participants used more than one, aiming to obtain a more encompassing and reliable assessment. However, none of the teachers/preceptors used a systematized assessment of the clinical skills or provided feedback to the medical residents. After the workshop, with a focus on assessing performance in a simulated 'Objective Structured Clinical Examination' (OSCE) environment, all the participants were favorable to apply the OSCE in their teaching-learning practice with residents and undergraduate students, reaching Kirkpatrick level 3. Conclusion: The action research helped identify limitations in the assessment and feedback system of the pediatric resident physician. The methodology used revealed an aggregating effect and contributed to the development of the collaborative and integrative sense in the group. However, it was not enough to positively interfere with the pediatric medical residency assessment in the short term.

Resumo: Introdução: A residência médica é a especialização por excelência na formação do médico, e cabe ao programa assegurar que o residente egresso atinja o nível almejado de competência. Um sistema avaliativo bem elaborado e com feedback é ferramenta efetiva para aprimorar o desempenho do futuro especialista e garantir a qualificação dele. Objetivo: Este estudo teve como objetivo analisar o sistema de avaliação do médico residente em pediatria de um hospital universitário, com o intuito de promover a formação docente em métodos avaliativos. Método: Trata-se de uma pesquisa-ação educacional (pesquisa-ensino) realizada com docentes e preceptores da residência médica em pediatria de um hospital universitário. As etapas consistiram em: 1. aplicação de questionário sobre o perfil dos participantes e os métodos avaliativos utilizados com os residentes; 2. intervenção com a realização de um workshop sobre avaliação de habilidades clínicas e feedback; 3. avaliação imediata, após o workshop, com aplicação de outro questionário, elaborado com base no nível 1 do método Kirkpatrick. Utilizaram-se a análise estatística simples, para os dados objetivos, e a análise de conteúdo, segundo recomendações de Malheiros e Bardin, para a parte qualitativa. Resultado: Dos 21 participantes, dez (48%) informaram que não tinham capacitação formal em avaliação e que utilizavam métodos avaliativos mais tradicionais. Quanto aos métodos, 81% (17/21) dos participantes informaram que utilizavam mais de um, com finalidade somativa, para obter uma avaliação mais abrangente e fidedigna. No entanto, nenhum utilizava uma avaliação sistematizada de habilidades clínicas com fornecimento de feedback. Após o workshop com enfoque em avaliação de desempenho em ambiente simulado, em que se adotou o Objective Structured Clinical Examination (OSCE), os participantes utilizaram, com os internos, o método avaliativo do aprendizado na sua prática cotidiana, e, dessa forma, o treinamento atingiu o nível 3 de Kirkpatrick. Conclusão: A pesquisa-ação propiciou identificar limitações no sistema de avaliação e feedback do médico residente em pediatria. A metodologia utilizada revelou um efeito agregador e contribuiu para desenvolver o sentido colaborativo e integrativo no grupo. No entanto, não foi suficiente para interferir positivamente, em curto prazo, na avaliação da residência médica em pediatria.

Effect of a Social Norm Email Feedback Program on the Unnecessary Prescription of Nimodipine in Ambulatory Care of Older Adults: A Randomized Clinical Trial.

Importance: Nimodipine is a highly prescribed drug for the treatment of cognitive impairment and dementia in Argentina. There is little evidence to support the use of nimodipine for cognitive impairment and dementia. Objective: To test the effectiveness of a behavioral intervention based on social norm feedback to reduce prescription of nimodipine for cognitive impairment in Argentina. Design, Setting, and Participants: This pragmatic parallel-group randomized clinical trial included 2 arms with a 1:1 allocation ratio. General practitioner physicians in the national health care system for older adults in Argentina (INSSJP-PAMI) with history of high nimodipine prescription rate were enrolled. The study was conducted from May 2019 to October 2019, and data were analyzed from November 2019 to February 2020. Interventions: The treatment group received 2 emails with evidence-based information about nimodipine plus the individual's level of nimodipine prescription compared with their peers. The control group received 2 emails with general information about the risks of overprescription in older adults. Main Outcomes and Measures: The primary outcome was the cumulative number of nimodipine prescriptions per 1000 prescriptions of all drugs made by the targeted physicians during the 6 months of the study. Secondary outcomes included annual monetary savings attributable to the intervention and physicians' qualitative perceptions of the acceptability of the procedure. Results: Of 1811 physicians enrolled, 906 physicians (354 [39.1%] women; mean [SD] age, 57.10 [10.73] years) were randomized to treatment and 905 participants (331 [36.6%] women; mean [SD] age, 56.49 [10.47] years) to the control group. Physicians in the treatment group wrote a mean of 93.25 (95% CI, 89.27 to 97.24) prescriptions of nimodipine, compared with 98.99 (95% CI, 95.00 to 102.98) prescriptions among practitioners in the control group during the half-year of the intervention (mean difference, -5.73 [95% CI, -11.38 to -0.10] prescriptions; P = .046), which meant a 5.79% reduction. Regression analysis revealed a significant association of the group condition with number of prescriptions per 1000 total prescriptions when controlling for baseline prescriptions (B = -0.312 [95% CI, -0.465 to -0.160]; P < .001). The observed difference corresponds to a 4.48% reduction in nimodipine prescriptions per 1000 prescriptions of all drugs made by physicians in the treated group compared with the control group. Physicians who effectively opened the email in the treatment group (427 physicians [47.1%]) prescribed the drug 11.3% less compared with the control group (426 physicians) (mean difference, -10.78 [95% CI, -18.53 to -3.03] prescriptions; P = .006). Expenditures were 7.18% lower in the treatment group, resulting in an estimated annual net cost benefit of US $234 893.35 (95% CI, $225 565.35 to $237 112.30). Conclusions and Relevance: In this randomized clinical trial, the social norm email feedback program showed an effect on curbing the nonrecommended prescription of nimodipine. It was highly cost-effective and well accepted by participants. Trial Registration: ISRCTN.org identifier: ISRCTN17823729.

Human Anterior Insula Encodes Performance Feedback and Relays Prediction Error to the Medial Prefrontal Cortex.

Adaptive behavior requires the comparison of outcome predictions with actual outcomes (e.g., performance feedback). This process of performance monitoring is computed by a distributed brain network comprising the medial prefrontal cortex (mPFC) and the anterior insular cortex (AIC). Despite being consistently co-activated during different tasks, the precise neuronal computations of each region and their interactions remain elusive. In order to assess the neural mechanism by which the AIC processes performance feedback, we recorded AIC electrophysiological activity in humans. We found that the AIC beta oscillations amplitude is modulated by the probability of performance feedback valence (positive or negative) given the context (task and condition difficulty). Furthermore, the valence of feedback was encoded by delta waves phase-modulating the power of beta oscillations. Finally, connectivity and causal analysis showed that beta oscillations relay feedback information signals to the mPFC. These results reveal that structured oscillatory activity in the anterior insula encodes performance feedback information, thus coordinating brain circuits related to reward-based learning.

Evidence-based conservation education in Mexican communities: Connecting arts and science.

Several studies suggest that 63% of primate species are currently threatened due to deforestation, pet-trade, and bushmeat hunting. Successful primate conservation strategies require effective educational programs capable of enhancing critical system-thinking and responsible behavior towards these species. Arts-based conservation education can simultaneously foster cognitive and emotional processes. In this paper, we evaluate an arts-based educational program focused on the conservation of black howler monkeys (Alouatta pigra). Our goals were to determine (1) whether children's knowledge changed with our educational techniques, (2) if there was a particular educational technique that better improved the children's learning, and (3) the children's emotional feedback regarding the whole program. A total of 229 children from communities located in primate-habitat areas, both inside and outside protected areas, participated in the study. Different educational techniques were tested (storytelling, theater and shadow puppets), contrasted with a control group, and evaluated through an analysis of drawings. Our results showed that children's knowledge increase with each art-based technique, with storytelling being the most effective for children's learning. Specific drawings indicators also revealed the increase of children's knowledge and a decrease of misconceptions between pre and post evaluations. Finally, a satisfaction survey about the program showed a high positive feedback. The study highlights the value of designing multidisciplinary projects, where arts-based education program (grounded in scientific information) has shown to be a successful way to communicate animal knowledge and promote conservation.

Habilidades de comunicação clínica dos preceptores de medicina de família e comunidade em Florianópolis, Santa Catarina, Brasil / Clinical communication skills of preceptors of family and community medicine in Florianópolis, Santa Catarina, Brazil / Habilidades de comunicación clínica de los preceptores de medicina de familia y comunidad en Florianópolis, Santa Catarina, Brasil

Objetivo: Este estudo investigou a autoavaliação dos preceptores (versão resumida do Guia Observacional Calgary-Cambridge) sobre quanto aplicam e ensinam HCC, bem como sobre oportunidades de ensino e qualidade do feedback. Métodos: Realizou-se um estudo transversal com 44 preceptores ativos do internato e da residência de medicina de família e comunidade de Florianópolis, Santa Catarina, Brasil. Resultados: Os preceptores se autoavaliaram positivamente em relação à aplicação e ao ensino de HCC, mas as oportunidades de ensino de HCC são escassas e a qualidade do feedback é mediana. Conclusão: É preciso melhorar a estrutura física e a educação permanente sobre feedback e métodos de ensino, incluindo videogravação de consulta, para ampliar as oportunidades de ensino de HCC.

Objective: This study investigated self-assessment of preceptors (short version of the Calgary-Cambridge Observation Guide) about how much they apply and teach CCS, as well as about teaching opportunities and feedback quality. Methods: A cross-sectional study was carried out with 44 active preceptors of the internship and of the family and community medicine residency of Florianópolis, Santa Catarina, Brazil. Results: Preceptors self-assessed positively regarding CCS application and teaching, but CCS teaching opportunities are scarce and feedback quality is medium. Conclusion: Physical structure and permanent education on feedback and teaching methods, including video recording, need to be improved to expand CCS teaching opportunities.

Objetivo: Este estudio investigó la autoevaluación de los preceptores (versión resumida del Guía Observacional Calgary-Cambridge) acerca de cuánto aplican y enseñan HCC, así como de oportunidades de enseñanza y calidad de la retroalimentación. Métodos: Se realizó un estudio transversal con 44 preceptores activos del Internado y de la Residencia de Medicina de Familia y Comunidad de Florianópolis, Santa Catarina, Brasil. Resultados: Los preceptores se autoevaluaron de forma positiva con relación a la aplicación y la enseñanza de HCC, pero las oportunidades de enseñanza de HCC son escasas, y la calidad de la retroalimentación es regular. Conclusión: Es necesario mejorar la estructura física y la educación permanente sobre retroalimentación y métodos de enseñanza, incluyendo la videograbación de consulta, para ampliar las oportunidades de enseñanza de HCC.