Twelve tips to leverage AI for efficient and effective medical question generation: A guide for educators using Chat GPT.

BACKGROUND: Crafting quality assessment questions in medical education is a crucial yet time-consuming, expertise-driven undertaking that calls for innovative solutions. Large language models (LLMs), such as ChatGPT (Chat Generative Pre-Trained Transformer), present a promising yet underexplored avenue for such innovations. AIMS: This study explores the utility of ChatGPT to generate diverse, high-quality medical questions, focusing on multiple-choice questions (MCQs) as an illustrative example, to increase educator's productivity and enable self-directed learning for students. DESCRIPTION: Leveraging 12 strategies, we demonstrate how ChatGPT can be effectively used to generate assessment questions aligned with Bloom's taxonomy and core knowledge domains while promoting best practices in assessment design. CONCLUSION: Integrating LLM tools like ChatGPT into generating medical assessment questions like MCQs augments but does not replace human expertise. With continual instruction refinement, AI can produce high-standard questions. Yet, the onus of ensuring ultimate quality and accuracy remains with subject matter experts, affirming the irreplaceable value of human involvement in the artificial intelligence-driven education paradigm.

Feasibility assurance: a review of automatic item generation in medical assessment.

BACKGROUND: Current demand for multiple-choice questions (MCQs) in medical assessment is greater than the supply. Consequently, an urgency for new item development methods arises. Automatic Item Generation (AIG) promises to overcome this burden, generating calibrated items based on the work of computer algorithms. Despite the promising scenario, there is still no evidence to encourage a general application of AIG in medical assessment. It is therefore important to evaluate AIG regarding its feasibility, validity and item quality. OBJECTIVE: Provide a narrative review regarding the feasibility, validity and item quality of AIG in medical assessment. METHODS: Electronic databases were searched for peer-reviewed, English language articles published between 2000 and 2021 by means of the terms 'Automatic Item Generation', 'Automated Item Generation', 'AIG', 'medical assessment' and 'medical education'. Reviewers screened 119 records and 13 full texts were checked according to the inclusion criteria. A validity framework was implemented in the included studies to draw conclusions regarding the validity of AIG. RESULTS: A total of 10 articles were included in the review. Synthesized data suggests that AIG is a valid and feasible method capable of generating high-quality items. CONCLUSIONS: AIG can solve current problems related to item development. It reveals itself as an auspicious next-generation technique for the future of medical assessment, promising several quality items both quickly and economically.

The assessment of capacity limitations in psychiatric work disability evaluations by the social functioning scale Mini-ICF-APP.

OBJECTIVE: Insurers frequently commission medical experts to estimate the degree of the remaining work capacity (RWC) in claimants for disability benefits. The social functioning scale Mini-ICF-APP allows for a rating of activity and participation limitations in thirteen capacity domains, considered as particularly relevant for work ability. The current study sought to evaluate the role of the Mini-ICF-APP ratings in psychiatric work disability evaluations, by examining how the capacity limitation ratings varied with the claimants' primary psychiatric diagnoses and how the ratings were related to RWC estimates. METHODS: Medical experts estimated the RWC of 946 claimants with mental disorders and rated their activity and participation limitations using the Mini-ICF-APP, with higher ratings reflecting more severe limitations. The ratings were compared between claimants with different psychiatric diagnoses by analyses of variance. The mean Mini-ICF-APP rating across all capacity domains as well as all capacity-specific ratings were entered in simple or multiple regression models to predict the RWC in an alternative job. RESULTS: The Mini-ICF-APP capacity limitation ratings in all domains but mobility were higher for claimants with personality and behavior disorders as compared to those with mood disorders or with neurotic, stress-related and somatoform disorders. The largest differences were observed in social capacities (e.g. group integration: F 2, 847 = 78.300, P < 0.001). In claimants with depression, all ratings increased with the severity of the diagnosis (all Fs 2, 203 > 16.393, all Ps < 0.001). In the overall sample, the mean Mini-ICF-APP rating showed a strong negative correlation with the estimated RWC (r = -.720, P < 0.001). Adding the capacity-specific ratings to the prediction model improved this prediction only marginally. DISCUSSION: The Mini-ICF-APP allows for documenting claimants' activity and participation limitations, which is likely to increase the transparency of medical experts' RWC estimates and enables them to check the plausibility of such estimates. However, our study showed that despite the strong association between RWC and Mini-ICF-APP ratings, half of the RWC variance was unrelated to the capacity limitations documented in the Mini-ICF-APP.

Video analysis of concussion mechanisms and immediate management in French men's professional football (soccer) from 2015 to 2019.

In this study, the concussion mechanisms were analyzed in male professional competition football, with the main objective to specify the frequency of head-to-head impact, and immediate management of the concussed players was described in order to check its compliance with the recommendations of football's governing bodies. Based on continuously recorded data from the French Football Federation (FFF), a retrospective database of all reported concussions during matches in the 1st and 2nd French Male leagues was generated comprising seasons 2015/16-2018/19. Injury mechanisms, playing action, immediate medical assessment and management of concussed players, and foul play-referee's decision, were analyzed from video recordings. In total, 41 concussions were reported (incidence rate of 0.44/1000 hours of match exposure [95% CI: 0.40 to 0.49]) of which 36 were identified and analyzed on video sequences. The commonest playing action leading to concussion was aerial challenge (61%), and the main mechanism was head-to-head impact (47%). Following the head impact, 28% of concussed players were not medically assessed on pitch and 53% returned to play the same match. Head-to-head impact was not associated with systematic medical assessment, nor with foul play. In conclusion, the main cause of concussions involved head-to-head impact occurring when two players challenge for heading the ball in the air. The detection of potential concussive head impacts and the immediate management of players possibly concussed during matches remain insufficient according to the international recommendations. Some rules changes, with particular vigilance in case of head-to-head impact, should be discussed.

Effectiveness of clinical criteria in directing patient flow from the emergency department to a medical assessment unit in Queensland, Australia: a retrospective chart review of hospital administrative data.

BACKGROUND: Medical Assessment Units (MAUs) have become a popular model of acute medical care to improve patient flow through timely clinical assessment and patient management. The purpose of this study was to determine the effectiveness of a consensus-derived set of clinical criteria for patient streaming from the Emergency Department (ED) to a 15-bed MAU within the highly capacity-constrained environment of a large quaternary hospital in Queensland, Australia. METHODS: Clinically coded data routinely submitted for inter-hospital benchmarking purposes was used to identify the cohort of medical admission patients presenting to the ED in February 2016 (summer) and June 2016 (winter). A retrospective review of patient medical records for this cohort was then conducted to extract MAU admission data, de-identified patient demographic data, and clinical criteria. The primary outcome was the proportion of admissions that adhered to the MAU admission criteria. RESULTS: Of the total of 540 included patients, 386 (71 %) patients were deemed to meet the MAU eligibility admission criteria. Among patients with MAU indications, 66 % were correctly transferred (95 % CI: 61 to 71) to the MAU; this estimated sensitivity was statistically significant when compared with random allocation (p-value < 0.001). Transfer outcomes for patients with contraindications were subject to higher uncertainty, with a high proportion of these patients incorrectly transferred to the MAU (73 % transferred; 95 % CI: 50 to 89 %; p-value = 0.052). CONCLUSIONS: Based on clinical criteria, approximately two-thirds of patients were appropriately transferred to the MAU; however, a larger proportion of patients were inappropriately transferred to the MAU. While clinical criteria and judgement are generally established as the process in making decisions to transfer patients to a limited-capacity MAU, our findings suggest that other contextual factors such as bed availability, time of day, and staffing mix, including discipline profile of decision-making staff during ordinary hours and after hours, may influence decisions in directing patient flow. Further research is needed to better understand the interplay of other determinants of clinician decision making behaviour to inform strategies for improving more efficient use of MAUs, and the impact this has on clinical outcomes, length of stay, and patient flow measures in MAUs.

Analysis of disability for HIV disease in 2010-2018.

The present paper analyses the development of invalidity in people living with HIV over a nine-year period from 2010 to 2018. The disability assessment criteria currently in place were introduced in 2010 and are legally regulated. The paper draws from the Czech Social Security Administration data to analyse the incidence of invalidity as a result of HIV infection compared to other diseases in the Czech population. The authors illustrate the invalidity assessment criteria with a case study. In the final part, updating the current assessment criteria is recommended, also because of the envisaged ICD-11 implementation in the Czech Republic.

Virtually prepared! Student-led online clinical assessment.

The transition of medical education from a face-to-face to virtual setting due to the ongoing COVID-19 restrictions has been challenging. While both students and educators have now somewhat settled into new teaching methods, from Zoom™ lectures to online tutorials, the adaption of clinical skills teaching to the virtual setting has lagged behind. As a result, many students have been left feeling anxious and concerned about practicing practical and communication skills that are central to being a competent and safe doctor. In light of this, medical students at the Queen's University Belfast General Practice (GP) Society organised a series of virtual, mock Objective Structured Clinical Examinations (OSCEs) for students in Years 2-5 conducted via Zoom™. Medical students and doctors acted as examiners and simulated patients (SPs) with 'breakout rooms' being used to simulate distinct OSCE stations. This collaborative project was well received by participants and doctors alike, who found the virtual OSCEs improved their confidence in performing key clinical skills and virtual consultations. As medical students ourselves, we gained early career exposure to designing and delivering assessments and developed transferable skills, relevant both to medicine and teaching. Lastly, the peer-led approach disrupted the traditional hierarchy in medical education. Students are a key, and often overlooked, resource to overcoming challenges in medical education and educators should encourage students to become involved in medical education at an early stage in their careers.

Understand My Language, to Understand My Pain: Challenges of Neurological Evaluation Among Refugees.

The increasing number of migrants and refugees entering Albania during the last decade has been a challenge to the medical service of the country. Many of the migrants arrive from remote areas of Middle East or other Asian regions, heading toward northern Europe, deprived from medical assistance during their tormenting journey. An exacerbation of previous m"unicodeedical conditions is expected and is related to the hardship of traveling conditions. The medical professionals working in migration medicine have little, if any, training on the field and need to familiarize themselves with a variety of previously unknown conditions. Empathy, necessary on an individual basis, may not be sufficient in itself; the burden of medically treating migrants needs a holistic and multidisciplinary approach.

[Emergency medical assessment of the patient with psychiatric conditions]. / Évaluation médicale aux urgences du patient à présentation psychiatrique.

The evaluation by the emergency doctor of the patient presenting with a psychiatric symptom before being taken care of by the psychiatric team is described by the term medical clearance. There is little work on the performance of complementary examinations on these patients. A retrospective multicentre study conducted at the Metz-Thionville regional hospital (57) shows that at least one complementary examination was carried out in 61% of hospitalised patients, compared with 28% of non-hospitalised patients. For 2.4% of patients, the final diagnosis was organic.

Different cognitive styles can affect performance in laparoscopic surgery skill training.

BACKGROUND: The lack of depth cues and haptic feedback makes minimally invasive surgery a cognitive challenge. It is therefore important to know which individuals are expected to perform well in minimally invasive surgery. In cognitive psychology, methods are available with which one can measure different cognitive thinking styles. It is well known that these cognitive styles correlate with many different tasks. We investigated whether this method can also predict performance on a box trainer (Lübeck Toolbox®), a device for training laparoscopic surgery. If so, the method might help to select and train those people who will most likely develop high skills in minimally invasive surgery. METHODS: Thirty medical students and thirty non-medical students performed five laparoscopic surgical tasks on a box trainer. We measured the time required and the errors participants made on each task. Their cognitive style was measured with a method from cognitive psychology that distinguishes between people who think visually, spatially, or verbally. Furthermore, all students completed a subset of a standard intelligence test (Wechsler Adult Intelligence Scale) and three subtests of the German Medical University Admission Test (TMS). RESULTS: Participants with spatial thinking styles performed best on the box trainer. Visual and verbal cognitive styles impeded box trainer performance. Performance on the box trainer could also be predicted by the TMS and IQ scores. CONCLUSIONS: The study shows for the first time that a standard method from cognitive psychology can be used to distinguish between different cognitive styles in surgical education and that these different cognitive styles affect performance on a box trainer. Since the correlation between box trainer performance and surgical proficiency is well documented, the method might be an efficient way to reduce errors and to elevate patient safety in laparoscopic surgery.

Excessive daytime sleepiness in obstructive sleep apnea: implications for driving licenses.

PURPOSE: Excessive daytime sleepiness (EDS) while driving is a major international public health issue resulting in a more than doubled risk of motor vehicle accidents (MVAs). Obstructive sleep apnea (OSA) is the most frequent medical cause of EDS. Therefore, the European Union Directive 2014/85/EU determined that "untreated moderate to severe OSA coincident with EDS constitutes a medical disorder leading to unfitness to drive." The paper aims are to provide a brief review of sleepiness and its implications for driving safety, as well as to describe the subjective and objective methods to accurately evaluate EDS in order to assess fitness to drive in patients with OSA. METHODS: We examined databases including PubMed, Medline, and EMBASE using the search terms "sleepiness at the wheel, excessive daytime sleepiness, sleepiness measure, sleep-wake cycle, obstructive sleep apnea, driving license, fitness to drive." RESULTS: Significant interindividual variability in EDS exists in patients with comparable severity of OSA. Objective methods of measuring EDS are too expensive and time consuming to be suitable for the certification of driving licenses. The reliability of subjective methods depends upon the clinical setting and subjective tools assess only limited aspects of EDS. Objective measures, such as biochemical biomarkers, must, therefore, support subjective methods. CONCLUSIONS: Extensive data have supported different subjective and objective methods for the appraisal of EDS in patients with OSA depending upon the clinical and experimental setting. Challenges remain to determine an appropriate tool for the evaluation of fitness to drive.

Effects of a vocational rehabilitation programme on return to work among sick-listed primary health care patients: a population-based matched, case-control study.

BACKGROUND: To evaluate the efficacy of a multidisciplinary vocational programme in sick-listed, primary health care patients as compared to matched non-programme patients. METHODS: The design was a 3-year prospective population-based, matched case-control study. It was set in a large primary healthcare centre in the city of Eskilstuna, Sweden. The subjects were 943 sickness-certified patients (482 women and 461 men). 170 high-risk patients and a matched control group (n = 340) with similar risk for not returning to work within expected time, based on propensity score was created. The intervention group passed a multidisciplinary medical assessment and a coordinated vocational programme, while the control group received usual care by their general practitioner. Main outcome was sick leave conclusion and the day when it occurred. RESULTS: The follow-up time was subdivided into four periods. During the first two periods, days 1-14 and days 15-112 after baseline, the intervention group had a significantly lower sick leave conclusion rate than the control group (hazard ratios, (HR) 0.32, 95% CI 0.20-0.51, p <  0.0001 and 0.47, 95% CI 0.35-0.64). During the third period, days 113-365, the intervention group had an insignificantly lower conclusion rate (HR 0.70, 95% CI 0.46-1.08, p = 0.10), and during the fourth follow-up period, days 366-1096, the intervention group had an insignificantly higher conclusion rate than the control group (HR 1.16, 95% CI 0.69-1.96, p = 0.58). Across the total follow-up period, the intervention group had a lower conclusion rate than the control group (HR 0.55, 95% CI 0.45-0.66, p <  0.0001). CONCLUSIONS: No positive significant effects of the rehabilitation programme on time to sick leave conclusion were found.

[What is an accident anyway and what is injury? : Considerations on causality in various legal fields]. / Was ist überhaupt Unfall und was Verletzung? : Kausalitätsüberlegungen in verschiedenen Rechtsgebieten.

It is not infrequent for physicians or lawyers who only occasionally deal with medical expert opinions to have difficulty understanding terms used in a legal context. A question of proof relating to consequences of an accidental injury can refer to the accidental injury itself and it seems relatively unknown that the term accident can apply to both the event and the damage/harm to health. The special situations with mental injuries (psychotrauma) are not dealt with in this article.This article explains the concepts and terms that are frequently used in relation to questions of causality and explains the fundamentals of medical causality assessment, from the viewpoint of both medical expertise and law. The focus is on private and public accident insurance, but the law relating to accidents at work of public officials and liability are also considered.

[Problems of forensic medical assessment of neurological manifestations of injury of the caudal spine and ways to solve them]. / Problemy sudebno-meditsinskoi otsenki nevrologicheskikh proyavlenii ushiba kaudal'nykh otdelov spinnogo mozga i puti ikh resheniya.

The aim of the work is to consider the problematic issues of forensic medical assessment of neurological manifestations of injure of the caudal spine. The current edition of the Medical criteria of characteristics doesn't contain clear qualification and interpretation of definitions of the health severity in patients with injury of the caudal spine. Proposed to determine the health damage by the outcome in accordance with the degree of persistent loss of general ability to work when examining spine injuries with clinically established neurological deficits in the absence of danger to human life.

Considerations that will determine if competency-based assessment is a sustainable innovation.

Educational assessment for the health professions has seen a major attempt to introduce competency based frameworks. As high level policy developments, the changes were intended to improve outcomes by supporting learning and skills development. However, we argue that previous experiences with major innovations in assessment offer an important road map for developing and refining assessment innovations, including careful piloting and analyses of their measurement qualities and impacts. Based on the literature, numerous assessment workshops, personal interactions with potential users, and our 40 years of experience in implementing assessment change, we lament the lack of a coordinated approach to clarify and improve measurement qualities and functionality of competency based assessment (CBA). To address this worrisome situation, we offer two roadmaps to guide CBA's further development. Initially, reframe and address CBA as a measurement development opportunity. Secondly, using a roadmap adapted from the management literature on sustainable innovation, the medical assessment community needs to initiate an integrated plan to implement CBA as a sustainable innovation within existing educational programs and self-regulatory enterprises. Further examples of down-stream opportunities to refocus CBA at the implementation level within faculties and within the regulatory framework of the profession are offered. In closing, we challenge the broader assessment community in medicine to step forward and own the challenge and opportunities to reframe CBA as an innovation to improve the quality of the clinical educational experience. The goal is to optimize assessment in health education and ultimately improve the public's health.

[Morphogenesis of central and peripheral liver ruptures in blunt-force trauma]. / Morfogenez tsentral'nykh i perifericheskikh razryvov pecheni pri travme tupymi predmetami.

The purpose of this study was an in depth investigation of the morphogenesis of central and peripheral liver ruptures in blunt trauma and to obtain additional information about their forensic medical significance. It has been established that central and peripheral ruptures are formed by shocks caused by very high forces, as well as by frontal compression of the body as a result of general deformation of the organ and rupture of parenchyma from stretching and tissue shearing. The surface relief of central ruptures was found to be independent of the type of external influence and was determined by the size of the rupture. The peripheral part of such ruptures was characterized by a relatively homogeneous surface topography formed by shear ridges, while the central part was characterized by an inhomogeneous surface topography formed by tensile zones. The surface relief of peripheral ruptures also did not depend on the type of external influence. The surface was relatively homogeneous, with ridges along the edge of the rupture, shear ridges and stretch zones directed deep into the rupture and forming the rupture surface relief in the form of alternating elevations and depressions.

[Osteoporosis in private accident insurance]. / Osteoporose in der privaten Unfallversicherung.

Osteoporosis is a multifactorial disease resulting in reduced bone strength and increased bone fragility. The cause of osteoporosis is underexplored. The manifestation of osteoporosis makes a significant contribution to the development of bone fractures. In the medical assessment, the question arises to what extent osteoporosis is considered to be a previous disability or in particular as a contributory factor. In particular, there are some uncertainties relating to the degree of possible participation, as there are only insufficient scientific evaluation systems. From the authors' point of view no valid assessment of the degree of participation exists on the basis of technical examinations or even the severity of the trauma. At the current time there is no possibility to indicate the level of contribution in 10% or 20% steps. Taking the total picture, including clinical and radiological findings into consideration, it seems possible to assess the contribution only in larger percentage steps (e.g. 0%, 50% or ≥80%). The mere diagnosis of osteoporosis does not justify a participation rate unless its effects can be pathomorphologically proven.

Choosing medical assessments: Does the multiple-choice question make the grade?

Background: The multiple-choice question (MCQ) has been shown to measure the same constructs as the short-answer question (SAQ), yet the use of the latter persists. The study aims to evaluate whether assessment using the MCQ alone provides the same outcomes as testing with the SAQ. Methods: A prospective study design was used. A total of 276 medical students participated in a mock examination consisting of forty MCQs paired to forty SAQs, each pair matched in cognitive skill level and content. Each SAQ was marked by three independent markers. The impact of item-writing flaws (IWFs) on examination outcome was also evaluated. Results: The intraclass correlation coefficient (ICC) was 0.75 for the year IV examinations and 0.68 for the year V examinations. MCQs were more prone to IWFs than SAQs, but the effect when present in the latter was greater. Removal of questions containing IWFs from the year V SAQ allowed 39% of students who would otherwise have failed to pass. Discussion: The MCQ can test higher order skills as effectively as the SAQ and can be used as a single format in written assessment provided quality items testing higher order cognitive skills are used. IWFs can have a critical role in determining pass/fail results.

Task Demands in OSCEs Influence Learning Strategies.

THEORY: Models on pre-assessment learning effects confirmed that task demands stand out among the factors assessors can modify in an assessment to influence learning. However, little is known about which tasks in objective structured clinical examinations (OSCEs) improve students' cognitive and metacognitive processes. Research is needed to support OSCE designs that benefit students' metacognitive strategies when they are studying, reinforcing a hypothesis-driven approach. With that intent, hypothesis-driven physical examination (HDPE) assessments ask students to elicit and interpret findings of the physical exam to reach a diagnosis ("Examine this patient with a painful shoulder to reach a diagnosis"). HYPOTHESES: When studying for HDPE, students will dedicate more time to hypothesis-driven discussions and practice than when studying for a part-task OSCE ("Perform the shoulder exam"). It is expected that the whole-task nature of HDPE will lead to a hypothesis-oriented use of the learning resources, a frequent use of adjustment strategies, and persistence with learning. METHOD: In a mixed-methods study, 40 medical students were randomly paired and filmed while studying together for two hypothetical OSCE stations. Each 25-min study period began with video cues asking to study for either a part-task OSCE or an HDPE. In a crossover design, sequences were randomized for OSCEs and contents (shoulder or spine). Time-on-task for discussions or practice were categorized as "hypothesis-driven" or "sequence of signs and maneuvers." Content analysis of focus group interviews summarized students' perception of learning resources, adjustment strategies, and persistence with learning. RESULTS: When studying for HDPE, students allocate significantly more time for hypothesis-driven discussions and practice. Students use resources contrasting diagnoses and report persistence with learning. When studying for part-task OSCEs, time-on-task is reversed, spent on rehearsing a sequence of signs and maneuvers. CONCLUSIONS: OSCEs with similar contents but different task demands lead to opposite learning strategies regarding how students manage their study time. Measuring pre-assessment effects from a metacognitive perspective provides empirical evidence to redesign assessments for learning.

A pilot study to assess the utility of a freely downloadable mobile application simulator for undergraduate clinical skills training: a single-blinded, randomised controlled trial.

BACKGROUND: Medical simulators offer an invaluable educational resource for medical trainees. However, owing to cost and portability restrictions, they have traditionally been limited to simulation centres. With the advent of sophisticated mobile technology, simulators have become cheaper and more accessible. Touch Surgery is one such freely downloadable mobile application simulator (MAS) used by over one million healthcare professionals worldwide. Nevertheless, to date, it has never been formally validated as an adjunct in undergraduate medical education. METHODS: Medical students in the final 3 years of their programme were recruited and randomised to one of three revision interventions: 1) no formal revision resources, 2) traditional revision resources, or 3) MAS. Students completed pre-test questionnaires and were then assessed on their ability to complete an undisclosed male urinary catheterisation scenario. Following a one-hour quarantined revision period, all students repeated the scenario. Both attempts were scored by allocation-blinded examiners against an objective 46-point mark scheme. RESULTS: A total of 27 medical students were randomised (n = 9 per group). Mean scores improved between baseline and post-revision attempts by 8.7% (p = 0.003), 19.8% (p = 0.0001), and 15.9% (p = 0.001) for no resources, traditional resources, and MAS, respectively. However, when comparing mean score improvements between groups there were no significant differences. CONCLUSIONS: Mobile simulators offer an unconventional, yet potentially useful adjunct to enhance undergraduate clinical skills education. Our results indicate that MAS's perform comparably to current gold-standard revision resources; however, they may confer significant advantages in terms of cost-effectiveness and practice flexibility. TRIAL REGISTRATION: Not applicable.