Performance of ChatGPT on the Situational Judgement Test-A Professional Dilemmas-Based Examination for Doctors in the United Kingdom.

BACKGROUND: ChatGPT is a large language model that has performed well on professional examinations in the fields of medicine, law, and business. However, it is unclear how ChatGPT would perform on an examination assessing professionalism and situational judgement for doctors. OBJECTIVE: We evaluated the performance of ChatGPT on the Situational Judgement Test (SJT): a national examination taken by all final-year medical students in the United Kingdom. This examination is designed to assess attributes such as communication, teamwork, patient safety, prioritization skills, professionalism, and ethics. METHODS: All questions from the UK Foundation Programme Office's (UKFPO's) 2023 SJT practice examination were inputted into ChatGPT. For each question, ChatGPT's answers and rationales were recorded and assessed on the basis of the official UK Foundation Programme Office scoring template. Questions were categorized into domains of Good Medical Practice on the basis of the domains referenced in the rationales provided in the scoring sheet. Questions without clear domain links were screened by reviewers and assigned one or multiple domains. ChatGPT's overall performance, as well as its performance across the domains of Good Medical Practice, was evaluated. RESULTS: Overall, ChatGPT performed well, scoring 76% on the SJT but scoring full marks on only a few questions (9%), which may reflect possible flaws in ChatGPT's situational judgement or inconsistencies in the reasoning across questions (or both) in the examination itself. ChatGPT demonstrated consistent performance across the 4 outlined domains in Good Medical Practice for doctors. CONCLUSIONS: Further research is needed to understand the potential applications of large language models, such as ChatGPT, in medical education for standardizing questions and providing consistent rationales for examinations assessing professionalism and ethics.

Artificial intelligence for diagnostic and prognostic neuroimaging in dementia: A systematic review.

INTRODUCTION: Artificial intelligence (AI) and neuroimaging offer new opportunities for diagnosis and prognosis of dementia. METHODS: We systematically reviewed studies reporting AI for neuroimaging in diagnosis and/or prognosis of cognitive neurodegenerative diseases. RESULTS: A total of 255 studies were identified. Most studies relied on the Alzheimer's Disease Neuroimaging Initiative dataset. Algorithmic classifiers were the most commonly used AI method (48%) and discriminative models performed best for differentiating Alzheimer's disease from controls. The accuracy of algorithms varied with the patient cohort, imaging modalities, and stratifiers used. Few studies performed validation in an independent cohort. DISCUSSION: The literature has several methodological limitations including lack of sufficient algorithm development descriptions and standard definitions. We make recommendations to improve model validation including addressing key clinical questions, providing sufficient description of AI methods and validating findings in independent datasets. Collaborative approaches between experts in AI and medicine will help achieve the promising potential of AI tools in practice. HIGHLIGHTS: There has been a rapid expansion in the use of machine learning for diagnosis and prognosis in neurodegenerative disease Most studies (71%) relied on the Alzheimer's Disease Neuroimaging Initiative (ADNI) dataset with no other individual dataset used more than five times There has been a recent rise in the use of more complex discriminative models (e.g., neural networks) that performed better than other classifiers for classification of AD vs healthy controls We make recommendations to address methodological considerations, addressing key clinical questions, and validation We also make recommendations for the field more broadly to standardize outcome measures, address gaps in the literature, and monitor sources of bias.

Incidence and Outcome of Neurologic Immune-Related Adverse Events Associated With Immune Checkpoint Inhibitors in Patients With Melanoma.

BACKGROUND AND OBJECTIVES: Neurologic immune-related adverse events (n-irAEs) reportedly occur in up to 8% of patients treated with immune checkpoint inhibitors (ICIs) of all age groups. We investigated the association between age and n-irAEs in patients treated with ICIs and examined the effect of n-irAEs on survival outcomes in a large cohort of patients with melanoma. METHODS: We conducted a retrospective analysis of patients with advanced melanoma treated with ICIs at Ella Institute for Immuno-oncology and Melanoma between January 1, 2015, and April 20, 2022. The outcomes of interest were defined as the investigation of age-related frequency and severity of n-irAEs, the need for ICI interruption, the treatment required for n-irAE management, the safety of ICI reintroduction, and n-irAE's effect on survival. RESULTS: ICI was administered to 937 patients. At least one irAE occurred in 73.5% (n = 689) of them. Among the study population, 8% (n = 76) developed a n-irAE, with a median age of 66 years in female and 68 years in male patients at onset. The median follow-up after n-irAE was 1,147 days (IQR: 1,091.5 range: 3,938). Fewer irAEs occurred in patients older than 70 years (median: 3 events, p = 0.04, CI 2.5-4.7) while specifically colitis and pneumonitis were more common in the 18-60 age group (p = 0.03, 95% CI 0.8-0.38, p = 0.009, 95% CI 0.06-0.2). Grade ≥ 3 toxicity was seen in 35.5% of patients across age groups. The median time from ICI administration to n-irAE development was 48 days across age groups. Common n-irAE phenotypes were myositis (44.7%), encephalitis (10.5%), and neuropathy (10.5%). N-irAE required hospitalization in 40% of patients and steroids treatment in 46% with a median of 4 days from n-irAE diagnosis to steroids treatment initiation. Nine patients needed second-line immunosuppressive treatment. Rechallenge did not cause additional n-irAE in 71% of patients. Developing n-irAE (HR = 0.4, 95% CI 0.32-0.77) or any irAE (HR = 0.7195% CI 0.56-0.88) was associated with longer survival. DISCUSSION: N-irAEs are a relatively common complication of ICIs (8% of our cohort). Older age was not associated with its development or severity, in contrast with non-n-irAEs which occurred less frequently in the elderly population. Rechallenge did not result in life-threatening AEs. Development of any irAEs was associated with longer survival; this association was stronger with n-irAEs.

The Prevalence of Immediate Hypersensitivity Reactions to the BNT162b2 mRNA Vaccine against SARS-CoV-2: Data from the Vaccination Campaign in a Large Academic Hospital.

The anti-SARS-CoV-2 vaccination has probably been the most effective tool for preventing the infection and negative outcomes of the COVID-19 disease, and therefore for interrupting the pandemic state. The first licensed SARS-CoV-2 vaccine was BNT162b2, an mRNA vaccine that has been widely used since the earliest stages of the global vaccination campaign. Since the beginning of the vaccination campaign, some cases of suspected allergic reactions to BNT162b2 have been described. Epidemiological data, however, have provided reassuring results of an extremely low prevalence of these hypersensitivity reactions to anti-SARS-CoV-2 vaccines. In this article, we describe the results of a survey carried out through the use of a questionnaire, administered to all the health personnel of our university hospital after the first two doses of the BNT162b2 vaccine, which investigated the development of adverse reactions after a vaccination. We analyzed the responses of 3112 subjects subjected to the first dose of the vaccine; among these, 1.8% developed symptoms compatible with allergic reactions and 0.9% with clinical manifestations of possible anaphylaxis. Only 10.3% of the subjects who had allergic reactions after the first injection experienced similar reactions after the second dose and none of them experienced anaphylaxis. In conclusion, the anti-SARS-CoV-2 vaccination is rarely associated with severe allergic reactions and the second dose of vaccine is safe for this group of patients.

A rare presentation of rapidly progressing myopathy in an adolescent.

We present a case of severe juvenile dermatomyositis with limited response to steroids in an adolescent who developed symptoms within hours after receiving Pfizer BNT162b2 coronavirus disease 2019 vaccine. The patient presented with severe weakness of proximal muscles, dyspnoea, and tachycardia. His muscle enzymes were raised, and he was diagnosed with severe juvenile dermatomyositis following magnetic resonance imaging and muscle biopsy. His management was challenging, requiring multidisciplinary input, and difficult decisions with regard to the appropriate immunomodulatory treatments. The patient had to undergo escalating immunosuppressive treatments before he began to recover clinically and biochemically. To our knowledge, this is the first case in an adolescent although a few cases of similar presentations following coronavirus disease 2019 vaccination have been reported in adults. Elucidating the potential relationship of the vaccine with this severe myopathy in an adolescent is important for global vaccination policies, but avoiding the conflation of association with causation is also crucial in the context of the pandemic.

Biologics and airway remodeling in severe asthma.

Asthma is a chronic inflammatory airway disease resulting in airflow obstruction, which in part can become irreversible to conventional therapies, defining the concept of airway remodeling. The introduction of biologics in severe asthma has led in some patients to the complete normalization of previously considered irreversible airflow obstruction. This highlights the need to distinguish a "fixed" airflow obstruction due to structural changes unresponsive to current therapies, from a "reversible" one as demonstrated by lung function normalization during biological therapies not previously obtained even with high-dose systemic glucocorticoids. The mechanisms by which exposure to environmental factors initiates the inflammatory responses that trigger airway remodeling are still incompletely understood. Alarmins represent epithelial-derived cytokines that initiate immunologic events leading to inflammatory airway remodeling. Biological therapies can improve airflow obstruction by addressing these airway inflammatory changes. In addition, biologics might prevent and possibly even revert "fixed" remodeling due to structural changes. Hence, it appears clinically important to separate the therapeutic effects (early and late) of biologics as a new paradigm to evaluate the effects of these drugs and future treatments on airway remodeling in severe asthma.

Biologics in severe asthma: the role of real-world evidence from registries.

Asthma is one of the most common noncommunicable diseases; in the majority of patients it is well controlled with inhaled bronchodilators and inhaled corticosteroids, but the management of severe asthma has been a significant challenge historically. The introduction of novel biologic drugs in the past few decades has revolutionised the field, presenting physicians with a variety of biologic drugs with different mechanisms for the treatment of severe asthma.It is of crucial importance to evaluate the effectiveness of these drugs by following their "real-life" effectiveness rather than relying solely on their efficacy, established in carefully designed clinical trials, which therefore do not necessarily match the profile of the real-life patient. Understanding the actual effectiveness of the specific drugs in real-life patients is a crucial part of tailoring the right drugs to the right patients. Registries serve as an important tool in obtaining real-life evidence, since they are in effect observational studies, following the entire patient population.

Artificial intelligence processing electronic health records to identify commonalities and comorbidities cluster at Immuno Center Humanitas.

Background: Comorbidities are common in chronic inflammatory conditions, requiring multidisciplinary treatment approach. Understanding the link between a single disease and its comorbidities is important for appropriate treatment and management. We evaluate the ability of an NLP-based process for knowledge discovery to detect information about pathologies, patients' phenotype, doctors' prescriptions and commonalities in electronic medical records, by extracting information from free narrative text written by clinicians during medical visits, resulting in the extraction of valuable information and enriching real world evidence data from a multidisciplinary setting. Methods: We collected clinical notes from the Allergy Department of Humanitas Research Hospital written in the last 3 years and used it to look for diseases that cluster together as comorbidities associated to the main pathology of our patients, and for the extent of prescription of systemic corticosteroids, thus evaluating the ability of NLP-based tools for knowledge discovery to extract structured information from free text. Results: We found that the 3 most frequent comorbidities to appear in our clusters were asthma, rhinitis, and urticaria, and that 991 (of 2057) patients suffered from at least one of these comorbidities. The clusters which co-occur particularly often are oral allergy syndrome and urticaria (131 patients), angioedema and urticaria (105 patients), rhinitis and asthma (227 patients). With regards to systemic corticosteroid prescription volume by our clinicians, we found it was lower when compared to the therapy the patients followed before coming to our attention, with the exception of two diseases: Chronic obstructive pulmonary disease and Angioedema. Conclusions: This analysis seems to be valid and is confirmed by the data from the literature. This means that NLP tools could have significant role in many other research fields of medicine, as it may help identify other important, and possibly previously neglected clusters of patients with comorbidities and commonalities. Another potential benefit of this approach lies in its potential ability to foster a multidisciplinary approach, using the same drugs to treat pathologies normally treated by physicians in different branches of medicine, thus saving resources and improving the pharmacological management of patients.

Short-Term Adverse Events and Antibody Response to the BNT162b2 SARS-CoV-2 Vaccine in 4156 Health Care Professionals.

Short-term adverse events are common following the BNT162b2 vaccine for SARS-Cov-2 and have been possibly associated with IgG response. We aimed to determine the incidence of adverse reactions to the vaccine and the impact on IgG response. Our study included 4156 health-care professionals who received two doses of the BNT162b2 vaccine 21 days apart and obtained 6113 online questionnaires inquiring about adverse events. The serum response was tested in 2765 subjects 10 days after the second dose. Adverse events, most frequently a local reaction at the site of injection, were reported by 39% of subjects. Multivariate analysis showed that female sex (odds ratio­OR­1.95; 95% confidence interval­CI­1.74−2.19; p < 0.001), younger age (OR 0.98 per year, p < 0.001), second dose of vaccine (OR 1.36, p < 0.001), and previous COVID-19 infection (OR 1.41, p < 0.001) were independently associated with adverse events. IgG response was significantly higher in subjects with adverse events (1110 AU/mL­IQR 345-1630 vs. 386 AU/mL, IQR 261-1350, p < 0.0001), and the association was more pronounced in subjects experiencing myalgia, fever, and lymphadenopathy. We demonstrate that a more pronounced IgG response is associated with specific adverse events, and these are commonly reported by health care professionals after the BNT162b2 vaccine for SARS-Cov-2.

Allergen immunotherapy for respiratory allergy: Quality appraisal of observational comparative effectiveness studies using the REal Life Evidence AssessmeNt Tool. An EAACI methodology committee analysis.

BACKGROUND: Observational comparative effectiveness studies in allergen immunotherapy (AIT) represent an important evidence source answering research questions that can be challenging to obtain from randomized controlled trials (RCTs), such as long-term benefits of AIT, the effects on asthma prevention and the onset of new allergen sensitizations. However, observational studies are prone to several sources of bias, which limit their reliability.The REal Life Evidence AssessmeNt Tool (RELEVANT) was recently developed to assist in quality appraisal of observational comparative research to enable identification of useful nonrandomized studies to be considered within guideline development. OBJECTIVE: To systematically appraise the quality of published observational comparative AIT studies using RELEVANT. METHODS: Observational studies comparing AIT to pharmacotherapy for respiratory allergies, assessing as outcome measures reduction of symptoms and/or medication use reduction, were retrieved by computerized bibliographic searches. According to RELEVANT, a failure to meet any one of primary items (background, design, measures, analysis, results, discussion/interpretation, and conflict of interest) represents a critical flaw, significantly undermining the validity of the study results. RESULTS: The 14 studies identified supported the benefit of AIT in real-life, which persists after treatment discontinuation. However, none of them met all the 7 primary RELEVANT criteria. The main defects were reported in the design (28.6% of studies), measures and analysis (64.3% of studies), and results (78.6% of studies) items, due to selection bias and lack of methods for adjusting controls. Half of the studies did not report on conflict of interest. CONCLUSION: There is a need for more robust observational research in AIT. RELEVANT appears as an easy-to-use and sensitive tool for quality appraisal in AIT studies.