Exploring the usability of simulated patient methodology in dental clinics in Western Australia: A pilot survey.

OBJECTIVES: This study aimed to explore the dental staff knowledge of simulated patient methodology and support for its use to investigate dental staffs' triaging ability. MATERIAL AND METHODS: Staff at dental practices in Western Australia were invited to participate in a cross-sectional online questionnaire, consisting of demographic questions, questions on triaging, and knowledge of simulated patient methodology. Descriptive and parametric tests were undertaken for quantitative data; qualitative responses were thematically analyzed. RESULTS: Of the 100 participants, most were female (71%), aged 25-39 years (57%), dentists (46%), and worked in private practices (60%). While 82% of participants triaged dental appointment enquiries, only 26% had heard of simulated patient studies. The majority (66%) of participants spent 1-5 min when triaging appointments and less than half (29%) asked about medical history, aggravating or alleviating factors. Although there was a general positive attitude toward use of simulated patient methodology to investigate practice, some concerns were identified. CONCLUSIONS: The findings of our exploratory study suggests that there may be a potential for utilizing simulated patient studies to improve the care of patients by dental receptionists in general dental practices.

ChatGPT With GPT-4 Outperforms Emergency Department Physicians in Diagnostic Accuracy: Retrospective Analysis.

BACKGROUND: OpenAI's ChatGPT is a pioneering artificial intelligence (AI) in the field of natural language processing, and it holds significant potential in medicine for providing treatment advice. Additionally, recent studies have demonstrated promising results using ChatGPT for emergency medicine triage. However, its diagnostic accuracy in the emergency department (ED) has not yet been evaluated. OBJECTIVE: This study compares the diagnostic accuracy of ChatGPT with GPT-3.5 and GPT-4 and primary treating resident physicians in an ED setting. METHODS: Among 100 adults admitted to our ED in January 2023 with internal medicine issues, the diagnostic accuracy was assessed by comparing the diagnoses made by ED resident physicians and those made by ChatGPT with GPT-3.5 or GPT-4 against the final hospital discharge diagnosis, using a point system for grading accuracy. RESULTS: The study enrolled 100 patients with a median age of 72 (IQR 58.5-82.0) years who were admitted to our internal medicine ED primarily for cardiovascular, endocrine, gastrointestinal, or infectious diseases. GPT-4 outperformed both GPT-3.5 (P<.001) and ED resident physicians (P=.01) in diagnostic accuracy for internal medicine emergencies. Furthermore, across various disease subgroups, GPT-4 consistently outperformed GPT-3.5 and resident physicians. It demonstrated significant superiority in cardiovascular (GPT-4 vs ED physicians: P=.03) and endocrine or gastrointestinal diseases (GPT-4 vs GPT-3.5: P=.01). However, in other categories, the differences were not statistically significant. CONCLUSIONS: In this study, which compared the diagnostic accuracy of GPT-3.5, GPT-4, and ED resident physicians against a discharge diagnosis gold standard, GPT-4 outperformed both the resident physicians and its predecessor, GPT-3.5. Despite the retrospective design of the study and its limited sample size, the results underscore the potential of AI as a supportive diagnostic tool in ED settings.

Medical maximization: The effect of personality on triage decision-making.

Mass Casualty Incidents (MCIs) rapidly overwhelm the ability of local medical resources to deliver comprehensive and definitive medical care and they have been occurring more frequently in recent decades and affect countries of all socioeconomic backgrounds (Hart et al., 2018). As such, it is important to understand how individuals make such decisions in these events and what factors can hinder or help the process. In this study we focused on the critical role of maximization within MCI triage. Triaging an MCI requires juggling the demand and supply of resources, time, and focus, likely leading to various decisions involving compromise/sacrifice. In a vignette study, hosted on Amazon Mturk (n = 235, Mean age = 38.05, 51.49% self-identified as male), which involved triaging over 100 patients we found that trait differences maximization impacted the willingness to use a "black tag". Furthermore, maximization also impacted how much information an individual needed about the patient before being willing to use a black tag. Overall, this research demonstrates the importance of understanding factors that create individual differences in how people make decisions during MCI events, especially those decisions that involve the use of potentially lifesaving treatments.

Journal Club: Prehospital Detection of Large Vessel Occlusion Stroke With Electroencephalography: Results of the ELECTRA-STROKE Study.

The ELECTRA-STROKE study investigated the potential of EEG for prehospital triage of patients with ischemic stroke due to large vessel occlusion (LVO), in which fast triage to stroke centers for endovascular treatment is crucial. The study was conducted in 4 phases, and this Journal Club article focuses on the fourth phase in the prehospital setting with suspected stroke patients. An EEG cap with dry electrodes was used to measure brain activity. The main focus was on the diagnostic accuracy of the theta/alpha ratio, which yielded an area under the receiver operator characteristic curve (AUC) of 0.80. Secondary endpoints, particularly the Brain Symmetry Index (a quantified EEG interhemispheric cortical power asymmetry index) in the delta frequency band, showed an AUC of 0.91. Despite the convenient study design and user-friendly EEG device, limitations include a single-arm design, a relatively small sample size, and exclusions due to data quality issues. The usefulness of EEG in the detection of neuronal changes based on brain ischemia was highlighted, but uncertainties remain regarding its use in certain patient groups. The improvements in the Brain Symmetry Index from phase 3 to 4 of the study indicate the potential for further refinement and investigation of combined methods to improve diagnostic accuracy. The study provides insight into the role of EEG in prehospital stroke detection, recognizing both the strengths and limitations. Overall, the study contributes to understanding the promise of EEG in optimizing LVO stroke triage and urges further refinement and exploration of complementary diagnostic approaches.

Acute internal medicine physicians' clinical intuition based on acute care telephone referral: A prospective study.

INTRODUCTION: In the Netherlands, most emergency department (ED) patients are referred by a general practitioner (GP) or a hospital specialist. Early risk stratification during telephone referral could allow the physician to assess the severity of the patients' illness in the prehospital setting. We aim to assess the discriminatory value of the acute internal medicine (AIM) physicians' clinical intuition based on telephone referral of ED patients to predict short-term adverse outcomes, and to investigate on which information their predictions are based. METHODS: In this prospective study, we included adult ED patients who were referred for internal medicine by a GP or a hospital specialist. Primary outcomes were hospital admission and triage category according to the Manchester Triage System (MTS). Secondary outcome was 31-day mortality. The discriminatory performance of the clinical intuition was assessed using an area under the receiver operating characteristics curve (AUC). To identify which information is important to predict adverse outcomes, we performed univariate regression analysis. Agreement between predicted and observed MTS triage category was assessed using intraclass and Spearman's correlation. RESULTS: We included 333 patients, of whom 172 (51.7%) were referred by a GP, 146 (43.8%) by a hospital specialist, and 12 (3.6%) by another health professional. The AIM physician's clinical intuition showed good discriminatory performance regarding hospital admission (AUC 0.72, 95% CI: 0.66-0.78) and 31-day mortality (AUC 0.73, 95% CI: 0.64-0.81). Univariate regression analysis showed that age ≥65 years and a sense of alarm were significant predictors. The predicted and observed triage category were similar in 45.2%, but in 92.5% the prediction did not deviate by more than one category. Intraclass and Spearman's correlation showed fair agreement between predicted and observed triage category (ICC 0.48, Spearman's 0.29). CONCLUSION: Clinical intuition based on relevant information during a telephone referral can be used to accurately predict short-term outcomes, allowing for early risk stratification in the prehospital setting and managing ED patient flow more effectively.

Mapping the processes and information flows of a prehospital emergency care system in Rwanda: a process mapping exercise.

OBJECTIVE: A vital component of a prehospital emergency care system is getting an injured patient to the right hospital at the right time. Process and information flow mapping are recognised methods to show where efficiencies can be made. We aimed to understand the process and information flows used by the prehospital emergency service in transporting community emergencies in Rwanda in order to identify areas for improvement. DESIGN: Two facilitated process/information mapping workshops were conducted. Process maps were produced in real time during discussions and shared with participants for their agreement. They were further validated by field observations. SETTING: The study took place in two prehospital care settings serving predominantly rural and predominantly urban patients. PARTICIPANTS: 24 healthcare professionals from various cadres. Field observations were done on 49 emergencies across both sites. RESULTS: Two maps were produced, and four main process stages were described: (1) call triage by the dispatch/call centre team, (2) scene triage by the ambulance team, (3) patient monitoring by the ambulance team on the way to the health facility and (4) handover process at the health facility. The first key finding was that the rural site had multiple points of entry into the system for emergency patients, whereas the urban system had one point of entry (the national emergency number); processes were otherwise similar between sites. The second was that although large amounts of information were collected to inform decision-making about which health facility to transfer patients to, participants found it challenging to articulate the intellectual process by which they used this to make decisions; guidelines were not used for decision-making. DISCUSSION: We have identified several areas of the prehospital care processes where there can be efficiencies. To make efficiencies in the decision-making process and produce a standard approach for all patients will require protocolising care pathways.

Validation of the Korean Version of the Clinical Frailty Scale-Adjusted Korean Triage and Acuity Scale for Older Patients in the Emergency Department.

Background and Objectives: The Clinical Frailty Scale (CFS), used to screen for prehospital frailty in patients aged >65 years, is simple, time-efficient, and has been validated in emergency departments (EDs). In this study, we analyzed whether the Korean Triage and Acuity Scale (KTAS) classification by level in older patients determined to have frailty based on the Korean version of the CFS increases the triage performance of the current KTAS. Materials and Methods: The primary outcome was 30-day in-hospital mortality, and secondary outcomes were hospital and intensive care unit (ICU) admissions. This study retrospectively analyzed prospectively collected data from three ED centers. Patients with a CFS score ranging from five (mildly frail) to nine (terminally ill) were categorized into the frailty group. We upgraded the KTAS classification of the frailty group by one level of urgency and defined this as the CFS-KTAS. Results: The cutoff values for predicting admission were three and two for the KTAS and CFS-KTAS, respectively. A significant difference was observed in the area under the receiver operating characteristic (AUROC) curve between the KTAS and CFS-KTAS. To predict ICU admission, the cutoff score was two for both scales. A significant difference was observed in the AUROC curve between the KTAS and CFS-KTAS. For predicting in-hospital mortality, the cutoff score was two for both scales. A significant difference was observed in the AUROC curve between the KTAS and CFS-KTAS. Conclusions: This study showed that the CFS-adjusted KTAS has a more useful prognostic value than the KTAS alone for predicting hospital outcomes in older patients.

Efficacy of the Cardiac Implantable Electronic Device Multisensory Triage-HF Algorithm in Heart Failure Care: A Real-World Clinical Experience.

Heart failure (HF) admissions are burdensome, and the mainstay of prevention is the timely detection of impending fluid retention, creating a window for medical treatment intensification. This study evaluated the accuracy and performance of a Triage-HF-guided carepath in real-world ambulatory HF patients in daily clinical practice. In this prospective, observational study, 92 adult HF patients (71 males (78%), with a median age of 69 [IQR 59-75] years) with the Triage-HF algorithm activated in their cardiac implantable electronic devices (CIEDs), were monitored. Following high-risk alerts, an HF nurse contacted patients to identify signs and symptoms of fluid retention. The sensitivity and specificity were 83% and 97%, respectively. The positive predictive value was 89%, and negative predictive value was 94%. The unexplained alert rate was 0.05 alerts/patient year, and the false negative rate was 0.11 alerts/patient year. Ambulatory diuretics were initiated or escalated in 77% of high-risk alert episodes. In 23% (n = 6), admission was ultimately required. The median alert handling time was 2 days. Fifty-eight percent (n = 18) of high-risk alerts were classified as true positives in the first week, followed by 29% in the second-third weeks (n = 9), and 13% (n = 4) in the fourth-sixth weeks. Common sensory triggers included an elevated night ventricular rate (84%), OptiVol (71%), and reduced patient activity (71%). The CIED-based Triage-HF algorithm-driven carepath enables the timely detection of impending fluid retention in a contemporary ambulatory setting, providing an opportunity for clinical action.

Use of Mobile Technologies to Streamline Pretriage Patient Flow in the Emergency Department: Observational Usability Study.

BACKGROUND: In emergency departments (EDs), triage nurses are under tremendous daily pressure to rapidly assess the acuity level of patients and log the collected information into computers. With self-service technologies, patients could complete data entry on their own, allowing nurses to focus on higher-order tasks. Kiosks are a popular working example of such self-service technologies; however, placing a sufficient number of unwieldy and fixed machines demands a spatial change in the greeting area and affects pretriage flow. Mobile technologies could offer a solution to these issues. OBJECTIVE: The aim of this study was to investigate the use of mobile technologies to improve pretriage flow in EDs. METHODS: The proposed stack of mobile technologies includes patient-carried smartphones and QR technology. The web address of the self-registration app is encoded into a QR code, which was posted directly outside the walk-in entrance to be seen by every ambulatory arrival. Registration is initiated immediately after patients or their proxies scan the code using their smartphones. Patients could complete data entry at any site on the way to the triage area. Upon completion, the result is saved locally on smartphones. At the triage area, the result is automatically decoded by a portable code reader and then loaded into the triage computer. This system was implemented in three busy metropolitan EDs in Shanghai, China. Both kiosks and smartphones were evaluated randomly while being used to direct pretriage patient flow. Data were collected during a 20-day period in each center. Timeliness and usability of medical students simulating ED arrivals were assessed with the After-Scenario Questionnaire. Usability was assessed by triage nurses with the Net Promoter Score (NPS). Observations made during system implementation were subject to qualitative thematic analysis. RESULTS: Overall, 5928 of 8575 patients performed self-registration on kiosks, and 7330 of 8532 patients checked in on their smartphones. Referring effort was significantly reduced (43.7% vs 8.8%; P<.001) and mean pretriage waiting times were significantly reduced (4.4, SD 1.7 vs 2.9, SD 1.0 minutes; P<.001) with the use of smartphones compared to kiosks. There was a significant difference in mean usability scores for "ease of task completion" (4.4, SD 1.5 vs 6.7, SD 0.7; P<.001), "satisfaction with completion time" (4.5, SD 1.4 vs 6.8, SD 0.6; P<.001), and "satisfaction with support" (4.9, SD 1.9 vs 6.6, SD 1.2; P<.001). Triage nurses provided a higher NPS after implementation of mobile self-registration compared to the use of kiosks (13.3% vs 93.3%; P<.001). A modified queueing model was identified and qualitative findings were grouped by sequential steps. CONCLUSIONS: This study suggests patient-carried smartphones as a useful tool for ED self-registration. With increased usability and a tailored queueing model, the proposed system is expected to minimize pretriage waiting for patients in the ED.

A Bibliometric Analysis of Telephone Triage Research to 2021 Using VOSviewer.

Telephone triage services are becoming increasingly commonplace in modern healthcare. Despite this widespread adoption, health researchers and practitioners seeking to understand evidence-based best practice face several challenges. Firstly, the few systematic reviews available yield small sample sizes, suggesting a small amount of research. Secondly, the rapid pace of development of telephone triage technologies means that there may be temporal validity issues with the available research, given some of this research is relatively old. Thirdly, researchers use different terminologies to describe telephone triage, meaning evidence may be more difficult to find than if consistent terminology was used. This bibliometric analysis therefore is aimed at providing a macroscopic overview of telephone triage, to understand the scale and scope of the available evidence (i.e., where, when, and by whom research is conducted), for interested researchers and practitioners. Additionally, it is aimed at quantifying the prevalence of terms used to describe telephone triage, to recommend consistent terminology for future use, and to improve accessibility of research. To address these aims, literature searches using three different key terms: "telephone triage," "remote triage," and "teletriage" were conducted in Scopus and PubMed. Corresponding bibliometric data was visualised and analysed using VOSviewer. This bibliometric review identified 784 papers since the term "telephone triage" first appears in 1980, confirming a paucity of literature in the field. An overview of telephone triage research up to 2021 is provided, which should serve as a useful foundation for future research and application of evidence-based practice. Gaps in telephone triage research are identified, and the use of consistent terminology is encouraged, with the aim of supporting telephone triage researchers in determining research priorities and improving the impact of future studies.

Factors affecting communication during telephone triage in medical call centres: a mixed methods systematic review.

BACKGROUND: Telephone triage is used to optimise patient flow in emergency primary healthcare. Poor communication can lead to misunderstandings and compromise patient safety. To improve quality, a comprehensive understanding of factors affecting communication in medical call centres in primary care is needed. The aim of this review was to identify such factors and to describe how they affect communication during telephone triage. METHOD: A mixed-method systematic review was performed. In April 2021 and June 2023, MEDLINE, Embase, CINAHL, and Web of Science were searched for original studies describing communication during telephone triage in primary care medical call centres handling all types of medical problems from an unselected population. All studies were screened by two authors, blinded to each other's decisions. Disagreements were resolved by a third author. A framework was created by the thematic synthesis of the qualitative data and later used to synthesise the quantitative data. By using convergent integrated synthesis, the qualitative and quantitative findings were integrated. The Mixed Methods Appraisal Tool was used to assess methodological limitations. RESULTS: Out of 5087 studies identified in the search, 62 studies were included, comprising 40 qualitative, 16 quantitative and six mixed-method studies. Thirteen factors were identified and organised into four main themes: organisational factors, factors related to the operator, factors related to the caller and factors in the interaction. Organisational factors included availability, working conditions and decision support systems. Factors related to the operator were knowledge and experience, personal qualities and communication strategies. Factors related to the caller were individual differences and the presented medical problem. Factors in the interaction were faceless communication, connection between operator and caller, third-person caller and communication barriers. The factors seem interrelated, with organisational factors affecting all parts of the conversation, and the operator's communication in particular. CONCLUSION: Many factors affect the structure, content, and flow of the conversation. The operators influence the communication directly but rely on the organisation to create a working environment that facilitates good communication. The results are mainly supported by qualitative studies and further studies are needed to explore and substantiate the relevance and effect of individual factors. SYSTEMATIC REVIEW REGISTRATION: PROSPERO CRD42022298022.

Performance of CADM1, MAL and miR124-2 methylation as triage markers for early detection of cervical cancer in self-collected and clinician-collected samples: an exploratory observational study in Papua New Guinea.

OBJECTIVE: WHO recommends human papillomavirus (HPV) testing for cervical screening, with triage of high-risk HPV (hrHPV) positive women. However, there are limitations to effective triage for low-resource, high-burden settings, such as Papua New Guinea. In this exploratory study, we assessed the performance of host methylation as triage tools for predicting high-grade squamous intraepithelial lesions (HSIL) in self-collected and clinician-collected samples. DESIGN: Exploratory observational study. SETTING: Provincial hospital, same-day cervical screen-and-treat trial, Papua New Guinea. PARTICIPANTS: 44 hrHPV+women, with paired self/clinician-collected samples (4 squamous cell carcinomas (SCC), 19 HSIL, 4 low-grade squamous intraepithelial lesions, 17 normal). PRIMARY AND SECONDARY OUTCOME MEASURES: Methylation levels of CADM1, MAL and miR124-2 analysed by methylation-specific PCRs against the clinical endpoint of HSIL or SCC (HSIL+) measured using liquid-based-cytology/p16-Ki67 stain. RESULTS: In clinician-collected samples, MAL and miR124-2 methylation levels were significantly higher with increasing grade of disease (p=0.0046 and p<0.0015, respectively). miR124-2 was the best predictor of HSIL (area under the curve, AUC 0.819) while MAL of SCC (AUC 0.856). In self-collected samples, MAL best predicted HSIL (AUC 0.595) while miR124-2 SCC (AUC 0.812). Combined miR124-2/MAL methylation yielded sensitivity and specificity for HSIL+ of 90.5% (95% CI 69.6% to 98.8%) and 70% (95% CI 45.7% to 88.1%), respectively, in clinician-collected samples, and 81.8% (95% CI 59.7% to 94.8%) and 47.6% (95% CI 25.7% to 70.2%), respectively, in self-collected samples. miR124-2/MAL plus HPV16/HPV18 improved sensitivity for HSIL+ (95.2%, 95% CI 76.2% to 99.9%) but decreased specificity (55.0%, 95% CI 31.5% to 76.9%). CONCLUSION: miR124-2/MAL methylation is a potential triage strategy for the detection of HSIL/SCC in low-income and middle-income country.

Patients suffering traumatic brain injury: patient characteristics, prehospital triage, primary referral and mortality - A population-based follow-up study.

BACKGROUND: Traumatic brain injury (TBI) is a potential high-risk condition, but appropriate care pathways, including prehospital triage and primary referral to a specialised neurosurgical centre, can improve neurological outcome and survival. The care pathway starts with layman triage, wherein the patient or bystander decides whether to contact a general practitioner (GP) or emergency services (1-1-2 call) as an entryway into the health care system. The GP or 112-health care professional then decides on the level of urgency and dispatches emergency medical services (EMS) when needed. Finally, a decision is made regarding referral of the TBI patient to a specialised neurotrauma centre or a local hospital. Recent studies have shown that injuries are generally more severe in patients entering the health care system through EMS (112-calls) than through GPs; however, no information exists on whether mortality and morbidity outcomes differ depending on the referral choice. The aim of this study was to examine triage pathways, including the method of entry into the health care system, as well as patient characteristics and place of primary referral, to determine the associated 30-day and 1-year mortality rates in TBI patients with confirmed intracranial lesions. METHODS: This retrospective observational population-based follow-up study was conducted in the Central Denmark Region from 1 February 2017 to 31 January 2019. We included all adult patients who contacted hospitals and were ascribed a predefined TBI ICD-10 diagnosis code in the Danish National Patient Register. The obtained TBI cohort was merged with prehospital data from the Prehospital Emergency Medical Services, Central Denmark Region, and vital status from the Danish Civil Registration System. Binary logistic regression analysis of mortality was conducted. In all patients with TBI (including concussions), the primary outcome was primary referral to a specialised centre based on mode of entry ('GP/HCP', '112-call' or 'Unreferred') into the health care system. In the subgroup of patients with confirmed intracranial lesions, the secondary outcomes were the relative risk of death at day 30 and 1 year based on the place of primary referral. RESULTS: Of 5,257 first TBI hospital contacts of adult patients included in the cohort, 1,430 (27.2%) entered the health care system via 1-1-2 emergency medical calls. TBI patients triaged by 112-calls were more likely to receive the highest level of emergency response (15.6% vs. 50.3%; p < 0.001) and second-tier resources and were more frequently referred directly to a specialised centre than were patients entering through GPs or other health care personnel. In the subgroup of 1188/5257 (22.4%) patients with confirmed intracranial lesions, we found no difference in the risk ratio of 30 day (RR 1.04 (95%CI 0.65-1.63)) or 1 year (RR 0.96 (95%CI 0.72-1.25)) all-cause mortality between patients primarily referred to a regional hospital or to a specialised centre when adjusting for age, sex, comorbidities, antiplatelet/anticoagulant treatment and type of intracranial lesions. CONCLUSION: TBI patients mainly enter the health system by contact with GPs or other health care professionals. However, patients entering through 112-calls are more frequently triaged directly to specialised centres. We were unable to demonstrate any significant difference in the adjusted 30-day and 1-year mortality based on e primary referral to a specialised centre. The inability to demonstrate an effect on mortality based on primary referral to a specialised centre may reflect a lack of clinical data in the registries used. Considerable differences may exist in nondocumented baseline characteristics (i.e., GCS, blood pressure and injury severity) between the groups and may limit conclusions about differences in mortality. Further research providing high-quality evidence on the effect of primary referral is needed to secure early neurosurgical interventions in TBI patients.

Triage Performance Across Large Language Models, ChatGPT, and Untrained Doctors in Emergency Medicine: Comparative Study.

BACKGROUND: Large language models (LLMs) have demonstrated impressive performances in various medical domains, prompting an exploration of their potential utility within the high-demand setting of emergency department (ED) triage. This study evaluated the triage proficiency of different LLMs and ChatGPT, an LLM-based chatbot, compared to professionally trained ED staff and untrained personnel. We further explored whether LLM responses could guide untrained staff in effective triage. OBJECTIVE: This study aimed to assess the efficacy of LLMs and the associated product ChatGPT in ED triage compared to personnel of varying training status and to investigate if the models' responses can enhance the triage proficiency of untrained personnel. METHODS: A total of 124 anonymized case vignettes were triaged by untrained doctors; different versions of currently available LLMs; ChatGPT; and professionally trained raters, who subsequently agreed on a consensus set according to the Manchester Triage System (MTS). The prototypical vignettes were adapted from cases at a tertiary ED in Germany. The main outcome was the level of agreement between raters' MTS level assignments, measured via quadratic-weighted Cohen κ. The extent of over- and undertriage was also determined. Notably, instances of ChatGPT were prompted using zero-shot approaches without extensive background information on the MTS. The tested LLMs included raw GPT-4, Llama 3 70B, Gemini 1.5, and Mixtral 8x7b. RESULTS: GPT-4-based ChatGPT and untrained doctors showed substantial agreement with the consensus triage of professional raters (κ=mean 0.67, SD 0.037 and κ=mean 0.68, SD 0.056, respectively), significantly exceeding the performance of GPT-3.5-based ChatGPT (κ=mean 0.54, SD 0.024; P<.001). When untrained doctors used this LLM for second-opinion triage, there was a slight but statistically insignificant performance increase (κ=mean 0.70, SD 0.047; P=.97). Other tested LLMs performed similar to or worse than GPT-4-based ChatGPT or showed odd triaging behavior with the used parameters. LLMs and ChatGPT models tended toward overtriage, whereas untrained doctors undertriaged. CONCLUSIONS: While LLMs and the LLM-based product ChatGPT do not yet match professionally trained raters, their best models' triage proficiency equals that of untrained ED doctors. In its current form, LLMs or ChatGPT thus did not demonstrate gold-standard performance in ED triage and, in the setting of this study, failed to significantly improve untrained doctors' triage when used as decision support. Notable performance enhancements in newer LLM versions over older ones hint at future improvements with further technological development and specific training.

Clinical evaluation of primary human papillomavirus (HPV) testing with extended HPV genotyping triage for cervical cancer screening: A pooled analysis of individual patient data from nine population-based cervical cancer screening studies from China.

OBJECTIVE: To assess the clinical values of extended human papillomavirus (HPV) genotyping in triage of high-risk HPV-positive women, focusing on the trade-off between cervical precancer detections and colposcopy referrals. METHODS: A bivariate random-effects model was used to estimate the diagnostic accuracy of primary HPV screening with following triage strategies to detect cervical precancers: (i) partial genotyping for HPV16/18 combined with cytological testing at atypical squamous cells of undetermined significance threshold (used as the comparator), (ii) genotyping for HPV16/18/58/52, (iii) genotyping for HPV16/18/58/52/33, (iv) genotyping for HPV16/18/58/33/31, (v) genotyping for HPV16/18/58/52/33/31, and (vi) genotyping for HPV16/18/58/52/33/31/39/51. Internal risk benchmarks for clinical management were used to evaluate the risk stratification of each triage strategy. RESULTS: A total of 16,982 women (mean age 46.1 years, range 17-69) were included in this analysis. For CIN3+ detection, triage with HPV16/18/58/33/31 genotyping achieved lower positivity (6.85% vs. 7.35%, p = 0.001), while maintaining similar sensitivity (91.35% vs. 96.42%, p = 0.32) and specificity (94.09% vs. 93.67%, p = 0.56) compared with the comparator strategy. Similar patterns were observed for CIN2+ detection. Women with a positive HPV16/18/58/33/31 genotyping test had high enough risk for CIN3+ for colposcopy referral, while the risk for women with a negative test was below the 1-year return decision threshold according to internal benchmarks. CONCLUSIONS: Our findings suggested extended HPV genotyping is of potential to be used as a triage technique integrated into HPV-based cervical cancer screening, leading to reduced need for colposcopy referral while maintaining similar disease detection and efficient risk stratification.

Comparison of HPV-positive triage strategies combining extended genotyping with cytology or p16/ki67 dual staining in the Italian NTCC2 study.

BACKGROUND: Each high-risk HPV genotype has different oncogenic potential, and the risk of CIN3+ varies according to genotype. We evaluated the performance of different strategies of HPV-positivity triage combining cytology, p16/ki67 dual staining (DS), and extended genotyping. METHODS: Samples from 3180 consecutive women from the NTCC2 study (NCT01837693) positive for HPV DNA at primary screening, were retrospectively analyzed by the BD Onclarity HPV Assay, which allows extended genotyping. Genotypes were divided into three groups based on the risk of CIN3+. HPV DNA-positive women were followed up for 24 months or to clearance. FINDINGS: Combining the three groups of genotypes with cytology or DS results we identify a group of women who need immediate colposcopy (PPV for CIN3+ from 7.8 to 20.1%), a group that can be referred to 1-year HPV retesting (PPV in those HPV-positive at retesting from 2.2 to 3.8), and a group with a very low 24-month CIN3+ risk, i.e. 0.4%, composed by women cytology or DS negative and positive for HPV 56/59/66 or 35/39/68 or negative with the Onclarity test, who can be referred to 3-year retesting. INTERPRETATION: Among the baseline HPV DNA positive/cytology or DS negative women, the extended genotyping allows to stratify for risk of CIN3+, and to identify a group of women with a risk of CIN3+ so low in the next 24 months that they could be referred to a new screening round after 3 years. FUNDING: Italian Ministry of Health (grant number RF-2009-1536040). Hologic-Genprobe, Roche Diagnostics, and Becton & Dickinson provided financial and non-financial support.

Rethinking the Role of Biodosimetry to Assess Risks for Acute Radiation Syndrome in Very Large Radiation Events: Reconsidering Legacy Concepts.

The development of effective uses of biodosimetry in large-scale events has been hampered by residual, i.e., "legacy" thinking based on strategies that scale up from biodosimetry in small accidents. Consequently, there remain vestiges of unrealistic assumptions about the likely magnitude of victims in "large" radiation events and incomplete analyses of the logistics for making biodosimetry measurements/assessments in the field for primary triage. Elements remain from an unrealistic focus on developing methods to use biodosimetry in the initial stage of triage for a million or more victims. Based on recent events and concomitant increased awareness of the potential for large-scale events as well as increased sophistication in planning and experience in the development of biodosimetry, a more realistic assessment of the most effective roles of biodosimetry in large-scale events is urgently needed. We argue this leads to a conclusion that the most effective utilization of biodosimetry in very large events would occur in a second stage of triage, after initially winnowing the population by identifying those most in need of acute medical attention, based on calculations of geographic sites where significant exposures could have occurred. Understanding the potential roles and limitations of biodosimetry in large-scale events involving significant radiation exposure should lead to development of the most effective and useful biodosimetric techniques for each stage of triage for acute radiation syndrome injuries, i.e., based on more realistic assumptions about the underlying event and the logistics for carrying out biodosimetry for large populations.