Artificial intelligence-based evaluation of carotid artery compressibility via point-of-care ultrasound in determining the return of spontaneous circulation during cardiopulmonary resuscitation.

AIM: This study introduces RealCAC-Net, an artificial intelligence (AI) system, to quantify carotid artery compressibility (CAC) and determine the return of spontaneous circulation (ROSC) during cardiopulmonary resuscitation. METHODS: A prospective study based on data from a South Korean emergency department from 2022 to 2023 investigated carotid artery compressibility in adult patients with cardiac arrest using a novel AI model, RealCAC-Net. The data comprised 11,958 training images from 161 cases and 15,080 test images from 134 cases. RealCAC-Net processes images in three steps: TransUNet-based segmentation, the carotid artery compressibility measurement algorithm for improved segmentation and CAC calculation, and CAC-based classification from 0 (indicating a circular shape) to 1 (indicating high compression). The accuracy of the ROSC classification model was tested using metrics such as the dice similarity coefficient, intersection-over-union, precision, recall, and F1 score. RESULTS: RealCAC-Net, which applied the carotid artery compressibility measurement algorithm, performed better than the baseline model in cross-validation, with an average dice similarity coefficient of 0.90, an intersection-over-union of 0.84, and a classification accuracy of 0.96. The test set achieved a classification accuracy of 0.96 and an F1 score of 0.97, demonstrating its efficacy in accurately identifying ROSC in cardiac arrest situations. CONCLUSIONS: RealCAC-Net enabled precise CAC quantification for ROSC determination during cardiopulmonary resuscitation. Future research should integrate this AI-enhanced ultrasound approach to revolutionize emergency care.

Emergency medicine residents' learning curve in diagnosing deep vein thrombosis with 3-point venous point-of-care ultrasound.

BACKGROUND: Many cases of deep vein thrombosis (DVT) are diagnosed in the emergency department, and abbreviated lower extremity venous point-of-care ultrasound (POCUS) has already shown an accuracy comparable to that of specialists. This study aimed to identify the learning curve necessary for emergency medicine (EM) residents to achieve expertise-level accuracy in diagnosing DVT through a 3-point lower extremity venous POCUS. METHODS: This prospective study was conducted at an emergency department between May 2021 and October 2022. Four EM residents underwent a one-hour POCUS training session and performed DVT assessments in participants with DVT symptoms or confirmed pulmonary embolism. POCUS was performed at three proximal lower extremity sites to evaluate the thrombi presence and vein compressibility, with results validated by specialized radiology ultrasound. Cumulative sum (CUSUM) and the Bush and Mosteller models were used to analyze the learning curve, while generalized estimating equations were used to identify factors affecting diagnostic accuracy. RESULTS: 91 POCUS scans were conducted in 49 patients, resulting in 22% DVT confirmed by specialized venous ultrasound. In the CUSUM analysis, all four EM residents attained a 90% success rate at the common femoral vein, whereas only half achieved this rate when all three sites were considered. According to Bush and Mosteller models, 13-18 cases are required to attain 90-95% diagnostic accuracy. After 10-16 cases, the examination time for each resident decreased, and a 20% increase in examiner confidence was linked to a 2.506-fold increase in the DVT diagnosis accuracy. CONCLUSION: EM residents generally required 13-18 cases for 90-95% DVT diagnostic accuracy, but proficiency varied among individuals, particularly requiring more cases for regions outside the common femoral vein.

Inter hospital external validation of interpretable machine learning based triage score for the emergency department using common data model.

Emergency departments (ED) are complex, triage is a main task in the ED to prioritize patient with limited medical resources who need them most. Machine learning (ML) based ED triage tool, Score for Emergency Risk Prediction (SERP), was previously developed using an interpretable ML framework with single center. We aimed to develop SERP with 3 Korean multicenter cohorts based on common data model (CDM) without data sharing and compare performance with inter-hospital validation design. This retrospective cohort study included all adult emergency visit patients of 3 hospitals in Korea from 2016 to 2017. We adopted CDM for the standardized multicenter research. The outcome of interest was 2-day mortality after the patients' ED visit. We developed each hospital SERP using interpretable ML framework and validated inter-hospital wisely. We accessed the performance of each hospital's score based on some metrics considering data imbalance strategy. The study population for each hospital included 87,670, 83,363 and 54,423 ED visits from 2016 to 2017. The 2-day mortality rate were 0.51%, 0.56% and 0.65%. Validation results showed accurate for inter hospital validation which has at least AUROC of 0.899 (0.858-0.940). We developed multicenter based Interpretable ML model using CDM for 2-day mortality prediction and executed Inter-hospital external validation which showed enough high accuracy.

Real-Time Tracheal Ultrasound vs. Capnography for Intubation Confirmation during CPR Wearing a Powered Air-Purifying Respirator in COVID-19 Era.

This study aimed to compare the accuracy of real-time trans-tracheal ultrasound (TTUS) with capnography to confirm intubation in cardiopulmonary resuscitation (CPR) while wearing a powered air-purifying respirator (PAPR). This setting reflects increased caution due to contagious diseases. This single-center, prospective, comparative study enrolled patients requiring CPR while wearing a PAPR who visited the emergency department of a tertiary medical center from December 2020 to August 2022. A physician performed the TTUS in real time and recorded the tube placement assessment. Another healthcare provider attached waveform capnography to the tube and recorded end-tidal carbon dioxide (EtCO2) after five ventilations. The accuracy and agreement of both methods compared with direct laryngoscopic visualization of tube placement, and the time taken by both methods was evaluated. Thirty-three patients with cardiac arrest were analyzed. TTUS confirmed tube placement with 100% accuracy, sensitivity, and specificity, whereas capnography demonstrated 97% accuracy, 96.8% sensitivity, and 100% specificity. The Kappa values for TTUS and capnography compared to direct visualization were 1.0 and 0.7843, respectively. EtCO2 was measured in 45 (37-59) seconds (median (interquartile range)), whereas TTUS required only 12 (8-23) seconds, indicating that TTUS was significantly faster (p < 0.001). No significant correlation was found between the physician's TTUS proficiency and image acquisition time. This study demonstrated that TTUS is more accurate and faster than EtCO2 measurement for confirming endotracheal tube placement during CPR, particularly in the context of PAPR usage in pandemic conditions.

Analysis of aneurysmal subarachnoid hemorrhage as a multistep process.

BACKGROUND AND PURPOSE: Aneurysmal subarachnoid hemorrhage (ASAH) is a complex disease with higher incidence in women compared to men and in Japan compared to other countries. It was hypothesized that ASAH is consistent with a multistep model of disease. The following assessments were made: (1) the number of steps needed for the disease to occur and (2) whether this number may be different in female versus male and in Japanese versus non-Japanese patients. METHODS: Incidence data were generated from a meta-analysis on ASAH incidence until 2017, which was supplemented with a literature search from 2017 to April 2023. Age- and sex-adjusted incidences per 10-year age groups were calculated and the logarithm of age-specific incidence against the logarithm of age was regressed with least-squares regression. RESULTS: In 2317 ASAH patients a linear relationship between logarithm of incidence and logarithm of age was found with a slope estimate of 3.13 (95% confidence interval 2.60-3.65), consistent with a four-step process. Similar estimates were found for female, male, Japanese and non-Japanese patients. CONCLUSIONS: Our results suggest that ASAH is a four-step process, also in subgroups with higher ASAH incidence. Elucidation of the exact nature of these steps can provide important clues for identification of disease mechanisms underlying ASAH.

Effect of Blade Size on the First-Pass Success Rate of Endotracheal Intubation Using the C-MAC Video Laryngoscope.

We sought to determine whether blade size influences the first-pass success (FPS) rate when performing endotracheal intubation (ETI) with a C-MAC video laryngoscope (VL) in emergency department (ED) patients. This single-center, retrospective, observational study was conducted between August 2016 and July 2022. A total of 1467 patients was divided into two categories based on the blade size used during the first ETI attempt: blade-3 (n = 365) and blade-4 groups (n = 1102). The primary outcome was the FPS rate. The secondary outcomes included the glottic view, multiple attempt rate, and ETI-related complications. We used propensity score matching to reduce the potential confounders between the two groups. Among these, 363 pairs of matched propensity scores were generated. The FPS rate did not differ between the blade-3 (84.8%) and blade-4 groups (87.3%) in the matched cohort (p = 0.335). The multiple attempt rate did not differ significantly between groups (p = 0.289) and was 3.9% and 2.5% in the blade-3 and blade-4 groups, respectively. The difficult glottic view (11.3 vs. 6.9%, p = 0.039) and complication rates (15.4% vs. 10.5%, p = 0.047) were significantly higher in the blade-3 group than in the blade-4 group. The FPS rates of ETI with the blade-3 and blade-4 groups in adult patients in the ED did not differ significantly.

Epidemiologic trends of patients who visited nationwide emergency departments: a report from the National Emergency Department Information System (NEDIS) of Korea, 2018-2022.

OBJECTIVE: : This study analyzed trends in emergency department (ED) visits in South Korea using the National Emergency Department Information System (NEDIS) data from 2018 to 2022. METHODS: : This was a retrospective observational study using data from the NEDIS database from 2018 to 2022. Age- and sex-standardized ED visits per 100,000 population, as well as age- and sex-standardized rates for mortality, admission, and transfer, were calculated. RESULTS: : The standardized ED visits per 100,000 population was approximately 20,000 from 2018 to 2019 and decreased to about 18,000 in 2022. The standardized mortality rate ranged from 1.4% to 1.7%. The admission rate (18.4%-19.4%) and the transfer rates (1.6%-1.8%) were similar during the study period. Approximately 5.5% of patients were triaged as Korean Triage and Acuity Scale score 1 or 2. About 91% of patients visited the ED directly and 21.7% of patients visited the ED with an ambulance. The ED length of stay was less than 6 hours in 90.3% of patients and the ED mortality rate was 0.6%. Acute gastroenteritis was the most common diagnosis. Respiratory virus symptoms, such as fever and sore throat, were also common chief complaints. CONCLUSION: : ED visits decreased during the 5-year period, while admission, transfer, and death rates remained relatively stable.

Machine learning pre-hospital real-time cardiac arrest outcome prediction (PReCAP) using time-adaptive cohort model based on the Pan-Asian Resuscitation Outcome Study.

To save time during transport, where resuscitation quality can degrade in a moving ambulance, it would be prudent to continue the resuscitation on scene if there is a high likelihood of ROSC occurring at the scene. We developed the pre-hospital real-time cardiac arrest outcome prediction (PReCAP) model to predict ROSC at the scene using prehospital input variables with time-adaptive cohort. The patient survival at discharge from the emergency department (ED), the 30-day survival rate, and the final Cerebral Performance Category (CPC) were secondary prediction outcomes in this study. The Pan-Asian Resuscitation Outcome Study (PAROS) database, which includes out-of-hospital cardiac arrest (OHCA) patients transferred by emergency medical service in Asia between 2009 and 2018, was utilized for this study. From the variables available in the PAROS database, we selected relevant variables to predict OHCA outcomes. Light gradient-boosting machine (LightGBM) was used to build the PReCAP model. Between 2009 and 2018, 157,654 patients in the PAROS database were enrolled in our study. In terms of prediction of ROSC on scene, the PReCAP had an AUROC score between 0.85 and 0.87. The PReCAP had an AUROC score between 0.91 and 0.93 for predicting survived to discharge from ED, and an AUROC score between 0.80 and 0.86 for predicting the 30-day survival. The PReCAP predicted CPC with an AUROC score ranging from 0.84 to 0.91. The feature importance differed with time in the PReCAP model prediction of ROSC on scene. Using the PAROS database, PReCAP predicted ROSC on scene, survival to discharge from ED, 30-day survival, and CPC for each minute with an AUROC score ranging from 0.8 to 0.93. As this model used a multi-national database, it might be applicable for a variety of environments and populations.

Patient Anxiety and Communication Experience in the Emergency Department: A Mobile, Web-Based, Mixed-Methods Study on Patient Isolation During the COVID-19 Pandemic.

BACKGROUND: Anxiety and communication difficulties in the emergency department (ED) may increase for various reasons, including isolation due to coronavirus disease 2019 (COVID-19). However, little research on anxiety and communication in EDs exists. This study explored the isolation-related anxiety and communication experiences of ED patients during the COVID-19 pandemic. METHODS: A prospective mixed-methods study was conducted from May to August 2021 at the Samsung Medical Center ED, Seoul. There were two patient groups: isolation and control. Patients measured their anxiety using the State-Trait Anxiety Inventory (STAI X1) at two time points, and we surveyed patients at two time points about factors contributing to their anxiety and communication experiences. These were measured through a mobile web-based survey. Researchers interviewed patients after their discharge. RESULTS: ED patients were not anxious regardless of isolation, and there was no statistical significance between each group at the two time points. STAI X1 was 48.4 (standard deviation [SD], 8.0) and 47.3 (SD, 10.9) for early follow-up and 46.3 (SD, 13.0) and 46.2 (SD, 13.6) for late follow-up for the isolation and control groups, respectively. The clinical process was the greatest factor contributing to anxiety as opposed to the physical environment or communication. Communication was satisfactory in 71.4% of the isolation group and 66.7% of the control group. The most important aspects of communication were information about the clinical process and patient status. CONCLUSION: ED patients were not anxious and were generally satisfied with medical providers' communication regardless of their isolation status. However, patients need clinical process information for anxiety reduction and better communication.

Clinical support system for triage based on federated learning for the Korea triage and acuity scale.

Background and aims: This study developed a clinical support system based on federated learning to predict the need for a revised Korea Triage Acuity Scale (KTAS) to facilitate triage. Methods: This was a retrospective study that used data from 11,952,887 patients in the Korean National Emergency Department Information System (NEDIS) from 2016 to 2018 for model development. Separate cohorts were created based on the emergency medical center level in the NEDIS: regional emergency medical center (REMC), local emergency medical center (LEMC), and local emergency medical institution (LEMI). External and temporal validation used data from emergency department (ED) of the study site from 2019 to 2021. Patient features obtained during the triage process and the initial KTAS scores were used to develop the prediction model. Federated learning was used to rectify the disparity in data quality between EDs. The patient's demographic information, vital signs in triage, mental status, arrival information, and initial KTAS were included in the input feature. Results: 3,626,154 patients' visits were included in the regional emergency medical center cohort; 8,278,081 patients' visits were included in the local emergency medical center cohort; and 48,652 patients' visits were included in the local emergency medical institution cohort. The study site cohort, which is used for external and temporal validation, included 135,780 patients visits. Among the patients in the REMC and study site cohorts, KTAS level 3 patients accounted for the highest proportion at 42.4% and 45.1%, respectively, whereas in the LEMC and LEMI cohorts, KTAS level 4 patients accounted for the highest proportion. The area under the receiver operating characteristic curve for the prediction model was 0.786, 0.750, and 0.770 in the external and temporal validation. Patients with revised KTAS scores had a higher admission rate and ED mortality rate than those with unaltered KTAS scores. Conclusions: This novel system might accurately predict the likelihood of KTAS acuity revision and support clinician-based triage.

A Pilot Study Evaluating LV Diastolic Function with M-Mode Measurement of Mitral Valve Movement in the Parasternal Long Axis View.

This pilot study aimed to develop a new, reliable, and easy-to-use method for the evaluation of diastolic function through the M-mode measurement of mitral valve (MV) movement in the parasternal long axis (PSLA), similar to E-point septal separation (EPSS) used for systolic function estimation. Thirty healthy volunteers from a tertiary emergency department (ED) underwent M-mode measurements of the MV anterior leaflet in the PSLA view. EPSS, A-point septal separation (APSS), A-point opening length (APOL), and E-point opening length (EPOL) were measured in the PSLA view, along with the E and A velocities and e' velocity in the apical four-chamber view. Correlation analyses were performed to assess the relationship between M-mode and Doppler measurements, and the measurement time was evaluated. No significant correlations were found between M-mode and Doppler measurements in the study. However, M-mode measurements exhibited high reproducibility and faster acquisition, and the EPOL value consistently exceeded the APOL value, resembling the E and A pattern. These findings suggest that visually assessing the M-mode pattern on the MV anterior leaflet in the PSLA view may be a practical approach to estimating diastolic function in the ED. Further investigations with a larger and more diverse patient population are needed to validate these findings.

EARLY PREDICTION OF UNEXPECTED LATENT SHOCK IN THE EMERGENCY DEPARTMENT USING VITAL SIGNS.

ABSTRACT: Objective/Introduction : Sequential vital-sign information and trends in vital signs are useful for predicting changes in patient state. This study aims to predict latent shock by observing sequential changes in patient vital signs. Methods : The dataset for this retrospective study contained a total of 93,194 emergency department (ED) visits from January 1, 2016, and December 31, 2020, and Medical Information Mart for Intensive Care (MIMIC)-IV-ED data. We further divided the data into training and validation datasets by random sampling without replacement at a 7:3 ratio. We carried out external validation with MIMIC-IV-ED. Our prediction model included logistic regression (LR), random forest (RF) classifier, a multilayer perceptron (MLP), and a recurrent neural network (RNN). To analyze the model performance, we used area under the receiver operating characteristic curve (AUROC). Results : Data of 89,250 visits of patients who met prespecified criteria were used to develop a latent-shock prediction model. Data of 142,250 patient visits from MIMIC-IV-ED satisfying the same inclusion criteria were used for external validation of the prediction model. The AUROC values of prediction for latent shock were 0.822, 0.841, 0.852, and 0.830 with RNN, MLP, RF, and LR methods, respectively, at 3 h before latent shock. This is higher than the shock index or adjusted shock index. Conclusion : We developed a latent shock prediction model based on 24 h of vital-sign sequence that changed with time and predicted the results by individual.

Feasibility of patch-type wireless 12-lead electrocardiogram in laypersons.

Various efforts have been made to diagnose acute cardiovascular diseases (CVDs) early in patients. However, the sole option currently is symptom education. It may be possible for the patient to obtain an early 12-lead electrocardiogram (ECG) before the first medical contact (FMC), which could decrease the physical contact between patients and medical staff. Thus, we aimed to verify whether laypersons can obtain a 12-lead ECG in an off-site setting for clinical treatment and diagnosis using a patch-type wireless 12-lead ECG (PWECG). Participants who were ≥ 19 years old and under outpatient cardiology treatment were enrolled in this simulation-based one-arm interventional study. We confirmed that participants, regardless of age and education level, can use the PWECG on their own. The median age of the participants was 59 years (interquartile range [IQR] = 56-62 years), and the median duration to obtain a 12-lead ECG result was 179 s (IQR = 148-221 s). With appropriate education and guidance, it is possible for a layperson to obtain a 12-lead ECG, minimizing the contact with a healthcare provider. These results can be used subsequently for treatment.

A Simple Bacteremia Score for Predicting Bacteremia in Patients with Suspected Infection in the Emergency Department: A Cohort Study.

Bacteremia is a life-threatening condition that has increased in prevalence over the past two decades. Prompt recognition of bacteremia is important; however, identification of bacteremia requires 1 to 2 days. This retrospective cohort study, conducted from 10 November 2014 to November 2019, among patients with suspected infection who visited the emergency department (ED), aimed to develop and validate a simple tool for predicting bacteremia. The study population was randomly divided into derivation and development cohorts. Predictors of bacteremia based on the literature and logistic regression were assessed. A weighted value was assigned to predictors to develop a prediction model for bacteremia using the derivation cohort; discrimination was then assessed using the area under the receiver operating characteristic curve (AUC). Among the 22,519 patients enrolled, 18,015 were assigned to the derivation group and 4504 to the validation group. Sixteen candidate variables were selected, and all sixteen were used as significant predictors of bacteremia (model 1). Among the sixteen variables, the top five with higher odds ratio, including procalcitonin, neutrophil-lymphocyte ratio (NLR), lactate level, platelet count, and body temperature, were used for the simple bacteremia score (model 2). The proportion of bacteremia increased according to the simple bacteremia score in both cohorts. The AUC for model 1 was 0.805 (95% confidence interval [CI] 0.785-0.824) and model 2 was 0.791 (95% CI 0.772-0.810). The simple bacteremia prediction score using only five variables demonstrated a comparable performance with the model including sixteen variables using all laboratory results and vital signs. This simple score is useful for predicting bacteremia-assisted clinical decisions.

Impact of the 24-hour time target policy for emergency departments in South Korea: a mixed method study in a single medical center.

BACKGROUND: In South Korea, after the spread of the Middle East Respiratory Syndrome epidemic was aggravated by long stays in crowded emergency departments (EDs), a 24-hour target policy for EDs was introduced to prevent crowding and reduce patients' length of stay (LOS). The policy requires at least 95% of all patients to be admitted, discharged or transferred from an ED within 24 hours of arrival. This study analyzes the effects of the 24-hour target policy on ED LOS and compliance rates and describes the consequences of the policy. METHODS: A mixed-methods approach was applied to a retrospective observational study of ED visits combined with a survey of medical professionals. The primary measure was ED LOS, and the secondary measure was policy compliance rate which refers to the proportion of patient visits with a LOS shorter than 24 hours. Patient flow, quality of care, patient safety, staff workload, and staff satisfaction were also investigated through surveys. Mann-Whitney U and χ2 tests were used to compare variables before and after the introduction of the policy. RESULTS: The median ED LOS increased from 3.9 hours (interquartile range [IQR] = 2.1-7.6) to 4.5 hours (IQR = 2.5-8.5) after the policy was introduced. This was likely influenced by the average monthly number of patients, which greatly increased from 4819 (SD = 340) to 5870 (SD = 462) during the same period. The proportion of patients with ED LOS greater than 24 hours remained below5% only after 6 months of policy implementation, but the number of patients whose disposition was decided at 23 hours increased by 4.84 times. Survey results suggested that patient flow and quality of care improved slightly, while the workload of medical staff worsened. CONCLUSIONS: After implementing the 24-hour target policy, the proportion of patients whose ED LOS exceeded 24 hours decreased, even though the median ED LOS increased. However, the unintended consequences of the policy were observed such as increased medical professional workload and abrupt expulsion of patients before 24 hours.

National Surveillance of Pediatric Out-of-Hospital Cardiac Arrest in Korea: The 10-Year Trend From 2009 to 2018.

BACKGROUND: This study reports trends in pediatric out-of-hospital cardiac arrest (OHCA) and factors affecting clinical outcomes by age group. METHODS: We identified 4,561 OHCA patients younger than 18 years between January 2009 and December 2018 in the Korean OHCA Registry. The patients were divided into four groups: group 1 (1 year or younger), group 2 (1 to 5 years), group 3 (6 to 12 years), and group 4 (13 to 17 years). The primary outcome was survival to hospital discharge, and the secondary outcomes were return of spontaneous circulation (ROSC) at the emergency department (ED) and good neurological status at discharge. Multivariate logistic analyses were performed. RESULTS: The incidence rate of pediatric OHCA in group 1 increased from 45.57 to 60.89 per 100,000 person-years, while that of the overall population decreased over the 10 years. The rates of ROSC at the ED, survival to hospital discharge, and good neurologic outcome were highest in group 4 (37.9%, 9.7%, 4.9%, respectively) and lowest in group 1 (28.3%, 7.1%, 3.2%). The positive factors for survival to discharge were event location of a public/commercial building or place of recreation, type of first responder, prehospital delivery of automated external defibrillator shock, initial shockable rhythm at the ED. The factors affecting survival outcomes differed by age group. CONCLUSION: This study reports comprehensive trends in pediatric OHCA in the Republic of Korea. Our findings imply that preventive methods for the targeted population should be customized by age group.

Endotracheal Intubation Using C-MAC Video Laryngoscope vs. Direct Laryngoscope While Wearing Personal Protective Equipment.

This study sought to determine whether the C-MAC video laryngoscope (VL) performed better than a direct laryngoscope (DL) when attempting endotracheal intubation (ETI) in the emergency department (ED) while wearing personal protective equipment (PPE). This was a retrospective single-center observational study conducted in an academic ED between February 2020 and March 2022. All emergency medical personnel who participated in any ETI procedure were required to wear PPE. The patients were divided into the C-MAC VL group and the DL group based on the device used during the first ETI attempt. The primary outcome measure was the first-pass success (FPS) rate. A multiple logistic regression was used to determine the factors associated with FPS. Of the 756 eligible patients, 650 were assigned to the C-MAC group and 106 to the DL group. The overall FPS rate was 83.5% (n = 631/756). The C-MAC group had a significantly higher FPS rate than the DL group (85.7% vs. 69.8%, p < 0.001). In the multivariable logistic regression analysis, C-MAC use was significantly associated with an increased FPS rate (adjusted odds ratio, 2.86; 95% confidence interval, 1.69−4.08; p < 0.001). In this study, we found that the FPS rate of ETI was significantly higher when the C-MAC VL was used than when a DL was used by emergency physicians constrained by cumbersome PPE.

Appropriateness of Alerts and Physicians' Responses With a Medication-Related Clinical Decision Support System: Retrospective Observational Study.

BACKGROUND: Alert fatigue is unavoidable when many irrelevant alerts are generated in response to a small number of useful alerts. It is necessary to increase the effectiveness of the clinical decision support system (CDSS) by understanding physicians' responses. OBJECTIVE: This study aimed to understand the CDSS and physicians' behavior by evaluating the clinical appropriateness of alerts and the corresponding physicians' responses in a medication-related passive alert system. METHODS: Data on medication-related orders, alerts, and patients' electronic medical records were analyzed. The analyzed data were generated between August 2019 and June 2020 while the patient was in the emergency department. We evaluated the appropriateness of alerts and physicians' responses for a subset of 382 alert cases and classified them. RESULTS: Of the 382 alert cases, only 7.3% (n=28) of the alerts were clinically appropriate. Regarding the appropriateness of the physicians' responses about the alerts, 92.4% (n=353) were deemed appropriate. In the classification of alerts, only 3.4% (n=13) of alerts were successfully triggered, and 2.1% (n=8) were inappropriate in both alert clinical relevance and physician's response. In this study, the override rate was 92.9% (n=355). CONCLUSIONS: We evaluated the appropriateness of alerts and physicians' responses through a detailed medical record review of the medication-related passive alert system. An excessive number of unnecessary alerts are generated, because the algorithm operates as a rule base without reflecting the individual condition of the patient. It is important to maximize the value of the CDSS by comprehending physicians' responses.