Validation of the Pediatric Appendicitis Risk Calculator (pARC) in a Community Emergency Department Setting.

STUDY OBJECTIVE: The pediatric Appendicitis Risk Calculator (pARC) is a validated clinical tool for assessing a child's probability of appendicitis. Our objective was to assess the performance of the pARC in community emergency departments (EDs) and to compare its performance with that of the Pediatric Appendicitis Score (PAS). METHODS: We conducted a prospective validation study from October 1, 2016, to April 30, 2018, in 11 community EDs serving general populations. Patients aged 5 to 20.9 years and with a chief complaint of abdominal pain and less than or equal to 5 days of right-sided or diffuse abdominal pain were eligible for study enrollment. Our primary outcome was the presence or absence of appendicitis within 7 days of the index visit. We reported performance characteristics and secondary outcomes by pARC risk strata and compared the receiver operator characteristic (ROC) curves of the PAS and pARC. RESULTS: We enrolled 2,089 patients with a mean age of 12.4 years, 46% of whom were male patients. Appendicitis was confirmed in 353 patients (16.9%), of whom 55 (15.6%) had perforated appendixes. Fifty-four percent of patients had very low (<5%) or low (5% to 14%) predicted risk, 43% had intermediate risk (15% to 84%), and 4% had high risk (≥85%). In the very-low- and low-risk groups, 1.4% and 3.0% of patients had appendicitis, respectively. The area under the ROC curve was 0.89 (95% confidence interval 0.87 to 0.92) for the pARC compared with 0.80 (95% confidence interval 0.77 to 0.82) for the PAS. CONCLUSION: The pARC accurately assessed appendicitis risk for children aged 5 years and older in community EDs and the pARC outperformed the PAS.

Implementation of a Clinical Decision Support System for Children With Minor Blunt Head Trauma Who Are at Nonnegligible Risk for Traumatic Brain Injuries.

STUDY OBJECTIVE: To determine the effect of providing risk estimates of clinically important traumatic brain injuries and management recommendations on emergency department (ED) outcomes for children with isolated intermediate Pediatric Emergency Care Applied Research Network clinically important traumatic brain injury risk factors. METHODS: This was a secondary analysis of a nonrandomized clinical trial with concurrent controls, conducted at 5 pediatric and 8 general EDs between November 2011 and June 2014, enrolling patients younger than 18 years who had minor blunt head trauma. After a baseline period, intervention sites received electronic clinical decision support providing patient-level clinically important traumatic brain injury risk estimates and management recommendations. The following primary outcomes in patients with one intermediate Pediatric Emergency Care Applied Research Network risk factor were compared before and after clinical decision support: proportion of ED computed tomography (CT) scans, adjusted for age, time trend, and site; and prevalence of clinically important traumatic brain injuries. RESULTS: The risk of clinically important traumatic brain injuries was known for 3,859 children with isolated findings (1,711 at intervention sites before clinical decision support, 1,702 at intervention sites after clinical decision support, and 446 at control sites). In this group, pooled CT proportion decreased from 24.2% to 21.6% after clinical decision support (odds ratio 0.86; 95% confidence interval 0.73 to 1.01). Decreases in CT use were noted across intervention EDs, but not in controls. The pooled adjusted odds ratio for CT use after clinical decision support was 0.73 (95% confidence interval 0.60 to 0.88). Among the entire cohort, clinically important traumatic brain injury was diagnosed at the index ED visit for 37 of 37 (100%) patients before clinical decision support and 32 of 33 patients (97.0%) after clinical decision support. CONCLUSION: Providing specific risks of clinically important traumatic brain injury through electronic clinical decision support was associated with a modest and safe decrease in ED CT use for children at nonnegligible risk of clinically important traumatic brain injuries.

Increasing Safe Outpatient Management of Emergency Department Patients With Pulmonary Embolism: A Controlled Pragmatic Trial.

Background: Many low-risk patients with acute pulmonary embolism (PE) in the emergency department (ED) are eligible for outpatient care but are hospitalized nonetheless. One impediment to home discharge is the difficulty of identifying which patients can safely forgo hospitalization. Objective: To evaluate the effect of an integrated electronic clinical decision support system (CDSS) to facilitate risk stratification and decision making at the site of care for patients with acute PE. Design: Controlled pragmatic trial. (ClinicalTrials.gov: NCT03601676). Setting: All 21 community EDs of an integrated health care delivery system (Kaiser Permanente Northern California). Patients: Adult ED patients with acute PE. Intervention: Ten intervention sites selected by convenience received a multidimensional technology and education intervention at month 9 of a 16-month study period (January 2014 to April 2015); the remaining 11 sites served as concurrent controls. Measurements: The primary outcome was discharge to home from either the ED or a short-term (<24-hour) outpatient observation unit based in the ED. Adverse outcomes included return visits for PE-related symptoms within 5 days and recurrent venous thromboembolism, major hemorrhage, and all-cause mortality within 30 days. A difference-in-differences approach was used to compare pre-post changes at intervention versus control sites, with adjustment for demographic and clinical characteristics. Results: Among 881 eligible patients diagnosed with PE at intervention sites and 822 at control sites, adjusted home discharge increased at intervention sites (17.4% pre- to 28.0% postintervention) without a concurrent increase at control sites (15.1% pre- and 14.5% postintervention). The difference-in-differences comparison was 11.3 percentage points (95% CI, 3.0 to 19.5 percentage points; P = 0.007). No increases were seen in 5-day return visits related to PE or in 30-day major adverse outcomes associated with CDSS implementation. Limitation: Lack of random allocation. Conclusion: Implementation and structured promotion of a CDSS to aid physicians in site-of-care decision making for ED patients with acute PE safely increased outpatient management. Primary Funding Source: Garfield Memorial National Research Fund and The Permanente Medical Group Delivery Science and Physician Researcher Programs.

Emergency Department Management of Atrial Fibrillation and Flutter and Patient Quality of Life at One Month Postvisit.

STUDY OBJECTIVE: We identify characteristics of patients with atrial fibrillation or flutter associated with favorable assessments of emergency department (ED) effectiveness and 30-day quality of life. METHODS: As part of a prospective observational study of ED management and short-term outcomes of patients with nonvalvular atrial fibrillation or flutter, we adapted a disease-specific quality-of-life instrument. By telephone, we administered the Atrial Fibrillation Effect on Quality-of-life survey to patients 30 days after an ED visit in which they were treated for newly diagnosed or recent-onset atrial fibrillation or flutter and discharged home. We also asked respondents to rate the effectiveness of ED treatment. Using data prospectively collected in the ED and extracted from electronic health records, we recorded rhythm management (cardioversion attempts and type) and patient and ED treatment characteristics. Using multivariable regression, we examined the association between these characteristics and patient-reported effectiveness of ED treatment ("very effective" or not) and any atrial fibrillation or flutter quality-of-life effect. RESULTS: Six hundred fifty-two eligible ED patients (response rate 89%) treated between May 2011 and November 2012 completed follow-up. Of these patients, 454 (69.6%) reported that their ED treatment was "very effective" and 113 (17.3%) reported no quality-of-life influence. In multivariable analyses, there was an association between ED electrocardioversion and perceived ED effectiveness (P<.05) but none between treatment strategy and 30-day atrial fibrillation or flutter quality-of-life score. Respondents who were younger, women, and had worse pre-ED self-reported health (P<.05) were more likely to report a quality-of-life effect. CONCLUSION: In this observational study, ED rhythm management strategy was associated with greater perceived effectiveness of the ED visit but not with a difference in 30-day quality-of-life score.

Implementation of Computerized Physician Order Entry Is Associated With Increased Thrombolytic Administration for Emergency Department Patients With Acute Ischemic Stroke.

STUDY OBJECTIVE: Electronic health record systems with computerized physician order entry and condition-specific order sets are intended to standardize patient management and minimize errors of omission. However, the effect of these systems on disease-specific process measures and patient outcomes is not well established. We seek to evaluate the effect of computerized physician order entry electronic health record implementation on process measures and short-term health outcomes for patients hospitalized with acute ischemic stroke. METHODS: We conducted a quasi-experimental cohort study of patients hospitalized for acute ischemic stroke with concurrent controls that took advantage of the staggered implementation of a comprehensive computerized physician order entry electronic health record across 16 medical centers within an integrated health care delivery system from 2007 to 2012. The study population included all patients admitted to the hospital from the emergency department (ED) for acute ischemic stroke, with an initial neuroimaging study within 2.5 hours of ED arrival. We evaluated the association between the availability of a computerized physician order entry electronic health record and the rates of ED intravenous tissue plasminogen activator administration, hospital-acquired pneumonia, and inhospital and 90-day mortality, using doubly robust estimation models to adjust for demographics, comorbidities, secular trends, and concurrent primary stroke center certification status at each center. RESULTS: Of 10,081 eligible patients, 6,686 (66.3%) were treated in centers after the computerized physician order entry electronic health record had been implemented. Computerized physician order entry was associated with significantly higher rates of intravenous tissue plasminogen activator administration (rate difference 3.4%; 95% confidence interval 0.8% to 6.0%) but not with significant rate differences in pneumonia or mortality. CONCLUSION: For patients hospitalized for acute ischemic stroke, computerized physician order entry use was associated with increased use of intravenous tissue plasminogen activator.

Bleeding complications of central venous catheterization in septic patients with abnormal hemostasis.

OBJECTIVES: Central venous catheterization (CVC) is thought to be relatively contraindicated in patients with thrombocytopenia or coagulopathy. We measured the 24-hour incidence of bleeding in septic emergency department (ED) patients undergoing CVC. METHODS: This multicenter, retrospective cohort study included septic ED patients undergoing CVC with one of the following: platelets less than 100,000/µL, international normalized ratio at least 1.3, or partial thromboplastin time at least 35 seconds. Major bleeding included radiographically confirmed intrathoracic, mediastinal, or internal neck hemorrhage or line-related bleeding causing hemodynamic compromise. Minor bleeding included local oozing or superficial hematoma. Multivariable regression analysis was performed to determine the association between candidate variables and hemorrhagic complications. RESULTS: Of the 936 cases, mean age was 68.1 years; 535 (57.2%) were male. Two or more qualifying laboratory abnormalities were present in 204 cases (21.8%). The proceduralists were predominately attendings (790; 84.4%). The initial veins were the internal jugular (n = 800; 85.5%), subclavian (n = 123; 13.1%), and femoral (n = 13; 1.4%). Initial access was successful in 872 cases (93.2%). We found one case (95% upper confidence limit: 0.6%) of major bleeding and 37 cases (4.0%; 95% confidence interval [CI], 2.8%-5.4%) of minor bleeding. Only failed access at the initial site was independently associated with hemorrhagic outcomes: adjusted odds ratio 8.2 (95% CI, 3.7-18.0). CONCLUSIONS: Major bleeding from CVC in ED patients with abnormal hemostasis is rare. Minor bleeding is uncommon and infrequently requires intervention. Successful catheterization on the initial attempt is associated with fewer hemorrhagic complications. These results can inform the risk/benefit calculus for CVC in this population.

Immediate and delayed traumatic intracranial hemorrhage in patients with head trauma and preinjury warfarin or clopidogrel use.

STUDY OBJECTIVE: Patients receiving warfarin or clopidogrel are considered at increased risk for traumatic intracranial hemorrhage after blunt head trauma. The prevalence of immediate traumatic intracranial hemorrhage and the cumulative incidence of delayed traumatic intracranial hemorrhage in these patients, however, are unknown. The objective of this study is to address these gaps in knowledge. METHODS: A prospective, observational study at 2 trauma centers and 4 community hospitals enrolled emergency department (ED) patients with blunt head trauma and preinjury warfarin or clopidogrel use from April 2009 through January 2011. Patients were followed for 2 weeks. The prevalence of immediate traumatic intracranial hemorrhage and the cumulative incidence of delayed traumatic intracranial hemorrhage were calculated from patients who received initial cranial computed tomography (CT) in the ED. Delayed traumatic intracranial hemorrhage was defined as traumatic intracranial hemorrhage within 2 weeks after an initially normal CT scan result and in the absence of repeated head trauma. RESULTS: A total of 1,064 patients were enrolled (768 warfarin patients [72.2%] and 296 clopidogrel patients [27.8%]). There were 364 patients (34.2%) from Level I or II trauma centers and 700 patients (65.8%) from community hospitals. One thousand patients received a cranial CT scan in the ED. Both warfarin and clopidogrel groups had similar demographic and clinical characteristics, although concomitant aspirin use was more prevalent among patients receiving clopidogrel. The prevalence of immediate traumatic intracranial hemorrhage was higher in patients receiving clopidogrel (33/276, 12.0%; 95% confidence interval [CI] 8.4% to 16.4%) than patients receiving warfarin (37/724, 5.1%; 95% CI 3.6% to 7.0%), relative risk 2.31 (95% CI 1.48 to 3.63). Delayed traumatic intracranial hemorrhage was identified in 4 of 687 (0.6%; 95% CI 0.2% to 1.5%) patients receiving warfarin and 0 of 243 (0%; 95% CI 0% to 1.5%) patients receiving clopidogrel. CONCLUSION: Although there may be unmeasured confounders that limit intergroup comparison, patients receiving clopidogrel have a significantly higher prevalence of immediate traumatic intracranial hemorrhage compared with patients receiving warfarin. Delayed traumatic intracranial hemorrhage is rare and occurred only in patients receiving warfarin. Discharging patients receiving anticoagulant or antiplatelet medications from the ED after a normal cranial CT scan result is reasonable, but appropriate instructions are required because delayed traumatic intracranial hemorrhage may occur.

Predictors of Acute Atrial Fibrillation and Flutter Hospitalization across 7 U.S. Emergency Departments: A Prospective Study.

INTRODUCTION: International rates of hospitalization for atrial fibrillation and flutter (AFF) from the emergency department (ED) vary widely without clear evidence to guide the identification of high-risk patients requiring inpatient management. We sought to determine (1) variation in hospital admission and (2) modifiable factors associated with hospitalization of AFF patients within a U.S. integrated health system. METHODS: This multicenter prospective observational study of health plan members with symptomatic AFF was conducted using convenience sampling in 7 urban community EDs from 05/2011 to 08/2012. Prospective data collection included presenting symptoms, characteristics of atrial dysrhythmia, ED physician impression of hemodynamic instability, comorbid diagnoses, ED management, and ED discharge rhythm. All centers had full-time on-call cardiology consultation available. Additional variables were extracted from the electronic health record. We identified factors associated with hospitalization and included predictors in a multivariate Poisson Generalized Estimating Equations regression model to estimate adjusted relative risks while accounting for clustering by physician. RESULTS: Among 1,942 eligible AFF patients, 1,074 (55.3%) were discharged home and 868 (44.7%) were hospitalized. Hospitalization rates ranged from 37.4% to 60.4% across medical centers. After adjustment, modifiable factors associated with increased hospital admission from the ED included non-sinus rhythm at ED discharge, no attempted cardioversion, and heart rate reduction. DISCUSSION: Within an integrated health system, we found significant variation in AFF hospitalization rates and identified several modifiable factors associated with hospital admission. Standardizing treatment goals that specifically address best practices for ED rate reduction and rhythm control may reduce hospitalizations.

Prospective Validation and Comparative Analysis of Coronary Risk Stratification Strategies Among Emergency Department Patients With Chest Pain.

Background Coronary risk stratification is recommended for emergency department patients with chest pain. Many protocols are designed as "rule-out" binary classification strategies, while others use graded-risk stratification. The comparative performance of competing approaches at varying levels of risk tolerance has not been widely reported. Methods and Results This is a prospective cohort study of adult patients with chest pain presenting between January 2018 and December 2019 to 13 medical center emergency departments within an integrated healthcare delivery system. Using an electronic clinical decision support interface, we externally validated and assessed the net benefit (at varying risk thresholds) of several coronary risk scores (History, ECG, Age, Risk Factors, and Troponin [HEART] score, HEART pathway, Emergency Department Assessment of Chest Pain Score Accelerated Diagnostic Protocol), troponin-only strategies (fourth-generation assay), unstructured physician gestalt, and a novel risk algorithm (RISTRA-ACS). The primary outcome was 60-day major adverse cardiac event defined as myocardial infarction, cardiac arrest, cardiogenic shock, coronary revascularization, or all-cause mortality. There were 13 192 patient encounters included with a 60-day major adverse cardiac event incidence of 3.7%. RISTRA-ACS and HEART pathway had the lowest negative likelihood ratios (0.06, 95% CI, 0.03-0.10 and 0.07, 95% CI, 0.04-0.11, respectively) and the greatest net benefit across a range of low-risk thresholds. RISTRA-ACS demonstrated the highest discrimination for 60-day major adverse cardiac event (area under the receiver operating characteristic curve 0.92, 95% CI, 0.91-0.94, P<0.0001). Conclusions RISTRA-ACS and HEART pathway were the optimal rule-out approaches, while RISTRA-ACS was the best-performing graded-risk approach. RISTRA-ACS offers promise as a versatile single approach to emergency department coronary risk stratification. Registration URL: https://www.clinicaltrials.gov; Unique identifier: NCT03286179.

Graded Coronary Risk Stratification for Emergency Department Patients With Chest Pain: A Controlled Cohort Study.

Background Resource utilization among emergency department (ED) patients with possible coronary chest pain is highly variable. Methods and Results Controlled cohort study amongst 21 EDs of an integrated healthcare system examining the implementation of a graded coronary risk stratification algorithm (RISTRA-ACS [risk stratification for acute coronary syndrome]). Thirteen EDs had access to RISTRA-ACS within the electronic health record (RISTRA sites) beginning in month 24 of a 48-month study period (January 2016 to December 2019); the remaining 8 EDs served as contemporaneous controls. Study participants had a chief complaint of chest pain and serum troponin measurement in the ED. The primary outcome was index visit resource utilization (observation unit or hospital admission, or 7-day objective cardiac testing). Secondary outcomes were 30-day objective cardiac testing, 60-day major adverse cardiac events (MACE), and 60-day MACE-CR (MACE excluding coronary revascularization). Difference-in-differences analyses controlled for secular trends with stratification by estimated risk and adjustment for risk factors, ED physician and facility. A total of 154 914 encounters were included. Relative to control sites, 30-day objective cardiac testing decreased at RISTRA sites among patients with low (≤2%) estimated 60-day MACE risk (-2.5%, 95% CI -3.7 to -1.2%, P<0.001) and increased among patients with non-low (>2%) estimated risk (+2.8%, 95% CI +0.6 to +4.9%, P=0.014), without significant overall change (-1.0%, 95% CI -2.1 to 0.1%, P=0.079). There were no statistically significant differences in index visit resource utilization, 60-day MACE or 60-day MACE-CR. Conclusions Implementation of RISTRA-ACS was associated with better allocation of 30-day objective cardiac testing and no change in index visit resource utilization or 60-day MACE. Registration URL: https://www.clinicaltrials.gov; Unique identifier: NCT03286179.

Effect of Clinical Decision Support on Diagnostic Imaging for Pediatric Appendicitis: A Cluster Randomized Trial.

Importance: Appendicitis is the most common pediatric surgical emergency. Efforts to improve efficiency and quality of care have increased reliance on computed tomography (CT) and ultrasonography (US) in children with suspected appendicitis. Objective: To evaluate the effectiveness of an electronic health record-linked clinical decision support intervention, AppyCDS, on diagnostic imaging, health care costs, and safety outcomes for patients with suspected appendicitis. Design, Setting, and Participants: In this parallel, cluster randomized trial, 17 community-based general emergency departments (EDs) in California, Minnesota, and Wisconsin were randomized to the AppyCDS intervention group or usual care (UC) group. Patients were aged 5 to 20 years, presenting for an ED visit with right-sided or diffuse abdominal pain lasting 5 days or less. We excluded pregnant patients, those with a prior appendectomy, those with selected comorbidities, and those with traumatic injuries. The trial was conducted from October 2016 to July 2019. Interventions: AppyCDS prompted data entry at the point of care to estimate appendicitis risk using the pediatric appendicitis risk calculator (pARC). Based on pARC estimates, AppyCDS recommended next steps in care. Main Outcomes and Measures: Primary outcomes were CT, US, or any imaging (CT or US) during the index ED visit. Safety outcomes were perforations, negative appendectomies, and missed appendicitis. Costs were a secondary outcome. Ratio of ratios (RORs) for primary and safety outcomes and differences by group in cost were used to evaluate effectiveness of the clinical decision support tool. Results: We enrolled 3161 patients at intervention EDs and 2779 patients at UC EDs. The mean age of patients was 11.9 (4.6) years and 2614 (44.0%) were boys or young men. RORs for CT (0.94; 95% CI, 0.75-1.19), US (0.98; 95% CI, 0.84-1.14), and any imaging (0.96; 95% CI, 0.86-1.07) did not differ by study group. In an exploratory analysis conducted in 1 health system, AppyCDS was associated with a reduction in any imaging (ROR, 0.82; 95% CI, 0.73- 0.93) for patients with pARC score of 15% or less and a reduction in CT (ROR, 0.58; 95% CI, 0.45-0.74) for patients with a pARC score of 16% to 50%. Perforations, negative appendectomies, and cases of missed appendicitis by study phase did not differ significantly by study group. Costs did not differ overall by study group. Conclusions and Relevance: In this study, AppyCDS was not associated with overall reductions in diagnostic imaging; exploratory analysis revealed more appropriate use of imaging in patients with a low pARC score. Trial Registration: ClinicalTrials.gov Identifier: NCT02633735.

Diagnostic Performance of Emergency Physician Gestalt for Predicting Acute Appendicitis in Patients Age 5 to 20 Years.

OBJECTIVES: Pediatric appendicitis remains a challenging diagnosis in the emergency department (ED). Available risk prediction algorithms may contribute to excessive ED imaging studies. Incorporation of physician gestalt assessment could help refine predictive tools and improve diagnostic imaging decisions. METHODS: This study was a subanalysis of a parent study that prospectively enrolled patients ages 5 to 20.9 years with a chief complaint of abdominal pain presenting to 11 community EDs within an integrated delivery system between October 1, 2016, and September 30, 2018. Prior to diagnostic imaging, attending emergency physicians enrolled patients with ≤5 days of right-sided or diffuse abdominal pain using a Web-based application embedded in the electronic health record. Predicted risk (gestalt) of acute appendicitis was prospectively entered using a sliding scale from 1% to 100%. As a planned secondary analysis, we assessed the performance of gestalt via c-statistics of receiver operating characteristic (ROC) curves; tested associations between gestalt performance and patient, physician, and facility characteristics; and examined clinical characteristics affecting gestalt estimates. RESULTS: Of 3,426 patients, 334 (9.8%) had confirmed appendicitis. Physician gestalt had excellent ROC curve characteristics (c-statistic = 0.83, 95% confidence interval = 0.81 to 0.85), performing particularly well in the low-risk strata (appendicitis rate = 1.1% in gestalt 1%-10% range, negative predictive value of 98.9% for appendicitis diagnosis). Physicians with ≥5 years since medical school graduation demonstrated improved gestalt performance over those with less experience (p = 0.007). All clinical characteristics tested, except pain <24 hours, were significantly associated with physician gestalt value (p < 0.05). CONCLUSION: Physician gestalt for acute appendicitis diagnosis performed well, especially in low-risk patients and when employed by experienced physicians.

Automated Retrospective Calculation of the EDACS and HEART Scores in a Multicenter Prospective Cohort of Emergency Department Chest Pain Patients.

OBJECTIVES: Coronary risk scores are commonly applied to emergency department patients with undifferentiated chest pain. Two prominent risk score-based protocols are the Emergency Department Assessment of Chest pain Score Accelerated Diagnostic Protocol (EDACS-ADP) and the History, ECG, Age, Risk factors, and Troponin (HEART) pathway. Since prospective documentation of these risk determinations can be challenging to obtain, quality improvement projects could benefit from automated retrospective risk score classification methodologies. METHODS: EDACS-ADP and HEART pathway data elements were prospectively collected using a Web-based electronic clinical decision support (eCDS) tool over a 24-month period (2018-2019) among patients presenting with chest pain to 13 EDs within an integrated health system. Data elements were also extracted and processed electronically (retrospectively) from the electronic health record (EHR) for the same patients. The primary outcome was agreement between the prospective/eCDS and retrospective/EHR data sets on dichotomous risk protocol classification, as assessed by kappa statistics (ĸ). RESULTS: There were 12,110 eligible eCDS uses during the study period, of which 66 and 47% were low-risk encounters by EDACS-ADP and HEART pathway, respectively. Agreement on low-risk status was acceptable for EDACS-ADP (ĸ = 0.73, 95% confidence interval [CI] = 0.72 to 0.75) and HEART pathway (ĸ = 0.69, 95% CI = 0.68 to 0.70) and for the continuous scores (interclass correlation coefficients = 0.87 and 0.84 for EDACS and HEART, respectively). CONCLUSIONS: Automated retrospective determination of low risk status by either the EDACS-ADP or the HEART pathway provides acceptable agreement compared to prospective score calculations, providing a feasible risk adjustment option for use in large data set analyses.

Text message alerts to emergency physicians identifying potential study candidates increase clinical trial enrollment.

Prospective enrollment of research subjects in the fast-paced emergency department (ED) is challenging. We sought to develop a software application to increase real-time clinical trial enrollment during an ED visit. The Prospective Intelligence System for Clinical Emergency Services (PISCES) scans the electronic health record during ED encounters for preselected clinical characteristics of potentially eligible study participants and notifies the treating physician via mobile phone text alerts. PISCES alerts began 3 months into a cluster randomized trial of an electronic health record-based risk stratification tool for pediatric abdominal pain in 11 Northern California EDs. We compared aggregate enrollment before (2577 eligible patients, October 2016 to December 2016) and after (12 049 eligible patients, January 2017 to January 2018) PISCES implementation. Enrollment increased from 10.8% to 21.1% following PISCES implementations (P < .001). PISCES significantly increased study enrollment and can serve as a valuable tool to assist prospective research enrollment in the ED.

Development of a Clinical Decision Support System for Pediatric Abdominal Pain in Emergency Department Settings Across Two Health Systems Within the HCSRN.

BACKGROUND: Appendicitis is a common surgical emergency in children, yet diagnosis can be challenging. An electronic health record (EHR) based, clinical decision support (CDS) system called Appy CDS was designed to help guide management of pediatric patients with acute abdominal pain within the Health Care Systems Research Network (HCSRN). OBJECTIVES: To describe the development and implementation of a clinical decision support tool (Appy CDS) built independently but synergistically at two large HCSRN affiliated health systems using well-established platforms, and to assess the tool's Triage component, aiming to identify pediatric patients at increased risk for appendicitis. RESULTS: Despite differences by site in design and implementation, such as the use of alerts, incorporating gestalt, and other workflow variations across sites, using simple screening questions and automated exclusions, both systems were able to identify a population with similar appendicitis rates (11.8 percent and 10.6 percent), where use of the full Appy CDS would be indicated. DISCUSSION: These 2 HCSRN sites designed Appy CDS to capture a population at risk for appendicitis and deliver CDS to that population while remaining locally relevant and adhering to organizational preferences. Despite different approaches to point-of-care CDS, the sites have identified similar cohorts with nearly identical background rates of appendicitis. NEXT STEPS: The full Appy CDS tool, providing personalized risk assessment and tailored recommendations, is undergoing evaluation as part of a pragmatic cluster randomized trial aiming to reduce reliance on advanced diagnostic imaging. The novel approaches to CDS we present could serve as the basis for future ED interventions.

Development and Validation of a Novel Pediatric Appendicitis Risk Calculator (pARC).

OBJECTIVES: We sought to develop and validate a clinical calculator that can be used to quantify risk for appendicitis on a continuous scale for patients with acute abdominal pain. METHODS: The pediatric appendicitis risk calculator (pARC) was developed and validated through secondary analyses of 3 distinct cohorts. The derivation sample included visits to 9 pediatric emergency departments between March 2009 and April 2010. The validation sample included visits to a single pediatric emergency department from 2003 to 2004 and 2013 to 2015. Variables evaluated were as follows: age, sex, temperature, nausea and/or vomiting, pain duration, pain location, pain with walking, pain migration, guarding, white blood cell count, and absolute neutrophil count. We used stepwise regression to develop and select the best model. Test performance of the pARC was compared with the Pediatric Appendicitis Score (PAS). RESULTS: The derivation sample included 2423 children, 40% of whom had appendicitis. The validation sample included 1426 children, 35% of whom had appendicitis. The final pARC model included the following variables: sex, age, duration of pain, guarding, pain migration, maximal tenderness in the right-lower quadrant, and absolute neutrophil count. In the validation sample, the pARC exhibited near perfect calibration and a high degree of discrimination (area under the curve: 0.85; 95% confidence interval: 0.83 to 0.87) and outperformed the PAS (area under the curve: 0.77; 95% confidence interval: 0.75 to 0.80). By using the pARC, almost half of patients in the validation cohort could be accurately classified as at <15% risk or ≥85% risk for appendicitis, whereas only 23% would be identified as having a comparable PAS of <3 or >8. CONCLUSIONS: In our validation cohort of patients with acute abdominal pain, the pARC accurately quantified risk for appendicitis.

Thromboprophylaxis for Patients with High-risk Atrial Fibrillation and Flutter Discharged from the Emergency Department.

INTRODUCTION: Many patients with atrial fibrillation or atrial flutter (AF/FL) who are high risk for ischemic stroke are not receiving evidence-based thromboprophylaxis. We examined anticoagulant prescribing within 30 days of receiving dysrhythmia care for non-valvular AF/FL in the emergency department (ED). METHODS: This prospective study included non-anticoagulated adults at high risk for ischemic stroke (ATRIA score ≥7) who received emergency AF/FL care and were discharged home from seven community EDs between May 2011 and August 2012. We characterized oral anticoagulant prescribing patterns and identified predictors of receiving anticoagulants within 30 days of the index ED visit. We also describe documented reasons for withholding anticoagulation. RESULTS: Of 312 eligible patients, 128 (41.0%) were prescribed anticoagulation at ED discharge or within 30 days. Independent predictors of anticoagulation included age (adjusted odds ratio [aOR] 0.89 per year, 95% confidence interval [CI] 0.82-0.96); ED cardiology consultation (aOR 1.89, 95% CI [1.10-3.23]); and failure of sinus restoration by time of ED discharge (aOR 2.65, 95% CI [1.35-5.21]). Reasons for withholding anticoagulation at ED discharge were documented in 139 of 227 cases (61.2%), the most common of which were deferring the shared decision-making process to the patient's outpatient provider, perceived bleeding risk, patient refusal, and restoration of sinus rhythm. CONCLUSION: Approximately 40% of non-anticoagulated AF/FL patients at high risk for stroke who presented for emergency dysrhythmia care were prescribed anticoagulation within 30 days. Physicians were less likely to anticoagulate older patients and those with ED sinus restoration. Opportunities exist to improve rates of thromboprophylaxis in this high-risk population.

Discharge recommendation based on a novel technique of homeostatic analysis.

OBJECTIVE: We propose a computational framework for integrating diverse patient measurements into an aggregate health score and applying it to patient stability prediction. MATERIALS AND METHODS: We mapped retrospective patient data from the Multiparameter Intelligent Monitoring in Intensive Care (MIMIC) II clinical database into a discrete multidimensional space, which was searched for measurement combinations and trends relevant to patient outcomes of interest. Patient trajectories through this space were then used to make outcome predictions. As a case study, we built AutoTriage, a patient stability prediction tool to be used for discharge recommendation. RESULTS: AutoTriage correctly identified 3 times as many stabilizing patients as existing tools and achieved an accuracy of 92.9% (95% CI: 91.6-93.9%), while maintaining 94.5% specificity. Analysis of AutoTriage parameters revealed that interdependencies between risk factors comprised the majority of each patient stability score. DISCUSSION: AutoTriage demonstrated an improvement in the sensitivity of existing stability prediction tools, while considering patient safety upon discharge. The relative contributions of risk factors indicated that time-series trends and measurement interdependencies are most important to stability prediction. CONCLUSION: Our results motivate the application of multidimensional analysis to other clinical problems and highlight the importance of risk factor trends and interdependencies in outcome prediction.

Use of Traumatic Brain Injury Prediction Rules With Clinical Decision Support.

OBJECTIVES: We determined whether implementing the Pediatric Emergency Care Applied Research Network (PECARN) traumatic brain injury (TBI) prediction rules and providing risks of clinically important TBIs (ciTBIs) with computerized clinical decision support (CDS) reduces computed tomography (CT) use for children with minor head trauma. METHODS: Nonrandomized trial with concurrent controls at 5 pediatric emergency departments (PEDs) and 8 general EDs (GEDs) between November 2011 and June 2014. Patients were <18 years old with minor blunt head trauma. Intervention sites received CDS with CT recommendations and risks of ciTBI, both for patients at very low risk of ciTBI (no Pediatric Emergency Care Applied Research Network rule factors) and those not at very low risk. The primary outcome was the rate of CT, analyzed by site, controlling for time trend. RESULTS: We analyzed 16 635 intervention and 2394 control patients. Adjusted for time trends, CT rates decreased significantly (P < .05) but modestly (2.3%-3.7%) at 2 of 4 intervention PEDs for children at very low risk. The other 2 PEDs had small (0.8%-1.5%) nonsignificant decreases. CT rates did not decrease consistently at the intervention GEDs, with low baseline CT rates (2.1%-4.0%) in those at very low risk. The control PED had little change in CT use in similar children (from 1.6% to 2.9%); the control GED showed a decrease in the CT rate (from 7.1% to 2.6%). For all children with minor head trauma, intervention sites had small decreases in CT rates (1.7%-6.2%). CONCLUSIONS: The implementation of TBI prediction rules and provision of risks of ciTBIs by using CDS was associated with modest, safe, but variable decreases in CT use. However, some secular trends were also noted.