The Clinical Emergency Data Registry: Structure, Use, and Limitations for Research.

The Clinical Emergency Data Registry (CEDR) is a qualified clinical data registry that collects data from participating emergency departments (EDs) in the United States for quality measurement, improvement, and reporting purposes. This article aims to provide an overview of the data collection and validation process, describe the existing data structure and elements, and explain the potential opportunities and limitations for ongoing and future research use. CEDR data are primarily collected for quality reporting purposes and are obtained from diverse sources, including electronic health records and billing data that are de-identified and stored in a secure, centralized database. The CEDR data structure is organized around clinical episodes, which contain multiple data elements that are standardized using common data elements and are mapped to established terminologies to enable interoperability and data sharing. The data elements include patient demographics, clinical characteristics, diagnostic and treatment procedures, and outcomes. Key limitations include the limited generalizability due to the selective nature of participating EDs and the limited validation and completeness of data elements not currently used for quality reporting purposes, including demographic data. Nonetheless, CEDR holds great potential for ongoing and future research in emergency medicine due to its large-volume, longitudinal, near real-time, clinical data. In 2021, the American College of Emergency Physicians authorized the transition from CEDR to the Emergency Medicine Data Institute, which will catalyze investments in improved data quality and completeness for research to advance emergency care.

Detection of COVID-19 using multimodal data from a wearable device: results from the first TemPredict Study.

Early detection of diseases such as COVID-19 could be a critical tool in reducing disease transmission by helping individuals recognize when they should self-isolate, seek testing, and obtain early medical intervention. Consumer wearable devices that continuously measure physiological metrics hold promise as tools for early illness detection. We gathered daily questionnaire data and physiological data using a consumer wearable (Oura Ring) from 63,153 participants, of whom 704 self-reported possible COVID-19 disease. We selected 73 of these 704 participants with reliable confirmation of COVID-19 by PCR testing and high-quality physiological data for algorithm training to identify onset of COVID-19 using machine learning classification. The algorithm identified COVID-19 an average of 2.75 days before participants sought diagnostic testing with a sensitivity of 82% and specificity of 63%. The receiving operating characteristic (ROC) area under the curve (AUC) was 0.819 (95% CI [0.809, 0.830]). Including continuous temperature yielded an AUC 4.9% higher than without this feature. For further validation, we obtained SARS CoV-2 antibody in a subset of participants and identified 10 additional participants who self-reported COVID-19 disease with antibody confirmation. The algorithm had an overall ROC AUC of 0.819 (95% CI [0.809, 0.830]), with a sensitivity of 90% and specificity of 80% in these additional participants. Finally, we observed substantial variation in accuracy based on age and biological sex. Findings highlight the importance of including temperature assessment, using continuous physiological features for alignment, and including diverse populations in algorithm development to optimize accuracy in COVID-19 detection from wearables.

Fair Play: Application of Normalized Scoring to Emergency Department Throughput Quality Measures in a National Registry.

STUDY OBJECTIVE: The measurement of emergency department (ED) throughput as a patient-centered quality measure is ubiquitous; however, marked heterogeneity exists between EDs, complicating comparisons for payment purposes. We evaluate 4 scoring methodologies for accommodating differences in ED visit volume and heterogeneity among ED groups that staff multiple EDs to improve the validity and "fairness" of ED throughput quality measurement in a national registry, with the goal of developing a volume-adjusted throughput measure that balances variation at the ED group level. METHODS: We conducted an ED group-level analysis using the 2017 American College of Emergency Physicians Clinical Emergency Data Registry data set, which included 548 ED groups inclusive of 889 unique EDs. We calculated ED throughput performance scores for each ED group by using 4 scoring approaches: plurality, simple average, weighted average, and a weighted standardized score. For comparison, ED groups (ie, taxpayer identification numbers) were grouped into 3 types: taxpayer identification numbers with only 1 ED; those with multiple EDs, but no ED with greater than 60,000 visits; and those with multiple EDs and at least 1 ED with greater than 60,000 visits. RESULTS: We found marked differences in the classification of ED throughput performance between scoring approaches. The weighted standardized score (z score) approach resulted in the least skewed and most uniform distribution across the majority of ED types, with a kurtosis of 12.91 for taxpayer identification numbers composed of 1 ED, 2.58 for those with multiple EDs without any supercenter, and 3.56 for those with multiple EDs with at least 1 supercenter, all lower than comparable scoring methods. The plurality and simple average scoring approaches appeared to disproportionally penalize ED groups that staff a single ED or multiple large-volume EDs. CONCLUSION: Application of a weighted standardized (z score) approach to ED throughput measurement resulted in a more balanced variation between different ED group types and reduced distortions in the length-of-stay measurement among ED groups staffing high-volume EDs. This approach may be a more accurate and acceptable method of profiling ED group throughput pay-for-performance programs.

Development of a qualified clinical data registry for emergency medicine.

The passage of the Medicare Access and CHIP Reauthorization Act (MACRA) in 2015 marked a fundamental transition in physician payment by the Centers for Medicare and Medicaid Services (CMS) from traditional fee-for service to value-based models. MACRA led to the creation of the CMS Quality Payment Program (QPP), which bases the value of physician care in large part on physician quality reporting. The QPP enabled a shift away from legacy CMS-stewarded quality measures that had limited applicability to individual specialties toward specialty-specific quality measures developed and stewarded by physician specialty societies using Qualified Clinical Data Registries (QCDRs). This article describes the development of the first nationally available emergency medicine QCDR as a means for emergency physicians to participate in the QPP, measure, and benchmark emergency physician quality.

Trends in Costs of Care for Medicare Beneficiaries Treated in the Emergency Department From 2011 to 2016.

Importance: There is little evidence regarding how total costs of care associated with an emergency department (ED) visit have changed, despite increasing policy focus on the value of acute care. Objective: To examine trends in total standardized 30-day costs of care associated with an ED visit. Design, Setting, and Participants: This cross-sectional study of 14 113 088 ED visits at 4730 EDs from 2011 to 2016 included a 20% national sample of traditional Medicare beneficiaries aged 65 years and older. Data analysis was conducted from August 2018 to April 2020. Exposures: Time (year) as a continuous variable. Main Outcomes and Measures: Trends in disposition from the ED and 30-day total standardized costs for all ED visits as well as the following spending components: index visit cost, physician costs, subsequent ED visit costs, subsequent inpatient costs, subsequent observation costs, non-ED outpatient care, postacute care, and aggregated total spending after the index ED visit. Results: The analytic sample consisted of 14 113 088 ED visits at 4730 EDs. The mean (SD) beneficiary age was 78.6 (8.6) years, 8 573 652 visits (60.7%) were among women, and 11 908 691 visits (84.7%) were among white patients. The proportion of patients discharged from the ED rose from 1 233 701 of 2 309 563 visits (53.4%) in 2011 to 1 279 701 of 2 268 363 visits (56.4%) in 2016. Total adjusted 30-day standardized costs of care declined from a mean (SE) of $8851 ($35.3) in 2011 to a mean (SE) of $8143 ($35.4) in 2016 (-$126/y; 95% CI, -$130 to -$121; P < .001) for all ED visits. This decrease was primarily associated with a decline in total spending on the index ED visit (-$48/y; 95% CI, -$50 to -$47; P < .001) as well as lower spending on postacute care (-$42/y; 95% CI, -$44 to -$41; P < .001) and subsequent inpatient care (-$34/y; 95% CI, -$36 to -$32; P < .001). There was an increase in spending after the index visit on downstream observation care ($3.6/y; 95% CI, $3.5 to $3.7; P < .001), outpatient ED care ($4.6/y; 95% CI, $4.4 to $4.8; P < .001), and other outpatient care ($15/y; 95% CI, $12 to $18; P < .001). Conclusions and Relevance: In this study, total 30-day standardized costs of ED care for Medicare beneficiaries decreased in recent years. It may be that more intensive ED spending up front is associated with reductions in total costs of an acute episode.

Trends in Mortality for Medicare Beneficiaries Treated in the Emergency Department From 2009 to 2016.

Importance: Emergency department (ED) visits are common and increasing. Whether outcomes associated with care in the ED are improving over time is largely unknown to date. Objective: To examine trends in 30-day mortality rates associated with ED care among Medicare beneficiaries aged 65 years or older. Design, Setting, and Participants: This cross-sectional study used a random 5% sample in 2009 and 2010 and a 20% sample from 2011 to 2016, for a total of 15 416 385 ED visits from 2009 to 2016 among Medicare beneficiaries aged 65 years or older. Exposures: Time (year) as a continuous variable. Main Outcomes and Measures: The primary outcome was 30-day mortality, overall and stratified by illness severity and hospital characteristics. Secondary outcomes included mortality rates on the day of the ED visit (day 0) as well as at 7 and 14 days. Changes in disposition from the ED (admission, observation, transfer, died in the ED, and discharged) over time were also examined. Results: The sample included 15 416 385 ED visits (60.8% women and 39.2% men; mean [SD] age, 78.6 [8.5] years) at 4828 acute care hospitals. The percentage of patients discharged from the ED increased from 53.6% in 2009 to 56.7% in 2016. Unadjusted 30-day mortality declined from 5.1% in 2009 to 4.6% in 2016 (-0.068% per year; 95% CI, -0.074% to -0.063% per year; P < .001). After adjusting for hospital random effects, patient demographics, and chronic conditions, the adjusted 30-day mortality trend was -0.198% per year (95% CI, -0.204% to -0.193% per year; P < .001). The magnitude of this trend was greatest for patients with a high severity of illness (-0.662%; 95% CI, -0.681% to -0.644%; P < .001), followed by those with a medium severity of illness (-0.103% per year; 95% CI, -0.108% to -0.097% per year; P < .001) and those with a low severity of illness (-0.009% per year; 95% CI, -0.006% to -0.011% per year; P < .001). Declines in mortality were seen in each category of ED disposition, including visits resulting in admission (-0.356% per year; 95% CI, -0.368% to -0.343% per year; P < .001) as well as those resulting in discharge (-0.059% per year; 95% CI, -0.064% to -0.055% per year; P < .001). The decline was greater for major teaching hospitals (compared with nonteaching hospitals), nonprofit hospitals (compared with for-profit hospitals), and urban hospitals (compared with rural hospitals). Conclusions and Relevance: Among Medicare beneficiaries receiving ED care in the United States, mortality within 30 days of an ED visit appears to have declined in recent years, particularly for patients with the highest severity of illness, even as fewer patients are being admitted from an ED visit. This study's findings suggest that further study is needed to understand the reasons for this decline and why certain types of hospitals are seeing greater improvements in outcomes.

Emergency Department Involvement in Accountable Care Organizations in Massachusetts: A Survey Study.

STUDY OBJECTIVE: We assess Massachusetts emergency department (ED) involvement and internal ED constructs within accountable care organization contracts. METHODS: An online survey was distributed to 70 Massachusetts ED directors. Questions attempted to assess involvement of EDs in accountable care organizations and the structures in place in EDs-from departmental resources to physician incentives-to help achieve accountable care organization goals of decreasing spending and improving quality. RESULTS: Of responding ED directors, 79% reported alignment between the ED and an accountable care organization. Almost all ED groups (88%) reported bearing no financial risk as a result of the accountable care organization contracts in which their organizations participated. Major obstacles to meeting accountable care organization objectives included care coordination challenges (62%) and lack of familiarity with accountable care organization goals (58%). The most common cost-reduction strategies included ED case management (85%) and information technology (61%). Limitations of this study include that information was self-reported by ED directors, a focus limited to Massachusetts, and a survey response rate of 47%. CONCLUSION: The ED directors perceived that the majority of physicians were not familiar with accountable care organization goals, many challenges remain in coordinating care for patients in the ED, and most EDs have no financial incentives tied to accountable care organizations. EDs in Massachusetts have begun to implement strategies aimed at reducing admissions, utilization, and overall cost, but these strategies are not widespread apart from case management, even in a state with heavy accountable care organization penetration. Our results suggest that Massachusetts EDs still lack clear directives and direct involvement in meeting accountable care organization goals.

The Affordable Care Act and emergency care.

The Affordable Care Act (ACA) will have far-reaching effects on the way health care is designed and delivered. Several elements of the ACA will directly affect both demand for ED care and expectations for its role in providing coordinated care. Hospitals will need to employ strategies to reduce ED crowding as the ACA expands insurance coverage. Discussions between EDs and primary care physicians about their respective roles providing acute unscheduled care would promote the goals of the ACA.

The effect of an ambulance diversion ban on emergency department length of stay and ambulance turnaround time.

STUDY OBJECTIVE: Massachusetts became the first state in the nation to ban ambulance diversion in 2009. It was feared that the diversion ban would lead to increased emergency department (ED) crowding and ambulance turnaround time. We seek to characterize the effect of a statewide ambulance diversion ban on ED length of stay and ambulance turnaround time at Boston-area EDs. METHODS: We conducted a retrospective, pre-post observational analysis of 9 Boston-area hospital EDs before and after the ban. We used ED length of stay as a proxy for ED crowding. We compared hospitals individually and in aggregate to determine any changes in ED length of stay for admitted and discharged patients, ED volume, and turnaround time. RESULTS: No ED experienced an increase in ED length of stay for admitted or discharged patients or ambulance turnaround time despite an increase in volume for several EDs. There was an overall 3.6% increase in ED volume in our sample, a 10.4-minute decrease in length of stay for admitted patients, and a 2.2-minute decrease in turnaround time. When we compared high- and low-diverting EDs separately, neither saw an increase in length of stay, and both saw a decrease in turnaround time. CONCLUSION: After the first statewide ambulance diversion ban, there was no increase in ED length of stay or ambulance turnaround time at 9 Boston-area EDs. Several hospitals actually experienced improvements in these outcome measures. Our results suggest that the ban did not worsen ED crowding or ambulance availability at Boston-area hospitals.

Emergency department crowding and risk of preventable medical errors.

The objective of the study is to determine the association between emergency department (ED) crowding and preventable medical errors (PME). This was a retrospective cohort study of 533 ED patients enrolled in the National ED Safety Study (NEDSS) in four Massachusetts EDs. Individual patients' average exposure to ED crowding during their ED visit was compared with the occurrence of a PME (yes/no) for the three diagnostic categories in NEDSS: acute myocardial infarction, asthma exacerbation, and dislocation requiring procedural sedation. To accommodate site-to-site differences in available administrative data, ED crowding was measured using one of three previously validated crowding metrics (ED Work Index, ED Workscore, and ED Occupancy). At each site, the continuous measure was placed into site-specific quartiles, and these quartiles then were combined across sites. We found that 46 (8.6%; 95% confidence interval, 6.4-11.3%) of the 533 patients experienced a PME. For those seen during higher levels of ED crowding (quartile 4 vs. quartile 1), the occurrence of PMEs was more than twofold higher, both on unadjusted analysis and adjusting for two potential confounders (diagnosis, site). The association appeared non-linear, with most PMEs occurring at the highest crowding level. We identified a direct association between high levels of ED crowding and risk of preventable medical errors. Further study is needed to determine the generalizability of these results. Should such research confirm our findings, we would suggest that mitigating ED crowding may reduce the occurrence of preventable medical errors.

Trial to end ambulance diversion in Boston: report from the conference of the Boston teaching hospitals consortium.

INTRODUCTION: Annual ambulance diversion hours in Boston increased more than six-fold from 1997 to 2006. Although interventions and best practices were implemented, there was no reduction in the number of diversion hours. OBJECTIVES: A consortium of Boston teaching hospitals instituted a two-week moratorium on citywide diversion from 02 October 2006 to 15 October 2006. The hypothesis was that there would be no significant difference in measures of hospital and emergency medical services (EMS) efficiency compared with the two weeks immediately prior. METHODS: A total of nine hospitals and the municipal emergency medical services in Boston submitted data for analysis. The following mean daily hospital measures were studied: (1) emergency department volume; (2) number of emergency department admissions; (3) length of stay (LOS) for all patients; and (4) number of elopements. Mean EMS at-hospital time by destination and the percent of all Boston EMS transports to each hospital destination were calculated. The median differences (MD) were calculated as "before" minus "during" the study period and were compared with paired, Wilcoxon, non-parametric tests. Additional mean EMS measures for all destinations included: (1) to hospital time; (2) number of responses with transport initiated per day; (3) incident entry to arrival; and (4) at-hospital time. RESULTS: The LOS for admitted patients (MD = 0.30 hours; IQR 0.10,1.30; p = 0.03) and number of daily admissions (MD = -1.50 patients; IQR -1.50, -0.10; p = 0.04) were significantly different statistically. The results for LOS for all patients, LOS for discharged patients, ED volume, EMS time at hospital by destination, number of elopements, and percent of Boston EMS transports to each hospital revealed no statistically significant differences. The difference between the study and control periods for mean EMS to hospital time, at-hospital time, and incident entry to arrival was a maximum of 0.6 minutes. The vast majority of EMS respondents to an online survey believed that the "no diversion" policy should be made routine practice. CONCLUSIONS: The LOS for admitted patients decreased by 18 minutes, and the number of admissions increased by 1.5 patients per day during the study period. The "no diversion" policy resulted in minimal changes in EMS efficiency and operations. Diversion was temporarily eliminated in a major city without significant detrimental changes in ED, hospital, or EMS efficiency.

Enhancing systems to improve the management of acute, unscheduled care.

For acutely ill patients, health care services are available in many different settings, including hospital-based emergency departments (EDs), retail clinics, federally qualified health centers, and outpatient clinics. Certain conditions are the sole domain of particular settings: stabilization of critically ill patients can typically only be provided in EDs. By contrast, many conditions that do not require hospital resources, such as advanced radiography, admission, and same-day consultation can often be managed in clinic settings. Because clinics are generally not open nights, and often not on weekends or holidays, the ED remains the only option for face-to-face medical care during these times. For patients who can be managed in either setting, there are many open research questions about which is the best setting, because these venues differ in terms of access, costs of care, and potentially, quality. Consideration of these patients must be risk-adjusted, as patients may self-select a venue for care based upon perceived acuity. We present a research agenda for acute, unscheduled care in the United States developed in conjunction with an Agency for Healthcare Research and Quality-funded conference hosted by the American College of Emergency Physicians in October 2009, titled "Improving the Quality and Efficiency of Emergency Care Across the Continuum: A Systems Approach." Given the possible increase in ED utilization over the next several years as more people become insured, understanding differences in cost, quality, and access for conditions that may be treated in EDs or clinic settings will be vital in guiding national health policy.

Measures of crowding in the emergency department: a systematic review.

OBJECTIVES: Despite consensus regarding the conceptual foundation of crowding, and increasing research on factors and outcomes associated with crowding, there is no criterion standard measure of crowding. The objective was to conduct a systematic review of crowding measures and compare them in conceptual foundation and validity. METHODS: This was a systematic, comprehensive review of four medical and health care citation databases to identify studies related to crowding in the emergency department (ED). Publications that "describe the theory, development, implementation, evaluation, or any other aspect of a 'crowding measurement/definition' instrument (qualitative or quantitative)" were included. A "measurement/definition" instrument is anything that assigns a value to the phenomenon of crowding in the ED. Data collected from papers meeting inclusion criteria were: study design, objective, crowding measure, and evidence of validity. All measures were categorized into five measure types (clinician opinion, input factors, throughput factors, output factors, and multidimensional scales). All measures were then indexed to six validation criteria (clinician opinion, ambulance diversion, left without being seen (LWBS), times to care, forecasting or predictions of future crowding, and other). RESULTS: There were 2,660 papers identified by databases; 46 of these papers met inclusion criteria, were original research studies, and were abstracted by reviewers. A total of 71 unique crowding measures were identified. The least commonly used type of crowding measure was clinician opinion, and the most commonly used were numerical counts (number or percentage) of patients and process times associated with patient care. Many measures had moderate to good correlation with validation criteria. CONCLUSIONS: Time intervals and patient counts are emerging as the most promising tools for measuring flow and nonflow (i.e., crowding), respectively. Standardized definitions of time intervals (flow) and numerical counts (nonflow) will assist with validation of these metrics across multiple sites and clarify which options emerge as the metrics of choice in this "crowded" field of measures.

Regionalization findings in the national report card of the state of emergency medicine.

The National Report Card on the State of Emergency Medicine (2009 edition) evaluated the conditions under which emergency care is delivered in each of the 50 states and compared those conditions between the states. The Report Card ranked states in five major categories: access to emergency care, quality and patient safety environment, public health and injury prevention, liability environment, and disaster preparedness. Three of those categories are particularly relevant to regionalization: access to emergency care, quality and patient safety environment, and disaster-preparedness. Within these categories, there was great variability between states in the distribution, planning, infrastructure, and available personnel for emergency care. Effective regionalization may require additional resources or a redistribution of existing resources within and among the states.

Forecasting emergency department crowding: an external, multicenter evaluation.

STUDY OBJECTIVE: We apply a previously described tool to forecast emergency department (ED) crowding at multiple institutions and assess its generalizability for predicting the near-future waiting count, occupancy level, and boarding count. METHODS: The ForecastED tool was validated with historical data from 5 institutions external to the development site. A sliding-window design separated the data for parameter estimation and forecast validation. Observations were sampled at consecutive 10-minute intervals during 12 months (n=52,560) at 4 sites and 10 months (n=44,064) at the fifth. Three outcome measures-the waiting count, occupancy level, and boarding count-were forecast 2, 4, 6, and 8 hours beyond each observation, and forecasts were compared with observed data at corresponding times. The reliability and calibration were measured following previously described methods. After linear calibration, the forecasting accuracy was measured with the median absolute error. RESULTS: The tool was successfully used for 5 different sites. Its forecasts were more reliable, better calibrated, and more accurate at 2 hours than at 8 hours. The reliability and calibration of the tool were similar between the original development site and external sites; the boarding count was an exception, which was less reliable at 4 of 5 sites. Some variability in accuracy existed among institutions; when forecasting 4 hours into the future, the median absolute error of the waiting count ranged between 0.6 and 3.1 patients, the median absolute error of the occupancy level ranged between 9.0% and 14.5% of beds, and the median absolute error of the boarding count ranged between 0.9 and 2.8 patients. CONCLUSION: The ForecastED tool generated potentially useful forecasts of input and throughput measures of ED crowding at 5 external sites, without modifying the underlying assumptions. Noting the limitation that this was not a real-time validation, ongoing research will focus on integrating the tool with ED information systems.

The effect of a CT and MR preauthorization program on ED utilization.

OBJECTIVES: To determine if a new outpatient preauthorization process for radiologic studies was associated with a change in emergency department (ED) CT and MRI utilization rates. METHODS: This was a retrospective study set in an urban tertiary teaching hospital. Subjects included all nonadmitted ED patients who had either a CT or MRI during a control or preauthorization period. The study group consisted of those patients whose insurance required preauthorization. The control group consisted of those patients for whom preauthorization was not required. We used a multiple regression with autoregressive error adjusting for seasonal and monthly variation to obtain the rates of change of CT and MRI usage over time for the control and preauthorization periods. RESULTS: The control period consisted of 29,303 ED visits over 54 weeks not resulting in hospital admission. The preauthorization period contained 33,858 patients over 64 weeks. The baseline ordering of CT and MRI was not significantly different between the groups. After controlling for seasonal and monthly variation, our results demonstrated that while both insurance groups demonstrated an increase in use of CT and MRI from the control to preauthorization periods, there is a statistically significant increase only in the rate of MRI utilization in the study group during the preauthorization period. CONCLUSION: A telephone preauthorization process for radiological studies produced a statistically significant change in the rate of ordering MRI studies, but not CT, in the study group. We conclude that this preauthorization process may have resulted in additional ED visits for outpatient MR scans.

Development of an emergency department work score to predict ambulance diversion.

OBJECTIVES: The authors sought to develop and validate an emergency department (ED) work score that could be used in real time to quantify crowding and staff workload in an ED. This work score could be used by public health officials to direct ambulance traffic based on an objective measure of ED status and to track ED conditions over time. In addition, the authors sought to determine which portion of ED care was most responsible for crowding. METHODS: The setting was a tertiary teaching hospital with an emergency medicine residency. A number of ED parameters were measured throughout 2003 and then matched to times that an ED was on diversion status. Odd months of the year were used to develop the standard and even months to validate the standard. A marginal logistic regression analysis was used to develop the standard. The decision to divert ambulances was used as the criterion for ED crowding. RESULTS: The logistic regression demonstrated excellent correlation between the work score and diversion status. At the point of maximum inflection of the receiver operating characteristic curve, the work score predicted diversion status with 86% sensitivity and 80% specificity. CONCLUSIONS: An ED work score was successfully developed and internally validated. External validation should be performed before widespread use.