Practical Guide to Survey Research in Surgical Education.

This Guide to Statistics and Methods describes aspects of methods of survey research in surgical education, important considerations, and pitfalls and limitations.

Development of a clinical prediction instrument to estimate risk of initial violent injury.

BACKGROUND: Interpersonal violent injury is a public health crisis, disproportionately affecting young people of color. We aimed to evaluate associations between sociobehavioral predictors and first-time violent injury, and to develop a predictive risk score for violent injury. METHODS: We performed a retrospective case-cohort study of adolescents aged 12-18 years. Multivariable logistic regression was used to estimate associations between 35 candidate variables and interpersonal first-time violent injury resulting in an emergency department (ED) visit. Multiple imputation was used to account for missing values and a risk score was developed by multiplying regression coefficients by 10 to generate a composite tool to predict initial violent injury (IVI). Discrimination and calibration were assessed using 10-fold cross validation. RESULTS: 19,210 adolescents were included, 276 (1.4%) as victims of IVI. The final model, the Initial Violent Injury Risk Prediction Tool (IVI-RPT), included: age, fight within the prior year, trouble with the law, and alcohol use. IVI-RPT scores were categorized as: 0-7 (low risk), 8-16 (moderate), and 17-26 (high), and IVI prevalence was 0.8% (95% confidence interval [CI]: 0.6%, 0.9%), 2.5% (95% CI: 1.9%, 3.1%), and 5.3% (95% CI: 4.1%, 6.6%), respectively. The area under the receiver operating characteristic curve was 0.70 (95% CI: 0.66, 0.73), while the slope of the calibration curve was 1.1 (95% CI: 0.9, 1.2). CONCLUSIONS: We developed a promising clinical prediction instrument, the IVI-RPT, that categorizes individuals into risk groups with increasing probabilities of violent injury. External validation of this tool is required prior to clinical practice implementation.

Patterns of use and perceptions of an institution-specific antibiotic stewardship application among emergency department and urgent care clinicians.

We surveyed emergency department and urgent care clinicians to assess patterns of use and perceived usefulness of a local antibiotic stewardship application to deliver institution-specific prescribing guidance. Among 114 eligible respondents, the application was widely utilized, and it was perceived to be a useful clinical resource that improved prescribing.

Denver ED Trauma Organ Failure Score predicts healthcare resource utilization in adult trauma patients.

BACKGROUND: Early identification of trauma patients who need specialized healthcare resources may facilitate goal-directed resuscitation and effective secondary triage. OBJECTIVE: To estimate associations between Denver Emergency Department (ED) Trauma Organ Failure (TOF) Score and healthcare resource utilization. METHODS: Retrospective study of adult trauma patients at Denver Health Medical Center. The outcome was resource utilization including: intensive care unit (ICU) length of stay (LOS), hospital LOS, procedures, and costs. Multivariable regression analyses were used to estimate associations between moderate- or high-risk patients, as determined by the Denver ED TOF Score, and healthcare resource utilization. RESULTS: We included 3000 patients with a median age of 42 (IQR 27-56) years, 71% male, median injury severity score 9 (IQR 5-16), and 83% blunt mechanism. Among the cohort, 1379 patients (46%) were admitted to the ICU and 122 (4%) died. The adjusted relative risk for high- and moderate-risk as compared to low risk for number of procedures performed was 2.31 (95% CI 2.07-2.57) and 1.80 (95% CI 1.59-2.03) respectively; ICU LOS was 2.87 (95% CI 2.70-3.05) and 1.71 (95% CI 1.60-1.83) respectively; hospital LOS was 3.33 (95% CI 3.21-3.45) and 1.97 (95% CI 1.90-2.05) respectively. The adjusted geometric mean for high-, moderate-, and low-risk for costs was $48,881 (95% CI $43,799-$54,552), $27,890 (95% CI $25,460-$30,551), and $12,983 (95% CI $12,493-$13,492), respectively. CONCLUSIONS: The Denver ED TOF Score predicts healthcare resource utilization, and is a useful bedside tool to identify patients early after injury that are likely to require significant healthcare resources and specialized trauma care.

Undertriage of Trauma-Related Deaths in U.S. Emergency Departments.

INTRODUCTION: Accurate field triage of critically injured patients to trauma centers is vital for improving survival. We sought to estimate the national degree of undertriage of trauma patients who die in emergency departments (EDs) by evaluating the frequency and characteristics associated with triage to non-trauma centers. METHODS: This was a retrospective cross-sectional analysis of adult ED trauma deaths in the 2010 National Emergency Department Sample (NEDS). The primary outcome was appropriate triage to a trauma center (Level I, II or III) or undertriage to a non-trauma center. We subsequently focused on urban areas given improved access to trauma centers. We evaluated the associations of patient demographics, hospital region and mechanism of injury with triage to a trauma versus non-trauma center using multivariable logistic regression. RESULTS: We analyzed 3,971 included visits, representing 18,464 adult ED trauma-related deaths nationally. Of all trauma deaths, nearly half (44.5%, 95% CI [43.0-46.0]) of patients were triaged to non-trauma centers. In a subgroup analysis, over a third of urban ED visits (35.6%, 95% CI [34.1-37.1]) and most rural ED visits (86.4%, 95% CI [81.5-90.1]) were triaged to non-trauma centers. In urban EDs, female patients were less likely to be triaged to trauma centers versus non-trauma centers (adjusted odds ratio [OR] 0.83, 95% CI [0.70-0.99]). Highest median household income zip codes (≥$67,000) were less likely to be triaged to trauma centers than lowest median income ($1-40,999) (OR 0.54, 95% CI [0.43-0.69]). Compared to motor vehicle trauma, firearm trauma had similar odds of being triaged to a trauma center (OR 0.90, 95% CI [0.71-1.14]); however, falls were less likely to be triaged to a trauma center (OR 0.50, 95 %CI [0.38-0.66]). CONCLUSION: We found that nearly half of all trauma patients nationally and one-third of urban trauma patients, who died in the ED, were triaged to non-trauma centers, and thus undertriaged. Sex and other demographic disparities associated with this triage decision represent targeted opportunities to improve our trauma systems and reduce undertriage.

Perspectives on Tiered Older Driver Assessment in Primary Care Settings.

PURPOSE OF THE STUDY: Widespread screening of older drivers, with in-depth evaluation only of those who screen positive ("tiered assessment"), might efficiently balance driver safety and mobility. To inform program development, we sought to examine the perspectives of older drivers and clinicians on the concept of tiered assessment in primary care settings. DESIGN AND METHODS: Iterative focus groups and interviews with 33 community-dwelling current drivers aged ≥65 years and 8 primary care providers. We used inductive and deductive theme analysis to explore driver and clinician perspectives and to identify barriers and facilitators to establishing a tiered older driver assessment program in primary care settings. RESULTS: Four dominant themes emerged. Two themes addressed the overall concept: (a) support for the concept of tiered older driver assessment and (b) concerns about the consequences of older driver assessment and how these could affect program viability. Two themes addressed screening: (c) tension inherent in using a generalized approach to the highly individualized issue of driving and (d) logistical considerations for screening in primary care settings. IMPLICATIONS: Standardized older driver screening and referral might improve clinician-driver communication, but screening should occur in a context that includes personalized mobility counseling.

Comparison of droperidol and haloperidol for use by paramedics: assessment of safety and effectiveness.

BACKGROUND: Since the 2001 "black box" warning on droperidol, its use in the prehospital setting has decreased substantially in favor of haloperidol. There are no studies comparing the prehospital use of either drug. The goal of this study was to compare QTc prolongation, adverse events, and effectiveness of droperidol and haloperidol among a cohort of agitated patients in the prehospital setting. METHODS: In this institutional review board-approved before and after study, we collected data on 532 patients receiving haloperidol (n = 314) or droperidol (n = 218) between 2007 and 2010. We reviewed emergency department (ED) electrocardiograms when available (haloperidol, n = 78, 25%; droperidol, n = 178, 76%) for QTc length (in milliseconds), medical records for clinically relevant adverse events (defined a priori as systolic blood pressure (SBP) <90 mmHg, seizure, administration of anti-dysrhythmic medications, cardioversion or defibrillation, bag-valve-mask ventilation, intubation, cardiopulmonary arrest, and prehospital or in-hospital death). We also compared effectiveness of the medications, using administration of additional sedating medications within 30 minutes of ED arrival as a proxy for effectiveness. RESULTS: The mean haloperidol dose was 7.9 mg (median 10 mg, range 4-20 mg). The mean droperidol dose was 2.9 mg (median 2.5 mg, range 1.25-10 mg.) Haloperidol was given i.m. in 289 cases (92%), and droperidol was given i.m. in 132 cases (61%); in all other cases, the medication was given i.v.. There was no statistically significant difference in median QTc after medication administration (haloperidol 447 ms, 95% CI: 440-454 ms; droperidol 454 ms, 95% CI: 450-457). There were no statistically significant differences in adverse events in the droperidol group as compared to the haloperidol group. One patient in the droperidol group with a history of congenital heart disease suffered a cardiopulmonary arrest and was resuscitated with neurologically intact survival. There was no significant difference in the use of additional sedating medications within 30 minutes of ED arrival after receiving droperidol (2.9%, 95% CI: -2.5-8.4%). CONCLUSIONS: In this cohort of agitated patients treated with haloperidol or droperidol in the prehospital setting, there was no significant difference found in QTc prolongation, adverse events, or need for repeat sedation between haloperidol and droperidol.

Barriers and facilitators to learning and performing cardiopulmonary resuscitation in neighborhoods with low bystander cardiopulmonary resuscitation prevalence and high rates of cardiac arrest in Columbus, OH.

BACKGROUND: Residents who live in neighborhoods that are primarily black, Latino, or poor are more likely to have an out-of-hospital cardiac arrest, less likely to receive cardiopulmonary resuscitation (CPR), and less likely to survive. No prior studies have been conducted to understand the contributing factors that may decrease the likelihood of residents learning and performing CPR in these neighborhoods. The goal of this study was to identify barriers and facilitators to learning and performing CPR in 3 low-income, high-risk, and predominantly black neighborhoods in Columbus, OH. METHODS AND RESULTS: Community-Based Participatory Research approaches were used to develop and conduct 6 focus groups in conjunction with community partners in 3 target high-risk neighborhoods in Columbus, OH, in January to February 2011. Snowball and purposeful sampling, done by community liaisons, was used to recruit participants. Three reviewers analyzed the data in an iterative process to identify recurrent and unifying themes. Three major barriers to learning CPR were identified and included financial, informational, and motivational factors. Four major barriers were identified for performing CPR and included fear of legal consequences, emotional issues, knowledge, and situational concerns. Participants suggested that family/self-preservation, emotional, and economic factors may serve as potential facilitators in increasing the provision of bystander CPR. CONCLUSIONS: The financial cost of CPR training, lack of information, and the fear of risking one's own life must be addressed when designing a community-based CPR educational program. Using data from the community can facilitate improved design and implementation of CPR programs.

The trade-offs in field trauma triage: a multiregion assessment of accuracy metrics and volume shifts associated with different triage strategies.

BACKGROUND: National benchmarks for trauma triage sensitivity (≥95%) and specificity (≥50%) have not been rigorously evaluated across broad populations of injured patients. We evaluated the impact of different field triage schemes for identifying seriously injured patients across a range of sensitivity values. Impact metrics included specificity and number of undertriaged and overtriaged patients compared with current triage practices. METHODS: This was a retrospective cohort study of injured children and adults transported by 48 emergency medical service (EMS) agencies to 105 hospitals in 6 regions of the Western United States from 2006 through 2008. Hospital outcomes were probabilistically linked to EMS records through trauma registries, state discharge databases, and state emergency department databases. The primary outcome was an Injury Severity Score (ISS) of 16 or greater. We evaluated 40 field predictor variables, including 31 current field triage criteria, using classification and regression tree analysis and cross-validation to generate estimates for sensitivity and specificity. RESULTS: A total of 89,261 injured patients were evaluated and transported by EMS providers during the 3-year period, of whom 5,711 (6.4%) had ISS of 16 or greater. As the 95% sensitivity target for triage was approached (from the current value of 87.5%), decision tree complexity increased, specificity decreased (from 62.8% to 18.7%), and the number of triage-positive patients without serious injury doubled (67,927 vs. 31,104). Analyses restricted to children and older adults were similar. The most consistent modification to the current triage algorithm to increase sensitivity without a major decrease in specificity was altering the Glasgow Coma Scale (GCS) score cutoff point from 13 or less to 14 or less (sensitivity increase to 90.4%). CONCLUSION: Reaching the field triage sensitivity benchmark of 95% would require a large decrease in specificity (increase in overtriage). A 90% sensitivity target seems more realistic and may be obtainable by modest changes to the current triage algorithm.

Potential barriers associated with increased prevalence of perforated appendicitis in Colorado's pediatric Medicaid population.

OBJECTIVE: We sought to identify barriers and delays in care associated with the increased prevalence of perforated appendicitis among Colorado's pediatric Medicaid population. METHODS: We conducted a retrospective cohort study of all cases of pediatric appendicitis, which had Colorado Medicaid from 2007 to 2008 using descriptive statistics, bivariate analysis, and multivariable logistic regression. RESULTS: Of the 479 appendicitis cases, 42.6% were perforated. In both the bivariate and multivariate analysis, perforated cases did not significantly differ from nonperforated cases with respect to sex, rurality of residence, or race with the exception of black race in the multivariate model. Perforated cases were more likely to be younger, have been enrolled in Medicaid for less than 6 months, have seen a provider within 5 days of their diagnosis, and have been transferred to another hospital for treatment. CONCLUSIONS: The high prevalence of perforated appendicitis in Colorado children with Medicaid coverage is not associated with race or physical proximity to care but may be associated with the duration of Medicaid coverage, which highlights the importance of establishing medical homes to direct patients on where and how to seek care.

Programmatic cost evaluation of nontargeted opt-out rapid HIV screening in the emergency department.

BACKGROUND: The Centers for Disease Control and Prevention recommends nontargeted opt-out HIV screening in healthcare settings. Cost effectiveness is critical when considering potential screening methods. Our goal was to compare programmatic costs of nontargeted opt-out rapid HIV screening with physician-directed diagnostic rapid HIV testing in an urban emergency department (ED) as part of the Denver ED HIV Opt-Out Trial. METHODS: This was a prospective cohort study nested in a larger quasi-experiment. Over 16 months, nontargeted rapid HIV screening (intervention) and diagnostic rapid HIV testing (control) were alternated in 4-month time blocks. During the intervention phase, patients were offered HIV testing using an opt-out approach during registration; during the control phase, physicians used a diagnostic approach to offer HIV testing to patients. Each method was fully integrated into ED operations. Direct program costs were determined using the perspective of the ED. Time-motion methodology was used to estimate personnel activity costs. Costs per patient newly-diagnosed with HIV infection by intervention phase, and incremental cost effectiveness ratios were calculated. RESULTS: During the intervention phase, 28,043 eligible patients were included, 6,933 (25%) completed testing, and 15 (0.2%, 95% CI: 0.1%-0.4%) were newly-diagnosed with HIV infection. During the control phase, 29,925 eligible patients were included, 243 (0.8%) completed testing, and 4 (1.7%, 95% CI: 0.4%-4.2%) were newly-diagnosed with HIV infection. Total annualized costs for nontargeted screening were $148,997, whereas total annualized costs for diagnostic HIV testing were $31,355. The average costs per HIV diagnosis were $9,932 and $7,839, respectively. Nontargeted HIV screening identified 11 more HIV infections at an incremental cost of $10,693 per additional infection. CONCLUSIONS: Compared to diagnostic testing, nontargeted HIV screening was more costly but identified more HIV infections. More effective and less costly testing strategies may be required to improve the identification of patients with undiagnosed HIV infection in the ED.

The changing landscape of america's health care system and the value of emergency medicine.

The Patient Protection and Affordable Care Act (ACA), passed in 2010, has important implications for emergency physicians (EPs). In addition to dramatically reducing the number of uninsured in the United States, this comprehensive health care reform legislation seeks to curb the escalating costs of health care delivery, optimize resource utilization, eliminate waste, and improve the quality of service delivered by the health care system. At the annual Association of American Medical Colleges (AAMC) meeting on November 5, 2011, an expert panel from public health, emergency medicine, and health services research was convened by the Association of Academic Chairs of Emergency Medicine (AACEM) and the Society for Academic Emergency Medicine (SAEM) to discuss possible future models for the emergency care system and academic emergency medicine in the era of the ACA.

Payer status, race/ethnicity, and acceptance of free routine opt-out rapid HIV screening among emergency department patients.

OBJECTIVES: We estimated associations between payer status, race/ethnicity, and acceptance of nontargeted opt-out rapid HIV screening in the emergency department (ED). METHODS: We analyzed data from a prospective clinical trial between 2007 and 2009 at Denver Health. Patients in the ED were offered free HIV testing. Patient demographics and payer status were collected, and we used multivariable logistic regression to estimate associations with HIV testing acceptance. RESULTS: A total of 31,525 patients made 44, 765 unique visits: 40% were White, 37% Hispanic, 14% Black, 1% Asian, and 7% unknown race/ethnicity. Of all visits, 10 ,237 (23%) agreed to HIV testing; 27% were self-pay, 23% state-sponsored, 18% Medicaid, 13% commercial insurance, 12% Medicare, and 8% another payer source. Compared with commercial insurance patients, self-pay patients (odds ratio [OR] = 1.63; 95% confidence interval [CI] = 1.51, 1.75), state-sponsored patients (OR = 1.64; 95% CI = 1.52, 1.77), and Medicaid patients (OR = 1.24; 95% CI = 1.14, 1.34) had increased odds of accepting testing. Compared with White patients, Black (OR = 1.29; 95% CI = 1.21, 1.38) and Hispanic (OR = 1.17; 95% CI = 1.11, 1.23) patients had increased odds of accepting testing. CONCLUSIONS: Many ED patients are uninsured or subsidized through government programs and are more likely to consent to free rapid HIV testing.

Empirical hospital and professional charges for patient care associated with out of hospital cardiac arrest before and after implementation of therapeutic hypothermia for comatose survivors.

OBJECTIVE: The objectives of this study are to characterize the total hospital and professional charges for patients with out of hospital cardiac arrest both with and without therapeutic hypothermia treatment. METHODS: Retrospective cohort study of all adult patients with non-traumatic out of hospital cardiac arrest brought to the ED of a single tertiary care hospital over 20 months preceding and 20 months following implementation of therapeutic hypothermia for comatose survivors. Billing and clinical data were obtained from administrative databases and the electronic medical record using explicit audited abstraction. Demographic, payer characteristics, median charges and reimbursements with interquartile ranges are described before and after implementation, stratified by patient outcome. RESULTS: Two hundred and twenty-three patients met study criteria. The median charge was $3,112 among the 135 patients (60.5%) that did not survive to admission and $94,916 among the 88 (39.5%) that did. Median charges before and after implementation of therapeutic hypothermia were $6,324 and $15,537 respectively. Medicare was the most frequent payer. Good neurological outcome occurred in 11/115 patients (9.6%) prior to implementation and 22/108 patients (20.4%) after. Among 23 patients treated with hypothermia, good neurological outcome occurred in 11 patients (47.8%). Good neurological outcome and treatment with hypothermia were associated with increased procedure utilization and higher charges. CONCLUSION: Empirical patient level data confirm that charges for patients with out of hospital cardiac arrest are substantial, even among patients that do not survive to hospital admission. Treatment with therapeutic hypothermia is associated with better outcomes, more procedures, and higher charges.

A multisite assessment of the American College of Surgeons Committee on Trauma field triage decision scheme for identifying seriously injured children and adults.

BACKGROUND: The American College of Surgeons Committee on Trauma (ACSCOT) has developed and updated field trauma triage protocols for decades, yet the ability to identify major trauma patients remains unclear. We estimate the diagnostic value of the Field Triage Decision Scheme for identifying major trauma patients (Injury Severity Score [ISS] ≥ 16) in a large and diverse multisite cohort. STUDY DESIGN: This was a retrospective cohort study of injured children and adults transported by 94 emergency medical services (EMS) agencies to 122 hospitals in 7 regions of the Western US from 2006 through 2008. Patients who met any of the field trauma triage criteria (per EMS personnel) were considered triage positive. Hospital outcomes measures were probabilistically linked to EMS records through trauma registries, state discharge data, and emergency department data. The primary outcome defining a "major trauma patient" was ISS ≥ 16. RESULTS: There were 122,345 injured patients evaluated and transported by EMS over the 3-year period, 34.5% of whom met at least 1 triage criterion and 5.8% had ISS ≥ 16. The overall sensitivity and specificity of the criteria for identifying major trauma patients were 85.8% (95% CI 85.0% to 86.6%) and 68.7% (95% CI 68.4% to 68.9%), respectively. Triage sensitivity and specificity, respectively, differed by age: 84.1% and 66.4% (0 to 17 years); 89.5% and 64.3% (18 to 54 years); and 79.9% and 75.4% (≥55 years). Evaluating the diagnostic value of triage by hospital destination (transport to Level I/II trauma centers) did not substantially improve these findings. CONCLUSIONS: The sensitivity of the Field Triage Decision Scheme for identifying major trauma patients is lower and specificity higher than previously described, particularly among elders.

Design and implementation of a controlled clinical trial to evaluate the effectiveness and efficiency of routine opt-out rapid human immunodeficiency virus screening in the emergency department.

In 2006, the Centers for Disease Control and Prevention (CDC) released revised recommendations for performing human immunodeficiency virus (HIV) testing in health care settings, including implementing routine rapid HIV screening, the use of an integrated opt-out consent, and limited prevention counseling. Emergency departments (EDs) have been a primary focus of these efforts. These revised CDC recommendations were primarily based on feasibility studies and have not been evaluated through the application of rigorous research methods. This article describes the design and implementation of a large prospective controlled clinical trial to evaluate the CDC's recommendations in an ED setting. From April 15, 2007, through April 15, 2009, a prospective quasi-experimental equivalent time-samples clinical trial was performed to compare the clinical effectiveness and efficiency of routine (nontargeted) opt-out rapid HIV screening (intervention) to physician-directed diagnostic rapid HIV testing (control) in a high-volume urban ED. In addition, three nested observational studies were performed to evaluate the cost-effectiveness and patient and staff acceptance of the two rapid HIV testing methods. This article describes the rationale, methodologies, and study design features of this program evaluation clinical trial. It also provides details regarding the integration of the principal clinical trial and its nested observational studies. Such ED-based trials are rare, but serve to provide valid comparisons between testing approaches. Investigators should consider similar methodology when performing future ED-based health services research.