The heterogeneous wound microbiome varies with wound care pain, dressing type, and inflammatory gene expression.

Wound dressing changes are essential procedures for wound management. However, ~50% of patients experience severe pain during these procedures despite the availability of analgesic medications, indicating a need for novel therapeutics that address underlying causes of pain. Along with other clinical factors, wound pathogens and inflammatory immune responses have previously been implicated in wound pain. To test whether these factors could contribute to severe pain during wound dressing changes, we conducted an exploratory, cross-sectional analysis of patient-reported pain, inflammatory immune responses, and wound microbiome composition in 445 wounds at the time of a study dressing change. We profiled the bacterial composition of 406 wounds using 16S ribosomal RNA amplicon sequencing and quantified gene expression of 13 inflammatory markers in wound fluid using quantitative real-time polymerase chain reaction (qPCR). Neither inflammatory gene expression nor clinically observed inflammation were associated with severe pain, but Corynebacterium and Streptococcus were of lower relative abundance in wounds of patients reporting severe pain than those reporting little or no pain. Wound microbiome composition differed by wound location, and correlated with six of the inflammatory markers, including complement receptor C5AR1, pro-inflammatory cytokine interleukin (IL)1ß, chemokine IL-8, matrix metalloproteinase MMP2, and the antimicrobial peptide encoding cathelicidin antimicrobial peptide. Interestingly, we found a relationship between the wound microbiome and vacuum-assisted wound closure (VAC). These findings identify preliminary, associative relationships between wound microbiota and host factors which motivate future investigation into the directional relationships between wound care pain, wound closure technologies, and the wound microbiome.

A Pilot Study to Assess the Performance of Phase-Sensitive Breast Tomosynthesis.

Background A new modality, phase-sensitive breast tomosynthesis (PBT), may have similar diagnostic performance to conventional breast tomosynthesis but with a reduced radiation dose. Purpose To perform a pilot study of the performance of a novel PBT system compared with conventional digital breast tomosynthesis (DBT) in patients undergoing additional diagnostic imaging workup for breast lesions. Materials and Methods In a prospective study from June 2020 to March 2021, participants with suspicious breast lesions detected at screening DBT or MRI were recruited for additional PBT imaging before additional diagnostic workup or biopsy. In this pilot study, nine radiologists independently evaluated image quality and assessed the likelihood of lesion malignancy by retrospectively evaluating DBT and PBT images in two separate reading sessions. Image quality was rated subjectively using a Likert scale from 1 to 5. Areas under the receiver operating characteristic curve (AUCs) were used to compare the lesion classification (malignant vs benign) performance of the radiologists. Results Images in 50 patients (mean age, 56 years ± 12 [SD]; 49 women) with 52 evaluable lesions (28 malignant) were assessed. For image appearance and general feature visibility, DBT images had a higher total mean image quality score (3.8) than PBT images (2.9), with P < .002 for each comparison. For classification of lesions as benign or malignant, the AUCs were 0.74 for both PBT and DBT. PBT images were acquired at a 24% mean radiation dose reduction (mean, 1.78 mGy vs 2.34 mGy for DBT; P < .001). Conclusion The phase-sensitive breast tomosynthesis system had a 24% lower mean radiation dose compared with digital breast tomosynthesis, although with lower image quality. Diagnostic performance of the system remains to be determined in larger studies. © RSNA, 2022 Online supplemental material is available for this article. See also the editorial by Gao and Moy in this issue.

Radiologists Help Each Other to Improve Efficiency by Decreasing the Time to Look Up a Patient's Relevant Clinical History in the Electronic Medical Record.

The study aims to prove that it takes less time to look up relevant clinical history from an electronic medical record (EMR) if the information is already provided in a specific space in the EMR by a fellow radiologist. Patients with complex oncological and surgical histories need frequent imaging, and every time a radiologist may spend a significant amount of time looking up the same clinical information as their peers. In collaboration with ACMIO and Radiant Epic team, a space labeled "Specialty Comments" was added to the SNAPSHOT of patient's chart in EMR. For our research purpose, the specialty comment was labeled as boxed history as a variable for data analysis. If the history was not provided in that particular space, it was labeled as without boxed history. Inclusion criteria included outpatients with complex oncological histories undergoing CT chest, abdomen, and pelvis with IV contrast. The time to look up history (LUT) was documented in minutes and seconds. Two assistant professors from Abdominal Imaging provided LUT. A total of 85 cases were included in the study, 39 with boxed history and 46 without boxed history. Comparing averages of the individual reader means for history, mean LUT differed by 2.03 min (without boxed history) versus 0.57 min (with boxed history), p < 0.0001. The t-test and the nonparametric Wilcoxon tests for a difference in the population means were highly significant (p < 0.0001). A history directed to radiologist's needs resulted in a statistically significant decrease in time spent by interpreting radiologists to look through the electronic medical records for patients with complex oncological histories. Availability of history pertinent to radiology has wide-ranging advantages, including quality reporting, decrease in turnaround time, reduction in interpretation errors, and radiologists' continued learning. The space for documenting clinical history may be reproduced, or some similar area may be developed by optimizing the electronic medical records.

Relationship between Roe and Metz simulation model for multireader diagnostic data and Obuchowski-Rockette model parameters.

For the typical diagnostic radiology study design, each case (ie, patient) undergoes several diagnostic tests (or modalities) and the resulting images are interpreted by several readers. Often, each reader is asked to assign a confidence-of-disease rating to each case for each test, and the diagnostic tests are compared with respect to reader-performance outcomes that are functions of the reader receiver operating characteristic (ROC) curves, such as the area under the ROC curve. These reader-performance outcomes are frequently analyzed using the Obuchowski and Rockette method, which allows conclusions to generalize to both the reader and case populations. The simulation model proposed by Roe and Metz (RM) in 1997 emulates confidence-of-disease data collected from such studies and has been an important tool for empirically evaluating various reader-performance analysis methods. However, because the RM model parameters are expressed in terms of a continuous decision variable rather than in terms of reader-performance outcomes, it has not been possible to evaluate the realism of the RM model. I derive the relationships between the RM and Obuchowski-Rockette model parameters for the empirical area under the ROC curve reader-performance outcome. These relationships make it possible to evaluate the realism of the RM parameter models and to assess the performance of Obuchowski-Rockette parameter estimates. An example illustrates the application of the relationships for assessing the performance of a proposed upper one-sided confidence bound for the Obuchowski-Rockette test-by-reader variance component, which is useful for sample size estimation.

Severe pain during wound care procedures: A cross-sectional study protocol.

AIM: The aim of this study is to: (a) develop and evaluate a model to predict severe pain during wound care procedures (WCPs) so that high-risk patients can be targeted for specialized dressings and preventive pain control; and (b) identify biological factors associated with severe pain during WCPs so that novel pain control strategies can be developed. BACKGROUND: Wound care procedures such as dressing changes can cause moderate to severe pain in 74% of patients, with nearly half (36%) of all patients experiencing severe pain (rated as 8-10 on a 10-point numeric rating scale) during dressing change. Additionally, clinicians have little direction with current guidelines regarding pain control during WCPs including the selection of the appropriate advanced wound dressings and the appropriate use of analgesics. DESIGN: This is a cross-sectional study. METHODS: The National Institute of Nursing Research approved and funded the study June of 2015 and the appropriate Institutional Review Board approved all study protocols prior to funding. Study enrolment is underway at the University of Iowa Hospitals and Clinics with a target of 525 participants. Potential participants must be adults (21+ years) and have a nonburn, nondiabetic foot, full-thickness wound. The research team performs a one-time study dressing change on enrolled participants and collects all study data. DISCUSSION: This study will allow the development of a tool for clinicians to use to predict severe pain during WCPs and identify biological factors significantly associated with severe pain during WCPs.

Longitudinal associations between mental health conditions and overactive bladder in women veterans.

BACKGROUND: One in 5 recently deployed US women veterans report overactive bladder symptoms. Mental health conditions such as depression and anxiety commonly co-occur in women with overactive bladder, but temporal relationships between these outcomes have not been well studied, and the mechanism behind this association is unknown. The Women Veterans Urinary Health Study, a nationwide longitudinal study in recently deployed women veterans, was designed to better understand relationships between overactive bladder and mental health conditions. OBJECTIVE: We sought to estimate the 1-year incidence and remission of overactive bladder and to identify the impact of depression, anxiety, posttraumatic stress disorder, and prior sexual assault on 1-year overactive bladder incidence and remission rates. STUDY DESIGN: Participants of this 1-year prospective cohort study were female veterans separated from military service who had returned from Iraq or Afghanistan deployment within the previous 2 years. Eligible women were identified through the Defense Manpower Data Center and recruited by mail and telephone. Telephone screening confirmed participants were ambulatory, community-dwelling veterans and excluded those with urinary tract fistula, congenital abnormality, or cancer; pelvic radiation; spinal cord injury; multiple sclerosis; Parkinson disease; stroke; or current/recent pregnancy. Data collection included computer-assisted telephone interviews performed at enrollment and 1 year later. The interview assessed demographic and military service characteristics; urinary symptoms and treatment; depression, anxiety, and posttraumatic stress disorder symptoms and treatment; and a lifetime history of sexual assault. Overactive bladder was identified if at least moderately bothersome urgency urinary incontinence and/or urinary frequency symptoms were reported on Urogenital Distress Inventory items. Exposures included depression, anxiety, posttraumatic stress disorder, and lifetime sexual assault, assessed at baseline using validated questionnaires (including the Patient Health Questionnaire and Posttraumatic Stress Disorder Checklist). Associations between exposures and overactive bladder incidence and remission were estimated using propensity score adjusted logistic regression models. RESULTS: In all, 1107 (88.0%) of 1258 eligible participants completed 1-year interviews. Median age was 29 (range 20-67) years and 53% were nulliparous. Overactive bladder was identified at baseline in 242 (22%), and 102 (9.2%), 218 (19.7%), 188 (17.0%), and 287 (25.9%) met criteria for baseline depression, anxiety, posttraumatic stress disorder, and lifetime sexual assault, respectively. At 1 year, overactive bladder incidence was 10.5% (95% confidence interval, 8.6-12.8%), and remission of overactive bladder was 36.9% (95% confidence interval, 30.8-43.4%). New overactive bladder occurred more often in women with baseline anxiety (21% vs 9%), posttraumatic stress disorder (19% vs 9%) and lifetime sexual assault (16% vs 9%) (all: P < .01). After adjustment, anxiety (odds ratio, 2.4; 95% confidence interval, 1.4-4.1) and lifetime sexual assault (odds ratio, 1.7; 95% confidence interval, 1.0-2.8) predicted 1-year incident overactive bladder. Overactive bladder remission occurred less often in those with baseline depression (19% vs 41%, P < .01) and anxiety (29% vs 42%, P = .03). After adjustment, depression decreased 1-year overactive bladder remission risk (odds ratio, 0.37; 95% confidence interval, 0.16-0.83). Overactive bladder treatment was uncommon and not associated with remission. CONCLUSION: Anxiety, depression, and prior sexual assault-common postdeployment problems for women veterans-influence the natural history of overactive bladder. Providers should screen for mental health conditions and sexual assault in women with newly diagnosed or persistent overactive bladder.

Equivalence of binormal likelihood-ratio and bi-chi-squared ROC curve models.

A basic assumption for a meaningful diagnostic decision variable is that there is a monotone relationship between it and its likelihood ratio. This relationship, however, generally does not hold for a decision variable that results in a binormal receiver operating characteristic (ROC) curve. As a result, ROC curve estimation based on the assumption of a binormal ROC-curve model produces improper ROC curves, which have 'hooks', are not concave over the entire domain and cross the chance line. Although in practice this 'improperness' is usually not noticeable, sometimes it is evident and problematic. To avoid this problem, Metz and Pan proposed basing ROC-curve estimation on the assumption of a binormal likelihood-ratio (binormal-LR) model, which states that the decision variable is an increasing transformation of the likelihood-ratio function of a random variable having normal conditional diseased and nondiseased distributions. However, their development is not easy to follow. I show that the binormal-LR model is equivalent to a bi-chi-squared model in the sense that the families of corresponding ROC curves are the same. The bi-chi-squared formulation provides an easier-to-follow development of the binormal-LR ROC curve and its properties in terms of well-known distributions. Copyright © 2015 John Wiley & Sons, Ltd.

Effect of a Behavioral Self-Regulation Intervention on Patient Adherence to Fluid-Intake Restrictions in Hemodialysis: a Randomized Controlled Trial.

OBJECTIVE: The purpose of this study is to evaluate the efficacy of a behavioral self-regulation intervention vs. active control condition using a parallel-group randomized clinical trial with a sample of center hemodialysis patients with chronic kidney disease. METHOD: Participants were recruited from 8 hemodialysis treatment centers in the Midwest. Eligible patients were (a) fluid nonadherent as defined by an interdialytic weight gain >2.5 kg over a 4-week period, (b) >18 years of age, (c) English-speaking without severe cognitive impairment, (d) treated with center-based hemodialysis for >3 months, and (e) not living in a care facility in which meals were managed. Medical records were used to identify eligible patients. Patients were randomly assigned to either a behavioral self-regulation intervention or active control condition in which groups of 3-8 patients met for hour-long, weekly sessions for 7 weeks at their usual hemodialysis clinic. Primary analyses were intention-to-treat. RESULTS: Sixty-one patients were randomized to the intervention while 58 were assigned to the attention-placebo support and discussion control. Covariate-adjusted between-subjects analyses demonstrated no unique intervention effect for the primary outcome, interdialytic weight gain (ß = 0.13, p = 0.48). Significant within-subjects improvement over time was observed for the intervention group (ß = -0.32, p = 0.014). CONCLUSIONS: The present study found that participation in a behavioral self-regulation intervention resulted in no unique intervention effect on a key indicator of adherence for those with severe chronic kidney disease. There was, however, modest within-subjects improvement in interdialytic weight gain for the intervention group which meshes with other evidence showing the utility of behavioral interventions in this patient population. ClinicalTrials.gov Identifier: NCT01066949.

Overactive bladder and mental health symptoms in recently deployed female veterans.

PURPOSE: We estimate the prevalence of current overactive bladder symptoms in recently deployed female veterans, and determine if overactive bladder symptoms are associated with problems commonly reported after deployment including mental health symptoms and prior sexual assault. MATERIALS AND METHODS: Baseline data were analyzed from a nationwide cohort study of urogenital symptoms in female veterans. Women returning from deployment to Iraq or Afghanistan in the prior 2 years and ending military service were eligible. Self-reported data were collected by computer assisted telephone interview. Overactive bladder and mental health conditions were identified using standardized definitions as well as validated urinary and mental health instruments. Associations between overactive bladder and depression, post-traumatic stress disorder, anxiety and sexual assault were assessed in separate logistic regression models using propensity scores to adjust for confounding. RESULTS: The 1,702 participants had a mean (SD) age of 31.1 (8.4) years and were racially/ethnically diverse. Overall 375 participants (22%; 95% CI 20.1, 24.1) reported overactive bladder. Mental health outcomes included post-traumatic stress disorder (19%), anxiety (21%), depression (10%) and prior sexual assault (27%). All outcomes were associated with overactive bladder (adjusted OR 2.7, 95% CI [2.0, 3.6], 2.7 [2.0, 3.5], 2.5 [1.5, 4.3] and 1.4 [1.1, 1.9], respectively). CONCLUSIONS: Overactive bladder symptoms occurred in 22% of recently deployed female veterans, and were associated with self-reported mental health symptoms and traumatic events including prior sexual assault. Screening and evaluation for bothersome urinary symptoms and mental health problems appear warranted in female veterans presenting for primary and urological care after deployment.

A marginal-mean ANOVA approach for analyzing multireader multicase radiological imaging data.

The correlated-error ANOVA method proposed by Obuchowski and Rockette (OR) has been a useful procedure for analyzing reader-performance outcomes, such as the area under the receiver-operating-characteristic curve, resulting from multireader multicase radiological imaging data. This approach, however, has only been formally derived for the test-by-reader-by-case factorial study design. In this paper, I show that the OR model can be viewed as a marginal-mean ANOVA model. Viewing the OR model within this marginal-mean ANOVA framework is the basis for the marginal-mean ANOVA approach, the topic of this paper. This approach (1) provides an intuitive motivation for the OR model, including its covariance-parameter constraints; (2) provides easy derivations of OR test statistics and parameter estimates, as well as their distributions and confidence intervals; and (3) allows for easy generalization of the OR procedure to other study designs. In particular, I show how one can easily derive OR-type analysis formulas for any balanced study design by following an algorithm that only requires an understanding of conventional ANOVA methods.

Implementing Best Evidence in Smoking Cessation Treatment for Hospitalized Veterans: Results from the VA-BEST Trial.

BACKGROUND: Although the US Department of Veterans Affairs (VA) has promoted adherence to smoking cessation guidelines since 1997, hospitalized smokers do not consistently receive assistance in quitting. METHODS: In a pre-post guideline implementation trial on the inpatient medicine units of four VA hospitals, the effectiveness of a multimodal intervention (enhanced academic detailing, modification of the nursing admission template, patient education materials and quitline referral, practice facilitation and staff feedback) changing practice behavior was evaluated. Peridischarge interviews were conducted with 824 patients to assess receipt of nurses' and physicians' delivery of the 5A's (Ask, Advise, Assess, Assist, Arrange) in hospitalized smokers. RESULTS: Subjects were significantly more likely to have received each of the 5A's from a nurse during the postimplementation period (except for "advise to quit"). More patients were assisted in quitting (75% versus 56%, adjusted odds ratio [OR] = 2.3, 95% confidence interval [CI] = 1.6, 3.1) and had follow-up arranged (23% versus 18%, adjusted OR = 1.5, 95% CI = 1.0, 2.2) by a nurse during the postimplementation period. However, unadjusted results showed no improvement in seven-day point prevalence abstinence at six-month follow-up (13.5% versus 13.9%). Nurses' self-efficacy in cessation counseling, as measured in a survey of 166 unit nurses, improved following guideline implementation. DISCUSSION: A multifaceted intervention including enhanced academic detailing is an effective strategy for improving the delivery of smoking cessation services in medical inpatients. To promote long-term cessation, more intensive interventions are needed to ensure that motivated smokers receive guideline-recommended treatment (including pharmacotherapy and referral to outpatient cessation counseling).

An alternative parameterization for the binormal ROC curve, with applications to sizing and simulation studies.

Because the conventional binormal ROC curve parameters are in terms of the underlying normal diseased and nondiseased rating distributions, transformations of these values are required for the user to understand what the corresponding ROC curve looks like in terms of its shape and size. In this paper I propose an alternative parameterization in terms of parameters that explicitly describe the shape and size of the ROC curve. The proposed two parameters are the mean-to-sigma ratio and the familiar area under the ROC curve (AUC), which are easily interpreted in terms of the shape and size of the ROC curve, respectively. In addition, the mean-to-sigma ratio describes the degree of improperness of the ROC curve and the AUC describes the ability of the corresponding diagnostic test to discriminate between diseased and nondiseased cases. The proposed parameterization simplifies the sizing of diagnostic studies when conjectured variance components are used and simplifies choosing the binormal a and b parameter values needed for simulation studies.

Implementing smoking cessation guidelines for hospitalized veterans: effects on nurse attitudes and performance.

BACKGROUND: A minority of hospitalized smokers actually receives assistance in quitting during hospitalization or cessation counseling following discharge. This study aims to determine the impact of a guideline-based intervention on 1) nurses' delivery of the 5A's (Ask-Advise-Assess-Assist-Arrange follow-up) in hospitalized smokers, and 2) nurses' attitudes toward the intervention. METHODS: We conducted a pre-post guideline implementation trial involving 205 hospitalized smokers on the inpatient medicine units at one US Department of Veterans Affairs (VA) medical center. The intervention included: 1) academic detailing of nurses on delivery of brief cessation counseling, 2) modification of the admission form to facilitate 5A's documentation, and 3) referral of motivated inpatients to receive proactive telephone counseling. Based on subject interviews, we calculated a nursing 5A's composite score for each patient (ranging from 0 to 9). We used linear regression with generalized estimating equations to compare the 5A's composite score (and logistic regression to compare individual A's) across periods. We compared 29 nurses' ratings of their self-efficacy and decisional balance ("pros" and "cons") with regard to cessation counseling before and after guideline implementation. Following implementation, we also interviewed a purposeful sample of nurses to assess their attitudes toward the intervention. RESULTS: Of 193 smokers who completed the pre-discharge interview, the mean nursing 5A's composite score was higher after guideline implementation (3.9 vs. 3.1, adjusted difference 1.0, 95 % CI 0.5-1.6). More patients were advised to quit (62 vs. 48 %, adjusted OR = 2.1, 95 % CI = 1.2-3.5) and were assisted in quitting (70 vs. 45 %, adjusted OR = 2.9, 95 % CI = 1.6-5.3) by a nurse during the post-implementation period. Nurses' attitudes toward cessation counseling improved following guideline implementation (35.3 vs. 32.7 on "pros" subscale, p = 0.01), without significant change on the "cons" subscale. CONCLUSIONS: A multifaceted intervention including academic detailing and adaptation of the nursing admission template is an effective strategy for improving nurses' delivery of brief cessation counseling in medical inpatients.

The emergency department action in smoking cessation (EDASC) trial: impact on cessation outcomes.

INTRODUCTION: The focus on acute care, time pressure, and lack of resources hamper the implementation of smoking cessation guidelines in the emergency department (ED). The purpose of this study was to determine whether an emergency nurse- initiated intervention based on the 5A's (Ask-Advise-Assess-Assist-Arrange) framework improves quit rates. METHODS: We conducted a pre-post implementation trial in 789 adult smokers who presented to two EDs in Iowa between August 13, 2008 and August 4, 2010. The intervention focused on improving delivery of the 5A's by ED nurses and physicians using academic detailing, charting/reminder tools, and group feedback. Performance of ED cessation counseling was measured using a 5A's composite score (ranging from 0 to 5). Smoking status was assessed by telephone interview at 3- and 6-month follow-up (with biochemical confirmation in those participants who reported abstinence at 6-month follow-up). RESULTS: Based on data from 650 smokers who completed the post-ED interview, there was a significant improvement in the mean 5A's composite score for emergency nurses during the intervention period at both hospitals combined (1.51 vs. 0.88, difference = 0.63, 95% confidence interval [CI] [0.41, 0.85]). At 6-month follow-up, 7-day point prevalence abstinence (PPA) was 6.8 and 5.1% in intervention and preintervention periods, respectively (adjusted odds ratio [OR] = 1.7, 95% CI [0.99, 2.9]). CONCLUSIONS: It is feasible to improve the delivery of brief smoking cessation counseling by ED staff. The observed improvements in performance of cessation counseling, however, did not translate into statistically significant improvements in cessation rates. Further improvements in the effectiveness of ED cessation interventions are needed.

A closer look at the recommended criteria for disclosing genetic results: perspectives of medical genetic specialists, genomic researchers, and institutional review board chairs.

Next generation sequencing offers benefit of improved health through knowledge, but comes with challenges, such as inevitable incidental findings (IFs). The applicability of recommended criteria for disclosure of individual results when applied to disclosure of IFs is not well known. The purpose of this study was to examine how medical genetic specialists, genomic researchers, and Institutional Review Board (IRB) chairs perceive the importance of recommended criteria when applied to genetic/genomic IFs. We conducted telephone interviews with medical genetic specialists (genetic counselors, genetic nurses, medical geneticists, laboratory professionals), genomic researchers, and IRB chairs (N = 103). Respondents rated and discussed the importance of nine recommended criteria regarding disclosure of genetic/genomic IFs. Stakeholders agreed the most important criteria for disclosure were: (1) the IF points to a life-threatening condition; (2) there is a treatment; (3) individuals indicate in writing they wanted to be informed of IFs. Criteria rated less important were: analytic validity, high penetrance, association with a young age of onset and relative risk more than 2.0. Respondents indicated that some technical criteria were confusing, and in need of context. Our findings suggest that development of guidelines regarding management of IF include multiple stakeholders' perspectives and be based on a common language.

Satisfaction and emergency department revisits in patients with possible acute coronary syndrome.

BACKGROUND: Patients with possible acute coronary syndrome (ACS) are typically instructed to return to the emergency department (ED) if their condition worsens. Little is known about the relationship between patient satisfaction in the ED and subsequent return visits. OBJECTIVE: Our aim was to determine the association between satisfaction with ED care and subsequent ED return visits. METHODS: One thousand and five consecutive ED patients with symptoms of possible ACS who participated in a prospective guideline implementation trial at two university hospitals completed a telephone survey at 30-day follow-up. Satisfaction with care at the initial ED visit was measured using items from the Press Ganey satisfaction questionnaire. Logistic regression was used to determine the association between individual satisfaction items and the occurrence of any ED revisits, and the association between satisfaction items and return visits to the same ED. RESULTS: Patients who reported superior ratings of person-centered care ("staff cared about you as a person") were significantly less likely to return to any ED during 30-day follow-up: 59 vs. 71%, adjusted odds ratio = 0.57 (95% confidence interval 0.37-0.87). Among those with ED revisits, superior ratings of personal care and perceived waiting time for emergency physician evaluation were significantly associated with return to the same ED. CONCLUSIONS: Although diagnostic workup and risk stratification are the primary focus in evaluating patients with possible ACS, greater attention to the patient's experience of care may have the positive impact of reducing ED return visits and increasing the likelihood that patients will return to the same ED for re-evaluation.

Roe and Metz identical-test simulation model for validating multi-reader methods of analysis for comparing different radiologic imaging modalities.

Purpose: The most frequently used model for simulating multi-reader multi-case (MRMC) data that emulate confidence-of-disease ratings from diagnostic imaging studies has been the Roe and Metz model, proposed by Roe and Metz in 1997 and later generalized by Hillis (2012), Abbey et al. (2013), and Gallas and Hillis (2014). These models have been used for evaluating MRMC analysis and sample size methods. The models suggested in these papers for assessing type I error have been null models, where the expected area under the receiver-operating-characteristic curve across readers is the same for each test. However, for these null models, there are other differences that would not exist if the two tests were identical. None of the papers mentioned above discuss how to formulate a null model that is also an identical-test model, where the two tests are identical in all respects. The purpose of this paper is to show how to formulate a Roe and Metz identical-test model and to show its usefulness for validating the error covariance constraints employed by the Obuchowski-Rockette (1995) method. Approach: For a given Roe-and-Metz model, the corresponding Roe-and-Metz identical-test model is derived by modifying the Roe and Metz null model under the assumption that the two tests are identical. Results: The importance of the Obuchowski-Rockette model constraints for avoiding negative variance estimates is established using data simulated from the Roe and Metz identical-test model. It is also shown that negative variance estimates can occur at nontrivial rates when the two tests are not identical but somewhat "close" to being identical. Conclusions: The findings of this paper are important because it has recently been shown (Hillis, 2022) that the commonly used MRMC method proposed by Gallas (2006) and Gallas et al. (2009) uses the same test statistic as the unconstrained Obuchowski-Rockette method.

Relationship between Obuchowski-Rockette-Hillis and Gallas methods for analyzing multi-reader diagnostic imaging data with empirical AUC as the reader performance measure.

For analyzing multireader multicase (MRMC) diagnostic imaging data when the reader performance measure of interest is the area under the receiver-operating-characteristic curve (AUC), two popular methods of analysis that allow conclusions to generalize to both the reader and case populations are the method developed by Obuchowski, Rockette and Hillis (ORH) and the method primarily developed by Gallas (Gallas). While the ORH method is a general method that is applicable to most reader performance metrics, the Gallas method is limited to those metrics for which an unbiased variance estimate exists. Previously it was not known if the ORH method could be adapted so as to produce the same variance estimate as the Gallas method. In this paper I show that a recently proposed version of the OR method produces the same unconstrained variance statistic as the Gallas method. However, the two methods differ in their approaches to constraining the variance estimate to be nonnegative and in their degrees-of-freedom estimates. These two differences are discussed and recommendations given. In addition, several contributions to the development of the ORH method are made, including determining sufficient conditions for unbiased variance estimates and providing justification for the ORH variance constraints and covariance estimation method.

Obuchowski-Rockette analysis for multi-reader multi-case (MRMC) readers-nested-in-test study design with unequal numbers of readers.

The Obuchowski-Rockette method has been an important tool for analyzing multi-reader multi-case (MRMC) radiologic imaging data. Although the typical study design for such studies has been the factorial design, where each reader reads each case using each test (modality), sometimes a reader-nested-in-test design is more appropriate. We consider such an example in this talk, where 53 Australian and 15 Singaporean breast radiologists interpreted the same test in their respective locations. In this paper we show how the Obuchowski-Rockette method can be used for analysis of such data, without assuming that the number of readers is the same for each test.

Correlation of free-response and receiver-operating-characteristic area-under-the-curve estimates: results from independently conducted FROC∕ROC studies in mammography.

PURPOSE: From independently conducted free-response receiver operating characteristic (FROC) and receiver operating characteristic (ROC) experiments, to study fixed-reader associations between three estimators: the area under the alternative FROC (AFROC) curve computed from FROC data, the area under the ROC curve computed from FROC highest rating data, and the area under the ROC curve computed from confidence-of-disease ratings. METHODS: Two hundred mammograms, 100 of which were abnormal, were processed by two image-processing algorithms and interpreted by four radiologists under the FROC paradigm. From the FROC data, inferred-ROC data were derived, using the highest rating assumption. Eighteen months afterwards, the images were interpreted by the same radiologists under the conventional ROC paradigm; conventional-ROC data (in contrast to inferred-ROC data) were obtained. FROC and ROC (inferred, conventional) data were analyzed using the nonparametric area-under-the-curve (AUC), (AFROC and ROC curve, respectively). Pearson correlation was used to quantify the degree of association between the modality-specific AUC indices and standard errors were computed using the bootstrap-after-bootstrap method. The magnitude of the correlations was assessed by comparison with computed Obuchowski-Rockette fixed reader correlations. RESULTS: Average Pearson correlations (with 95% confidence intervals in square brackets) were: Corr(FROC, inferred ROC) = 0.76[0.64, 0.84] > Corr(inferred ROC, conventional ROC) = 0.40[0.18, 0.58] > Corr (FROC, conventional ROC) = 0.32[0.16, 0.46]. CONCLUSIONS: Correlation between FROC and inferred-ROC data AUC estimates was high. Correlation between inferred- and conventional-ROC AUC was similar to the correlation between two modalities for a single reader using one estimation method, suggesting that the highest rating assumption might be questionable.