Appropriateness of inpatient stress testing: Implications for development of clinical decision support mechanisms and future criteria.

BACKGROUND: An upcoming national mandate will require consultation of appropriate use criteria (AUC) through a clinical decision support mechanism (CDSM) for advanced imaging. We aimed to evaluate our current ability to ascertain test appropriateness. METHODS: We prospectively collected data on 288 consecutive stress tests and coronary computed tomography angiography studies for medical inpatients. Study appropriateness was determined independently by two physicians using the 2013 Multimodality AUC. RESULTS: The median age of the study population was 66 years [interquartile range (IQR) 56, 75], 40.8% were female, and 52.8% had a history of coronary artery disease. Review of the electronic health record (EHR) alone was sufficient to deem appropriateness for 87.2% of cases. The most common reason it was insufficient was inability to determine if the patient could exercise (59.5%). After reviewing the EHR and pilot CDSM data together, appropriateness could be determined for 95.8% of the cases. The most common reason appropriateness could not be determined was that the exam indication was not addressed by an AUC criterion (83.3%). CONCLUSION: In preparing for the mandate, it will be important for future CDSM to obtain information on the patient's ability to exercise and for future AUC to include additional indications that are not currently addressed.

Comparing Tumor Characteristics and Rates of Breast Cancers Detected by Screening Digital Breast Tomosynthesis and Full-Field Digital Mammography.

OBJECTIVE. The purpose of this study was to compare the cancer detection rates (CDRs), tumor types, and characteristics between screening digital breast tomosynthesis (DBT) and screening full-field digital mammography (FFDM) in a matched patient population in a large academic breast imaging practice with mixed DBT and FFDM technology. MATERIALS AND METHODS. In this retrospective study, we reviewed consecutive screening FFDM and DBT examinations performed between October 2012 and September 2014. To control for nonrandomized selection of FFDM versus DBT examinations, we applied propensity score matching on the basis of patient age, imaging site, and prior imaging findings. An institutional breast cancer registry identified cancer diagnoses. CDR and tumor type, grade, receptor, nodal status, and size were compared between matched FFDM and DBT groups. RESULTS. Sixty-one cancers were detected in the matched screening cohort of DBT (n = 9817) and FFDM (n = 14,180) examinations. CDR was higher with DBT than with FFDM for invasive cancers (2.8 vs 1.3, p = 0.01), minimal cancers (2.4 vs 1.2, p = 0.03), estrogen receptor-positive invasive cancers (2.6 vs 1.1, p = 0.01), and node-negative invasive cancers (2.3 vs 1.1, p = 0.02.), respectively. The ratio of screen-detected invasive cancers to ductal carcinoma in situ on DBT (3.0) was not significantly different from that on FFDM (2.6) (p = 0.79). CONCLUSION. DBT results in an overall increase in CDR irrespective of the tumor type, size, or grade of cancer.

Variation in Follow-up Imaging Recommendations in Radiology Reports: Patient, Modality, and Radiologist Predictors.

Background Variation between radiologists when making recommendations for additional imaging and associated factors are, to the knowledge of the authors, unknown. Clear identification of factors that account for variation in follow-up recommendations might prevent unnecessary tests for incidental or ambiguous image findings. Purpose To determine incidence and identify factors associated with follow-up recommendations in radiology reports from multiple modalities, patient care settings, and imaging divisions. Materials and Methods This retrospective study analyzed 318 366 reports obtained from diagnostic imaging examinations performed at a large urban quaternary care hospital from January 1 to December 31, 2016, excluding breast and US reports. A subset of 1000 reports were randomly selected and manually annotated to train and validate a machine learning algorithm to predict whether a report included a follow-up imaging recommendation (training-and-validation set consisted of 850 reports and test set of 150 reports). The trained algorithm was used to classify 318 366 reports. Multivariable logistic regression was used to determine the likelihood of follow-up recommendation. Additional analysis by imaging subspecialty division was performed, and intradivision and interradiologist variability was quantified. Results The machine learning algorithm classified 38 745 of 318 366 (12.2%) reports as containing follow-up recommendations. Average patient age was 59 years ± 17 (standard deviation); 45.2% (143 767 of 318 366) of reports were from male patients. Among 65 radiologists, 57% (37 of 65) were men. At multivariable analysis, older patients had higher rates of follow-up recommendations (odds ratio [OR], 1.01 [95% confidence interval {CI}: 1.01, 1.01] for each additional year), male patients had lower rates of follow-up recommendations (OR, 0.9; 95% CI: 0.9, 1.0), and follow-up recommendations were most common among CT studies (OR, 4.2 [95% CI: 4.0, 4.4] compared with radiography). Radiologist sex (P = .54), presence of a trainee (P = .45), and years in practice (P = .49) were not significant predictors overall. A division-level analysis showed 2.8-fold to 6.7-fold interradiologist variation. Conclusion Substantial interradiologist variation exists in the probability of recommending a follow-up examination in a radiology report, after adjusting for patient, examination, and radiologist factors. © RSNA, 2019 See also the editorial by Russell in this issue.

Impact of a Multifaceted Information Technology-Enabled Intervention on the Adoption of ACR White Paper Follow-Up Recommendations for Incidental Adnexal Lesions Detected on CT.

OBJECTIVE. The objective of our study was to improve adherence to American College of Radiology (ACR) white paper follow-up imaging recommendations for incidental adnexal lesions seen on pelvic CT (herein referred to as "adherence rate to recommendations"). MATERIALS AND METHODS. This quality improvement project was conducted at a large academic teaching hospital. The baseline adherence rate to recommendations was assessed by screening all pelvic CT reports for the period from October 22, 2016, through December 22, 2016, for incidental adnexal findings, followed by manual review. Forty abdominal and cancer imaging radiologists were surveyed to understand the barriers to adoption of the recommendations. Interventions to address the most common identified barriers were implemented on December 23, 2016. The postintervention adherence rate was assessed from December 23, 2016, through February 15, 2017, by again screening CT pelvis reports for incidental adnexal lesions followed by manual review. The change in pre- and postintervention adherence rates was assessed using the Fisher exact test and statistical process control (SPC) p-chart with 3-sigma control limits. RESULTS. The adherence rate to recommendations at baseline was 67% (121/181). Of the 28 of 40 (70%) radiologists who completed the survey, only 29% (8/28) often or consistently used the recommendations. Not remembering the details of the recommendations or not having time to look them up accounted for 83.3% of the barriers cited by radiologists. Interventions consisted of radiologist education and creation of an easily accessible clinical decision support tool incorporated into radiology reporting workflow. The adherence rate to recommendations after the intervention increased to 87% (129/148; p < 0.0001), as also shown by the SPC chart. CONCLUSION. The rate of adherence to follow-up imaging recommendations significantly increased after radiologist education and incorporation of recommendations into the radiologist workflow.

Use of Imaging in the Emergency Department: Do Individual Physicians Contribute to Variation?

OBJECTIVE. The purpose of this study is to investigate the magnitude of physician variation in the use of imaging and the factors associated with variation in an urban emergency department (ED) in the United States. MATERIALS AND METHODS. This retrospective cohort study was conducted from April 1, 2013, to March 31, 2014, in the ED of a level I adult trauma center in the northeastern United States. The study cohort included all patient visits to the ED during the study period. We built hierarchic and logistic regression models to determine per-physician utilization of low- and high-cost imaging, and we identified factors correlated with variation in use. Global (i.e., intraclass correlation coefficient) and individual variability metrics were used to profile physician variation after controlling for patient-, visit-, and physician-related covariates. RESULTS. A total of 56,793 patients presented to the ED during the study; of these patients, 49.5% (28,135) underwent imaging, with 38.2% (21,686) undergoing low-cost imaging and 21.9% (12,430) undergoing high-cost imaging. Statistically significant predictors of imaging orders were patient age and sex, number of secondary diagnoses, certain primary diagnoses, time of arrival in the ED, and ED crowding. Unadjusted and adjusted intraclass correlation coefficients were 0.0072 and 0.0066, respectively, for low-cost imaging, and 0.0097 and 0.0090, respectively, for high-cost imaging. The coefficient of variation for adjusted imaging odds ratios was 10.9% and 14.0% for low- and high-cost imaging, respectively, indicating a moderate degree of variation. CONCLUSION. Unexplained and moderate variation in imaging utilization exists among ED physicians, even after controlling for patient, visit, and physician characteristics. Improvement initiatives using well-defined ED imaging quality measures may help improve quality and reduce waste.

Effect of Clinical Decision Support-Generated Report Cards Versus Real-Time Alerts on Primary Care Provider Guideline Adherence for Low Back Pain Outpatient Lumbar Spine MRI Orders.

OBJECTIVE: The purpose of this study is to determine whether the type of feedback on evidence-based guideline adherence influences adult primary care provider (PCP) lumbar spine (LS) MRI orders for low back pain (LBP). MATERIALS AND METHODS: Four types of guideline adherence feedback were tested on eight tertiary health care system outpatient PCP practices: no feedback during baseline (March 1, 2012-October 4, 2012), randomization by practice to either clinical decision support (CDS)-generated report cards comparing providers to peers only or real-time CDS alerts at order entry during intervention 1 (February 6, 2013-December 31, 2013), and both feedback types for all practices during intervention 2 (January 14, 2014-June 20, 2014, and September 4, 2014-January 21, 2015). International Classification of Disease codes identified LBP visits (excluding Medicare fee-for-service). The primary outcome of the likelihood of LS MRI order being made on the day of or 1-30 days after the outpatient LBP visit was adjusted by feedback type (none, report cards only, real-time alerts only, or both); patient age, sex, race, and insurance status; and provider sex and experience. RESULTS: Half of PCPs (54/108) remained for all three periods, conducting 9394 of 107,938 (8.7%) outpatient LBP visits. The proportion of LBP visits increased over the course of the study (p = 0.0001). In multilevel hierarchic regression, report cards resulted in a lower likelihood of LS MRI orders made the day of and 1-30 days after the visit versus baseline: 38% (p = 0.009) and 37% (p = 0.006) for report cards alone, and 27% (p = 0.020) and 27% (p = 0.016) with alerts, respectively. Real-time alerts alone did not affect MRI orders made the day of (p = 0.585) or 1-30 days after (p = 0.650) the visit. No patient or provider variables were associated with LS MRI orders being generated on the day of or 1-30 days after the LBP visit. CONCLUSION: CDS-generated evidence-based report cards can substantially reduce outpatient PCP LS MRI orders on the day of and 1-30 days after the LBP visit. Real-time CDS alerts do not.

Impact of a Health Information Technology-Enabled Appropriate Use Criterion on Utilization of Emergency Department CT for Renal Colic.

OBJECTIVE: The purpose of this study was to evaluate the impact of an appropriate use criterion (AUC) for renal colic based on local best practice, implemented as electronic clinical decision support (CDS), on the emergency department (ED) use of CT for patients with suspected nephrolithiasis. MATERIALS AND METHODS: This retrospective cohort study was performed in the EDs of a level I trauma center (study site) and local comparable hospital (control site). An AUC for patients younger than 50 years with a history of uncomplicated nephrolithiasis presenting with renal colic was developed by an interdisciplinary emergency medicine, emergency radiology, and urology team and embedded as CDS. AUC-consistent CT of ureter requests received no CDS alert. Otherwise, the orderer was alerted to consider a trial of symptomatic control or discharge without CT. A natural language processing tool mined ED notes for visits in September 2010-February 2012 (before AUC implementation) and April 2013-September 2014 (1 year after implementation) for concept unique identifiers of flank tenderness or renal or ureteral pain. Manual review excluded noneligible cases; the others were reviewed by a multidisciplinary team. Chi-square tests were used to assess for CT rate differences, the primary outcome. RESULTS: The final sample included 467 patients (194 study site) before and 306 (88 study site) after AUC implementation. The study site's CT of ureter rate decreased from 23.7% (46/194) to 14.8% (13/88) (p = 0.03) after implementation of the AUC. The rate at the control site remained unchanged, 49.8% (136/273) versus 48.2% (105/218) (p = 0.3). CONCLUSION: Implementing an AUC based on local best practice as CDS may effectively curb potential imaging overuse in a subset of ED patients with renal colic unlikely to have a complicated course or alternative dangerous diagnosis.

Risk Stratification Model: Lower-Extremity Ultrasonography for Hospitalized Patients with Suspected Deep Vein Thrombosis.

BACKGROUND: The Wells score for deep venous thrombosis (DVT) has a high failure rate and low efficiency among inpatients. OBJECTIVE: To create and validate an inpatient-specific risk stratification model to help assess pre-test probability of DVT in hospitalized patients. DESIGN: Prospective cohort study of hospitalized patients undergoing lower-extremity ultrasonography studies (LEUS) for suspected DVT. Demographics, physical findings, medical history, medications, hospitalization, and laboratory and imaging results were collected. Samples were divided into model derivation (patients undergoing LEUS 11/1/2012-12/31/2013) and validation cohorts (LEUS 1/1/2014-5/31/2015). A DVT prediction rule was derived using the recursive partitioning algorithm (decision tree-type approach) and was then validated. PARTICIPANTS: Adult inpatients undergoing LEUS for suspected DVT from November 2012 to May 2015, excluding those with DVT in the prior 3 months, at a 793-bed, urban academic quaternary-care hospital with ~50,000 admissions annually. MAIN MEASURES: The primary outcome was the presence of proximal DVT, and the secondary outcome was the presence of any DVT (proximal or distal). Model sensitivity and specificity for predicting DVT were calculated. KEY RESULTS: Recursive partitioning yielded four variables (previous DVT, active cancer, hospitalization ≥ 6 days, age ≥ 46 years) that optimized the prediction of proximal DVT and yield in the derivation cohort. From this decision tree, we stratified a scoring system using the validation cohort, categorizing patients into low- and high-risk groups. The incidence rates of proximal DVT were 2.9% and 12.0%, and of any DVT were 5.2% and 21.0%, for the low- and high-risk groups, respectively. The AUC for the discriminatory accuracy of the Center for Evidence-Based Imaging (CEBI) score for risk of proximal DVT identified on LEUS was 0.73. Model sensitivity was 98.1% for proximal and 98.1% for any DVT. CONCLUSIONS: In hospitalized adults, specific factors can help clinicians predict risk of DVT, identifying those with low pre-test probability, in whom ultrasonography can be safely avoided.

Clinical decision support increases diagnostic yield of computed tomography for suspected pulmonary embolism.

OBJECTIVE: Determine effects of evidence-based clinical decision support (CDS) on the use and yield of computed tomographic pulmonary angiography for suspected pulmonary embolism (CTPE) in Emergency Department (ED) patients. METHODS: This multi-site prospective quality improvement intervention conducted in three urban EDs used a pre/post design. For ED patients aged 18+years with suspected PE, CTPE use and yield were compared 19months pre- and 32months post-implementation of CDS intervention based on the Wells criteria, provided at the time of CTPE order, deployed in April 2012. Primary outcome was the yield (percentage of studies positive for acute PE). Secondary outcome was utilization (number of studies/100 ED visits) of CTPE. Chi-square and statistical process control chart assessed pre- and post-intervention differences. An interrupted time series analysis was also performed. RESULTS: Of 558,795 patients presenting October 2010-December 2014, 7987 (1.4%) underwent CTPE (mean age 52±17.5years, 66% female, 60.1% black); 34.7% of patients presented pre- and 65.3% post-CDS implementation. Overall CTPE diagnostic yield was 9.8% (779/7987 studies positive for PE). Yield increased a relative 30.8% after CDS implementation (8.1% vs. 10.6%; p=0.0003). There was no statistically significant change in CTPE utilization (1.4% pre- vs. 1.4% post-implementation; p=0.25). A statistical process control chart demonstrated immediate and sustained improvement in CTPE yield post-implementation. Interrupted time series analysis demonstrated the slope of PE findings versus time to be unchanged before and after the intervention (p=0.9). However, there was a trend that the intervention was associated with a 50% increased probability of PE finding (p=0.08), suggesting an immediate rather than gradual change after the intervention. CONCLUSIONS: Implementing evidence-based CDS in the ED was associated with an immediate, significant and sustained increase in CTPE yield without a measurable decrease in CTPE utilization. Further studies will be needed to assess whether stronger interventions could further improve appropriate use of CTPE.

Gender Differences in Academic Rank of Radiologists in U.S. Medical Schools.

Purpose To determine whether there were gender differences in full professorship after accounting for factors known to influence academic advancement. Materials and Methods Institutional review board approval was obtained for this HIPAA-compliant study, with waiver of informed consent. In this cross-sectional study, the authors used a comprehensive 2014 physician database (5089 academic radiologists, inclusive of all U.S. academic radiologists in 2014; 11.3% of all U.S. radiologists) containing information on physician age, years since residency, National Institutes of Health funding, scientific publications (first or last author and total), clinical trial investigation, and clinical volume measured according to 2013 Medicare reimbursement. Primary outcome of gender differences in full professorship was estimated by using a multilevel logistic regression model adjusting for these factors. Results Among 5089 academic radiologists, 3638 (71.5%) were men. The average age for male and female radiologists was 52 and 49 years, respectively. Overall, 239 women (16.5%) and 948 (26.1%) men were full professors (P < .001). Women had fewer total and first or last author publications than men (total, 12.2 vs 17.6; first or last, 6.8 vs 10.7; P < .001 for both comparisons). Women were less likely than men to have National Institutes of Health funding (2.0% vs 3.6%; P = .004) and generated less annual Medicare revenue ($63 346 vs $75 854; P = .001). After multivariate adjustment, rates of full professorship among female and male radiologists were not significantly different (absolute adjusted difference for female vs male radiologists, -1.5%; 95% confidence interval: -3.8%, 0.9%). Conclusion Among radiologists with U.S. medical school faculty appointments in 2014, men and women were similarly likely to be full professor after several factors known to influence promotion were taken into account. However, unadjusted differences in promotion and research productivity were present, which suggests that female radiologists may lack equal research opportunities. © RSNA, 2016.

Yield of CT Pulmonary Angiography in the Emergency Department When Providers Override Evidence-based Clinical Decision Support.

Purpose To determine the frequency of, and yield after, provider overrides of evidence-based clinical decision support (CDS) for ordering computed tomographic (CT) pulmonary angiography in the emergency department (ED). Materials and Methods This HIPAA-compliant, institutional review board-approved study was performed at a tertiary care, academic medical center ED with approximately 60 000 annual visits and included all patients who were suspected of having pulmonary embolism (PE) and who underwent CT pulmonary angiography between January 1, 2011, and August 31, 2013. The requirement to obtain informed consent was waived. Each CT order for pulmonary angiography was exposed to CDS on the basis of the Wells criteria. For patients with a Wells score of 4 or less, CDS alerts suggested d-dimer testing because acute PE is highly unlikely in these patients if d-dimer levels are normal. The yield of CT pulmonary angiography (number of positive PE diagnoses/total number of CT pulmonary angiographic examinations) was compared in patients in whom providers overrode CDS alerts (by performing CT pulmonary angiography in patients with a Wells score ≤4 and a normal d-dimer level or no d-dimer testing) (override group) and those in whom providers followed Wells criteria (CT pulmonary angiography only in patients with Wells score >4 or ≤4 with elevated d-dimer level) (adherent group). A validated natural language processing tool identified positive PE diagnoses, with subsegmental and/or indeterminate diagnoses removed by means of chart review. Statistical analysis was performed with the χ2 test, the Student t test, and logistic regression. Results Among 2993 CT pulmonary angiography studies in 2655 patients, 563 examinations had a Wells score of 4 or less but did not undergo d-dimer testing and 26 had a Wells score of 4 or less and had normal d-dimer levels. The yield of CT pulmonary angiography was 4.2% in the override group (25 of 589 studies, none with a normal d-dimer level) and 11.2% in the adherent group (270 of 2404 studies) (P < .001). After adjustment for the risk factor differences between the two groups, the odds of an acute PE finding were 51.3% lower when providers overrode alerts than when they followed CDS guidelines. Comparison of the two groups including only patients unlikely to have PE led to similar results. Conclusion The odds of an acute PE finding in the ED when providers adhered to evidence presented in CDS were nearly double those seen when providers overrode CDS alerts. Most overrides were due to the lack of d-dimer testing in patients unlikely to have PE. © RSNA, 2016.

Sex Differences in Radiologist Salary in U.S. Public Medical Schools.

OBJECTIVE: The purpose of this study was to evaluate salary differences between male and female academic radiologists at U.S. medical schools. MATERIALS AND METHODS: Laws in several U.S. states mandate public release of government records, including salary information of state employees. From online salary data published by 12 states, we extracted the salaries of all academic radiologists at 24 public medical schools during 2011-2013 (n = 573 radiologists). In this institutional review board-approved cross-sectional study, we linked these data to a physician database with information on physician sex, age, faculty rank, years since residency, clinical trial involvement, National Institutes of Health (NIH) funding, scientific publications, and clinical volume measured by 2013 Medicare payments. Sex difference in salary, the primary outcome, was estimated using a multilevel logistic regression adjusting for these factors. RESULTS: Among 573 academic radiologists, 171 (29.8%) were women. Female radiologists were younger (48.5 vs 51.6 years, p = 0.001) and more likely to be assistant professors (50.9% [87/171] vs 40.8% [164/402], p = 0.026). Salaries between men and women were similar in unadjusted analyses ($290,660 vs $289,797; absolute difference, $863; 95% CI, -$18,363 to $20,090), and remained so after adjusting for age, faculty rank, years since residency, clinical trial involvement, publications, total Medicare payments, NIH funding, and graduation from a highly ranked medical school. CONCLUSION: Among academic radiologists employed at 24 U.S. public medical schools, male and female radiologists had similar annual salaries both before and after adjusting for several variables known to influence salary among academic physicians.

Comparing Diagnostic Performance of Digital Breast Tomosynthesis and Full-Field Digital Mammography in a Hybrid Screening Environment.

OBJECTIVE: The purpose of this study is to compare the diagnostic performance of screening digital breast tomosynthesis (DBT) to that of full-field digital mammography (FFDM) in a mixed DBT and FFDM imaging environment. MATERIALS AND METHODS: This retrospective observational study consisted of all female patients undergoing screening DBT or FFDM at an academic medical center and outpatient imaging facility between October 2012 and May 2015. Patient demographics and personal history of breast cancer were collected from the electronic medical record. A natural language processing algorithm extracted patients' breast density, current or prior imaging findings, and BI-RADS category from their most recent prior imaging examinations. To control for differential selection of FFDM versus DBT, we applied propensity score matching based on patient age, imaging site, and prior imaging findings. An institutional breast cancer registry identified cancer diagnoses. Primary outcomes of recall rate, cancer detection rate, and positive predictive value 1 (PPV1) were compared between matched FFDM and DBT groups. RESULTS: Among 68,794 screening examinations, we matched 16,264 FFDM with 21,074 DBT examinations (total, 37,338 examinations) using nearest neighbor propensity score matching. Recall rates were 10.3% (1683/16,264) for FFDM and 10.7% (2254/21,074) for DBT (p = 0.26). Cancer detection rates (number of cancers/1000 examinations) were 1.8/1000 for FFDM and 3.8/1000 for DBT (p = 0.005). The PPV1 (number of cancers/number of recalls) was 1.8% (26/1478) for FFDM and 3.6% (37/1036) for DBT (p = 0.006). CONCLUSION: FFDM and DBT recall rates were not significantly different in a mixed FFDM and DBT breast imaging practice. However, the PPV1 of recalled cases and the cancer detection rate (the primary screening objective) were significantly higher with DBT compared with FFDM.

JOURNAL CLUB: Predictors of Provider Response to Clinical Decision Support: Lessons Learned From the Medicare Imaging Demonstration.

OBJECTIVE: The efficacy of imaging clinical decision support (CDS) varies. Our objective was to identify CDS factors contributing to imaging order cancellation or modification. SUBJECTS AND METHODS: This pre-post study was performed across four institutions participating in the Medicare Imaging Demonstration. The intervention was CDS at order entry for selected outpatient imaging procedures. On the basis of the information entered, computerized alerts indicated to providers whether orders were not covered by guidelines, appropriate, of uncertain appropriateness, or inappropriate according to professional society guidelines. Ordering providers could override or accept CDS. We considered actionable alerts to be those that could generate an immediate order behavior change in the ordering physician (i.e., cancellation of inappropriate orders or modification of orders of uncertain appropriateness that had a recommended alternative). Chi-square and logistic regression identified predictors of order cancellation or modification after an alert. RESULTS: A total of 98,894 radiology orders were entered (83,114 after the intervention). Providers ignored 98.9%, modified 1.1%, and cancelled 0.03% of orders in response to alerts. Actionable alerts had a 10 fold higher rate of modification (8.1% vs 0.7%; p < 0.0001) or cancellation (0.2% vs 0.02%; p < 0.0001) orders compared with nonactionable alerts. Orders from institutions with preexisting imaging CDS had a sevenfold lower rate of cancellation or modification than was seen at sites with newly implemented CDS (1.4% vs 0.2%; p < 0.0001). In multivariate analysis, actionable alerts were 12 times more likely to result in order cancellation or modification. Orders at sites with preexisting CDS were 7.7 times less likely to be cancelled or modified (p < 0.0001). CONCLUSION: Using results from the Medicare Imaging Demonstration project, we identified potential factors that were associated with CDS effect on provider imaging ordering; these findings may have implications for future design of such computerized systems.

Impact of a clinical decision support tool on adherence to the Ottawa Ankle Rules.

OBJECTIVE: The objective of the study is to determine impact of a clinical decision support (CDS) tool on documented adherence to the Ottawa Ankle Rules (OAR) and utilization and yield of ankle/foot radiography, for emergency department patients with acute ankle injury. METHODS: This is a before-and-after intervention study conducted at a 793-bed, quaternary care, academic hospital from August 2012 to October 2013. Emergency department visits from adults with acute ankle injury 6 months before and 8 months after the intervention were included. The intervention embedded the OAR into a CDS tool integrated with a computerized physician order entry system, which had data capture capability and provided feedback at the time of ankle/foot radiography order. Primary outcome was rate of documented adherence to OAR. Secondary outcomes were utilization and yield (clinically significant fracture rates among patients with acute ankle injuries) of ankle/foot radiography. RESULTS: The study population included 460 visits; 205 (44.6%) occurred preintervention. After intervention, documented OAR adherence increased from 55.9% (229/410) to 95.7% (488/510; P < .001). Utilization remained stable for ankle (77.5%; P = .800) and foot (48.6%; P = .514) radiography. Yield remained stable for ankle (17.8%; P = .891) and foot (19.8%; P = .889) radiography. DISCUSSION: Lack of documentation of key clinical data may hamper provider communication, delay care coordination, and result in legal liability. By embedding the OAR into a CDS tool, we achieved the same rate of documented adherence as previous onerous educational implementations while automating data collection/retrieval. In summary, implementation of the OAR into a CDS tool was associated with an increase in documented adherence to the OAR.

Gastrointestinal stromal tumor: optimizing the use of cross-sectional chest imaging during follow-up.

PURPOSE: To identify the frequency of and variables associated with thoracic metastasis in patients with gastrointestinal stromal tumor (GIST) to help optimize the use of cross-sectional chest imaging. MATERIALS AND METHODS: This retrospective institutional review board-approved study included 631 patients (343 men; mean age, 55 years; range, 19-94 years) with pathologically confirmed GIST who were identified with a natural language processing algorithm in a review of radiologic reports from January 2004 through October 2012, followed by manual confirmation. The requirement for informed consent was waived. Available imaging, pathologic, and clinical records were reviewed to confirm the presence of abdominal and thoracic metastases. The association of age; sex; size, location, mitotic count, and risk stratification of the primary tumor; initial treatment; presence of abdominal metastases; and bulky abdominal metastases (more than 10 lesions larger than 1 cm, or more than five lesions with at least one larger than 5 cm) with development of thoracic metastases, the primary outcome measure, was studied by using logistic regression. RESULTS: During median follow-up of 61.4 months (interquartile range, 37.8-93 months), 401 of 631 (63.5%) patients developed metastatic disease (median interval, 6.9 months; interquartile range, 0-25.6 months), all with peritoneal (n = 324) and/or hepatic metastases (n = 303). Bulky abdominal metastases were found in 218 (34.5%) patients. Although 579 (91.8%) patients underwent chest imaging, only 64 of 631 (10.1%) developed thoracic metastases (median, 51.4 months; interquartile range, 36-78.7 months); all had bulky abdominal metastases except one patient who presented with symptomatic scapular metastasis. Only bulky abdominal metastasis was significantly associated with the development of thoracic metastasis (P < .0001; odds ratio, 42.6; range, 8.6-211.5). CONCLUSION: Thoracic metastases are relatively uncommon in patients with GIST and are significantly associated only with presence of bulky abdominal metastases.

Use of Public Data to Target Variation in Providers' Use of CT and MR Imaging among Medicare Beneficiaries.

PURPOSE: To examine geographic variation in providers' use of diagnostic imaging to identify potential targets for quality improvement initiatives after adjusting for imaging referral across hospital referral regions (HRRs). MATERIALS AND METHODS: Using two Centers for Medicare and Medicaid Services datasets, the authors included all claims for beneficiaries enrolled in the Medicare fee-for-service program. Diagnostic imaging procedures were selected on the basis of common procedure coding system codes, excluding interventional procedures. The authors assessed providers' use of imaging for each HRR after creating an imaging referral index (IRI) to adjust for imaging referral rates across HRRs. Relative risk statistics were used to assess geographic variation. The authors calculated two imaging measures for computed tomography (CT) and magnetic resonance (MR) imaging: IRI-adjusted utilization intensity (number of examinations per 1000 beneficiaries) and total payments (in dollars, after deducting deductibles and coinsurances) in each HRR. High-impact regions were defined as those in the highest deciles for both imaging intensity and payment. RESULTS: For 34 million Medicare beneficiaries, 124 million unique diagnostic imaging services (totaling $5.6 billion) were performed in 2012. The average adjusted CT utilization intensity ranged from 330.4 studies per 1000 beneficiaries in the lowest decile to 684.0 in the highest decile (relative risk, 2.1); adjusted MR imaging utilization intensity varied from 105.7 studies per 1000 beneficiaries to 256.3 (relative risk, 2.4). The most common CT and MR imaging procedures were head CT and lumbar spine MR imaging. CONCLUSION: With use of public data, the authors identified a wide variation in imaging use across the United States. Potential targets for future imaging quality improvement initiatives include head CT and lumbar spine MR imaging.

Effect of Evidence-based Clinical Decision Support on the Use and Yield of CT Pulmonary Angiographic Imaging in Hospitalized Patients.

PURPOSE: To determine the effect of clinical decision support (CDS) on the use and yield of inpatient computed tomographic (CT) pulmonary angiography for acute pulmonary embolism (PE). MATERIALS AND METHODS: This HIPAA-compliant, institutional review board-approved study with waiver of informed consent included all adults admitted to a 793-bed teaching hospital from April 1, 2007, to June 30, 2012. The CDS intervention, implemented after a baseline observation period, informed providers who placed an order for CT pulmonary angiographic imaging about the pretest probability of the study based on a validated decision rule. Use of CT pulmonary angiographic and admission data from administrative databases was obtained for this study. By using a validated natural language processing algorithm on radiology reports, each CT pulmonary angiographic examination was classified as positive or negative for acute PE. Primary outcome measure was monthly use of CT pulmonary angiography per 1000 admissions. Secondary outcome was CT pulmonary angiography yield (percentage of CT pulmonary angiographic examinations that were positive for acute PE). Linear trend analysis was used to assess for effect and trend differences in use and yield of CT pulmonary angiographic imaging before and after CDS. RESULTS: In 272 374 admissions over the study period, 5287 patients underwent 5892 CT pulmonary angiographic examinations. A 12.3% decrease in monthly use of CT pulmonary angiography (26.0 to 22.8 CT pulmonary angiographic examinations per 1000 admissions before and after CDS, respectively; P = .008) observed 1 month after CDS implementation was sustained over the ensuing 32-month period. There was a nonsignificant 16.3% increase in monthly yield of CT pulmonary angiography or percentage of CT pulmonary angiographic examinations positive for acute PE after CDS (P = .65). CONCLUSION: Implementation of evidence-based CDS for inpatients was associated with a 12.3% immediate and sustained decrease in use of CT pulmonary angiographic examinations in the evaluation of inpatients for acute PE. for this article.

Effects of Performance Feedback Reports on Adherence to Evidence-Based Guidelines in Use of CT for Evaluation of Pulmonary Embolism in the Emergency Department: A Randomized Trial.

OBJECTIVE: The purpose of this study was to assess whether implementing emergency department (ED) physician performance feedback reports improves adherence to evidence-based guidelines for use of CT for evaluation of pulmonary embolism (PE) beyond that achieved with clinical decision support (CDS) alone. SUBJECTS AND METHODS: This prospective randomized controlled trial was conducted from January 1, 2012, to December 31, 2013, at an urban level 1 adult trauma center ED. Attending physicians were stratified into quartiles by use of CT for evaluation of PE in 2012 and were randomized to receive quarterly feedback reporting or not, beginning January 2013. Reports consisted of individual and anonymized group data on guideline adherence (using the Wells criteria), use of CT for PE (number of CT examinations for PE per 1000 patients), and yield (percentage of CT examinations for PE with positive findings). We compared guideline adherence (primary outcome) and use and yield (secondary outcomes) of CT for PE between the control and intervention groups in 2013 and with historical imaging data from 2012. RESULTS: Of 109,793 ED patients during the control and intervention periods, 2167 (2.0%) underwent CT for evaluation of PE. In the control group, guideline adherence remained unchanged between 2012 (78.8% [476/604]) and 2013 (77.2% [421/545]) (p = 0.5); in the intervention group, guideline adherence increased 8.8% after feedback report implementation, from 78.3% (426/544) to 85.2% (404/474) (p < 0.05). Use and yield were unchanged in both groups. CONCLUSION: Implementation of quarterly feedback reporting resulted in a modest but significant increase in adherence to evidence-based guidelines for use of CT for evaluation of PE in ED patients, enhancing the impact of CDS alone. These results suggest potentially synergistic effects of traditional performance improvement tools with CDS to improve guideline adherence.

Use of CT and MRI in emergency department patients with acute pancreatitis.

PURPOSE: Assess the utility of CT and MRI in patients with acute pancreatitis (AP) presenting to emergency department (ED). MATERIALS AND METHODS: In this Institutional Review Board-approved retrospective study, we identified all patients with AP from March 2012 through February 2013 in ED of a teaching hospital with approximately 60,000 annual visits. Patients were initially identified via ICD-9 code for AP (577.0); diagnosis was confirmed by chart review using established diagnostic criteria (presence of two of the following: typical abdominal pain, elevated lipase/amylase >3 times normal, or imaging findings of pancreatitis). Abdominal CT or MRI obtained in the ED and within 24 h of admission was reviewed by a fellowship-trained abdominal radiologist. RESULTS: Of 101 patients admitted with AP (60 women, 41 men; mean age 52 years, range 20-89), 63 (62.4%) underwent imaging; only one (1.6%) showed pancreatic necrosis. 88 (87.1%) patients could have been clinically diagnosed without imaging based on presence of abdominal pain and elevated laboratory values; 13 (12.9%) required imaging for diagnosis. Of 88 patients who met AP diagnostic criteria without imaging, 50 (56.8%) nonetheless underwent imaging, with AP without necrosis seen in 34 (68.0%), pancreatic necrosis in one (2.0%), sequelae of prior AP in four (8.0%), and no abnormality in 11 (22.0%). CONCLUSION: Early imaging is common in patients with AP, even when the diagnosis can be established based on non-imaging criteria, rarely demonstrating pancreatic necrosis. Reducing overuse of early imaging in patients with confident diagnosis of AP may improve quality and reduce waste.