User-Centered Design of a Preference-Driven Patient Activation Tool for Optimizing Depression Treatment in Integrated Primary Care Settings (The Transform DepCare Study).

BACKGROUND: Few patient engagement tools incorporate the complex patient experiences, contexts, and workflows that limit depression treatment implementation. OBJECTIVE: Describe a user-centered design (UCD) process for operationalizing a preference-driven patient activation tool. DESIGN: Informed by UCD and behavior change/implementation science principles, we designed a preference-driven patient activation prototype for engaging patients in depression treatment. We conducted three usability cycles using different recruitment/implementation approaches: near live/live testing in primary care waiting rooms (V1-2) and lab-based think aloud testing (V3) oversampling older, low-literacy, and Spanish-speaking patients in the community and via EHR algorithms. We elicited clinician and "heuristic" expert input. MAIN MEASURES: We administered the system usability scale (SUS) all three cycles and pre-post V3, the patient activation measure, decisional conflict scale, and depression treatment barriers. We employed descriptive statistics and thematically analyzed observer notes and transcripts for usability constructs. RESULTS: Overall, 43 patients, 3 clinicians, and 5 heuristic (a usability engineering method for identifying usability problems) experts participated. Among patients, 41.9% were ≥ 65 years old, 79.1% female, 23.3% Black, 62.8% Hispanic, and 55.8% Spanish-speaking and 46.5% had ≤ high school education. We described V1-3 usability (67.2, 77.3, 81.8), treatment seeking (92.3%, 87.5%, 92.9%), likelihood/comfort discussing with clinician (76.9%, 87.5%, 100.0%), and pre vs. post decisional conflict (23.7 vs. 15.2), treatment awareness (71.4% vs. 92.9%), interest in antidepressants (7.1% vs. 14.3%), and patient activation (66.8 vs. 70.9), with fewer barriers pertaining to cost/insurance, access/coordination, and self-efficacy/stigma/treatment efficacy. Key themes included digital literacy, understandability, high acceptability for aesthetics, high usefulness of patient/clinician videos, and workflow limitations. We adapted manual entry/visibility/content; added patient activation and a personalized algorithm; and proposed flexible, care manager delivery leveraging clinic screening protocols. DISCUSSION: We provide an example of leveraging UCD to design/adapt a real-world, patient experience and workflow-aligned patient activation tool in diverse populations.

Postdischarge thromboembolic outcomes and mortality of hospitalized patients with COVID-19: the CORE-19 registry.

Thromboembolic events, including venous thromboembolism (VTE) and arterial thromboembolism (ATE), and mortality from subclinical thrombotic events occur frequently in coronavirus disease 2019 (COVID-19) inpatients. Whether the risk extends postdischarge has been controversial. Our prospective registry included consecutive patients with COVID-19 hospitalized within our multihospital system from 1 March to 31 May 2020. We captured demographics, comorbidities, laboratory parameters, medications, postdischarge thromboprophylaxis, and 90-day outcomes. Data from electronic health records, health informatics exchange, radiology database, and telephonic follow-up were merged. Primary outcome was a composite of adjudicated VTE, ATE, and all-cause mortality (ACM). Principal safety outcome was major bleeding (MB). Among 4906 patients (53.7% male), mean age was 61.7 years. Comorbidities included hypertension (38.6%), diabetes (25.1%), obesity (18.9%), and cancer history (13.1%). Postdischarge thromboprophylaxis was prescribed in 13.2%. VTE rate was 1.55%; ATE, 1.71%; ΑCM, 4.83%; and MB, 1.73%. Composite primary outcome rate was 7.13% and significantly associated with advanced age (odds ratio [OR], 3.66; 95% CI, 2.84-4.71), prior VTE (OR, 2.99; 95% CI, 2.00-4.47), intensive care unit (ICU) stay (OR, 2.22; 95% CI, 1.78-2.93), chronic kidney disease (CKD; OR, 2.10; 95% CI, 1.47-3.0), peripheral arterial disease (OR, 2.04; 95% CI, 1.10-3.80), carotid occlusive disease (OR, 2.02; 95% CI, 1.30-3.14), IMPROVE-DD VTE score ≥4 (OR, 1.51; 95% CI, 1.06-2.14), and coronary artery disease (OR, 1.50; 95% CI, 1.04-2.17). Postdischarge anticoagulation was significantly associated with reduction in primary outcome (OR, 0.54; 95% CI, 0.47-0.81). Postdischarge VTE, ATE, and ACM occurred frequently after COVID-19 hospitalization. Advanced age, cardiovascular risk factors, CKD, IMPROVE-DD VTE score ≥4, and ICU stay increased risk. Postdischarge anticoagulation reduced risk by 46%.

Reducing prescribing of antibiotics for acute respiratory infections using a frontline nurse-led EHR-Integrated clinical decision support tool: protocol for a stepped wedge randomized control trial.

BACKGROUND: Overprescribing of antibiotics for acute respiratory infections (ARIs) remains a major issue in outpatient settings. Use of clinical prediction rules (CPRs) can reduce inappropriate antibiotic prescribing but they remain underutilized by physicians and advanced practice providers. A registered nurse (RN)-led model of an electronic health record-integrated CPR (iCPR) for low-acuity ARIs may be an effective alternative to address the barriers to a physician-driven model. METHODS: Following qualitative usability testing, we will conduct a stepped-wedge practice-level cluster randomized controlled trial (RCT) examining the effect of iCPR-guided RN care for low acuity patients with ARI. The primary hypothesis to be tested is: Implementation of RN-led iCPR tools will reduce antibiotic prescribing across diverse primary care settings. Specifically, this study aims to: (1) determine the impact of iCPRs on rapid strep test and chest x-ray ordering and antibiotic prescribing rates when used by RNs; (2) examine resource use patterns and cost-effectiveness of RN visits across diverse clinical settings; (3) determine the impact of iCPR-guided care on patient satisfaction; and (4) ascertain the effect of the intervention on RN and physician burnout. DISCUSSION: This study represents an innovative approach to using an iCPR model led by RNs and specifically designed to address inappropriate antibiotic prescribing. This study has the potential to provide guidance on the effectiveness of delegating care of low-acuity patients with ARIs to RNs to increase use of iCPRs and reduce antibiotic overprescribing for ARIs in outpatient settings. TRIAL REGISTRATION: ClinicalTrials.gov Identifier: NCT04255303, Registered February 5 2020, https://clinicaltrials.gov/ct2/show/NCT04255303 .

Incidence of Venous Thromboembolism and Mortality in Patients with Initial Presentation of COVID-19.

Venous thromboembolism (VTE) has emerged as an important issue in patients with COVID-19. The purpose of this study is to identify the incidence of VTE and mortality in COVID-19 patients initially presenting to a large health system. Our retrospective study included adult patients (excluding patients presenting with obstetric/gynecologic conditions) across a multihospital health system in the New York Metropolitan Region from March 1-April 27, 2020. VTE and mortality rates within 8 h of assessment were described. In 10,871 adults with COVID-19, 118 patients (1.09%) were diagnosed with symptomatic VTE (101 pulmonary embolism, 17 deep vein thrombosis events) and 28 patients (0.26%) died during initial assessment. Among these 146 patients, 64.4% were males, 56.8% were 60 years or older, 15.1% had a BMI > 35, and 11.6% were admitted to the intensive care unit. Comorbidities included hypertension (46.6%), diabetes (24.7%), hyperlipidemia (14.4%), chronic lung disease (12.3%), coronary artery disease (11.0%), and prior VTE (7.5%). Key medications included corticosteroids (22.6%), statins (21.2%), antiplatelets (20.6%), and anticoagulants (20.6%). Highest D-Dimer was greater than six times the upper limit of normal in 51.4%. Statin and antiplatelet use were associated with decreased VTE or mortality (each p < 0.01). In COVID-19 patients who initially presented to a large multihospital health system, the overall symptomatic VTE and mortality rate was over 1.0%. Statin and antiplatelet use were associated with decreased VTE or mortality. The potential benefits of antithrombotics in high risk COVID-19 patients during the pre-hospitalization period deserves study.

External validation of the IMPROVE-DD risk assessment model for venous thromboembolism among inpatients with COVID-19.

There is a need to discriminate which COVID-19 inpatients are at higher risk for venous thromboembolism (VTE) to inform prophylaxis strategies. The IMPROVE-DD VTE risk assessment model (RAM) has previously demonstrated good discrimination in non-COVID populations. We aimed to externally validate the IMPROVE-DD VTE RAM in medical patients hospitalized with COVID-19. This retrospective cohort study evaluated the IMPROVE-DD VTE RAM in adult patients with COVID-19 admitted to one of thirteen Northwell Health hospitals in the New York metropolitan area between March 1, 2020 and April 27, 2020. VTE was defined as new-onset symptomatic deep venous thrombosis or pulmonary embolism. To assess the predictive value of the RAM, the receiver operating characteristic (ROC) curve was plotted and the area under the curve (AUC) was calculated. Sensitivity, specificity, positive predictive value (PPV), and negative predictive value (NPV) were calculated. Of 9407 patients who met study criteria, 274 patients developed VTE with a prevalence of 2.91%. The VTE rate was 0.41% for IMPROVE-DD score 0-1 (low risk), 1.21% for score 2-3 (moderate risk), and 5.30% for score ≥ 4 (high risk). Approximately 45.7% of patients were classified as high VTE risk, 33.3% moderate risk, and 21.0% low risk. Discrimination of low versus moderate-high VTE risk demonstrated sensitivity 0.971, specificity 0.215, PPV 0.036, and NPV 0.996. ROC AUC was 0.703. In this external validation study, the IMPROVE-DD VTE RAM demonstrated very good discrimination to identify hospitalized COVID-19 patients at low, moderate, and high VTE risk.

A Machine Learning Prediction Model of Respiratory Failure Within 48 Hours of Patient Admission for COVID-19: Model Development and Validation.

BACKGROUND: Predicting early respiratory failure due to COVID-19 can help triage patients to higher levels of care, allocate scarce resources, and reduce morbidity and mortality by appropriately monitoring and treating the patients at greatest risk for deterioration. Given the complexity of COVID-19, machine learning approaches may support clinical decision making for patients with this disease. OBJECTIVE: Our objective is to derive a machine learning model that predicts respiratory failure within 48 hours of admission based on data from the emergency department. METHODS: Data were collected from patients with COVID-19 who were admitted to Northwell Health acute care hospitals and were discharged, died, or spent a minimum of 48 hours in the hospital between March 1 and May 11, 2020. Of 11,525 patients, 933 (8.1%) were placed on invasive mechanical ventilation within 48 hours of admission. Variables used by the models included clinical and laboratory data commonly collected in the emergency department. We trained and validated three predictive models (two based on XGBoost and one that used logistic regression) using cross-hospital validation. We compared model performance among all three models as well as an established early warning score (Modified Early Warning Score) using receiver operating characteristic curves, precision-recall curves, and other metrics. RESULTS: The XGBoost model had the highest mean accuracy (0.919; area under the curve=0.77), outperforming the other two models as well as the Modified Early Warning Score. Important predictor variables included the type of oxygen delivery used in the emergency department, patient age, Emergency Severity Index level, respiratory rate, serum lactate, and demographic characteristics. CONCLUSIONS: The XGBoost model had high predictive accuracy, outperforming other early warning scores. The clinical plausibility and predictive ability of XGBoost suggest that the model could be used to predict 48-hour respiratory failure in admitted patients with COVID-19.

Impact of Clinical Decision Support on Antibiotic Prescribing for Acute Respiratory Infections: a Cluster Randomized Implementation Trial.

BACKGROUND: Clinical decision support (CDS) is a promising tool for reducing antibiotic prescribing for acute respiratory infections (ARIs). OBJECTIVE: To assess the impact of previously effective CDS on antibiotic-prescribing rates for ARIs when adapted and implemented in diverse primary care settings. DESIGN: Cluster randomized clinical trial (RCT) implementing a CDS tool designed to guide evidence-based evaluation and treatment of streptococcal pharyngitis and pneumonia. SETTING: Two large academic health system primary care networks with a mix of providers. PARTICIPANTS: All primary care practices within each health system were invited. All providers within participating clinic were considered a participant. Practices were randomized selection to a control or intervention group. INTERVENTIONS: Intervention practice providers had access to an integrated clinical prediction rule (iCPR) system designed to determine the risk of bacterial infection from reason for visit of sore throat, cough, or upper respiratory infection and guide evidence-based evaluation and treatment. MAIN OUTCOME(S): Change in overall antibiotic prescription rates. MEASURE(S): Frequency, rates, and type of antibiotics prescribed in intervention and controls groups. RESULTS: 33 primary care practices participated with 541 providers and 100,573 patient visits. Intervention providers completed the tool in 6.9% of eligible visits. Antibiotics were prescribed in 35% and 36% of intervention and control visits, respectively, showing no statistically significant difference. There were also no differences in rates of orders for rapid streptococcal tests (RR, 0.94; P = 0.11) or chest X-rays (RR, 1.01; P = 0.999) between groups. CONCLUSIONS: The iCPR tool was not effective in reducing antibiotic prescription rates for upper respiratory infections in diverse primary care settings. This has implications for the generalizability of CDS tools as they are adapted to heterogeneous clinical contexts. TRIAL REGISTRATION: Clinicaltrials.gov (NCT02534987). Registered August 26, 2015 at https://clinicaltrials.gov.

Presenting Characteristics, Comorbidities, and Outcomes Among 5700 Patients Hospitalized With COVID-19 in the New York City Area.

Importance: There is limited information describing the presenting characteristics and outcomes of US patients requiring hospitalization for coronavirus disease 2019 (COVID-19). Objective: To describe the clinical characteristics and outcomes of patients with COVID-19 hospitalized in a US health care system. Design, Setting, and Participants: Case series of patients with COVID-19 admitted to 12 hospitals in New York City, Long Island, and Westchester County, New York, within the Northwell Health system. The study included all sequentially hospitalized patients between March 1, 2020, and April 4, 2020, inclusive of these dates. Exposures: Confirmed severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) infection by positive result on polymerase chain reaction testing of a nasopharyngeal sample among patients requiring admission. Main Outcomes and Measures: Clinical outcomes during hospitalization, such as invasive mechanical ventilation, kidney replacement therapy, and death. Demographics, baseline comorbidities, presenting vital signs, and test results were also collected. Results: A total of 5700 patients were included (median age, 63 years [interquartile range {IQR}, 52-75; range, 0-107 years]; 39.7% female). The most common comorbidities were hypertension (3026; 56.6%), obesity (1737; 41.7%), and diabetes (1808; 33.8%). At triage, 30.7% of patients were febrile, 17.3% had a respiratory rate greater than 24 breaths/min, and 27.8% received supplemental oxygen. The rate of respiratory virus co-infection was 2.1%. Outcomes were assessed for 2634 patients who were discharged or had died at the study end point. During hospitalization, 373 patients (14.2%) (median age, 68 years [IQR, 56-78]; 33.5% female) were treated in the intensive care unit care, 320 (12.2%) received invasive mechanical ventilation, 81 (3.2%) were treated with kidney replacement therapy, and 553 (21%) died. As of April 4, 2020, for patients requiring mechanical ventilation (n = 1151, 20.2%), 38 (3.3%) were discharged alive, 282 (24.5%) died, and 831 (72.2%) remained in hospital. The median postdischarge follow-up time was 4.4 days (IQR, 2.2-9.3). A total of 45 patients (2.2%) were readmitted during the study period. The median time to readmission was 3 days (IQR, 1.0-4.5) for readmitted patients. Among the 3066 patients who remained hospitalized at the final study follow-up date (median age, 65 years [IQR, 54-75]), the median follow-up at time of censoring was 4.5 days (IQR, 2.4-8.1). Conclusions and Relevance: This case series provides characteristics and early outcomes of sequentially hospitalized patients with confirmed COVID-19 in the New York City area.

The Clinical Utility of Chest Radiography for Identifying Pneumonia: Accounting for Diagnostic Uncertainty in Radiology Reports.

OBJECTIVE. Currently, chest radiography is the first-line imaging test for identifying pneumonia; chest CT is considered the reference standard. The purpose of this study was to calculate the statistical measures of performance of chest radiography for identifying pneumonia when taking into account uncertain results of both chest radiography and CT examinations. MATERIALS AND METHODS. Statistical measures of performance of chest radiography, using CT as the reference standard, were calculated with 95% CIs by varying uncertain radiology report impressions of both chest radiography and CT to all negative or all positive. The resulting scenarios were as follows: scenario 1, uncertain chest radiography and CT impressions are considered positive for pneumonia; scenario 2, uncertain chest radiography impressions are positive but uncertain CT impressions are negative; scenario 3, uncertain chest radiography impressions are negative and uncertain CT impressions are positive; scenario 4, uncertain chest radiography and CT impressions are negative; and scenario 5, uncertain chest radiography and CT impressions are excluded. RESULTS. A retrospective analysis of 2411 patient visits revealed the prevalence of uncertain radiology report impressions to be 31.8% for chest radiography and 21.7% for CT. Scenario 1 yielded the following performance values: sensitivity, 51.9%; specificity, 71.3%; PPV, 59.4%; and NPV, 64.5%. Scenario 2 produced the following performance values: sensitivity, 59.6%; specificity, 67.1%; PPV, 59.6%; and NPV, 67.1%. Scenario 3 showed the following performance values: sensitivity, 13.4%; specificity, 97.7%; PPV, 82.6%; and NPV, 58.1%. Scenario 4 yielded the following performance values: sensitivity, 19.6%; specificity, 96.4%; PPV, 81.6%; and NPV, 59.5%. Scenario 5 produced the following performance values: sensitivity, 32.7%; specificity, 96.8%; PPV, 89.2%; and NPV, 63.8%. CONCLUSION. Uncertain chest radiography results for the evaluation of pneumonia are prevalent. A chest radiography impression using the strongest language in support of a pneumonia diagnosis is useful to rule in pneumonia radiographically, but a negative result performs poorly at ruling out disease.

THE HIGH COST OF LOW VALUE CARE.

The main focus of this study is bridging the "evidence gap" between frontline decision-making in health care and the actual evidence, with the hope of reducing unnecessary diagnostic testing and treatments. From our work in pulmonary embolism (PE) and over ordering of computed tomography pulmonary angiography, we integrated the highly validated Wells' criteria into the electronic health record at two of our major academic tertiary hospitals. The Wells' clinical decision support tool triggered for patients being evaluated for PE and therefore determined a patients' pretest probability for having a PE. There were 12,759 patient visits representing 11,836 patients, 51% had no D-dimer, 41% had a negative D-dimer, and 9% had a positive D-dimer. Our study gave us an opportunity to determine which patients were very low probabilities for PE, with no need for further testing.

Discrimination and Calibration of Clinical Prediction Models: Users' Guides to the Medical Literature.

Accurate information regarding prognosis is fundamental to optimal clinical care. The best approach to assess patient prognosis relies on prediction models that simultaneously consider a number of prognostic factors and provide an estimate of patients' absolute risk of an event. Such prediction models should be characterized by adequately discriminating between patients who will have an event and those who will not and by adequate calibration ensuring accurate prediction of absolute risk. This Users' Guide will help clinicians understand the available metrics for assessing discrimination, calibration, and the relative performance of different prediction models. This article complements existing Users' Guides that address the development and validation of prediction models. Together, these guides will help clinicians to make optimal use of existing prediction models.

An Electronic Adherence Measurement Intervention to Reduce Clinical Inertia in the Treatment of Uncontrolled Hypertension: The MATCH Cluster Randomized Clinical Trial.

BACKGROUND: To appropriately manage uncontrolled hypertension, clinicians must decide whether blood pressure (BP) is above goal due to a need for additional medication or to medication nonadherence. Yet, clinicians are poor judges of adherence, and uncertainty about adherence may promote inertia with respect to medication modification. OBJECTIVE: We aimed to determine the effect of sharing electronically-measured adherence data with clinicians on the management of uncontrolled hypertension. DESIGN: This was a cluster randomized trial. PARTICIPANTS: Twenty-four primary care providers (12 intervention, 12 usual care; cluster units) and 100 patients with uncontrolled hypertension (65 intervention, 35 usual care) were included in the study. INTERVENTIONS: At one visit per patient, clinicians in the intervention group received a report summarizing electronically measured adherence to the BP regimen and recommended clinical actions. Clinicians in the control group did not receive a report. MAIN MEASURES: The primary outcome was the proportion of visits with appropriate clinical management (i.e., treatment intensification among adherent patients and adherence counseling among nonadherent patients). Secondary outcomes included patient-rated quality of care and communication during the visit. KEY RESULTS: The proportion of visits with appropriate clinical management was higher in the intervention group than the control group (45 out of 65; 69 %) versus (12 out of 35; 34 %; p = 0.001). A higher proportion of adherent patients in the intervention group had their regimen intensified (p = 0.01), and a higher proportion of nonadherent patients in the intervention group received adherence counseling (p = 0.005). Patients in the intervention group were more likely to give their clinician high ratings on quality of care (p = 0.05), and on measures of patient-centered (p = 0.001) and collaborative communication (p = 0.02). CONCLUSIONS: Providing clinicians with electronically-measured antihypertensive adherence reports reduces inertia in the management of uncontrolled hypertension. TRIAL REGISTRATION: NCT01257347 ; http://clinicaltrials.gov/show/ NCT01257347.

Avoiding alert fatigue in pulmonary embolism decision support: a new method to examine 'trigger rates'.

A clinical decision support system (CDSS) is integrated into the electronic health record (EHR) and allows physicians to easily use a clinical decision support (CDS) tool. However, often CDSSs are integrated into the EHR with poor adoption rates. One reason for this is secondary to 'trigger fatigue'. Therefore, we developed a new and innovative usability process named 'sensitivity and specificity trigger analysis' (SSTA) as part of our larger project around a pulmonary embolism decision support tool. SSTA will enable programmers to examine optimal trigger rates prior to the integration of a CDS tool into the EHR, by using a formal method of analysis. We performed a retrospective chart review. The outcome of interest was physician ordering of a CT angiography (CTA). Phrases that signify common symptoms associated with pulmonary embolism were assessed as possible triggers for the CDSS tool. We then analysed each trigger's ability to predict physician ordering of a CTA. We found that the most sensitive way to trigger the Pulmonary Embolism CDS tool while still maintaining a high specificity was by combining 1 or more pertinent symptoms with 1 or more elements of the Wells criteria. This study explored a unique methodology, SSTA, used to limit inaccurate triggering of a CDS tool prior to integration into the EHR. This methodology can be applied to other studies aiming to decrease triggering rates and increase adoption rates of previously validated CDSS tools.

Formative assessment and design of a complex clinical decision support tool for pulmonary embolism.

Electronic health record (EHR)-based clinical decision support (CDS) tools are rolled out with the urgency to meet federal requirements without time for usability testing and refinement of the user interface. As part of a larger project to design, develop and integrate a pulmonary embolism CDS tool for emergency physicians, we conducted a formative assessment to determine providers' level of interest and input on designs and content. This was a study to conduct a formative assessment of emergency medicine (EM) physicians that included focus groups and key informant interviews. The focus of this study was twofold, to determine the general attitude towards CDS tool integration and the ideal integration point into the clinical workflow. To accomplish this, we first approached EM physicians in a focus group, then, during key informant interviews, we presented workflow designs and gave a scenario to help the providers visualise how the CDS tool works. Participants were asked questions regarding the trigger location, trigger words, integration into their workflow, perceived utility and heuristic of the tool. Results from the participants' survey responses to trigger location, perceived utility and efficiency, indicated that the providers felt the tool would be more of a hindrance than an aid. However, some providers commented that they had not had exposure to CDS tools but had used online calculators, and thought the tools would be helpful at the point-of-care if integrated into the EHR. Furthermore, there was a preference for an order entry wireframe. This study highlights several factors to consider when designing CDS tools: (1) formative assessment of EHR functionality and clinical environment workflow, (2) focus groups and key informative interviews to incorporate providers' perceptions of CDS and workflow integration and/or (3) the demonstration of proposed workflows through wireframes to help providers visualise design concepts.

Longitudinal adoption rates of complex decision support tools in primary care.

Translating research findings into practice promises to standardise care. Translation includes the integration of evidence-based guidelines at the point of care, discerning the best methods to disseminate research findings and models to sustain the implementation of best practices.By applying usability testing to clinical decision support(CDS) design, overall adoption rates of 60% can be realised.What has not been examined is how long adoption rates are sustained and the characteristics associated with long-term use. We conducted secondary analysis to decipher the factors impacting sustained use of CD Stools. This study was a secondary data analysis from a clinical trial conducted at an academic institution in New York City. Study data was identified patients electronic health records (EHR). The trial was to test the implementation of an integrated clinical prediction rule(iCPR) into the EHR. The primary outcome variable was iCPR tool acceptance of the tool. iCPR tool completion and iCPR smartest completion were additional outcome variables of interest. The secondary aim was to examine user characteristics associated with iCPR tool use in later time periods. Characteristics of interest included age, resident year, use of electronic health records (yes/no) and use of best practice alerts (BPA) (yes/no). Generalised linear mixed models (GLiMM) were used to compare iCPR use over time for each outcome of interest: namely, iCPR acceptance, iCPR completion and iCPR smartset completion.GLiMM was also used to examine resident characteristics associated with iCPR tool use in later time periods; specifically, intermediate and long-term (ie, 90+days). The tool was accepted, on average, 82.18% in the first 90 days (short-term period). The use decreases to 56.07% and 45.61% in intermediate and long-term time periods, respectively. There was a significant association between iCPR tool completion and time periods(p<0.0001). There was no significant difference in iCPR tool completion between resident encounters in the intermediate and long-term periods (p<0.6627). There was a significant association between iCPR smartset completion and time periods (p<0.0021). There were no significant associations between iCPR smartest completion and any of the four predictors of interest. We examined the frequencies of components of the iCPR tool being accepted over time by individual clinicians. Rates of adoption of the different components of the tool decreased substantially over time. The data suggest that over time and prolonged exposure to CDS tools, providers are less likely to utilise the tool. It is not clear if it is fatigue with the CDS tool, acquired knowledge of the clinical prediction rule, or gained clinical experience and gestalt that are influencing adoption rates. Further analysis of individual adoption rates over time and the impact it has on clinical outcomes should be conducted.

Implementation of culturally targeted patient navigation system for screening colonoscopy in a direct referral system.

Low-income minorities often face system-based and personal barriers to screening colonoscopy (SC). Culturally targeted patient navigation (CTPN) programs employing professional navigators (Pro-PNs) or community-based peer navigators (Peer-PNs) can help overcome barriers but are not widely implemented. In East Harlem, NY, USA, where approximately half the residents participate in SC, 315 African American patients referred for SC at a primary care clinic with a Direct Endoscopic Referral System were recruited between May 2008 and May 2010. After medical clearance, 240 were randomized to receive CTPN delivered by a Pro-PN (n = 106) or Peer-PN (n = 134). Successful navigation was measured by SC adherence rate, patient satisfaction and navigator trust. Study enrollment was 91.4% with no significant differences in SC adherence rates between Pro-PN (80.0%) and Peer-PN (71.3%) (P = 0.178). Participants in both groups reported high levels of satisfaction and trust. These findings suggest that CTPN Pro-PN and Peer-PN programs are effective in this urban primary care setting. We detail how we recruited and trained navigators, how CTPN was implemented and provide a preliminary answer to our questions of the study aims: can peer navigators be as effective as professionals and what is the potential impact of patient navigation on screening adherence?

Disseminating child abuse clinical decision support among commercial electronic health records: Effects on clinical practice.

Objectives: The use of electronic health record (EHR)-embedded child abuse clinical decision support (CA-CDS) may help decrease morbidity from child maltreatment. We previously reported on the development of CA-CDS in Epic and Allscripts. The objective of this study was to implement CA-CDS into Epic and Allscripts and determine its effects on identification, evaluation, and reporting of suspected child maltreatment. Materials and Methods: After a preimplementation period, CA-CDS was implemented at University of Wisconsin (Epic) and Northwell Health (Allscripts). Providers were surveyed before the go-live and 4 months later. Outcomes included the proportion of children who triggered the CA-CDS system, had a positive Child Abuse Screen (CAS) and/or were reported to Child Protective Services (CPS). Results: At University of Wisconsin (UW), 3.5% of children in the implementation period triggered the system. The CAS was positive in 1.8% of children. The proportion of children reported to CPS increased from 0.6% to 0.9%. There was rapid uptake of the abuse order set.At Northwell Health (NW), 1.9% of children in the implementation period triggered the system. The CAS was positive in 1% of children. The child abuse order set was rarely used. Preimplementation, providers at both sites were similar in desire to have CA-CDS system and perception of CDS in general. After implementation, UW providers had a positive perception of the CA-CDS system, while NW providers had a negative perception. Discussion: CA-CDS was able to be implemented in 2 different EHRs with differing effects on clinical care and provider feedback. At UW, the site with higher uptake of the CA-CDS system, the proportion of children who triggered the system and the rate of positive CAS was similar to previous studies and there was an increase in the proportion of cases of suspected abuse identified as measured by reports to CPS. Our data demonstrate how local environment, end-users' opinions, and limitations in the EHR platform can impact the success of implementation. Conclusions: When disseminating CA-CDS into different hospital systems and different EHRs, it is critical to recognize how limitations in the functionality of the EHR can impact the success of implementation. The importance of collecting, interpreting, and responding to provider feedback is of critical importance particularly with CDS related to child maltreatment.

Integrating Clinical Decision Support Into Electronic Health Record Systems Using a Novel Platform (EvidencePoint): Developmental Study.

BACKGROUND: Through our work, we have demonstrated how clinical decision support (CDS) tools integrated into the electronic health record (EHR) assist providers in adopting evidence-based practices. This requires confronting technical challenges that result from relying on the EHR as the foundation for tool development; for example, the individual CDS tools need to be built independently for each different EHR. OBJECTIVE: The objective of our research was to build and implement an EHR-agnostic platform for integrating CDS tools, which would remove the technical constraints inherent in relying on the EHR as the foundation and enable a single set of CDS tools that can work with any EHR. METHODS: We developed EvidencePoint, a novel, cloud-based, EHR-agnostic CDS platform, and we will describe the development of EvidencePoint and the deployment of its initial CDS tools, which include EHR-integrated applications for clinical use cases such as prediction of hospitalization survival for patients with COVID-19, venous thromboembolism prophylaxis, and pulmonary embolism diagnosis. RESULTS: The results below highlight the adoption of the CDS tools, the International Medical Prevention Registry on Venous Thromboembolism-D-Dimer, the Wells' criteria, and the Northwell COVID-19 Survival (NOCOS), following development, usability testing, and implementation. The International Medical Prevention Registry on Venous Thromboembolism-D-Dimer CDS was used in 5249 patients at the 2 clinical intervention sites. The intervention group tool adoption was 77.8% (4083/5249 possible uses). For the NOCOS tool, which was designed to assist with triaging patients with COVID-19 for hospital admission in the event of constrained hospital resources, the worst-case resourcing scenario never materialized and triaging was never required. As a result, the NOCOS tool was not frequently used, though the EvidencePoint platform's flexibility and customizability enabled the tool to be developed and deployed rapidly under the emergency conditions of the pandemic. Adoption rates for the Wells' criteria tool will be reported in a future publication. CONCLUSIONS: The EvidencePoint system successfully demonstrated that a flexible, user-friendly platform for hosting CDS tools outside of a specific EHR is feasible. The forthcoming results of our outcomes analyses will demonstrate the adoption rate of EvidencePoint tools as well as the impact of behavioral economics "nudges" on the adoption rate. Due to the EHR-agnostic nature of EvidencePoint, the development process for additional forms of CDS will be simpler than traditional and cumbersome IT integration approaches and will benefit from the capabilities provided by the core system of EvidencePoint.