Transforming patient-centered cancer care using telehealth: the MATCHES Center.

Modern cancer care is costly and logistically burdensome for patients and their families despite an expansion of technology and medical advances that create the opportunity for novel approaches to care. Therefore, there is a growing appreciation for the need to leverage these innovations to make cancer care more patient centered and convenient. The Memorial Sloan Kettering Making Telehealth Delivery of Cancer Care at Home Efficient and Safe Telehealth Research Center is a National Cancer Institute-designated and funded Telehealth Research Center of Excellence poised to generate the evidence necessary to inform the appropriate use of telehealth as a strategy to improve access to cancer services that are convenient for patients. The center will evaluate telehealth as a strategy to personalize cancer care delivery to ensure that it is not only safe and effective but also convenient and efficient. In this article, we outline this new center's research strategy, as well as highlight challenges that exist in further integrating telehealth into standard oncology practice based on early experiences.

Opportunities and Challenges for Augmented Reality in Family Caregiving: Qualitative Video Elicitation Study.

BACKGROUND: Although family caregivers play a critical role in care delivery, research has shown that they face significant physical, emotional, and informational challenges. One promising avenue to address some of caregivers' unmet needs is via the design of digital technologies that support caregivers' complex portfolio of responsibilities. Augmented reality (AR) applications, specifically, offer new affordances to aid caregivers as they perform care tasks in the home. OBJECTIVE: This study explored how AR might assist family caregivers with the delivery of home-based cancer care. The specific objectives were to shed light on challenges caregivers face where AR might help, investigate opportunities for AR to support caregivers, and understand the risks of AR exacerbating caregiver burdens. METHODS: We conducted a qualitative video elicitation study with clinicians and caregivers. We created 3 video elicitations that offer ways in which AR might support caregivers as they perform often high-stakes, unfamiliar, and anxiety-inducing tasks in postsurgical cancer care: wound care, drain care, and rehabilitative exercise. The elicitations show functional AR applications built using Unity Technologies software and Microsoft Hololens2. Using elicitations enabled us to avoid rediscovering known usability issues with current AR technologies, allowing us to focus on high-level, substantive feedback on potential future roles for AR in caregiving. Moreover, it enabled nonintrusive exploration of the inherently sensitive in-home cancer care context. RESULTS: We recruited 22 participants for our study: 15 clinicians (eg, oncologists and nurses) and 7 family caregivers. Our findings shed light on clinicians' and caregivers' perceptions of current information and communication challenges caregivers face as they perform important physical care tasks as part of cancer treatment plans. Most significant was the need to provide better and ongoing support for execution of caregiving tasks in situ, when and where the tasks need to be performed. Such support needs to be tailored to the specific needs of the patient, to the stress-impaired capacities of the caregiver, and to the time-constrained communication availability of clinicians. We uncover opportunities for AR technologies to potentially increase caregiver confidence and reduce anxiety by supporting the capture and review of images and videos and by improving communication with clinicians. However, our findings also suggest ways in which, if not deployed carefully, AR technologies might exacerbate caregivers' already significant burdens. CONCLUSIONS: These findings can inform both the design of future AR devices, software, and applications and the design of caregiver support interventions based on already available technology and processes. Our study suggests that AR technologies and the affordances they provide (eg, tailored support, enhanced monitoring and task accuracy, and improved communications) should be considered as a part of an integrated care journey involving multiple stakeholders, changing information needs, and different communication channels that blend in-person and internet-based synchronous and asynchronous care, illness, and recovery.

Digitally Enabled Transitional Care Management in Oncology.

PURPOSE: Improving care transitions for patients with cancer discharged from the hospital is considered an important component of quality care. Digital monitoring has the potential to better the delivery of transitional care through improved patient-provider communication and enhanced symptom management. However, remote patient monitoring (RPM) interventions have not been widely implemented for oncology patients after discharge, an innovative setting in which to apply this technology. METHODS: We implemented a RPM intervention which identifies medical oncology patients at discharge, monitors their symptoms for 10 days, and intervenes as necessary to manage symptoms. We evaluated the feasibility (>50% patient engagement with symptom assessment), appropriateness (symptom alerts), and acceptability (net promoter score >0.7) of the intervention and the initial effect on acute care visits and return on investment. RESULTS: During the study period, January 1, 2021, to December 31, 2022, we evaluated 2,257 medical oncology discharges representing 1,857 unique patients. We found that 65.9% of patients discharged (N = 1,489) completed at least one symptom assessment postdischarge and of them, 45.5% (n = 678) generated a severe symptom alert that we helped to manage. Patients expressed high satisfaction with the intervention with a net promoter score of 84%. In preliminary analysis of patients with GI malignancies (n = 449), we found a nonsignificant decrease in 30-day readmissions for the intervention cohort (n = 269) by 5.8% as compared with the control (n = 180; from 33.3% to 27.5%; P = .22). CONCLUSION: Digital transitional care management was feasible and demonstrated that patients transitioning from the hospital to home have a substantial symptom burden. The intervention was associated with high patient satisfaction but will require further refinement and evaluation to increase its impact on 30-day readmission.

Telemedicine and Cancer Care: Barriers and Strategies to Optimize Delivery.

ABSTRACT: Telemedicine holds the potential to transform cancer care delivery and optimize value, access, and quality of care. A transformed regulatory environment coupled with the need to continue medical care despite operational limitations led to the rapid expansion of telemedicine in cancer care during the COVID-19 pandemic. Its utilization has since varied, and it has faced significant challenges. In this review, we will explore the state of telemedicine in cancer care delivery, the challenges it faces, and strategies to enhance its successful implementation.

Persistence of Telemedicine Usage for Breast and Prostate Cancer after the Peak of the COVID-19 Pandemic.

While COVID-19 catalyzed a shift to telemedicine, little is known about the persistence of remote cancer care in non-emergent times. We assessed telemedicine use at a high-volume academic cancer center in New York City and analyzed breast and prostate cancer visits pre-COVID-19, peak COVID-19, and post-peak. Descriptive statistics assessed visit mode (in person, telemedicine) and type (new, follow-up, other) by department/specialty, with Fisher's exact tests comparing peak/post-peak differences. The study included 602,233 visits, with telemedicine comprising 2% of visits pre-COVID-19, 50% peak COVID-19, and 30% post-peak. Notable variations emerged by department/specialty and visit type. Post-peak, most departments/specialties continued using telemedicine near or above peak levels, except medicine, neurology, and survivorship, where remote care fell. In psychiatry, social work, and nutrition, nearly all visits were conducted remotely during and after peak COVID-19, while surgery and nursing maintained low telemedicine usage. Post-peak, anesthesiology and neurology used telemedicine seldom for new visits but often for follow-ups, while nursing showed the opposite pattern. These trends suggest department- and visit-specific contexts where providers and patients choose telemedicine in non-emergent conditions. More research is needed to explore these findings and evaluate telemedicine's appropriateness and impact across the care continuum.

Electronic consent in clinical care: an international scoping review.

OBJECTIVE: Digital technologies create opportunities for improvement of consenting processes in clinical care. Yet little is known about the prevalence, characteristics or outcomes of shifting from paper to electronic consenting, or e-consent, in clinical settings. Thus questions remain around e-consent's impact on efficiency, data integrity, user experience, care access, equity and quality. Our objective was to scope all known findings on this critical topic. MATERIALS AND METHODS: Through an international, systematic scoping review, we identified and assessed all published findings on clinical e-consent in the scholarly and grey literatures, including consents for telehealth encounters, procedures and health information exchanges. From each relevant publication, we abstracted data on study design, measures, findings and other study features. MAIN OUTCOME MEASURES: Metrics describing or evaluating clinical e-consent, including preferences for paper versus e-consenting; efficiency (eg, time, workload) and effectiveness (eg, data integrity, care quality). User characteristics were captured where available. RESULTS: A total of 25 articles published since 2005, most from North America or Europe, report on the deployment of e-consent in surgery, oncology and other clinical settings. Experimental designs and other study characteristics vary, but nearly all focus on procedural e-consents. Synthesis reveals relatively consistent findings around improved efficiency and data integrity with, and user preferences for, e-consent. Care access and quality issues are less frequently explored, with disparate findings. DISCUSSION AND CONCLUSION: The literature is nascent and largely focused on issues that are immediate and straightforward to measure. As virtual care pathways expand, more research is urgently needed to ensure that care quality and access are advanced, not compromised, by e-consent.

Electronic Consent at US Cancer Centers: A Survey of Practices, Challenges, and Opportunities.

PURPOSE: Digital technologies create opportunities for improving consenting processes in cancer care and research. Yet, little is known about the prevalence of electronic consenting, or e-consent, at US cancer care institutions. METHODS: We surveyed institutions in the National Comprehensive Cancer Network about their capabilities for clinical, research, and administrative e-consents; technologies used; telemedicine consents; multilingual support; evaluations; and opportunities and challenges in moving from paper-based to electronic processes. Responses were summarized across responding institutions. RESULTS: Twenty-five institutions completed the survey (81% response rate). Respondents were from all census regions and included freestanding and matrix cancer centers. Twenty (80%) had e-consent capabilities, with variability in the extent of adoption: One (5%) had implemented e-consent for all clinical, research, and administrative needs while 19 (95%) had a mix of paper and electronic consenting. Among those with e-consent capabilities, the majority (14 of 20, 70%) were using features embedded in their electronic health record. Most had a combination of paper and e-consenting for clinical purposes (18, 72%). About two-thirds relied entirely on paper for research consents (16, 64%) but had at least some electronic processes for administrative consents (15, 60%). Obstacles to e-consenting included challenges with procuring or maintaining hardware, content management, workflow integration, and digital literacy of patients. Successes included positive user experiences, workflow improvements, and better record-keeping. Only two of 20 (10%) respondents with e-consent capabilities had evaluated the impact of automating consent processes. CONCLUSION: E-consent was prevalent in our sample, with 80% of institutions reporting at least some capabilities. Further progress is needed for the benefits of e-consenting to be realized broadly.

Assessment of Oncology Patient Engagement and Interest in Virtual Mind-Body Programming: Moving Toward Personalization of Virtual Care.

PURPOSE: Accelerated by the COVID-19 pandemic, the virtual platform has become a prominent medium to deliver mind-body therapies, but the extent to which patients engage in virtual mind-body programming remains unclear. This study aims to assess oncology patient engagement in a virtual mind-body program. METHODS: We surveyed oncology patients enrolled in a live-streamed (synchronous) virtual mind-body program in May 2021. Patients self-reported engagement by weekly attendance. We applied multivariate regression to identify associations of engagement with sociodemographic and clinical factors. As an exploratory analysis, we used machine learning to partition engagement subgroups to determine preferential interest in prerecorded (asynchronous) mind-body therapy videos. RESULTS: Among 148 patients surveyed (response rate: 21.4%), majority were female (94.5%), White (83.1%), age 65 years or older (64.9%), retired (64.2%), and in survivorship (61.8%). Patient engagement ranged from 1 to 13 classes/week (mean [standard deviation]: 4.23 [2.56]) and was higher for female (ß, .82; 95% CI, 0.01 to 1.62), non-White (ß, .63; 95% CI, 0.13 to 1.13), and retired patients (ß, .50; 95% CI, 0.12 to 0.88). The partition model identified three engagement subgroups: employed (low engagers), retired White (intermediate engagers), and retired non-White (high engagers). Particularly, low engagers had preferential interest in meditation videos (odds ratio, 2.85; 95% CI, 1.24 to 6.54), and both low and high engagers had preferential interest in Tai Chi videos (odds ratio, 2.26; 95% CI, 1.06 to 4.82). CONCLUSION: In this cross-sectional study among oncology patients, engagement in virtual mind-body programming was higher for female, non-White, and retired patients. Our findings suggest the need for both synchronous and asynchronous mind-body programming to meet the diverse needs of oncology patients.

Digitalizing the Clinical Research Informed Consent Process: Assessing the Participant Experience in Comparison With Traditional Paper-Based Methods.

PURPOSE: Consent processes are critical for clinical care and research and may benefit from incorporating digital strategies. We compared an electronic informed consent (eIC) option to paper consent across four outcomes: (1) technology burden, (2) protocol comprehension, (3) participant agency (ability to self-advocate), and (4) completion of required document fields. METHODS: We assessed participant experience with eIC processes compared with traditional paper-based consenting using surveys and compared completeness of required fields, over 3 years (2019-2021). Participants who consented to a clinical trial at a large academic cancer center via paper or eIC were invited to either pre-COVID-19 pandemic survey 1 (technology burden) or intrapandemic survey 2 (comprehension and agency). Consent document completeness was assessed via electronic health records. RESULTS: On survey 1, 83% of participants (n = 777) indicated eIC was easy or very easy to use; discomfort with technology overall was not correlated with discomfort using eIC. For survey 2, eIC (n = 262) and paper consenters (n = 193) had similar comprehension scores. All participants responded favorably to at least five of six agency statements; however, eIC generated a higher proportion of positive free-text comments (P < .05), with themes such as thoroughness of the discussion and consenter professionalism. eIC use yielded no completeness errors across 235 consents versus 6.4% for paper (P < .001). CONCLUSION: Our findings suggest that eIC when compared with paper (1) did not increase technology burden, (2) supported comparable comprehension, (3) upheld key elements of participant agency, and (4) increased completion of mandatory consent fields. The results support a broader call for organizations to offer eIC for clinical research discussions to enhance the overall participant experience and increase the completeness of the consent process.

Analysis of a Remote Monitoring Program for Symptoms Among Adults With Cancer Receiving Antineoplastic Therapy.

IMPORTANCE: Electronic patient-reported outcomes (ePROs) may have the potential to improve cancer care delivery by enhancing patient quality of life, reducing acute care visits, and extending overall survival. However, the optimal cadence of ePRO assessments is unknown. OBJECTIVE: To determine patient response preferences and the clinical value associated with a daily cadence for ePROs for patients receiving antineoplastic treatment. DESIGN, SETTING, AND PARTICIPANTS: This quality improvement study of adult patients undergoing antineoplastic treatment assessed a remote monitoring program using ePROs that was developed to manage cancer therapy-related symptoms. ePRO data submitted between October 16, 2018 to February 29, 2020, from a single regional site within the Memorial Sloan Kettering Cancer Center network were included. Data were analyzed from April 2020 to January 2022. EXPOSURE: While undergoing active treatment, patients received a daily ePRO assessment that, based on patient responses, generated yellow (moderate) or red (severe) symptom alerts that were sent to clinicians. MAIN OUTCOMES AND MEASURES: The main outcomes assessed included patient response rate, symptom alert frequency, and an analysis of the clinical value of daily ePROs. RESULTS: A total of 217 patients (median [range] age, 66 [31-92] years; 103 [47.5%] women and 114 [52.5%] men) initiating antineoplastic therapy at high risk for symptoms were monitored for a median (range) of 91 (2-369) days. Most patients had thoracic (59 patients [27.2%]), head and neck (48 patients [22.1%]), or gastrointestinal (43 patients [19.8%]) malignant neoplasms. Of 14 603 unique symptom assessments completed, 7349 (50.3%) generated red or yellow symptom alerts. Symptoms commonly generating alerts included pain (665 assessments [23.0%]) and functional status (465 assessments [16.1%]). Most assessments (8438 assessments [57.8%]) were completed at home during regular clinic hours (ie, 9 am-5 pm), with higher response rates on weekdays (58.4%; 95% CI, 57.5%-59.5%) than on weekend days (51.3%; 95% CI, 49.5%-53.1%). Importantly, 284 of 630 unique red alerts (45.1%) surfaced without a prior yellow alert for the same symptom within the prior 7 days; symptom severity fluctuated over the course of a week, and symptom assessments generating a red alert were followed by an acute care visit within 7 days 8.7% of the time compared with 2.9% for assessments without a red alert. CONCLUSIONS AND RELEVANCE: These findings suggest that daily ePRO assessments were associated with increased insight into symptom management in patients undergoing antineoplastic treatment and symptom alerts were associated with risk of acute care.

ChemoPalRx-A Mobile App That Enhances Chemotherapy Prescription Accuracy: A Cross-Sectional Study.

PURPOSE: ChemoPalRx is a novel provider order entry mobile application for chemotherapy. This study aims to evaluate the accuracy of prescribing chemotherapy using ChemoPalRx versus handwritten orders at a safety-net hospital in Los Angeles. METHODS: In a cross-sectional study from October 2019 to December 2019, we evaluated all outpatient chemotherapy orders for accuracy. Our primary predictor was type of prescription, dichotomized as handwritten or ChemoPalRx. Primary outcome was accuracy, dichotomized as accurate if no error was made on an order and as inaccurate if any error was made. Preplanned subgroup analyses were performed with covariates including provider experience, complexity of order, and day of order submission. We characterized error type and analyzed our data using univariate and multivariate logistic regression models. RESULTS: Among 288 orders (78.5% handwritten; 21.5% ChemoPalRx), prescription accuracy was higher among ChemoPalRx (93.5%) compared with handwritten orders (81.4%; P = .012). In multivariate analysis, prescription accuracy remained superior for ChemoPalRx after adjusting for provider experience, complexity of order, and day of order submission (adjusted odds ratio, 1.82; P = .012). Compared with handwritten orders, ChemoPalRx orders had less missing or incorrect information (1.6% v 13.7%; P = .0016). ChemoPalRx orders were also more accurate on prescriptions that contained two or fewer medications (92.2% v 80.2%; P = .032), submitted on the highest patient-volume clinic day of the week (96.7% v 83.2%; P = .035), and generated by a senior fellow or an attending (97.3% v 76.9%; P = .001). CONCLUSION: ChemoPalRx is associated with improved chemotherapy prescription accuracy over handwritten orders in the safety-net hospital setting and may serve as an alternative prescribing tool for oncology practices.

Needs and Perspectives of Cancer Center Stakeholders for Access to Patient Values in the Electronic Health Record.

PURPOSE: High-quality cancer care must incorporate patients' personal values in decision making throughout illness. Unfortunately, patient values are neither consistently elicited nor easily accessible in the electronic health record (EHR). Memorial Sloan Kettering Cancer Center is deploying a major EHR innovation, called the Patient Values Tab, which provides ready access to patients' values and personhood. To inform the Tab's design, we interviewed a large, diverse group of institutional stakeholders to understand their user needs for this Tab. METHODS: Qualitative data were collected through semistructured, audio-recorded, in-person, individual interviews. An interdisciplinary team of four coders conducted a process of thematic content analysis. Thematic saturation was achieved, and member checking was performed. RESULTS: A total of 110 stakeholders were approached and interviewed. Participants comprised a wide range of disciplines or professions and others involved in hospital and/or clinic administration. Analysis revealed the following themes related to important Tab content: personhood, support system or resources, social history, communication preferences, future planning, end of life, and illness and treatment understanding. Participants also discussed implementation considerations, the Tab's potential to improve communication, and privacy implications. CONCLUSION: This study focused on a major EHR innovation to centralize information about values and personhood of patients with cancer. We elicited views of over 100 institutional stakeholders through in-depth interviews that were rigorously analyzed, yielding themes related to content and format that helped guide the Tab's design. The interviews generated a sense of ownership and enthusiasm for the Tab among future users. The Tab's introduction advances the use of the EHR as a driver of the delivery of patient-centered care.

A Novel Patient Values Tab for the Electronic Health Record: A User-Centered Design Approach.

BACKGROUND: The COVID-19 pandemic has shined a harsh light on a critical deficiency in our health care system: our inability to access important information about patients' values, goals, and preferences in the electronic health record (EHR). At Memorial Sloan Kettering Cancer Center (MSK), we have integrated and systematized health-related values discussions led by oncology nurses for newly diagnosed cancer patients as part of routine comprehensive cancer care. Such conversations include not only the patient's wishes for care at the end of life but also more holistic personal values, including sources of strength, concerns, hopes, and their definition of an acceptable quality of life. In addition, health care providers use a structured template to document their discussions of patient goals of care. OBJECTIVE: To provide ready access to key information about the patient as a person with individual values, goals, and preferences, we undertook the creation of the Patient Values Tab in our center's EHR to display this information in a single, central location. Here, we describe the interprofessional, interdisciplinary, iterative process and user-centered design methodology that we applied to build this novel functionality as well as our initial implementation experience and plans for evaluation. METHODS: We first convened a working group of experts from multiple departments, including medical oncology, health informatics, information systems, nursing informatics, nursing education, and supportive care, and a user experience designer. We conducted in-depth, semistructured, audiorecorded interviews of over 100 key stakeholders. The working group sought consensus on the tab's main content, homing in on high-priority areas identified by the stakeholders. The core content was mapped to various EHR data sources. We established a set of high-level design principles to guide our process. Our user experience designer then created wireframes of the tab design. The designer conducted usability testing with physicians, nurses, and other health professionals. Data validation testing was conducted. RESULTS: We have already deployed the Patient Values Tab to a pilot sample of users in the MSK Gastrointestinal Medical Oncology Service, including physicians, advanced practice providers, nurses, and administrative staff. We have early evidence of the positive impact of this EHR innovation. Audit logs show increasing use. Many of the initial user comments have been enthusiastically positive, while others have provided constructive suggestions for additional tab refinements with respect to format and content. CONCLUSIONS: It is our challenge and obligation to enrich the EHR with information about the patient as a person. Realization of this capability is a pressing public health need requiring the collaboration of technological experts with a broad range of clinical leaders, users, patients, and families to achieve solutions that are both principled and practical. Our new Patient Values Tab represents a step forward in this important direction.

InSight Care Pilot Program: Redefining Seeing a Patient.

PURPOSE: Early detection and management of symptoms in patients with cancer improves outcomes. However, the optimal approach to symptom monitoring and management is unknown. InSight Care is a mobile health intervention that captures symptom data and facilitates patient-provider communication to mitigate symptom escalation. PATIENTS AND METHODS: Patients initiating antineoplastic treatment at a Memorial Sloan Kettering regional location were eligible. Technology supporting the program included the following: a predictive model that identified patient risk for a potentially preventable acute care visit; a secure patient portal enabling communication, televisits, and daily delivery of patient symptom assessments; alerts for concerning symptoms; and a symptom-trending application. The main outcomes of the pilot were feasibility and acceptability evaluated through enrollment and response rates and symptom alerts, and perceived value evaluated on the basis of qualitative patient and provider interviews. RESULTS: The pilot program enrolled 100 high-risk patients with solid tumors and lymphoma (29% of new treatment starts v goal of 25%). Over 6 months of follow-up, the daily symptom assessment response rate was 56% (the goal was 50%), and 93% of patients generated a severe symptom alert. Patients and providers perceived value in the program, and archetypes were developed for program improvement. Enrolled patients were less likely to use acute care than were other high-risk patients. CONCLUSION: InSight Care was feasible and holds the potential to improve patient care and decrease facility-based care. Future work should focus on optimizing the cadence of patient assessments, the workforce supporting remote symptom management, and the return of symptom data to patients and clinical teams.

A new approach to integrating patient-generated data with expert knowledge for personalized goal setting: A pilot study.

INTRODUCTION: Self-monitoring technologies produce patient-generated data that could be leveraged to personalize nutritional goal setting to improve population health; however, most computational approaches are limited when applied to individual-level personalization with sparse and irregular self-monitoring data. We applied informatics methods from expert suggestion systems to a challenging clinical problem: generating personalized nutrition goals from patient-generated diet and blood glucose data. MATERIALS AND METHODS: We applied qualitative process coding and decision tree modeling to understand how registered dietitians translate patient-generated data into recommendations for dietary self-management of diabetes (i.e., knowledge model). We encoded this process in a set of functions that take diet and blood glucose data as an input and output diet recommendations (i.e., inference engine). Dietitians assessed face validity. Using four patient datasets, we compared our inference engine's output to clinical narratives and gold standards developed by expert clinicians. RESULTS: To dietitians, the knowledge model represented how recommendations from patient data are made. Inference engine recommendations were 63 % consistent with the gold standard (range = 42 %-75 %) and 74 % consistent with narrative clinical observations (range = 63 %-83 %). DISCUSSION: Qualitative modeling and automating how dietitians reason over patient data resulted in a knowledge model representing clinical knowledge. However, our knowledge model was less consistent with gold standard than narrative clinical recommendations, raising questions about how best to evaluate approaches that integrate patient-generated data with expert knowledge. CONCLUSION: New informatics approaches that integrate data-driven methods with expert decision making for personalized goal setting, such as the knowledge base and inference engine presented here, demonstrate the potential to extend the reach of patient-generated data by synthesizing it with clinical knowledge. However, important questions remain about the strengths and weaknesses of computer algorithms developed to discern signal from patient-generated data compared to human experts.

Applying User-Centered Design in the Electronic Health Record (EHR) to Facilitate Patient-Centered Care in Oncology.

Patient-centered care is an essential component of quality health care. To support patient-centered care initiatives at our institution, we created a feature in our EHR to centrally view information about the patient's values, goals and preferences. We applied user-centered design methods to ensure that the aggregate view was easy to use and would meet user needs. We created a six-week plan to iterate through increasingly detailed design mock-ups. We defined 7 user stories that later served as a basis for user testing scripts. We conducted user testing on our third design iteration; we reached theme saturation with 8 testing sessions. We incorporated findings into the fourth design (week 6) but continued to refine the design in parallel to development (through week 20+). The advance directives section required the most attention. We will use a pilot and additional user testing to validate the design and to inform future versions.

Interrupting providers with clinical decision support to improve care for heart failure.

BACKGROUND: Evidence-based therapy for heart failure remains underutilized at hospital discharge, particularly for patients with heart failure who are hospitalized for another cause. We developed clinical decision support (CDS) to recommend an angiotensin converting enzyme (ACE) inhibitor during hospitalization to promote its continuation at discharge. The CDS was designed to be implemented in both interruptive and non-interruptive versions. OBJECTIVES: To compare the effectiveness and implementation of interruptive and non-interruptive versions of a CDS to improve care for heart failure. METHODS: Hospitalizations of patients with reduced ejection fraction were pseudo-randomized to deliver interruptive or non-interruptive CDS alerts to providers based on even or odd medical record number. We compared discharge utilization of an ACE inhibitor or angiotensin receptor blocker (ARB) for these two implementation approaches. We also assessed adoption and implementation fidelity of the CDS. RESULTS: Of 958 hospitalizations, interruptive alert hospitalizations had higher rates of discharge utilization of ACE inhibitors or ARBs than non-interruptive alert hospitalizations (79.6% vs. 74.2%, p = 0.05). Utilization was higher for interruptive alert versus non-interruptive alert hospitalizations which were principally for causes other than heart failure (79.8% vs. 73.4%; p = 0.05) but no difference was observed among hospitalizations with a principal heart failure diagnosis (85.9% vs.81.7%; p = 0.49). As compared to non-interruptive hospitalizations, interruptive alert hospitalizations were more likely to have had: an alert with any response (40.6% vs. 13.1%, p < 0.001), contraindications reported (33.1% vs 11.3%, p < 0.001), and an ACE inhibitor ordered within twelve hours of the alert (17.6% vs 10.3%, p < 0.01). The response rate for the interruptive alert was 1.7%, and a median (25th, 75th percentile) of 14 (5,32) alerts were triggered per hospitalization. CONCLUSIONS: A CDS implemented as an interruptive alert was associated with improved quality of care for heart failure. Whether the potential benefits of CDS in improving cardiovascular care were worth the high burden of interruptive alerts deserves further consideration. CLINICALTRIALS. GOV IDENTIFIER: NCT02858674.

Interruptive Versus Noninterruptive Clinical Decision Support: Usability Study.

BACKGROUND: Clinical decision support (CDS) has been shown to improve compliance with evidence-based care, but its impact is often diminished because of issues such as poor usability, insufficient integration into workflow, and alert fatigue. Noninterruptive CDS may be less subject to alert fatigue, but there has been little assessment of its usability. OBJECTIVE: This study aimed to study the usability of interruptive and noninterruptive versions of a CDS. METHODS: We conducted a usability study of a CDS tool that recommended prescribing an angiotensin-converting enzyme inhibitor for inpatients with heart failure. We developed 2 versions of the CDS: an interruptive alert triggered at order entry and a noninterruptive alert listed in the sidebar of the electronic health record screen. Inpatient providers were recruited and randomly assigned to use the interruptive alert followed by the noninterruptive alert or vice versa in a laboratory setting. We asked providers to "think aloud" while using the CDS and then conducted a brief semistructured interview about usability. We used a constant comparative analysis informed by the CDS Five Rights framework to analyze usability testing. RESULTS: A total of 12 providers participated in usability testing. Providers noted that the interruptive alert was readily noticed but generally impeded workflow. The noninterruptive alert was felt to be less annoying but had lower visibility, which might reduce engagement. Provider role seemed to influence preferences; for instance, some providers who had more global responsibility for patients seemed to prefer the noninterruptive alert, whereas more task-oriented providers generally preferred the interruptive alert. CONCLUSIONS: Providers expressed trade-offs between impeding workflow and improving visibility with interruptive and noninterruptive versions of a CDS. In addition, 2 potential approaches to effective CDS may include targeting alerts by provider role or supplementing a noninterruptive alert with an occasional, well-timed interruptive alert.