An Audio Personal Health Library of Clinic Visit Recordings for Patients and Their Caregivers (HealthPAL): User-Centered Design Approach.

BACKGROUND: Providing digital recordings of clinic visits to patients has emerged as a strategy to promote patient and family engagement in care. With advances in natural language processing, an opportunity exists to maximize the value of visit recordings for patients by automatically tagging key visit information (eg, medications, tests, and imaging) and linkages to trustworthy web-based resources curated in an audio-based personal health library. OBJECTIVE: This study aims to report on the user-centered development of HealthPAL, an audio personal health library. METHODS: Our user-centered design and usability evaluation approach incorporated iterative rounds of video-recorded sessions from 2016 to 2019. We recruited participants from a range of community settings to represent older patient and caregiver perspectives. In the first round, we used paper prototypes and focused on feature envisionment. We moved to low-fidelity and high-fidelity versions of the HealthPAL in later rounds, which focused on functionality and use; all sessions included a debriefing interview. Participants listened to a deidentified, standardized primary care visit recording before completing a series of tasks (eg, finding where a medication was discussed in the recording). In the final round, we recorded the patients' primary care clinic visits for use in the session. Findings from each round informed the agile software development process. Task completion and critical incidents were recorded in each round, and the System Usability Scale was completed by participants using the digital prototype in later rounds. RESULTS: We completed 5 rounds of usability sessions with 40 participants, of whom 25 (63%) were women with a median age of 68 years (range 23-89). Feedback from sessions resulted in color-coding and highlighting of information tags, a more prominent play button, clearer structure to move between one's own recordings and others' recordings, the ability to filter recording content by the topic discussed and descriptions, 10-second forward and rewind controls, and a help link and search bar. Perceived usability increased over the rounds, with a median System Usability Scale of 78.2 (range 20-100) in the final round. Participants were overwhelmingly positive about the concept of accessing a curated audio recording of a clinic visit. Some participants reported concerns about privacy and the computer-based skills necessary to access recordings. CONCLUSIONS: To our knowledge, HealthPAL is the first patient-centered app designed to allow patients and their caregivers to access easy-to-navigate recordings of clinic visits, with key concepts tagged and hyperlinks to further information provided. The HealthPAL user interface has been rigorously co-designed with older adult patients and their caregivers and is now ready for further field testing. The successful development and use of HealthPAL may help improve the ability of patients to manage their own care, especially older adult patients who have to navigate complex treatment plans.

Using CollaboRATE, a brief patient-reported measure of shared decision making: Results from three clinical settings in the United States.

INTRODUCTION: CollaboRATE is a brief patient survey focused on shared decision making. This paper aims to (i) provide insight on facilitators and challenges to implementing a real-time patient survey and (ii) evaluate CollaboRATE scores and response rates across multiple clinical settings with varied patient populations. METHOD: All adult patients at three United States primary care practices were eligible to complete CollaboRATE post-visit. To inform key learnings, we aggregated all mentions of unanticipated decisions, problems and administration errors from field notes and email communications. Mixed-effects logistic regression evaluated the impact of site, clinician, patient age and patient gender on the CollaboRATE score. RESULTS: While CollaboRATE score increased only slightly with increasing patient age (OR 1.018, 95% CI 1.014-1.021), female patient gender was associated with significantly higher CollaboRATE scores (OR 1.224, 95% CI 1.073-1.397). Clinician also predicts CollaboRATE score (random effect variance 0.146). Site-specific factors such as clinical workflow and checkout procedures play a key role in successful in-clinic implementation and are significantly related to CollaboRATE scores, with Site 3 scoring significantly higher than Site 1 (OR 1.759, 95% CI 1.216 to 2.545) or Site 2 (z=-2.71, 95% CI -1.114 to -0.178). DISCUSSION: This study demonstrates that CollaboRATE can be used in diverse primary care settings. A clinic's workflow plays a crucial role in implementation. Patient experience measurement risks becoming a burden to both patients and administrators. Episodic use of short measurement tools could reduce this burden.

Evaluating CollaboRATE in a clinical setting: analysis of mode effects on scores, response rates and costs of data collection.

BACKGROUND: Shared decision-making (SDM) has become a policy priority, yet its implementation is not routinely assessed. To address this gap we tested the delivery of CollaboRATE, a 3-item patient reported experience measure of SDM, via multiple survey modes. OBJECTIVE: To assess CollaboRATE response rates and respondent characteristics across different modes of administration, impact of mode and patient characteristics on SDM performance and cost of administration per response in a real-world primary care practice. DESIGN: Observational study design, with repeated assessment of SDM performance using CollaboRATE in a primary care clinic over 15 months of data collection. Different modes of administration were introduced sequentially including paper, patient portal, interactive voice response (IVR) call, text message and tablet computer. PARTICIPANTS: Consecutive patients ≥18 years, or parents/guardians of patients <18 years, visiting participating primary care clinicians. MAIN MEASURES: CollaboRATE assesses three core SDM tasks: (1) explanation about health issues, (2) elicitation of patient preferences and (3) integration of patient preferences into decisions. Responses to each item range from 0 (no effort was made) to 9 (every effort was made). CollaboRATE scores are calculated as the proportion of participants who report a score of nine on each of the three CollaboRATE questions. KEY RESULTS: Scores were sensitive to mode effects: the paper mode had the highest average score (81%) and IVR had the lowest (61%). However, relative clinician performance rankings were stable across the different data collection modes used. Tablet computers administered by research staff had the highest response rate (41%), although this approach was costly. Clinic staff giving paper surveys to patients as they left the clinic had the lowest response rate (12%). CONCLUSIONS: CollaboRATE can be introduced using multiple modes of survey delivery while producing consistent clinician rankings. This may allow routine assessment and benchmarking of clinician and clinic SDM performance.

Sharing Annotated Audio Recordings of Clinic Visits With Patients-Development of the Open Recording Automated Logging System (ORALS): Study Protocol.

BACKGROUND: Providing patients with recordings of their clinic visits enhances patient and family engagement, yet few organizations routinely offer recordings. Challenges exist for organizations and patients, including data safety and navigating lengthy recordings. A secure system that allows patients to easily navigate recordings may be a solution. OBJECTIVE: The aim of this project is to develop and test an interoperable system to facilitate routine recording, the Open Recording Automated Logging System (ORALS), with the aim of increasing patient and family engagement. ORALS will consist of (1) technically proficient software using automated machine learning technology to enable accurate and automatic tagging of in-clinic audio recordings (tagging involves identifying elements of the clinic visit most important to patients [eg, treatment plan] on the recording) and (2) a secure, easy-to-use Web interface enabling the upload and accurate linkage of recordings to patients, which can be accessed at home. METHODS: We will use a mixed methods approach to develop and formatively test ORALS in 4 iterative stages: case study of pioneer clinics where recordings are currently offered to patients, ORALS design and user experience testing, ORALS software and user interface development, and rapid cycle testing of ORALS in a primary care clinic, assessing impact on patient and family engagement. Dartmouth's Informatics Collaboratory for Design, Development and Dissemination team, patients, patient partners, caregivers, and clinicians will assist in developing ORALS. RESULTS: We will implement a publication plan that includes a final project report and articles for peer-reviewed journals. In addition to this work, we will regularly report on our progress using popular relevant Tweet chats and online using our website, www.openrecordings.org. We will disseminate our work at relevant conferences (eg, Academy Health, Health Datapalooza, and the Institute for Healthcare Improvement Quality Forums). Finally, Iora Health, a US-wide network of primary care practices (www.iorahealth.com), has indicated a willingness to implement ORALS on a larger scale upon completion of this development project. CONCLUSIONS: Upon the completion of this project we will have developed a novel recording system that will be ready for large-scale testing. Our long-term goal is for ORALS to seamlessly fit into a clinic's and patient's daily routine, increasing levels of patient engagement and transparency of care.