Implementing a Machine Learning Screening Tool for Malnutrition: Insights From Qualitative Research Applicable to Other Machine Learning-Based Clinical Decision Support Systems.

BACKGROUND: Machine learning (ML)-based clinical decision support systems (CDSS) are popular in clinical practice settings but are often criticized for being limited in usability, interpretability, and effectiveness. Evaluating the implementation of ML-based CDSS is critical to ensure CDSS is acceptable and useful to clinicians and helps them deliver high-quality health care. Malnutrition is a common and underdiagnosed condition among hospital patients, which can have serious adverse impacts. Early identification and treatment of malnutrition are important. OBJECTIVE: This study aims to evaluate the implementation of an ML tool, Malnutrition Universal Screening Tool (MUST)-Plus, that predicts hospital patients at high risk for malnutrition and identify best implementation practices applicable to this and other ML-based CDSS. METHODS: We conducted a qualitative postimplementation evaluation using in-depth interviews with registered dietitians (RDs) who use MUST-Plus output in their everyday work. After coding the data, we mapped emergent themes onto select domains of the nonadoption, abandonment, scale-up, spread, and sustainability (NASSS) framework. RESULTS: We interviewed 17 of the 24 RDs approached (71%), representing 37% of those who use MUST-Plus output. Several themes emerged: (1) enhancements to the tool were made to improve accuracy and usability; (2) MUST-Plus helped identify patients that would not otherwise be seen; perceived usefulness was highest in the original site; (3) perceived accuracy varied by respondent and site; (4) RDs valued autonomy in prioritizing patients; (5) depth of tool understanding varied by hospital and level; (6) MUST-Plus was integrated into workflows and electronic health records; and (7) RDs expressed a desire to eventually have 1 automated screener. CONCLUSIONS: Our findings suggest that continuous involvement of stakeholders at new sites given staff turnover is vital to ensure buy-in. Qualitative research can help identify the potential bias of ML tools and should be widely used to ensure health equity. Ongoing collaboration among CDSS developers, data scientists, and clinical providers may help refine CDSS for optimal use and improve the acceptability of CDSS in the clinical context.

Innovating in a crisis: a qualitative evaluation of a hospital and Google partnership to implement a COVID-19 inpatient video monitoring program.

OBJECTIVE: To describe adaptations necessary for effective use of direct-to-consumer (DTC) cameras in an inpatient setting, from the perspective of health care workers. METHODS: Our qualitative study included semi-structured interviews and focus groups with clinicians, information technology (IT) personnel, and health system leaders affiliated with the Mount Sinai Health System. All participants either worked in a coronavirus disease 2019 (COVID-19) unit with DTC cameras or participated in the camera implementation. Three researchers coded the transcripts independently and met weekly to discuss and resolve discrepancies. Abiding by inductive thematic analysis, coders revised the codebook until they reached saturation. All transcripts were coded in Dedoose using the final codebook. RESULTS: Frontline clinical staff, IT personnel, and health system leaders (N = 39) participated in individual interviews and focus groups in November 2020-April 2021. Our analysis identified 5 areas for effective DTC camera use: technology, patient monitoring, workflows, interpersonal relationships, and infrastructure. Participants described adaptations created to optimize camera use and opportunities for improvement necessary for sustained use. Non-COVID-19 patients tended to decline participation. DISCUSSION: Deploying DTC cameras on inpatient units required adaptations in many routine processes. Addressing consent, 2-way communication issues, patient privacy, and messaging about video monitoring could help facilitate a nimble rollout. Implementation and dissemination of inpatient video monitoring using DTC cameras requires input from patients and frontline staff. CONCLUSIONS: Given the resources and time it takes to implement a usable camera solution, other health systems might benefit from creating task forces to investigate their use before the next crisis.

Photovoice as a tool to improve patient-Provider communication in inflammatory bowel disease clinic: A feasibility study.

BACKGROUND: The emotional health of patients with inflammatory bowel disease (IBD) is critical to self-management, but has been difficult to elucidate in routine care. Patients are often unsure how to communicate their preferences and concerns to their providers in ways that could directly inform shared decision making. Photovoice is an established research methodology used to give vulnerable patients a voice through photographic expression, but has not been previously used in gastroenterology or in IBD. OBJECTIVE: To determine the acceptability and feasibility of using Photovoice in an IBD clinic. PATIENT INVOLVEMENT: Patients with IBD took photos in response to open-ended prompts, participated in a focus group, and brainstormed ways to share their experience with clinicians. METHODS: Enrolled IBD patients received a digital camera, training on basic usage and 10 open-ended prompts related to management of their IBD. Participants completed one-hour in-depth interviews about their photos, which were audio-recorded and professionally transcribed. Three analysts coded transcripts for themes using qualitative analysis software QSR NVivo 11. A subset of patients participated in a focus group about their Photovoice experience. Gastroenterologists were interviewed, using patient photos as prompts, to evaluate feasibility of using Photovoice in the clinic. RESULTS: Eleven patients completed the interviews, with five participating in the focus group. Patients shared and discussed a total of 118 photographs. We identified two major themes: disease burden and patient - provider communication. Five IBD physicians reviewed select patient photos and suggested ways to incorporate Photovoice into clinical practice. DISCUSSION: Photovoice may be a feasible methodology for patients with IBD and acceptable for providers to use in a clinical setting. PRACTICAL VALUE: Photovoice may help providers identify patient concerns and make their communication more patient-centred.