A Neurosurgical Readmissions Reduction Program in an Academic Hospital Leveraging Machine Learning, Workflow Analysis, and Simulation.

BACKGROUND: Predicting 30-day hospital readmissions is crucial for improving patient outcomes, optimizing resource allocation, and achieving financial savings. Existing studies reporting the development of machine learning (ML) models predictive of neurosurgical readmissions do not report factors related to clinical implementation. OBJECTIVES: Train individual predictive models with good performance (area under the receiver operating characteristic curve or AUROC > 0.8), identify potential interventions through semi-structured interviews, and demonstrate estimated clinical and financial impact of these models. METHODS: Electronic health records were utilized with five ML methodologies: gradient boosting, decision tree, random forest, ridge logistic regression, and linear support vector machine. Variables of interest were determined by domain experts and literature. The dataset was split divided 80% for training and validation and 20% for testing randomly. Clinical workflow analysis was conducted using semi-structured interviews to identify possible intervention points. Calibrated agent-based models (ABMs), based on a previous study with interventions, were applied to simulate reductions of the 30-day readmission rate and financial costs. RESULTS: The dataset covered 12,334 neurosurgical intensive care unit (NSICU) admissions (11,029 patients); 1,903 spine surgery admissions (1,641 patients), and 2,208 traumatic brain injury (TBI) admissions (2,185 patients), with readmission rate of 13.13, 13.93, and 23.73%, respectively. The random forest model for NSICU achieved best performance with an AUROC score of 0.89, capturing potential patients effectively. Six interventions were identified through 12 semi-structured interviews targeting preoperative, inpatient stay, discharge phases, and follow-up phases. Calibrated ABMs simulated median readmission reduction rates and resulted in 13.13 to 10.12% (NSICU), 13.90 to 10.98% (spine surgery), and 23.64 to 21.20% (TBI). Approximately $1,300,614.28 in saving resulted from potential interventions. CONCLUSION: This study reports the successful development and simulation of an ML-based approach for predicting and reducing 30-day hospital readmissions in neurosurgery. The intervention shows feasibility in improving patient outcomes and reducing financial losses.

Sleep Patterns of Premedical Undergraduate Students: Pilot Study and Protocol Evaluation.

BACKGROUND: Poor sleep hygiene persists in college students today, despite its heavy implications on adolescent development and academic performance. Although sleep patterns in undergraduates have been broadly investigated, no study has exclusively assessed the sleep patterns of premedical undergraduate students. A gap also exists in the knowledge of how students perceive their sleep patterns compared to their actual sleep patterns. OBJECTIVE: This study aims to address 2 research questions: What are the sleep patterns of premedical undergraduate students? Would the proposed study protocol be feasible to examine the perception of sleep quality and promote sleep behavioral changes in premedical undergraduate students? METHODS: An anonymous survey was conducted with premedical students in the Medical Science Baccalaureate program at an R1: doctoral university in the Midwest United States to investigate their sleep habits and understand their demographics. The survey consisted of both Pittsburg Sleep Quality Index (PSQI) questionnaire items (1-9) and participant demographic questions. To examine the proposed protocol feasibility, we recruited 5 students from the survey pool for addressing the perception of sleep quality and changes. These participants followed a 2-week protocol wearing Fitbit Inspire 2 watches and underwent preassessments, midassessments, and postassessments. Participants completed daily reflections and semistructured interviews along with PSQI questionnaires during assessments. RESULTS: According to 103 survey responses, premedical students slept an average of 7.1 hours per night. Only a quarter (26/103) of the participants experienced good sleep quality (PSQI<5), although there was no significant difference (P=.11) in the proportions of good (PSQI<5) versus poor sleepers (PSQI≥5) across cohorts. When students perceived no problem at all in their sleep quality, 50% (14/28) of them actually had poor sleep quality. Among the larger proportion of students who perceived sleep quality as only a slight problem, 26% (11/43) of them presented poor sleep quality. High stress levels were associated with poor sleep quality. This study reveals Fitbit as a beneficial tool in raising sleep awareness. Participants highlighted Fitbit elements that aid in comprehension such as being able to visualize their sleep stage breakdown and receive an overview of their sleep pattern by simply looking at their Fitbit sleep scores. In terms of protocol evaluation, participants believed that assessments were conducted within the expected duration, and they did not have a strong opinion about the frequency of survey administration. However, Fitbit was found to provide notable variation daily, leading to missing data. Moreover, the Fitbit app's feature description was vague and could lead to confusion. CONCLUSIONS: Poor sleep quality experienced by unaware premedical students points to a need for raising sleep awareness and developing effective interventions. Future work should refine our study protocol based on lessons learned and health behavior theories and use Fitbit as an informatics solution to promote healthy sleep behaviors.

Improving the design of patient-generated health data visualizations: design considerations from a Fitbit sleep study.

Interactive data visualization can be a viable way to discover patterns in patient-generated health data and enable health behavior changes. However, very few studies have investigated the design and usability of such data visualization. The present study aimed to (1) explore user experiences with sleep data visualizations in the Fitbit app, and (2) focus on end users' perspectives to identify areas of improvement and potential solutions. The study recruited eighteen pre-medicine college students, who wore Fitbit watches for a two-week sleep data collection period and participated in an exit semi-structured interview to share their experience. A focus group was conducted subsequently to ideate potential solutions. The qualitative analysis identified six pain points (PPs) from the interview data using affinity mapping. Four design solutions were proposed by the focus group to address these PPs and illustrated by a set of mock-ups. The study findings informed four design considerations: (1) usability, (2) transparency and explainability, (3) understandability and actionability, and (4) individualized benchmarking. Further research is needed to examine the design guidelines and best practices of sleep data visualization, to create well-designed visualizations for the general population that enables health behavior changes.