Clinical Prediction Models for Hospital-Induced Delirium Using Structured and Unstructured Electronic Health Record Data: Protocol for a Development and Validation Study.

BACKGROUND: Hospital-induced delirium is one of the most common and costly iatrogenic conditions, and its incidence is predicted to increase as the population of the United States ages. An academic and clinical interdisciplinary systems approach is needed to reduce the frequency and impact of hospital-induced delirium. OBJECTIVE: The long-term goal of our research is to enhance the safety of hospitalized older adults by reducing iatrogenic conditions through an effective learning health system. In this study, we will develop models for predicting hospital-induced delirium. In order to accomplish this objective, we will create a computable phenotype for our outcome (hospital-induced delirium), design an expert-based traditional logistic regression model, leverage machine learning techniques to generate a model using structured data, and use machine learning and natural language processing to produce an integrated model with components from both structured data and text data. METHODS: This study will explore text-based data, such as nursing notes, to improve the predictive capability of prognostic models for hospital-induced delirium. By using supervised and unsupervised text mining in addition to structured data, we will examine multiple types of information in electronic health record data to predict medical-surgical patient risk of developing delirium. Development and validation will be compliant to the Transparent Reporting of a multivariable prediction model for Individual Prognosis Or Diagnosis (TRIPOD) statement. RESULTS: Work on this project will take place through March 2024. For this study, we will use data from approximately 332,230 encounters that occurred between January 2012 to May 2021. Findings from this project will be disseminated at scientific conferences and in peer-reviewed journals. CONCLUSIONS: Success in this study will yield a durable, high-performing research-data infrastructure that will process, extract, and analyze clinical text data in near real time. This model has the potential to be integrated into the electronic health record and provide point-of-care decision support to prevent harm and improve quality of care. INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID): DERR1-10.2196/48521.

Use of a Data Repository to Identify Delirium as a Presenting Symptom of COVID-19 Infection in Hospitalized Adults: Cross-Sectional Cohort Pilot Study.

BACKGROUND: Delirium, an acute confusional state highlighted by inattention, has been reported to occur in 10% to 50% of patients with COVID-19. People hospitalized with COVID-19 have been noted to present with or develop delirium and neurocognitive disorders. Caring for patients with delirium is associated with more burden for nurses, clinicians, and caregivers. Using information in electronic health record data to recognize delirium and possibly COVID-19 could lead to earlier treatment of the underlying viral infection and improve outcomes in clinical and health care systems cost per patient. Clinical data repositories can further support rapid discovery through cohort identification tools, such as the Informatics for Integrating Biology and the Bedside tool. OBJECTIVE: The specific aim of this research was to investigate delirium in hospitalized older adults as a possible presenting symptom in COVID-19 using a data repository to identify neurocognitive disorders with a novel group of International Classification of Diseases, Tenth Revision (ICD-10) codes. METHODS: We analyzed data from 2 catchment areas with different demographics. The first catchment area (7 counties in the North-Central Florida) is predominantly rural while the second (1 county in North Florida) is predominantly urban. The Integrating Biology and the Bedside data repository was queried for patients with COVID-19 admitted to inpatient units via the emergency department (ED) within the health center from April 1, 2020, and April 1, 2022. Patients with COVID-19 were identified by having a positive COVID-19 laboratory test or a diagnosis code of U07.1. We identified neurocognitive disorders as delirium or encephalopathy, using ICD-10 codes. RESULTS: Less than one-third (1437/4828, 29.8%) of patients with COVID-19 were diagnosed with a co-occurring neurocognitive disorder. A neurocognitive disorder was present on admission for 15.8% (762/4828) of all patients with COVID-19 admitted through the ED. Among patients with both COVID-19 and a neurocognitive disorder, 56.9% (817/1437) were aged ≥65 years, a significantly higher proportion than those with no neurocognitive disorder (P<.001). The proportion of patients aged <65 years was significantly higher among patients diagnosed with encephalopathy only than patients diagnosed with delirium only and both delirium and encephalopathy (P<.001). Most (1272/4828, 26.3%) patients with COVID-19 admitted through the ED during our study period were admitted during the Delta variant peak. CONCLUSIONS: The data collected demonstrated that an increased number of older patients with neurocognitive disorder present on admission were infected with COVID-19. Knowing that delirium increases the staffing, nursing care needs, hospital resources used, and the length of stay as previously noted, identifying delirium early may benefit hospital administration when planning for newly anticipated COVID-19 surges. A robust and accessible data repository, such as the one used in this study, can provide invaluable support to clinicians and clinical administrators in such resource reallocation and clinical decision-making.

Application of a practice-based approach in variable selection for a prediction model development study of hospital-induced delirium.

BACKGROUND: Prognostic models of hospital-induced delirium, that include potential predisposing and precipitating factors, may be used to identify vulnerable patients and inform the implementation of tailored preventive interventions. It is recommended that, in prediction model development studies, candidate predictors are selected on the basis of existing knowledge, including knowledge from clinical practice. The purpose of this article is to describe the process of identifying and operationalizing candidate predictors of hospital-induced delirium for application in a prediction model development study using a practice-based approach. METHODS: This study is part of a larger, retrospective cohort study that is developing prognostic models of hospital-induced delirium for medical-surgical older adult patients using structured data from administrative and electronic health records. First, we conducted a review of the literature to identify clinical concepts that had been used as candidate predictors in prognostic model development-and-validation studies of hospital-induced delirium. Then, we consulted a multidisciplinary task force of nine members who independently judged whether each clinical concept was associated with hospital-induced delirium. Finally, we mapped the clinical concepts to the administrative and electronic health records and operationalized our candidate predictors. RESULTS: In the review of 34 studies, we identified 504 unique clinical concepts. Two-thirds of the clinical concepts (337/504) were used as candidate predictors only once. The most common clinical concepts included age (31/34), sex (29/34), and alcohol use (22/34). 96% of the clinical concepts (484/504) were judged to be associated with the development of hospital-induced delirium by at least two members of the task force. All of the task force members agreed that 47 or 9% of the 504 clinical concepts were associated with hospital-induced delirium. CONCLUSIONS: Heterogeneity among candidate predictors of hospital-induced delirium in the literature suggests a still evolving list of factors that contribute to the development of this complex phenomenon. We demonstrated a practice-based approach to variable selection for our model development study of hospital-induced delirium. Expert judgement of variables enabled us to categorize the variables based on the amount of agreement among the experts and plan for the development of different models, including an expert-model and data-driven model.

The relationship between electronic health records user interface features and data quality of patient clinical information: an integrative review.

OBJECTIVES: Electronic health records (EHRs) user interfaces (UI) designed for data entry can potentially impact the quality of patient information captured in the EHRs. This review identified and synthesized the literature evidence about the relationship of UI features in EHRs on data quality (DQ). MATERIALS AND METHODS: We performed an integrative review of research studies by conducting a structured search in 5 databases completed on October 10, 2022. We applied Whittemore & Knafl's methodology to identify literature, extract, and synthesize information, iteratively. We adapted Kmet et al appraisal tool for the quality assessment of the evidence. The research protocol was registered with PROSPERO (CRD42020203998). RESULTS: Eleven studies met the inclusion criteria. The relationship between 1 or more UI features and 1 or more DQ indicators was examined. UI features were classified into 4 categories: 3 types of data capture aids, and other methods of DQ assessment at the UI. The Weiskopf et al measures were used to assess DQ: completeness (n = 10), correctness (n = 10), and currency (n = 3). UI features such as mandatory fields, templates, and contextual autocomplete improved completeness or correctness or both. Measures of currency were scarce. DISCUSSION: The paucity of studies on UI features and DQ underscored the limited knowledge in this important area. The UI features examined had both positive and negative effects on DQ. Standardization of data entry and further development of automated algorithmic aids, including adaptive UIs, have great promise for improving DQ. Further research is essential to ensure data captured in our electronic systems are high quality and valid for use in clinical decision-making and other secondary analyses.

Risk of bias in prognostic models of hospital-induced delirium for medical-surgical units: A systematic review.

PURPOSE: The purpose of this systematic review was to assess risk of bias in existing prognostic models of hospital-induced delirium for medical-surgical units. METHODS: APA PsycInfo, CINAHL, MEDLINE, and Web of Science Core Collection were searched on July 8, 2022, to identify original studies which developed and validated prognostic models of hospital-induced delirium for adult patients who were hospitalized in medical-surgical units. The Checklist for Critical Appraisal and Data Extraction for Systematic Reviews of Prediction Modelling Studies was used for data extraction. The Prediction Model Risk of Bias Assessment Tool was used to assess risk of bias. Risk of bias was assessed across four domains: participants, predictors, outcome, and analysis. RESULTS: Thirteen studies were included in the qualitative synthesis, including ten model development and validation studies and three model validation only studies. The methods in all of the studies were rated to be at high overall risk of bias. The methods of statistical analysis were the greatest source of bias. External validity of models in the included studies was tested at low levels of transportability. CONCLUSIONS: Our findings highlight the ongoing scientific challenge of developing a valid prognostic model of hospital-induced delirium for medical-surgical units to tailor preventive interventions to patients who are at high risk of this iatrogenic condition. With limited knowledge about generalizable prognosis of hospital-induced delirium in medical-surgical units, existing prognostic models should be used with caution when creating clinical practice policies. Future research protocols must include robust study designs which take into account the perspectives of clinicians to identify and validate risk factors of hospital-induced delirium for accurate and generalizable prognosis in medical-surgical units.

Examining Care Planning Efficiency and Clinical Decision Support Adoption in a System Tailoring to Nurses' Graph Literacy: National, Web-Based Randomized Controlled Trial.

BACKGROUND: The proliferation of health care data in electronic health records (EHRs) is fueling the need for clinical decision support (CDS) that ensures accuracy and reduces cognitive processing and documentation burden. The CDS format can play a key role in achieving the desired outcomes. Building on our laboratory-based pilot study with 60 registered nurses (RNs) from 1 Midwest US metropolitan area indicating the importance of graph literacy (GL), we conducted a fully powered, innovative, national, and web-based randomized controlled trial with 203 RNs. OBJECTIVE: This study aimed to compare care planning time (CPT) and the adoption of evidence-based CDS recommendations by RNs randomly assigned to 1 of 4 CDS format groups: text only (TO), text+table (TT), text+graph (TG), and tailored (based on the RN's GL score). We hypothesized that the tailored CDS group will have faster CPT (primary) and higher adoption rates (secondary) than the 3 nontailored CDS groups. METHODS: Eligible RNs employed in an adult hospital unit within the past 2 years were recruited randomly from 10 State Board of Nursing lists representing the 5 regions of the United States (Northeast, Southeast, Midwest, Southwest, and West) to participate in a randomized controlled trial. RNs were randomly assigned to 1 of 4 CDS format groups-TO, TT, TG, and tailored (based on the RN's GL score)-and interacted with the intervention on their PCs. Regression analysis was performed to estimate the effect of tailoring and the association between CPT and RN characteristics. RESULTS: The differences between the tailored (n=46) and nontailored (TO, n=55; TT, n=54; and TG, n=48) CDS groups were not significant for either the CPT or the CDS adoption rate. RNs with low GL had longer CPT interacting with the TG CDS format than the TO CDS format (P=.01). The CPT in the TG CDS format was associated with age (P=.02), GL (P=.02), and comfort with EHRs (P=.047). Comfort with EHRs was also associated with CPT in the TT CDS format (P<.001). CONCLUSIONS: Although tailoring based on GL did not improve CPT or adoption, the study reinforced previous pilot findings that low GL is associated with longer CPT when graphs were included in care planning CDS. Higher GL, younger age, and comfort with EHRs were associated with shorter CPT. These findings are robust based on our new innovative testing strategy in which a diverse national sample of RN participants (randomly derived from 10 State Board of Nursing lists) interacted on the web with the intervention on their PCs. Future studies applying our innovative methodology are recommended to cost-effectively enhance the understanding of how the RN's GL, combined with additional factors, can inform the development of efficient CDS for care planning and other EHR components before use in practice.

Fall risk management using clinical decision support in a rural nursing-led primary care practice.

BACKGROUND: The leading cause of injuries among older adults in the United States is unintentional falls. The American Geriatrics Society/British Geriatrics Society promote fall risk management in primary care; however, this is challenging in low-resource settings. LOCAL PROBLEM: Archer Family Health Care (AFHC), an Advanced Practice Registered Nurse (APRN)-managed and federally designated rural health clinic, identified a care gap with falls adherence to guidelines for patients at higher risk for falls. METHODS: The aim of this quality improvement effort was to integrate an evidence-based fall risk management tool in a rural nurse-managed primary care practice. A standardized fall risk management process with a new brief paper-based clinical decision support (CDS) tool was developed and tested in two phases. INTERVENTION: Phase 1 focused on developing a fall risk management CDS tool, identifying the primary care visit workflow, communicating the workflow patterns to the AFHC staff, and collaborating with the staff to identify when and who should implement the tool. Phase 2 focused on implementation of the fall risk management CDS tool into standard practice among older adults aged 65 years and older. RESULTS: We found that integrating the tool did not disrupt the workflow of primary care visits at AFHC. The most common recommended intervention for patients at risk of falling was daily vitamin D supplementation. CONCLUSION: This project revealed that it is feasible to introduce a brief fall risk management decision support tool in an APRN-managed rural primary care practice.

Clinical Decision Support for Fall Prevention: Defining End-User Needs.

BACKGROUND AND SIGNIFICANCE: Falls in community-dwelling older adults are common, and there is a lack of clinical decision support (CDS) to provide health care providers with effective, individualized fall prevention recommendations. OBJECTIVES: The goal of this research is to identify end-user (primary care staff and patients) needs through a human-centered design process for a tool that will generate CDS to protect older adults from falls and injuries. METHODS: Primary care staff (primary care providers, care coordinator nurses, licensed practical nurses, and medical assistants) and community-dwelling patients aged 60 years or older associated with Brigham & Women's Hospital-affiliated primary care clinics and the University of Florida Health Archer Family Health Care primary care clinic were eligible to participate in this study. Through semi-structured and exploratory interviews with participants, our team identified end-user needs through content analysis. RESULTS: User needs for primary care staff (n = 24) and patients (n = 18) were categorized under the following themes: workload burden; systematic communication; in-person assessment of patient condition; personal support networks; motivational tools; patient understanding of fall risk; individualized resources; and evidence-based safe exercises and expert guidance. While some of these themes are specific to either primary care staff or patients, several address needs expressed by both groups of end-users. CONCLUSION: Our findings suggest that there are many care gaps in fall prevention management in primary care and that personalized, actionable, and evidence-based CDS has the potential to address some of these gaps.

Assessing the Usability of a Clinical Decision Support System: Heuristic Evaluation.

BACKGROUND: Poor usability is a primary cause of unintended consequences related to the use of electronic health record (EHR) systems, which negatively impacts patient safety. Due to the cost and time needed to carry out iterative evaluations, many EHR components, such as clinical decision support systems (CDSSs), have not undergone rigorous usability testing prior to their deployment in clinical practice. Usability testing in the predeployment phase is crucial to eliminating usability issues and preventing costly fixes that will be needed if these issues are found after the system's implementation. OBJECTIVE: This study presents an example application of a systematic evaluation method that uses clinician experts with human-computer interaction (HCI) expertise to evaluate the usability of an electronic clinical decision support (CDS) intervention prior to its deployment in a randomized controlled trial. METHODS: We invited 6 HCI experts to participate in a heuristic evaluation of our CDS intervention. Each expert was asked to independently explore the intervention at least twice. After completing the assigned tasks using patient scenarios, each expert completed a heuristic evaluation checklist developed by Bright et al based on Nielsen's 10 heuristics. The experts also rated the overall severity of each identified heuristic violation on a scale of 0 to 4, where 0 indicates no problems and 4 indicates a usability catastrophe. Data from the experts' coded comments were synthesized, and the severity of each identified usability heuristic was analyzed. RESULTS: The 6 HCI experts included professionals from the fields of nursing (n=4), pharmaceutical science (n=1), and systems engineering (n=1). The mean overall severity scores of the identified heuristic violations ranged from 0.66 (flexibility and efficiency of use) to 2.00 (user control and freedom and error prevention), in which scores closer to 0 indicate a more usable system. The heuristic principle user control and freedom was identified as the most in need of refinement and, particularly by nonnursing HCI experts, considered as having major usability problems. In response to the heuristic match between system and the real world, the experts pointed to the reversed direction of our system's pain scale scores (1=severe pain) compared to those commonly used in clinical practice (typically 1=mild pain); although this was identified as a minor usability problem, its refinement was repeatedly emphasized by nursing HCI experts. CONCLUSIONS: Our heuristic evaluation process is simple and systematic and can be used at multiple stages of system development to reduce the time and cost needed to establish the usability of a system before its widespread implementation. Furthermore, heuristic evaluations can help organizations develop transparent reporting protocols for usability, as required by Title IV of the 21st Century Cures Act. Testing of EHRs and CDSSs by clinicians with HCI expertise in heuristic evaluation processes has the potential to reduce the frequency of testing while increasing its quality, which may reduce clinicians' cognitive workload and errors and enhance the adoption of EHRs and CDSSs.

Conducting a representative national randomized control trial of tailored clinical decision support for nurses remotely: Methods and implications.

Clinical Decision Support (CDS) systems, patient specific evidence delivered to clinicians via the electronic health record (EHR) at the right time and in the right format, has the potential to improve patient outcomes. Unfortunately, outcomes of CDS research are mixed. A potential cause lies in its testing. Many CDS are implemented in practice without sufficient testing, potentially leading to patient harm. When testing is conducted, most research has focused on "what" evidence to provide with little attention to the impact of the CDS display format (e.g., textual, graphical) on the user. In an adequately powered randomized control trial with 220 hospital based registered nurses, we will compare 4 randomly assigned CDS format groups (text, text table, text graphs, tailored to subject's graph literacy score) for effects on decision time and simulated patient outcomes. We recruit using state based professional registries, which allows access to participants from multiple institutions across the nation. We use online survey software (REDCap) for efficient study workflow including screening, informed consent documentation, pre-experiment demographic data collection including a graph literacy questionnaire used in randomization. The CDS prototype is accessed via a web app and the simulation-based experiment is conducted remotely at a subject's local computer using video-conferencing software. Also included are 6 post intervention surveys to assess cognitive workload, usability, numeracy, format preference, CDS utilization rationale, and CDS interpretation. Our methods are replicable and scalable for testing of health information technologies and have the potential to improve the safety and effectiveness of these technologies across disciplines.

Spiritual Interventions Delivered by Nurses to Address Patients' Needs in Hospitals or Long-Term Care Facilities: A Systematic Review.

Introduction: Despite increasing evidence of the benefits of spiritual care and nurses' efforts to incorporate spiritual interventions into palliative care and clinical practice, the role of spirituality is not well understood and implemented. There are divergent meanings and practices within and across countries. Understanding the delivery of spiritual interventions may lead to improved patient outcomes. Aim: We conducted a systematic review to characterize spiritual interventions delivered by nurses and targeted outcomes for patients in hospitals or assisted long-term care facilities. Methodology: The systematic review was developed following PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines, and a quality assessment was performed. Our protocol was registered on PROSPERO (Registration No. CRD42020197325). The CINAHL, Embase, PsycINFO, and PubMed databases were searched from inception to June 2020. Results: We screened a total of 1005 abstracts and identified 16 experimental and quasi-experimental studies of spiritual interventions delivered by nurses to individuals receiving palliative care or targeted at chronic conditions, such as advanced cancer diseases. Ten studies examined existential interventions (e.g., spiritual history, spiritual pain assessment, touch, and psychospiritual interventions), two examined religious interventions (e.g., prayer), and four investigated mixed interventions (e.g., active listening, presence, and connectedness with the sacred, nature, and art). Patient outcomes associated with the delivery of spiritual interventions included spiritual well-being, anxiety, and depression. Conclusion: Spiritual interventions varied with the organizational culture of institutions, patients' beliefs, and target outcomes. Studies showed that spiritual interventions are associated with improved psychological and spiritual patient outcomes. The studies' different methodological approaches and the lack of detail made it challenging to compare, replicate, and validate the applicability and circumstances under which the interventions are effective. Further studies utilizing rigorous methods with operationalized definitions of spiritual nursing care are recommended.

Twenty-first Century Bedside Manner: Exploring Patient-Centered Communication in Secure Messaging with Cancer Patients.

Patient-centered communication (PCC) is integral to providing high-quality health care and is recommended to be incorporated during face-to-face consultations. Electronic communication, such as the use of secure messaging (SM) within patient portals, is a popular form of patient-provider communication, but preliminary studies have shown that PCC is rarely utilized by providers in SM. As a consequence, the patient-provider relationship can be negatively affected, especially for cancer patients who have greater electronic health information needs than the general population. Therefore, our objective was to determine the importance of SM to cancer patients and to identify which attributes of PCC are preferred to be incorporated into secure messages. Five focus groups were conducted, comprised of patients with a current or previous cancer diagnosis (three all-female; two all-male). Participants recalled their own experiences and reviewed simulated messages. Three main topics emerged from the thematic analysis: (1) the normalization of SM, (2) SM quality can affect perceptions of care, and (3) patients need guidance. Overall, participants valued the ability to communicate with their care team using SM and indicated that electronic communication may have the potential to have just as big of an impact on a patient's care than in-person communication.

Improving secure messaging: A framework for support, partnership & information-giving communicating electronically (SPICE).

BACKGROUND: Patient-centered communication benefits patients and is widely endorsed. However, it is primarily associated with face-to-face contexts, although patients are increasingly using electronic platforms, such as secure messaging in patient portals, to communicate with providers. PURPOSE: Given the popularity of secure messaging and its ability to impact the patient-provider relationship, this study aimed to determine which attributes of patient-centered communication are most desired by cancer patients using secure messaging. METHODS: A 26 balanced incomplete block design discrete choice experiment was conducted using the best-worst scaling technique. Respondents were asked to select their most and least preferred attributes of two simulated patient-provider exchanges within each of eight choice sets. RESULTS: 210 respondents indicated that either level of partnership (high and low) and either level of information-giving (high and low) were most preferred, while response times greater than 24 hours and low levels of support were least favored. CONCLUSIONS: Similar to face-to-face communication, patients value aspects of patient-centered communication in the secure messaging setting and desire them to be included in provider replies. PRACTICE IMPLICATIONS: Patient-centered communication is important to patients using secure messaging. Providers should incorporate SPICE (Support, Partnership, and Information-giving while Communicating Electronically).

Nutrition Support Therapies on the Medication Administration Record: Impacts on Staff Perception of Nutrition Care.

BACKGROUND: It has been reported that many hospitals in the United States have fragmented and ineffective ordering, administration, documentation, and evaluation/monitoring of nutrition therapies. This paper reports on a project to investigate if perceived hospital staff awareness and documentation of nutrition support therapies (NSTs) improves by including them as part of the medication administration record (MAR). METHODS: Surveys were conducted with nursing staff, physicians, and dietitians before and after adding NSTs to the MAR to evaluate the perceived impact on the outcome of interest. The outcomes of interest include nurses' perception of ease of finding information, awareness of an order, and ability to assess administration and documentation and dietitian, nurse, and physician staff perceptions of impact of intervention on aspects of the nutrition care process. RESULTS: After adding NST to the MAR, nursing staff perceived improvement in knowing that their patient had an oral nutritional supplement (ONS) order (P = .01), when and how much product was last administered (P = .01), and documentation of the type of product consumed (P = .01) and volume of product consumed (P = .01). The majority of dietitian and nurses surveyed reported perceived improvement in placing and finding ONS orders, in administration of ONS, in ability to evaluate patient nutrition status, and in ONS intake and a positive impact on clinical practice. CONCLUSION: Inclusion of NST in the MAR presents an innovative solution to enhance staff awareness of ordered therapies and perception of improved documentation of nutrition interventions for hospitalized patients.

Identification of important factors in an inpatient fall risk prediction model to improve the quality of care using EHR and electronic administrative data: A machine-learning approach.

BACKGROUND: Inpatient falls, many resulting in injury or death, are a serious problem in hospital settings. Existing falls risk assessment tools, such as the Morse Fall Scale, give a risk score based on a set of factors, but don't necessarily signal which factors are most important for predicting falls. Artificial intelligence (AI) methods provide an opportunity to improve predictive performance while also identifying the most important risk factors associated with hospital-acquired falls. We can glean insight into these risk factors by applying classification tree, bagging, random forest, and adaptive boosting methods applied to Electronic Health Record (EHR) data. OBJECTIVE: The purpose of this study was to use tree-based machine learning methods to determine the most important predictors of inpatient falls, while also validating each via cross-validation. MATERIALS AND METHODS: A case-control study was designed using EHR and electronic administrative data collected between January 1, 2013 to October 31, 2013 in 14 medical surgical units. The data contained 38 predictor variables which comprised of patient characteristics, admission information, assessment information, clinical data, and organizational characteristics. Classification tree, bagging, random forest, and adaptive boosting methods were used to identify the most important factors of inpatient fall-risk through variable importance measures. Sensitivity, specificity, and area under the ROC curve were computed via ten-fold cross validation and compared via pairwise t-tests. These methods were also compared to a univariate logistic regression of the Morse Fall Scale total score. RESULTS: In terms of AUROC, bagging (0.89), random forest (0.90), and boosting (0.89) all outperformed the Morse Fall Scale (0.86) and the classification tree (0.85), but no differences were measured between bagging, random forest, and adaptive boosting, at a p-value of 0.05. History of Falls, Age, Morse Fall Scale total score, quality of gait, unit type, mental status, and number of high fall risk increasing drugs (FRIDs) were considered the most important features for predicting inpatient fall risk. CONCLUSIONS: Machine learning methods have the potential to identify the most relevant and novel factors for the detection of hospitalized patients at risk of falling, which would improve the quality of patient care, and to more fully support healthcare provider and organizational leadership decision-making. Nurses would be able to enhance their judgement to caring for patients at risk for falls. Our study may also serve as a reference for the development of AI-based prediction models of other iatrogenic conditions. To our knowledge, this is the first study to report the importance of patient, clinical, and organizational features based on the use of AI approaches.

Fall Prevention Decision Making of Acute Care Registered Nurses.

OBJECTIVE: The aim of this study was to examine acute care registered nurses' (RNs') fall prevention decision-making. BACKGROUND: The RN decision-making process related to fall prevention needs to be investigated to ensure that hospital policies align with nursing workflow and support nursing judgment. METHODS: Qualitative semistructured interviews based on the Critical Decision Method were conducted with RNs about their planning and decision making during their last 12-hour shift worked. RESULTS: Data saturation was achieved with 12 RNs. Nine themes emerged related to the RN decision-making process and included hospital-level (eg, fear of discipline), unit-level (eg, value of bed alarm technology), and nurse-level (eg, professional judgment) factors that could influence fall prevention. CONCLUSIONS: Nursing administrators should consider a multilevel approach to fall prevention policies that includes promoting a practice environment that embraces self-reporting adverse events without fear of shame or being reprimanded, evaluating unit-level practice and technology acceptance and usability, and supporting autonomous nursing practice.

Using an Electronic Medication Event-Monitoring System for Antiretroviral Therapy Self-Management Among African American Women Living With HIV in Rural Florida: Cohort Study.

BACKGROUND: HIV remains a significant health issue in the United States and disproportionately affects African Americans. African American women living with HIV (AAWH) experience a particularly high number of barriers when attempting to manage their HIV care, including antiretroviral therapy (ART) adherence. To enable the development and assessment of effective interventions that address these barriers to support ART adherence, there is a critical need to understand more fully the use of objective measures of ART adherence among AAWH, including electronic medication dispensers for real-time surveillance. OBJECTIVE: This study aimed to evaluate the use of the Wisepill medication event-monitoring system (MEMS) and compare the objective and subjective measures of ART adherence. METHODS: We conducted a 30-day exploratory pilot study of the MEMS among a convenience sample of community-dwelling AAWH (N=14) in rural Florida. AAWH were trained on the use of the MEMS to determine the feasibility of collecting, capturing, and manipulating the MEMS data for an objective measure of ART adherence. Self-reported sociodemographic information, including a self-reported measure of ART adherence, was also collected from AAWH. RESULTS: We found that the majority of participants were successful at using the electronic MEMS. Daily use of the MEMS tended to be outside of the usual time participants took their medication. Three 30-day medication event patterns were found that characterized ART adherence, specifically uniform and nonuniform medication adherence and nonuniform medication nonadherence. There were relatively few MEMS disruptions among study participants. Overall, adjusted daily ART adherence was 81.08% and subjective ART adherence was 77.78%. CONCLUSIONS: This pilot study on the use and evaluation of the Wisepill MEMS among AAWH in rural Florida is the first such study in the United States. The findings of this study are encouraging because 10 out of 12 participants consistently used the MEMS, there were relatively few failures, and objective adjusted daily and overall subjective ART adherence were very similar. On the basis of these findings, we think researchers should consider using the Wisepill MEMS in future studies of AAWH and people living with HIV in the United States after taking into account our practical suggestions. The following practical considerations are suggested when measuring objective medication adherence: (1) before using an MEMS, be familiar with the targeted populations' characteristics; (2) choose an MEMS that aligns with the participants' day-to-day activities; (3) ensure the MEMS' features and resulting data support the research goals; (4) assess the match among the user's ability, wireless features of the MEMS, and the geographic location of the participants; and (5) consider the cost of MEMS and the research budget.

Identifying relations of medications with adverse drug events using recurrent convolutional neural networks and gradient boosting.

OBJECTIVE: To develop a natural language processing system that identifies relations of medications with adverse drug events from clinical narratives. This project is part of the 2018 n2c2 challenge. MATERIALS AND METHODS: We developed a novel clinical named entity recognition method based on an recurrent convolutional neural network and compared it to a recurrent neural network implemented using the long-short term memory architecture, explored methods to integrate medical knowledge as embedding layers in neural networks, and investigated 3 machine learning models, including support vector machines, random forests and gradient boosting for relation classification. The performance of our system was evaluated using annotated data and scripts provided by the 2018 n2c2 organizers. RESULTS: Our system was among the top ranked. Our best model submitted during this challenge (based on recurrent neural networks and support vector machines) achieved lenient F1 scores of 0.9287 for concept extraction (ranked third), 0.9459 for relation classification (ranked fourth), and 0.8778 for the end-to-end relation extraction (ranked second). We developed a novel named entity recognition model based on a recurrent convolutional neural network and further investigated gradient boosting for relation classification. The new methods improved the lenient F1 scores of the 3 subtasks to 0.9292, 0.9633, and 0.8880, respectively, which are comparable to the best performance reported in this challenge. CONCLUSION: This study demonstrated the feasibility of using machine learning methods to extract the relations of medications with adverse drug events from clinical narratives.

Assessing Sexual Orientation and Gender Identity in Home Health Care: Perceptions and Attitudes of Nurses.

Purpose: The purpose of this study was to explore home health care nurses' attitudes, perceptions, and experiences related to routine collection and documentation of sexual orientation and gender identity data. Methods: This was a qualitative descriptive study. Twenty-four nurses from a large home health care agency in the New York metropolitan area were interviewed between November 2014 and December 2015. Results: Three broad categories of themes emerged from the content analysis: (1) current practices that relate to or influence the assessment of sexual orientation or gender identity by home health care nurses, (2) attitudes and perceptions regarding perceived barriers and facilitators to discussing and documenting sexual orientation and gender identity, and (3) training and resources identified as helpful in preparing nurses to discuss sexual orientation and gender identity with their patients. Nurses emphasized wanting to provide everyone with the same quality of care and wanted documentation to inform the care. They felt unprepared to discuss sexual orientation or gender identity with their patients and indicated a need for training and education related to LGBT health disparities. Conclusions: Results from this study can help inform the development of training materials and resources to enable nurses to collect patients' sexual orientation and gender identity data routinely and in a sensitive and culturally competent manner.

The Role of Nurse Managers in the Adoption of Health Information Technology: Findings From a Qualitative Study.

OBJECTIVE: This study aims to investigate the role of nurse managers in supporting point-of-care nurses' health information technology (IT) use and identify strategies employed by nurse managers to improve adoption, while also gathering point-of-care nurses' perceptions of these strategies. BACKGROUND: Nurse managers are essential in facilitating point-of-care nurses' use of health IT; however, the underlying phenomenon for this facilitation remains unreported. METHODS: A qualitative descriptive study was conducted with 10 nurse managers and 14 point-of-care nurses recruited from a mental health hospital environment in Ontario, Canada. Inductive and deductive content analyses were used to analyze the semistructured interviews. RESULTS: Nurse managers adopt the role of advocate, educator, and connector, using the following strategies: communicating system updates, demonstrating use of health IT, linking staff to resources, facilitating education, and providing IT oversight. CONCLUSIONS: Nurse managers use a variety of strategies to support nurses' use of health IT. Future research should focus on the effectiveness of these strategies.