Your browser doesn't support javascript.
loading
Show: 20 | 50 | 100
Results 1 - 20 de 24
Filter
1.
JAMA Netw Open ; 7(3): e243201, 2024 Mar 04.
Article in English | MEDLINE | ID: mdl-38506805

ABSTRACT

Importance: The emergence and promise of generative artificial intelligence (AI) represent a turning point for health care. Rigorous evaluation of generative AI deployment in clinical practice is needed to inform strategic decision-making. Objective: To evaluate the implementation of a large language model used to draft responses to patient messages in the electronic inbox. Design, Setting, and Participants: A 5-week, prospective, single-group quality improvement study was conducted from July 10 through August 13, 2023, at a single academic medical center (Stanford Health Care). All attending physicians, advanced practice practitioners, clinic nurses, and clinical pharmacists from the Divisions of Primary Care and Gastroenterology and Hepatology were enrolled in the pilot. Intervention: Draft replies to patient portal messages generated by a Health Insurance Portability and Accountability Act-compliant electronic health record-integrated large language model. Main Outcomes and Measures: The primary outcome was AI-generated draft reply utilization as a percentage of total patient message replies. Secondary outcomes included changes in time measures and clinician experience as assessed by survey. Results: A total of 197 clinicians were enrolled in the pilot; 35 clinicians who were prepilot beta users, out of office, or not tied to a specific ambulatory clinic were excluded, leaving 162 clinicians included in the analysis. The survey analysis cohort consisted of 73 participants (45.1%) who completed both the presurvey and postsurvey. In gastroenterology and hepatology, there were 58 physicians and APPs and 10 nurses. In primary care, there were 83 physicians and APPs, 4 nurses, and 8 clinical pharmacists. The mean AI-generated draft response utilization rate across clinicians was 20%. There was no change in reply action time, write time, or read time between the prepilot and pilot periods. There were statistically significant reductions in the 4-item physician task load score derivative (mean [SD], 61.31 [17.23] presurvey vs 47.26 [17.11] postsurvey; paired difference, -13.87; 95% CI, -17.38 to -9.50; P < .001) and work exhaustion scores (mean [SD], 1.95 [0.79] presurvey vs 1.62 [0.68] postsurvey; paired difference, -0.33; 95% CI, -0.50 to -0.17; P < .001). Conclusions and Relevance: In this quality improvement study of an early implementation of generative AI, there was notable adoption, usability, and improvement in assessments of burden and burnout. There was no improvement in time. Further code-to-bedside testing is needed to guide future development and organizational strategy.


Subject(s)
Academic Medical Centers , Artificial Intelligence , United States , Humans , Prospective Studies , Ambulatory Care Facilities , Burnout, Psychological
2.
Arterioscler Thromb Vasc Biol ; 44(1): 290-299, 2024 01.
Article in English | MEDLINE | ID: mdl-37970718

ABSTRACT

BACKGROUND: Despite the ubiquitous utilization of central venous catheters in clinical practice, their use commonly provokes thromboembolism. No prophylactic strategy has shown sufficient efficacy to justify routine use. Coagulation factors FXI (factor XI) and FXII (factor XII) represent novel targets for device-associated thrombosis, which may mitigate bleeding risk. Our objective was to evaluate the safety and efficacy of an anti-FXI mAb (monoclonal antibody), gruticibart (AB023), in a prospective, single-arm study of patients with cancer receiving central line placement. METHODS: We enrolled ambulatory cancer patients undergoing central line placement to receive a single dose of gruticibart (2 mg/kg) administered through the venous catheter within 24 hours of placement and a follow-up surveillance ultrasound at day 14 for evaluation of catheter thrombosis. A parallel, noninterventional study was used as a comparator. RESULTS: In total, 22 subjects (n=11 per study) were enrolled. The overall incidence of catheter-associated thrombosis was 12.5% in the interventional study and 40.0% in the control study. The anti-FXI mAb, gruticibart, significantly prolonged the activated partial thromboplastin time in all subjects on day 14 compared with baseline (P<0.001). Gruticibart was well tolerated and without infusion reactions, drug-related adverse events, or clinically relevant bleeding. Platelet flow cytometry demonstrated no difference in platelet activation following administration of gruticibart. T (thrombin)-AT (antithrombin) and activated FXI-AT complexes increased following central line placement in the control study, which was not demonstrated in our intervention study. CRP (C-reactive protein) did not significantly increase on day 14 in those who received gruticibart, but it did significantly increase in the noninterventional study. CONCLUSIONS: FXI inhibition with gruticibart was well tolerated without any significant adverse or bleeding-related events and resulted in a lower incidence of catheter-associated thrombosis on surveillance ultrasound compared with the published literature and our internal control study. These findings suggest that targeting FXI could represent a safe intervention to prevent catheter thrombosis. REGISTRATION: URL: https://www.clinicaltrials.gov; Unique identifier: NCT04465760.


Subject(s)
Neoplasms , Thrombosis , Humans , Factor XI/metabolism , Prospective Studies , Thrombosis/etiology , Thrombosis/prevention & control , Thrombosis/drug therapy , Hemorrhage/chemically induced , Catheters/adverse effects , Neoplasms/drug therapy , Neoplasms/complications
4.
JAMIA Open ; 6(3): ooad069, 2023 Oct.
Article in English | MEDLINE | ID: mdl-37600073

ABSTRACT

Objectives: Tertiary and quaternary (TQ) care refers to complex cases requiring highly specialized health services. Our study aimed to compare the ability of a natural language processing (NLP) model to an existing human workflow in predictively identifying TQ cases for transfer requests to an academic health center. Materials and methods: Data on interhospital transfers were queried from the electronic health record for the 6-month period from July 1, 2020 to December 31, 2020. The NLP model was allowed to generate predictions on the same cases as the human predictive workflow during the study period. These predictions were then retrospectively compared to the true TQ outcomes. Results: There were 1895 transfer cases labeled by both the human predictive workflow and the NLP model, all of which had retrospective confirmation of the true TQ label. The NLP model receiver operating characteristic curve had an area under the curve of 0.91. Using a model probability threshold of ≥0.3 to be considered TQ positive, accuracy was 81.5% for the NLP model versus 80.3% for the human predictions (P = .198) while sensitivity was 83.6% versus 67.7% (P<.001). Discussion: The NLP model was as accurate as the human workflow but significantly more sensitive. This translated to 15.9% more TQ cases identified by the NLP model. Conclusion: Integrating an NLP model into existing workflows as automated decision support could translate to more TQ cases identified at the onset of the transfer process.

5.
JAMIA Open ; 6(3): ooad054, 2023 Oct.
Article in English | MEDLINE | ID: mdl-37545984

ABSTRACT

Objective: To describe the infrastructure, tools, and services developed at Stanford Medicine to maintain its data science ecosystem and research patient data repository for clinical and translational research. Materials and Methods: The data science ecosystem, dubbed the Stanford Data Science Resources (SDSR), includes infrastructure and tools to create, search, retrieve, and analyze patient data, as well as services for data deidentification, linkage, and processing to extract high-value information from healthcare IT systems. Data are made available via self-service and concierge access, on HIPAA compliant secure computing infrastructure supported by in-depth user training. Results: The Stanford Medicine Research Data Repository (STARR) functions as the SDSR data integration point, and includes electronic medical records, clinical images, text, bedside monitoring data and HL7 messages. SDSR tools include tools for electronic phenotyping, cohort building, and a search engine for patient timelines. The SDSR supports patient data collection, reproducible research, and teaching using healthcare data, and facilitates industry collaborations and large-scale observational studies. Discussion: Research patient data repositories and their underlying data science infrastructure are essential to realizing a learning health system and advancing the mission of academic medical centers. Challenges to maintaining the SDSR include ensuring sufficient financial support while providing researchers and clinicians with maximal access to data and digital infrastructure, balancing tool development with user training, and supporting the diverse needs of users. Conclusion: Our experience maintaining the SDSR offers a case study for academic medical centers developing data science and research informatics infrastructure.

6.
JAMA ; 330(9): 866-869, 2023 09 05.
Article in English | MEDLINE | ID: mdl-37548965

ABSTRACT

Importance: There is increased interest in and potential benefits from using large language models (LLMs) in medicine. However, by simply wondering how the LLMs and the applications powered by them will reshape medicine instead of getting actively involved, the agency in shaping how these tools can be used in medicine is lost. Observations: Applications powered by LLMs are increasingly used to perform medical tasks without the underlying language model being trained on medical records and without verifying their purported benefit in performing those tasks. Conclusions and Relevance: The creation and use of LLMs in medicine need to be actively shaped by provisioning relevant training data, specifying the desired benefits, and evaluating the benefits via testing in real-world deployments.


Subject(s)
Language , Machine Learning , Medical Records , Medicine , Medical Records/standards , Medicine/methods , Medicine/standards , Computer Simulation
7.
NPJ Digit Med ; 6(1): 135, 2023 Jul 29.
Article in English | MEDLINE | ID: mdl-37516790

ABSTRACT

The success of foundation models such as ChatGPT and AlphaFold has spurred significant interest in building similar models for electronic medical records (EMRs) to improve patient care and hospital operations. However, recent hype has obscured critical gaps in our understanding of these models' capabilities. In this narrative review, we examine 84 foundation models trained on non-imaging EMR data (i.e., clinical text and/or structured data) and create a taxonomy delineating their architectures, training data, and potential use cases. We find that most models are trained on small, narrowly-scoped clinical datasets (e.g., MIMIC-III) or broad, public biomedical corpora (e.g., PubMed) and are evaluated on tasks that do not provide meaningful insights on their usefulness to health systems. Considering these findings, we propose an improved evaluation framework for measuring the benefits of clinical foundation models that is more closely grounded to metrics that matter in healthcare.

8.
Eur J Haematol ; 111(4): 516-527, 2023 Oct.
Article in English | MEDLINE | ID: mdl-37455616

ABSTRACT

Although considered "benign," mild blood count abnormalities, genetic factors imparting inconsequential thrombotic risk, and low-risk premalignant blood disorders can have significant psychological and financial impact on our patients. Several studies have demonstrated that patients with noncancerous conditions have increased levels of anxiety with distress similar to those with malignancy. Additionally, referral to a classical hematologist can be a daunting process for many patients due to uncertainties surrounding the reason for referral or misconstrued beliefs in a cancer diagnosis ascribed to the pairing of oncology and hematology in medical practice. If not properly triaged, incidental laboratory abnormalities can trigger extensive and costly evaluation. These challenges are compounded by a lack of consensus guidance and generalizability of modern reference ranges that do not adequately account for common influencing factors. Although often benign, incidental hematologic findings can lead to emotional suffering and careful consideration of the potential psychological and financial duress imparted to an individual must be considered. In this article, we will review the current literature describing the psychological effect of some commonly known hematologic conditions, identify benign causes for variations in hematologic laboratory values, and provide recommendations to reduce psychological toxicity as it pertains to hematologic testing.


Subject(s)
Hematologic Diseases , Hematology , Neoplasms , Humans , Hematologic Diseases/diagnosis , Hematologic Tests , Anxiety
9.
Front Digit Health ; 4: 943768, 2022.
Article in English | MEDLINE | ID: mdl-36339512

ABSTRACT

Multiple reporting guidelines for artificial intelligence (AI) models in healthcare recommend that models be audited for reliability and fairness. However, there is a gap of operational guidance for performing reliability and fairness audits in practice. Following guideline recommendations, we conducted a reliability audit of two models based on model performance and calibration as well as a fairness audit based on summary statistics, subgroup performance and subgroup calibration. We assessed the Epic End-of-Life (EOL) Index model and an internally developed Stanford Hospital Medicine (HM) Advance Care Planning (ACP) model in 3 practice settings: Primary Care, Inpatient Oncology and Hospital Medicine, using clinicians' answers to the surprise question ("Would you be surprised if [patient X] passed away in [Y years]?") as a surrogate outcome. For performance, the models had positive predictive value (PPV) at or above 0.76 in all settings. In Hospital Medicine and Inpatient Oncology, the Stanford HM ACP model had higher sensitivity (0.69, 0.89 respectively) than the EOL model (0.20, 0.27), and better calibration (O/E 1.5, 1.7) than the EOL model (O/E 2.5, 3.0). The Epic EOL model flagged fewer patients (11%, 21% respectively) than the Stanford HM ACP model (38%, 75%). There were no differences in performance and calibration by sex. Both models had lower sensitivity in Hispanic/Latino male patients with Race listed as "Other." 10 clinicians were surveyed after a presentation summarizing the audit. 10/10 reported that summary statistics, overall performance, and subgroup performance would affect their decision to use the model to guide care; 9/10 said the same for overall and subgroup calibration. The most commonly identified barriers for routinely conducting such reliability and fairness audits were poor demographic data quality and lack of data access. This audit required 115 person-hours across 8-10 months. Our recommendations for performing reliability and fairness audits include verifying data validity, analyzing model performance on intersectional subgroups, and collecting clinician-patient linkages as necessary for label generation by clinicians. Those responsible for AI models should require such audits before model deployment and mediate between model auditors and impacted stakeholders.

10.
JAMA Netw Open ; 5(8): e2227779, 2022 08 01.
Article in English | MEDLINE | ID: mdl-35984654

ABSTRACT

Importance: Various model reporting guidelines have been proposed to ensure clinical prediction models are reliable and fair. However, no consensus exists about which model details are essential to report, and commonalities and differences among reporting guidelines have not been characterized. Furthermore, how well documentation of deployed models adheres to these guidelines has not been studied. Objectives: To assess information requested by model reporting guidelines and whether the documentation for commonly used machine learning models developed by a single vendor provides the information requested. Evidence Review: MEDLINE was queried using machine learning model card and reporting machine learning from November 4 to December 6, 2020. References were reviewed to find additional publications, and publications without specific reporting recommendations were excluded. Similar elements requested for reporting were merged into representative items. Four independent reviewers and 1 adjudicator assessed how often documentation for the most commonly used models developed by a single vendor reported the items. Findings: From 15 model reporting guidelines, 220 unique items were identified that represented the collective reporting requirements. Although 12 items were commonly requested (requested by 10 or more guidelines), 77 items were requested by just 1 guideline. Documentation for 12 commonly used models from a single vendor reported a median of 39% (IQR, 37%-43%; range, 31%-47%) of items from the collective reporting requirements. Many of the commonly requested items had 100% reporting rates, including items concerning outcome definition, area under the receiver operating characteristics curve, internal validation, and intended clinical use. Several items reported half the time or less related to reliability, such as external validation, uncertainty measures, and strategy for handling missing data. Other frequently unreported items related to fairness (summary statistics and subgroup analyses, including for race and ethnicity or sex). Conclusions and Relevance: These findings suggest that consistent reporting recommendations for clinical predictive models are needed for model developers to share necessary information for model deployment. The many published guidelines would, collectively, require reporting more than 200 items. Model documentation from 1 vendor reported the most commonly requested items from model reporting guidelines. However, areas for improvement were identified in reporting items related to model reliability and fairness. This analysis led to feedback to the vendor, which motivated updates to the documentation for future users.


Subject(s)
Models, Statistical , Research Report , Data Collection , Humans , Prognosis , Reproducibility of Results
12.
Open Forum Infect Dis ; 8(11): ofab526, 2021 Nov.
Article in English | MEDLINE | ID: mdl-35005055

ABSTRACT

Among 880 healthcare workers with a positive severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) test, 264 (30.0%) infections were identified following receipt of at least 1 vaccine dose. Median SARS-CoV-2 cycle threshold values were highest among individuals receiving 2 vaccine doses, corresponding to lower viral shedding. Vaccination might lead to lower transmissibility of SARS-CoV-2.

13.
Surgery ; 168(6): 980-986, 2020 12.
Article in English | MEDLINE | ID: mdl-33008615

ABSTRACT

BACKGROUND: The coronavirus disease 2019 (COVID-19) pandemic has resulted in reduced performance of elective surgeries and procedures at medical centers across the United States. Awareness of the prevalence of asymptomatic disease is critical for guiding safe approaches to operative/procedural services. As COVID-19 polymerase chain reaction (PCR) testing has been limited largely to symptomatic patients, health care workers, or to those in communal care centers, data regarding asymptomatic viral disease carriage are limited. METHODS: In this retrospective observational case series evaluating UCLA Health patients enrolled in pre-operative/pre-procedure protocol COVID-19 reverse transcriptase (RT)-PCR testing between April 7, 2020 and May 21, 2020, we determine the prevalence of COVID-19 infection in asymptomatic patients scheduled for surgeries and procedures. RESULTS: Primary outcomes include the prevalence of COVID-19 infection in this asymptomatic population. Secondary data analysis includes overall population testing results and population demographics. Eighteen of 4,751 (0.38%) patients scheduled for upcoming surgeries and high-risk procedures had abnormal (positive/inconclusive) COVID-19 RT-PCR testing results. Six of 18 patients were confirmed asymptomatic and had positive test results. Four of 18 were confirmed asymptomtic and had inconclusive results. Eight of 18 had positive results in the setting of recent symptoms or known COVID-19 infection. The prevalence of asymptomatic COVID-19 infection was 0.13%. More than 90% of patients had residential addresses within a 67-mile geographic radius of our medical center, the median age was 58, and there was equal male/female distribution. CONCLUSION: These data demonstrating low levels (0.13% prevalence) of COVID-19 infection in an asymptomatic population of patients undergoing scheduled surgeries/procedures in a large urban area have helped to inform perioperative protocols during the COVID-19 pandemic. Testing protocols like ours may prove valuable for other health systems in their approaches to safe procedural practices during COVID-19.


Subject(s)
Academic Medical Centers/statistics & numerical data , Asymptomatic Diseases/epidemiology , COVID-19/epidemiology , Elective Surgical Procedures , Pandemics , Perioperative Care/statistics & numerical data , SARS-CoV-2 , Adult , Female , Humans , Male , Middle Aged , Prevalence , Retrospective Studies
14.
J Med Internet Res ; 22(9): e21562, 2020 09 10.
Article in English | MEDLINE | ID: mdl-32791492

ABSTRACT

BACKGROUND: Accurately assessing the regional activity of diseases such as COVID-19 is important in guiding public health interventions. Leveraging electronic health records (EHRs) to monitor outpatient clinical encounters may lead to the identification of emerging outbreaks. OBJECTIVE: The aim of this study is to investigate whether excess visits where the word "cough" was present in the EHR reason for visit, and hospitalizations with acute respiratory failure were more frequent from December 2019 to February 2020 compared with the preceding 5 years. METHODS: A retrospective observational cohort was identified from a large US health system with 3 hospitals, over 180 clinics, and 2.5 million patient encounters annually. Data from patient encounters from July 1, 2014, to February 29, 2020, were included. Seasonal autoregressive integrated moving average (SARIMA) time-series models were used to evaluate if the observed winter 2019/2020 rates were higher than the forecast 95% prediction intervals. The estimated excess number of visits and hospitalizations in winter 2019/2020 were calculated compared to previous seasons. RESULTS: The percentage of patients presenting with an EHR reason for visit containing the word "cough" to clinics exceeded the 95% prediction interval the week of December 22, 2019, and was consistently above the 95% prediction interval all 10 weeks through the end of February 2020. Similar trends were noted for emergency department visits and hospitalizations starting December 22, 2019, where observed data exceeded the 95% prediction interval in 6 and 7 of the 10 weeks, respectively. The estimated excess over the 3-month 2019/2020 winter season, obtained by either subtracting the maximum or subtracting the average of the five previous seasons from the current season, was 1.6 or 2.0 excess visits for cough per 1000 outpatient visits, 11.0 or 19.2 excess visits for cough per 1000 emergency department visits, and 21.4 or 39.1 excess visits per 1000 hospitalizations with acute respiratory failure, respectively. The total numbers of excess cases above the 95% predicted forecast interval were 168 cases in the outpatient clinics, 56 cases for the emergency department, and 18 hospitalized with acute respiratory failure. CONCLUSIONS: A significantly higher number of patients with respiratory complaints and diseases starting in late December 2019 and continuing through February 2020 suggests community spread of SARS-CoV-2 prior to established clinical awareness and testing capabilities. This provides a case example of how health system analytics combined with EHR data can provide powerful and agile tools for identifying when future trends in patient populations are outside of the expected ranges.


Subject(s)
Cough/epidemiology , Respiratory Insufficiency/epidemiology , Acute Disease , Adult , Ambulatory Care Facilities , Betacoronavirus , COVID-19 , California/epidemiology , Coronavirus Infections , Electronic Health Records , Emergency Service, Hospital , Female , Hospitalization/statistics & numerical data , Humans , Male , Middle Aged , Pandemics , Pneumonia, Viral , Retrospective Studies , SARS-CoV-2 , Seasons
15.
J Am Coll Radiol ; 17(10): 1299-1306, 2020 Oct.
Article in English | MEDLINE | ID: mdl-32387372

ABSTRACT

Diagnostic radiology (DxR), having had successful serial co-evolutions with imaging equipment and PACS, is faced with another. With a backdrop termed "globotics transition," it should create an IT and informatics infrastructure capable of integrating artificial intelligence (AI) into current critical communication functions of PACS and incorporating functions currently residing in balkanized products. DxR will face the challenge of adopting sustaining and disruptive AI innovations simultaneously. In this co-evolution, a major selection force for AI will be increasing the flow of information and patients; "increasing" means faster flow over larger areas defined by geography and content. Larger content includes a broader spectrum of imaging and nonimaging information streams that facilitate medical decision making. Evolution to faster flow will gravitate toward a hierarchical IT architecture consisting of many small channels feeding into fewer larger channels, something potentially difficult for current PACS. Smartphone-like architecture optimized for communication and integration could provide a large-channel backbone and many smaller feeding channels for basic functions, as well as those needing to innovate rapidly. New, more flexible architectures stimulate market competition in which DxR could act as an artificial selection force to influence development of faster increased flow in current PACS companies, in disruptors such as consolidated AI companies, or in entirely new entrants like Apple or Google. In this co-evolution, DxR should be able to stimulate design of a modern communication medium that increases the flow of information and decreases the time and energy necessary to absorb it, thereby creating even more indispensable clinical value for itself.


Subject(s)
Radiology Information Systems , Radiology , Artificial Intelligence , Diagnostic Imaging , Humans , Smartphone
17.
Appl Clin Inform ; 10(3): 421-445, 2019 05.
Article in English | MEDLINE | ID: mdl-31216590

ABSTRACT

BACKGROUND: In 2013, the American College of Cardiology (ACC) and the American Heart Association (AHA) released a revised guideline on statin therapy initiation. The guideline included a 10-year risk calculation based on regression modeling, which made hand calculation infeasible. Compliance to the guideline has been suboptimal, as many patients were recommended but not prescribed statin therapy. Clinical decision support (CDS) tools may improve statin guideline compliance. Few statin guideline CDS tools evaluated clinical outcome. OBJECTIVES: We determined if use of a CDS tool, the statin macro, was associated with increased 2013 ACC/AHA statin guideline compliance at the level of statin prescription versus no statin prescription. We did not determine if each patient's statin prescription met ACC/AHA 2013 therapy intensity recommendations (high vs. moderate vs. low). METHODS: The authors developed a clinician-initiated, EHR-embedded statin macro command ("statin macro") that displayed the 2013 ACC/AHA statin guideline recommendation in the electronic health record documentation. We included patients who had a primary care visit during the study period (January 1-June 30, 2016), were eligible for statin therapy based on the ACC/AHA guideline prior to the study period, and were not prescribed statin therapy prior to the study period. We tested the association of macro usage and statin therapy prescription during the study period using relative risk and mixed effect logistic regression. RESULTS: Subjects included 11,877 patients seen in primary care, who were retrospectively recommended statin therapy at study initiation based on the ACC/AHA guideline, but who had not received statin therapy. During the study period, 125 clinicians used the statin macro command for 389 of the 11,877 patients (3.2%). Of the 389 patients for whom that statin macro was used, 108 patients (28%) had a statin prescribed during the study period. Of the 11,488 for whom the statin macro was not used, 1,360 (13%) patients received a clinician-prescribed statin (relative risk 2.3, p < 0.001). Controlling for patient covariates and clinicians, statin macro usage was significantly associated with statin therapy prescription (odds ratio 2.86, p < 0.001). CONCLUSION: Although the statin macro had low uptake, its use was associated with a greater rate of statin prescriptions (dosage not determined) for patients whom 2013 ACC/AHA guidelines required statin therapy.


Subject(s)
Attitude to Computers , Decision Support Systems, Clinical , Drug Prescriptions/statistics & numerical data , Electronic Health Records/statistics & numerical data , Guidelines as Topic , Hydroxymethylglutaryl-CoA Reductase Inhibitors/therapeutic use , Physicians/psychology , Adult , Aged , Cohort Studies , Female , Humans , Male , Middle Aged , Physicians/statistics & numerical data , Retrospective Studies
18.
Int J Med Inform ; 124: 24-30, 2019 04.
Article in English | MEDLINE | ID: mdl-30784423

ABSTRACT

INTRODUCTION: Integrating mobile applications (apps) into users' standard electronic health record (EHR) workflows may be valuable, especially for apps that both read and write data. This report details the lessons learned during the integration of a patient decision aid - prostate specific antigen (PSA) testing for prostate cancer screening - into our users' standard EHR workflow for a small usability assessment. MATERIALS AND METHODS: This feasibility study included two steps. First we enabled realtime, secure bidirectional data exchange between the mobile app and EHR for 14 data elements, and second we pilot tested the production environment app with 9 primary care patients aged 60-65 years. Our primary usability metric was a net promoter score (NPS), based on users' recommendation of the app to a friend or family member; we also assessed the proportion of users who 1) updated their prostate cancer risk factor information present in the EHR and 2) submitted more than one unique response regarding their preference to have PSA testing. RESULTS: The seven web services necessary to read and write data required considerable configuration, but successfully delivered risk factor-specific educational content and recorded patients' values and decision preference directly within the EHR. Seven of the 9 patients (78%) would recommend this app to a friend/family member (NPS = 55.6%), one patient used the app to update risk factor information, and 4/9 (44%) changed their decision preference while using the app. CONCLUSIONS: It is feasible to implement a decision aid directly into users' standard EHR workflow for limited usability testing. Broad scale implementation may have a positive effect on patient engagement and improve shared decision making, but several challenges exist with proprietary EHR vendor application programming interfaces (API)s.


Subject(s)
Decision Making , Electronic Health Records , Prostatic Neoplasms/diagnosis , Aged , Early Detection of Cancer , Feasibility Studies , Humans , Male , Middle Aged , Mobile Applications , Prostate-Specific Antigen/analysis , User-Computer Interface
19.
Appl Clin Inform ; 10(1): 96-102, 2019 01.
Article in English | MEDLINE | ID: mdl-30727003

ABSTRACT

BACKGROUND: Given the widespread electronic health record adoption, there is increasing interest to leverage patient portals to improve care. OBJECTIVE: To determine characteristics of patient portal users and the activities they accessed in the patient portal. METHODS: We performed a retrospective analysis of patient portal usage at University of California, Los Angeles, Health from July 2014 to May 2015. A total dataset of 505,503 patients was compiled with 396,303 patients who did not register for the patient portal and 109,200 patients who registered for a patient portal account. We compared patients who did not register for the online portal to the top 75th percentile of users based on number of logins, which was done to exclude those who only logged in to register. Finally, to avoid doing statistical analysis on too large of a sample and overpower the analysis, we performed statistical tests on a random sample of 300 patients in each of the two groups. RESULTS: Patient portal users tended to be older (49.45 vs. 46.22 years in the entire sample, p = 0.008 in the random sample) and more likely female (62.59 vs. 54.91% in the entire sample, p = 0.035 in the random sample). Nonusers had more monthly emergency room (ER) visits on average (0.047 vs. 0.014, p < 0.001). The most frequently accessed activity on the portal was viewing laboratory results (79.7% of users looked at laboratory results). CONCLUSION: There are differences between patient portal users and nonusers, and further understanding of these differences can serve as foundation for further investigation and possible interventions to drive patient engagement and health outcomes.


Subject(s)
Demography , Patient Portals/statistics & numerical data , Female , Humans , Male , Middle Aged , Patient Participation/statistics & numerical data
20.
Pract Radiat Oncol ; 9(2): 102-107, 2019 Mar.
Article in English | MEDLINE | ID: mdl-30342179

ABSTRACT

PURPOSE: There is an increasing effort to allow patients open access to their physician notes through electronic medical record portals. However, limited data exist on the impact of such access on oncology patients, and concerns remain regarding potential harms. Therefore, we determined the baseline perceptions and impact of open access to oncology notes on radiation oncology patients. METHODS AND MATERIALS: Patients receiving radiation therapy were provided instructional materials on accessing oncology notes at the time of their initial evaluation. Patients were prospectively surveyed to evaluate baseline interest and expectations before access and to determine the actual usage and impact at the end of their radiation treatment course. RESULTS: A total of 220 patients were surveyed; 136 (62%) completed the baseline survey, of which 88 (40%) completed the final survey. The majority of participants were age >60 years (n = 83; 61%), and 70 were male (51%). Before accessing the notes, the majority of patients agreed that open access to oncology notes would improve understanding of diagnosis (99%), understanding of treatment side effects (98%), reassurance about treatment goals (96%), and communication with family (99%). All patients who accessed the notes found them to be useful. After accessing the notes, approximately 96%, 94%, and 96% of patients reported an improved understanding of their diagnosis, an improved understanding of treatment side effects, and feeling more reassured about their treatment, respectively. Approximately 11%, 6%, and 4% of patients noted increased worry, increased confusion, and finding information they now regret reading, respectively. Patient age, sex, and specific cancer diagnoses were not predictive of experiencing negative effects from accessing the notes. CONCLUSIONS: Radiation oncology patients have a strong interest in open access to their physician notes, and the majority of patients expect and actually report meaningful benefits. These data support strategies to allow more patients with cancer access to their physicians' notes.


Subject(s)
Access to Information , Neoplasms/radiotherapy , Physician-Patient Relations , Radiation Oncologists/organization & administration , Radiation Oncology/organization & administration , Adult , Aged , Aged, 80 and over , Electronic Health Records , Female , Humans , Internet , Male , Middle Aged , Neoplasms/psychology , Patient Education as Topic , Prospective Studies , Surveys and Questionnaires/statistics & numerical data , Young Adult
SELECTION OF CITATIONS
SEARCH DETAIL
...