Your browser doesn't support javascript.
loading
Mostrar: 20 | 50 | 100
Resultados 1 - 20 de 203
Filtrar
1.
JMIR Med Inform ; 12: e49781, 2024 Oct 14.
Artigo em Inglês | MEDLINE | ID: mdl-39401130

RESUMO

Background: Electronic medical records (EMRs) contain large amounts of detailed clinical information. Using medical record review to identify conditions within large quantities of EMRs can be time-consuming and inefficient. EMR-based phenotyping using machine learning and natural language processing algorithms is a continually developing area of study that holds potential for numerous mental health disorders. Objective: This review evaluates the current state of EMR-based case identification for depression and provides guidance on using current algorithms and constructing new ones. Methods: A scoping review of EMR-based algorithms for phenotyping depression was completed. This research encompassed studies published from January 2000 to May 2023. The search involved 3 databases: Embase, MEDLINE, and APA PsycInfo. This was carried out using selected keywords that fell into 3 categories: terms connected with EMRs, terms connected to case identification, and terms pertaining to depression. This study adhered to the PRISMA-ScR (Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews) guidelines. Results: A total of 20 papers were assessed and summarized in the review. Most of these studies were undertaken in the United States, accounting for 75% (15/20). The United Kingdom and Spain followed this, accounting for 15% (3/20) and 10% (2/20) of the studies, respectively. Both data-driven and clinical rule-based methodologies were identified. The development of EMR-based phenotypes and algorithms indicates the data accessibility permitted by each health system, which led to varying performance levels among different algorithms. Conclusions: Better use of structured and unstructured EMR components through techniques such as machine learning and natural language processing has the potential to improve depression phenotyping. However, more validation must be carried out to have confidence in depression case identification algorithms in general.


Assuntos
Algoritmos , Depressão , Registros Eletrônicos de Saúde , Processamento de Linguagem Natural , Humanos , Depressão/diagnóstico , Depressão/epidemiologia , Aprendizado de Máquina , Pacientes Internados/psicologia , Fenótipo
2.
Eur J Med Res ; 29(1): 491, 2024 Oct 07.
Artigo em Inglês | MEDLINE | ID: mdl-39375738

RESUMO

BACKGROUND: Over the past decade, numerous studies on potential factors contributing to ventilation-induced lung injury have been carried out. Mechanical power has been pointed out as the parameter that encloses all ventilation-induced lung injury-contributing factors. However, studies conducted to date provide data regarding mechanical power during the early hours of mechanical ventilation that may not accurately reflect the impact of power throughout the period of mechanical ventilatory support on intensive care unit mortality. METHODS: Retrospective observational study conducted at a single center in Spain. Patients admitted to the intensive care unit, > o = 18 years of age, and ventilated for over 24 h were included. We extracted the mechanical power values throughout the entire mechanical ventilation in controlled modes period from the clinical information system every 2 min. First, we calculate the cutoff-point for mechanical power beyond which there was a greater change in the probability of death. After, the sum of time values above the safe cut-off point was calculated to obtain the value in hours. We analyzed if the number of hours the patient was under ventilation with a mechanical power above the safe threshold was associated with intensive care unit mortality, invasive mechanical ventilation days, and intensive care unit length of stay. We repeated the analysis in different subgroups based on the degree of hypoxemia and in patients with SARS CoV-2 pneumonia. RESULTS: The cut-off point of mechanical power at with there is a higher increase in intensive care unit mortality was 18 J/min. The greater the number of hours patients were under mechanical power > 18 J/min the higher the intensive care unit mortality in all the study population, in patients with SARS CoV-2 pneumonia and in mild to moderate hypoxemic respiratory failure. The risk of death in the intensive care unit increases 0.1% for each hour with mechanical power exceeding 18 J/min. The number of hours with mechanical power > 18 J/min also affected the days of invasive mechanical ventilation and intensive care unit length of stay. CONCLUSIONS: The number of hours with mechanical power > 18 J/min is associated with mortality in the intensive care unit in critically ill patients. Continuous monitoring of mechanical power in controlled modes using an automated clinical information system could alert the clinician to this risk.


Assuntos
COVID-19 , Estado Terminal , Unidades de Terapia Intensiva , Respiração Artificial , Humanos , Estado Terminal/mortalidade , Masculino , Feminino , Estudos Retrospectivos , Pessoa de Meia-Idade , Idoso , COVID-19/mortalidade , COVID-19/terapia , Mortalidade Hospitalar , Espanha/epidemiologia , SARS-CoV-2 , Lesão Pulmonar Induzida por Ventilação Mecânica/mortalidade , Tempo de Internação
3.
Aust N Z J Psychiatry ; : 48674241286825, 2024 Oct 11.
Artigo em Inglês | MEDLINE | ID: mdl-39392262

RESUMO

OBJECTIVE: To determine whether completion of an online mental health self-assessment by patients who are waiting in the emergency department can save clinician time taken to complete clinical assessment and documentation. METHODS: Patients presenting to a psychiatric emergency department for a period of 6 months were allocated by week of presentation to either the intervention arm (online mental health self-assessment, followed by a clinical interview) or the control arm (usual assessment) arm on a random basis. Time at the beginning and end of the interview was recorded and used to derive interview time. Similarly, time at the beginning and end of the clinical documentation was recorded and used to derive the time to complete clinical documentation. RESULTS: Of 168 patients who presented during the study period, 69 (38.55%) agreed to participate, 33 completed the usual assessment and 30 completed the online mental health self-assessment followed by a clinical interview. Patients receiving usual care had a statistically significant, t(61) = 2.15, p = 0.035, longer interview duration (M = 48.7 minutes, SD = 19.8) compared with those in the online mental health self-assessment arm (M = 38.9 minutes, SD = 15.9). There was no statistically significant difference between groups for documentation time, t(61) = -0.64, p = 0.52. CONCLUSION: Online mental health self-assessment was associated with a statistically significant reduction in interview time by approximately 10 minutes without increasing documentation time. While online mental health self-assessment is not appropriate for all patients in the emergency department setting, it is likely to yield greater benefits in less acute settings.

4.
Womens Health Rep (New Rochelle) ; 5(1): 689-696, 2024.
Artigo em Inglês | MEDLINE | ID: mdl-39463472

RESUMO

Background: Decreasing primary care access and increasing emergency department (ED) usage is a potential contributor to declining cancer screening prevalences in those facing barriers to health care access. The ED is a non-traditional yet potentially high-yield setting for implementation of interventions to monitor and increase cancer screening. Methods: An ED-administered survey in July 2022 gathered data on breast, cervical, and colorectal cancer screening, as well as human papillomavirus (HPV) vaccination status of females presenting to the ED for care. This was compared with electronic health record (EHR) data extraction of all ED patients during the same timeframe. Primary outcome was proportion of cancer screening and HPV vaccination not up to date in each group. Results: ED survey was administered to 101 individuals; EHR data was extracted on 2934 patients. Survey versus EHR, respectively, found cervical cancer screening was not up to date in 6.2% vs. 77.6%, breast cancer screening in 14.3% vs. 73.4%, colorectal cancer screening in 22.9% vs. 56.5%, and HPV vaccination in 33.3% vs. 57.8%. p value was < 0.001 for all screening category comparisons between survey and EHR. Discussion: Our data indicate significant discrepancies between self-reported screening history and EHR data. ED survey results were more in line with the observed screening rates in various surveillance systems and published in the literature. This suggests that point-of-care ED survey administration may be more effective in identifying those needing preventative cancer screening, especially in individuals with less access to routine health care.

5.
JMIR Med Inform ; 12: e52678, 2024 Sep 20.
Artigo em Inglês | MEDLINE | ID: mdl-39302636

RESUMO

Background: Collaborative documentation (CD) is a behavioral health practice involving shared writing of clinic visit notes by providers and consumers. Despite widespread dissemination of CD, research on its effectiveness or impact on person-centered care (PCC) has been limited. Principles of PCC planning, a recovery-based approach to service planning that operationalizes PCC, can inform the measurement of person-centeredness within clinical documentation. Objective: This study aims to use the clinical informatics approach of natural language processing (NLP) to examine the impact of CD on person-centeredness in clinic visit notes. Using a dictionary-based approach, this study conducts a textual analysis of clinic notes from a community mental health center before and after staff were trained in CD. Methods: This study used visit notes (n=1981) from 10 providers in a community mental health center 6 months before and after training in CD. LIWC-22 was used to assess all notes using the Linguistic Inquiry and Word Count (LIWC) dictionary, which categorizes over 5000 linguistic and psychological words. Twelve LIWC categories were selected and mapped onto PCC planning principles through the consensus of 3 domain experts. The LIWC-22 contextualizer was used to extract sentence fragments from notes corresponding to LIWC categories. Then, fixed-effects modeling was used to identify differences in notes before and after CD training while accounting for nesting within the provider. Results: Sentence fragments identified by the contextualizing process illustrated how visit notes demonstrated PCC. The fixed effects analysis found a significant positive shift toward person-centeredness; this was observed in 6 of the selected LIWC categories post CD. Specifically, there was a notable increase in words associated with achievement (ß=.774, P<.001), power (ß=.831, P<.001), money (ß=.204, P<.001), physical health (ß=.427, P=.03), while leisure words decreased (ß=-.166, P=.002). Conclusions: By using a dictionary-based approach, the study identified how CD might influence the integration of PCC principles within clinical notes. Although the results were mixed, the findings highlight the potential effectiveness of CD in enhancing person-centeredness in clinic notes. By leveraging NLP techniques, this research illuminated the value of narrative clinical notes in assessing the quality of care in behavioral health contexts. These findings underscore the promise of NLP for quality assurance in health care settings and emphasize the need for refining algorithms to more accurately measure PCC.


Assuntos
Documentação , Processamento de Linguagem Natural , Assistência Centrada no Paciente , Humanos , Documentação/métodos , Registros Eletrônicos de Saúde , Serviços Comunitários de Saúde Mental/organização & administração
6.
J Med Internet Res ; 26: e55315, 2024 Sep 30.
Artigo em Inglês | MEDLINE | ID: mdl-39348889

RESUMO

BACKGROUND: Ensuring access to accurate and verified information is essential for effective patient treatment and diagnosis. Although health workers rely on the internet for clinical data, there is a need for a more streamlined approach. OBJECTIVE: This systematic review aims to assess the current state of artificial intelligence (AI) and natural language processing (NLP) techniques in health care to identify their potential use in electronic health records and automated information searches. METHODS: A search was conducted in the PubMed, Embase, ScienceDirect, Scopus, and Web of Science online databases for articles published between January 2000 and April 2023. The only inclusion criteria were (1) original research articles and studies on the application of AI-based medical clinical decision support using NLP techniques and (2) publications in English. A Critical Appraisal Skills Programme tool was used to assess the quality of the studies. RESULTS: The search yielded 707 articles, from which 26 studies were included (24 original articles and 2 systematic reviews). Of the evaluated articles, 21 (81%) explained the use of NLP as a source of data collection, 18 (69%) used electronic health records as a data source, and a further 8 (31%) were based on clinical data. Only 5 (19%) of the articles showed the use of combined strategies for NLP to obtain clinical data. In total, 16 (62%) articles presented stand-alone data review algorithms. Other studies (n=9, 35%) showed that the clinical decision support system alternative was also a way of displaying the information obtained for immediate clinical use. CONCLUSIONS: The use of NLP engines can effectively improve clinical decision systems' accuracy, while biphasic tools combining AI algorithms and human criteria may optimize clinical diagnosis and treatment flows. TRIAL REGISTRATION: PROSPERO CRD42022373386; https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=373386.


Assuntos
Sistemas de Apoio a Decisões Clínicas , Registros Eletrônicos de Saúde , Processamento de Linguagem Natural , Humanos , Inteligência Artificial
7.
JMIR Med Inform ; 12: e49997, 2024 Sep 09.
Artigo em Inglês | MEDLINE | ID: mdl-39250782

RESUMO

BACKGROUND: A wealth of clinically relevant information is only obtainable within unstructured clinical narratives, leading to great interest in clinical natural language processing (NLP). While a multitude of approaches to NLP exist, current algorithm development approaches have limitations that can slow the development process. These limitations are exacerbated when the task is emergent, as is the case currently for NLP extraction of signs and symptoms of COVID-19 and postacute sequelae of SARS-CoV-2 infection (PASC). OBJECTIVE: This study aims to highlight the current limitations of existing NLP algorithm development approaches that are exacerbated by NLP tasks surrounding emergent clinical concepts and to illustrate our approach to addressing these issues through the use case of developing an NLP system for the signs and symptoms of COVID-19 and PASC. METHODS: We used 2 preexisting studies on PASC as a baseline to determine a set of concepts that should be extracted by NLP. This concept list was then used in conjunction with the Unified Medical Language System to autonomously generate an expanded lexicon to weakly annotate a training set, which was then reviewed by a human expert to generate a fine-tuned NLP algorithm. The annotations from a fully human-annotated test set were then compared with NLP results from the fine-tuned algorithm. The NLP algorithm was then deployed to 10 additional sites that were also running our NLP infrastructure. Of these 10 sites, 5 were used to conduct a federated evaluation of the NLP algorithm. RESULTS: An NLP algorithm consisting of 12,234 unique normalized text strings corresponding to 2366 unique concepts was developed to extract COVID-19 or PASC signs and symptoms. An unweighted mean dictionary coverage of 77.8% was found for the 5 sites. CONCLUSIONS: The evolutionary and time-critical nature of the PASC NLP task significantly complicates existing approaches to NLP algorithm development. In this work, we present a hybrid approach using the Open Health Natural Language Processing Toolkit aimed at addressing these needs with a dictionary-based weak labeling step that minimizes the need for additional expert annotation while still preserving the fine-tuning capabilities of expert involvement.

8.
Stud Health Technol Inform ; 316: 362-366, 2024 Aug 22.
Artigo em Inglês | MEDLINE | ID: mdl-39176752

RESUMO

Biobanks serve as vital repositories for human biospecimens and clinical data, promoting biomedical and clinical research. The integration of electronic health records particularly enhances research opportunities in the era of genomics and personalized medicine, improving understanding of tumor development and disease progression. Based on the Korea Biobank Network Common Data Model, it is possible to expand data collection across various diseases. We have developed an innovative big data platform designed to efficiently collect large-scale clinical information within the KBN. By implementing the system structure, data quality management processes, and basic statistical preprocessing functionalities, we have collected data from 136,473 individuals from 2021 to 2023, demonstrating the platform's continuous and efficient data collection capabilities. Integration with hospital systems and robust quality management ensure the acquisition of high-quality data.


Assuntos
Big Data , Bancos de Espécimes Biológicos , Registros Eletrônicos de Saúde , República da Coreia , Humanos
9.
Stud Health Technol Inform ; 316: 791-795, 2024 Aug 22.
Artigo em Inglês | MEDLINE | ID: mdl-39176911

RESUMO

To address the persistent challenges in healthcare, it is crucial to incorporate firsthand experiences and perspectives from stakeholders such as patients and healthcare professionals. However, the current process of collecting, analyzing and interpreting qualitative data, such as interviews, is slow and labor-intensive. To expedite this process and enhance efficiency, automated approaches aim to extract meaningful themes and accelerate interpretation, but current approaches such as topic modeling reduce the richness of the raw data. Here, we evaluate whether Large Language Models can be used to support the semi-automated interpretation of qualitative interview data. We compare a novel approach based on LLMs to topic modeling approaches and to manually identified themes across two different qualitative interview datasets. This exploratory study finds that LLMs have the potential to support incorporating human perspectives more widely in the advancement of sustainable healthcare systems.


Assuntos
Entrevistas como Assunto , Pesquisa Qualitativa , Humanos , Processamento de Linguagem Natural
10.
Comput Biol Med ; 180: 108956, 2024 Sep.
Artigo em Inglês | MEDLINE | ID: mdl-39121682

RESUMO

BACKGROUND: The consent protocol is now a critical part in the overall orchestration of clinical research. We aimed to demonstrate the feasibility of an Ethereum-based informed consent system, which includes an immutable and automated channel of consent matching, to simultaneously assure patient privacy and increase the efficiency of researchers' data access. METHOD: We simulated a multi-site scenario, each assigned 10000 consent records. A consent record contained one patient's data-sharing preference with regards to seven data categories. We developed a blockchain-based infrastructure with a smart contract to record consents on-chain, and to query consenting patients corresponding to specific criteria. We measured our system's recording efficiency against a baseline design and verified accuracy by testing an exhaustive list of possible queries. RESULTS: Our method achieved ∼3-4% lead with an average insertion speed of ∼2 s per record per node on either a 3-, 4- or 5-node network, and 100 % accuracy. It also outperformed other solutions in external validation. DISCUSSION: The speed we achieved is reasonable in a real-world system under the realistic assumption that patients may not change their minds too frequently, with the added benefit of immutability. Furthermore, the per-insertion time did improve slightly as the number of network nodes increased, attesting to the benefit of node parallelism as it suggests no attrition of insertion efficiency due to scale of nodes. CONCLUSIONS: Our work confirms the technical feasibility of a blockchain-based consent mechanism, assuring patients with an immutable audit trail, and providing researchers with an efficient way to reach their cohorts.


Assuntos
Pesquisa Biomédica , Consentimento Livre e Esclarecido , Humanos , Disseminação de Informação , Blockchain , Registros Eletrônicos de Saúde
11.
JMIR Med Educ ; 10: e56342, 2024 Jul 25.
Artigo em Inglês | MEDLINE | ID: mdl-39118469

RESUMO

Background: Teaching medical students the skills required to acquire, interpret, apply, and communicate clinical information is an integral part of medical education. A crucial aspect of this process involves providing students with feedback regarding the quality of their free-text clinical notes. Objective: The goal of this study was to assess the ability of ChatGPT 3.5, a large language model, to score medical students' free-text history and physical notes. Methods: This is a single-institution, retrospective study. Standardized patients learned a prespecified clinical case and, acting as the patient, interacted with medical students. Each student wrote a free-text history and physical note of their interaction. The students' notes were scored independently by the standardized patients and ChatGPT using a prespecified scoring rubric that consisted of 85 case elements. The measure of accuracy was percent correct. Results: The study population consisted of 168 first-year medical students. There was a total of 14,280 scores. The ChatGPT incorrect scoring rate was 1.0%, and the standardized patient incorrect scoring rate was 7.2%. The ChatGPT error rate was 86%, lower than the standardized patient error rate. The ChatGPT mean incorrect scoring rate of 12 (SD 11) was significantly lower than the standardized patient mean incorrect scoring rate of 85 (SD 74; P=.002). Conclusions: ChatGPT demonstrated a significantly lower error rate compared to standardized patients. This is the first study to assess the ability of a generative pretrained transformer (GPT) program to score medical students' standardized patient-based free-text clinical notes. It is expected that, in the near future, large language models will provide real-time feedback to practicing physicians regarding their free-text notes. GPT artificial intelligence programs represent an important advance in medical education and medical practice.


Assuntos
Estudantes de Medicina , Humanos , Estudos Retrospectivos , Educação de Graduação em Medicina/métodos , Avaliação Educacional/métodos , Idioma , Anamnese/métodos , Anamnese/normas , Competência Clínica/normas , Masculino
12.
Life (Basel) ; 14(8)2024 Jul 24.
Artigo em Inglês | MEDLINE | ID: mdl-39202670

RESUMO

In Germany, there is currently no official guideline for the submission of placentas for histopathological examination. Placentas are sent for histological examination by obstetricians according to locally defined indications, which leads to different practices in different centers. In this study, two cohorts of placentas were compared to assess the clinical relevance of placental examination. One cohort consisted of placentas with a clinical indication for histologic examination and the other of placentas with a clinically healthy pregnancy and a healthy infant. In this study, a placenta request form based on established international guidelines was used. Placentas from singleton and twin pregnancies with and without clinical indications were histopathologically examined. Clinical information was extracted from the request form and later correlated with histological findings. A total of 236 placentas were examined, including 127 (53.8%) with clinical indications and 109 (46.2%) without. The concordance between submission reasons and histopathological findings was higher in singleton pregnancies with clinical indications (90.9%) compared to twin pregnancies (62.97%). Placentas from singleton and twin pregnancies with clinical indications exhibited significantly more pathological findings than their respective healthy control groups. Histopathological examination of the placenta can confirm or reveal placenta pathologies and therefore improve the care of the mother, child and future pregnancies.

13.
J Med Internet Res ; 26: e56095, 2024 Jul 15.
Artigo em Inglês | MEDLINE | ID: mdl-39008341

RESUMO

BACKGROUND: Digital tools are progressively reshaping the daily work of health care professionals (HCPs) in hospitals. While this transformation holds substantial promise, it leads to frustrating experiences, raising concerns about negative impacts on clinicians' well-being. OBJECTIVE: The goal of this study was to comprehensively explore the lived experiences of HCPs navigating digital tools throughout their daily routines. METHODS: Qualitative in-depth interviews with 52 HCPs representing 24 medical specialties across 14 hospitals in Switzerland were performed. RESULTS: Inductive thematic analysis revealed 4 main themes: digital tool use, workflow and processes, HCPs' experience of care delivery, and digital transformation and management of change. Within these themes, 6 intriguing paradoxes emerged, and we hypothesized that these paradoxes might partly explain the persistence of the challenges facing hospital digitalization: the promise of efficiency and the reality of inefficiency, the shift from face to face to interface, juggling frustration and dedication, the illusion of information access and trust, the complexity and intersection of workflows and care paths, and the opportunities and challenges of shadow IT. CONCLUSIONS: Our study highlights the central importance of acknowledging and considering the experiences of HCPs to support the transformation of health care technology and to avoid or mitigate any potential negative experiences that might arise from digitalization. The viewpoints of HCPs add relevant insights into long-standing informatics problems in health care and may suggest new strategies to follow when tackling future challenges.


Assuntos
Pesquisa Qualitativa , Humanos , Suíça , Entrevistas como Assunto , Hospitais , Feminino , Masculino , Pessoal de Saúde/psicologia , Fluxo de Trabalho , Atenção à Saúde
14.
Stud Health Technol Inform ; 315: 124-128, 2024 Jul 24.
Artigo em Inglês | MEDLINE | ID: mdl-39049238

RESUMO

CIS implementations are complex processes involving numerous teams, planning changes to both business and technical processes, and extensive change management. The complexity of implementation increases exponentially when dealing with implementation across an entire province rather than just a single site implementation. This paper addresses the One Person One Record Program in Nova Scotia, Canada where a single CIS will be implemented across the entire province involving 47 acute care facilities and 1400 individual ambulatory clinics. Developing and delivering localized role-specific training to end users is directly affected by the extensive arrange of unique user roles and is part of the complexity in this transformation program. Challenges arising from the additional complexity will be shared as well as lessons learned to support the implementations of future leaders with plans to lead such transformations in their own regions.


Assuntos
Registros Eletrônicos de Saúde , Nova Escócia , Humanos , Modelos Organizacionais
15.
Brain Sci ; 14(6)2024 Jun 20.
Artigo em Inglês | MEDLINE | ID: mdl-38928618

RESUMO

Intracerebral hemorrhage (ICH) is a critical condition characterized by a high prevalence, substantial mortality rates, and unpredictable clinical outcomes, which results in a serious threat to human health. Improving the timeliness and accuracy of prognosis assessment is crucial to minimizing mortality and long-term disability associated with ICH. Due to the complexity of ICH, the diagnosis of ICH in clinical practice heavily relies on the professional expertise and clinical experience of physicians. Traditional prognostic methods largely depend on the specialized knowledge and subjective judgment of healthcare professionals. Meanwhile, existing artificial intelligence (AI) methodologies, which predominantly utilize features derived from computed tomography (CT) scans, fall short of capturing the multifaceted nature of ICH. Although existing methods are capable of integrating clinical information and CT images for prognosis, the effectiveness of this fusion process still requires improvement. To surmount these limitations, the present study introduces a novel AI framework, termed the ICH Network (ICH-Net), which employs a joint-attention cross-modal network to synergize clinical textual data with CT imaging features. The architecture of ICH-Net consists of three integral components: the Feature Extraction Module, which processes and abstracts salient characteristics from the clinical and imaging data, the Feature Fusion Module, which amalgamates the diverse data streams, and the Classification Module, which interprets the fused features to deliver prognostic predictions. Our evaluation, conducted through a rigorous five-fold cross-validation process, demonstrates that ICH-Net achieves a commendable accuracy of up to 87.77%, outperforming other state-of-the-art methods detailed within our research. This evidence underscores the potential of ICH-Net as a formidable tool in prognosticating ICH, promising a significant advancement in clinical decision-making and patient care.

16.
JMIR Med Inform ; 12: e55318, 2024 Apr 08.
Artigo em Inglês | MEDLINE | ID: mdl-38587879

RESUMO

BACKGROUND: Large language models (LLMs) have shown remarkable capabilities in natural language processing (NLP), especially in domains where labeled data are scarce or expensive, such as the clinical domain. However, to unlock the clinical knowledge hidden in these LLMs, we need to design effective prompts that can guide them to perform specific clinical NLP tasks without any task-specific training data. This is known as in-context learning, which is an art and science that requires understanding the strengths and weaknesses of different LLMs and prompt engineering approaches. OBJECTIVE: The objective of this study is to assess the effectiveness of various prompt engineering techniques, including 2 newly introduced types-heuristic and ensemble prompts, for zero-shot and few-shot clinical information extraction using pretrained language models. METHODS: This comprehensive experimental study evaluated different prompt types (simple prefix, simple cloze, chain of thought, anticipatory, heuristic, and ensemble) across 5 clinical NLP tasks: clinical sense disambiguation, biomedical evidence extraction, coreference resolution, medication status extraction, and medication attribute extraction. The performance of these prompts was assessed using 3 state-of-the-art language models: GPT-3.5 (OpenAI), Gemini (Google), and LLaMA-2 (Meta). The study contrasted zero-shot with few-shot prompting and explored the effectiveness of ensemble approaches. RESULTS: The study revealed that task-specific prompt tailoring is vital for the high performance of LLMs for zero-shot clinical NLP. In clinical sense disambiguation, GPT-3.5 achieved an accuracy of 0.96 with heuristic prompts and 0.94 in biomedical evidence extraction. Heuristic prompts, alongside chain of thought prompts, were highly effective across tasks. Few-shot prompting improved performance in complex scenarios, and ensemble approaches capitalized on multiple prompt strengths. GPT-3.5 consistently outperformed Gemini and LLaMA-2 across tasks and prompt types. CONCLUSIONS: This study provides a rigorous evaluation of prompt engineering methodologies and introduces innovative techniques for clinical information extraction, demonstrating the potential of in-context learning in the clinical domain. These findings offer clear guidelines for future prompt-based clinical NLP research, facilitating engagement by non-NLP experts in clinical NLP advancements. To the best of our knowledge, this is one of the first works on the empirical evaluation of different prompt engineering approaches for clinical NLP in this era of generative artificial intelligence, and we hope that it will inspire and inform future research in this area.

17.
Radiography (Lond) ; 30(3): 799-805, 2024 05.
Artigo em Inglês | MEDLINE | ID: mdl-38493553

RESUMO

INTRODUCTION: The referral is the basis for radiologists' assessment of modality, protocol and urgency, and insufficient information may threaten patient safety. The aim of this study was to assess the completeness of referrals for lower extremity venous duplex ultrasonography (LEVDUS) and computed tomography pulmonary angiography (CTPA), and to investigate associations between the provided clinical information including risk factors, symptoms and lab results in the referrals and positive findings of deep vein thrombosis (DVT) and pulmonary embolism (PE), respectively. METHODS: Referrals for LEVDUS (801) and CTPA (800) performed from 2016 to 2019 were obtained. Three categories of clinical information from the referrals were recorded: symptoms, risk factors and laboratory results, as well as positive imaging findings of venous thromboembolism (VTE). Referral completeness was rated from zero to three according to how many categories of clinical information the referral provided. RESULTS: Information from all three clinical information categories was provided in 15% and 25% of referrals for LEVDUS and CTPA, respectively, while 2% and 10% of referrals did not contain any clinical information. Symptoms were provided most often (85% for LEVDUS and 94% for CTPA). Provided information about risk factors was significantly associated with positive findings for LEVDUS, (p = 0.02) and CTPA (p < 0.001). CONCLUSION: A great majority of referrals failed to provide one or more categories of clinical information. Risk factors were associated with a positive finding of VTE on LEVDUS and CTPA. IMPLICATIONS FOR PRACTICE: Improving clinical information in referrals may improve justification, patient safety and quality of radiology services.


Assuntos
Angiografia por Tomografia Computadorizada , Extremidade Inferior , Encaminhamento e Consulta , Tromboembolia Venosa , Humanos , Angiografia por Tomografia Computadorizada/métodos , Extremidade Inferior/diagnóstico por imagem , Extremidade Inferior/irrigação sanguínea , Tromboembolia Venosa/diagnóstico por imagem , Feminino , Masculino , Pessoa de Meia-Idade , Embolia Pulmonar/diagnóstico por imagem , Fatores de Risco , Ultrassonografia Doppler Dupla/métodos , Adulto , Idoso , Estudos Retrospectivos
18.
BMC Med Inform Decis Mak ; 24(1): 69, 2024 Mar 08.
Artigo em Inglês | MEDLINE | ID: mdl-38459531

RESUMO

BACKGROUND: The burden of chronic conditions is growing in Australia with people in remote areas experiencing high rates of disease, especially kidney disease. Health care in remote areas of the Northern Territory (NT) is complicated by a mobile population, high staff turnover, poor communication between health services and complex comorbid health conditions requiring multidisciplinary care. AIM: This paper aims to describe the collaborative process between research, government and non-government health services to develop an integrated clinical decision support system to improve patient care. METHODS: Building on established partnerships in the government and Aboriginal Community-Controlled Health Service (ACCHS) sectors, we developed a novel digital clinical decision support system for people at risk of developing kidney disease (due to hypertension, diabetes, cardiovascular disease) or with kidney disease. A cross-organisational and multidisciplinary Steering Committee has overseen the design, development and implementation stages. Further, the system's design and functionality were strongly informed by experts (Clinical Reference Group and Technical Working Group), health service providers, and end-user feedback through a formative evaluation. RESULTS: We established data sharing agreements with 11 ACCHS to link patient level data with 56 government primary health services and six hospitals. Electronic Health Record (EHR) data, based on agreed criteria, is automatically and securely transferred from 15 existing EHR platforms. Through clinician-determined algorithms, the system assists clinicians to diagnose, monitor and provide guideline-based care for individuals, as well as service-level risk stratification and alerts for clinically significant events. CONCLUSION: Disconnected health services and separate EHRs result in information gaps and a health and safety risk, particularly for patients who access multiple health services. However, barriers to clinical data sharing between health services still exist. In this first phase, we report how robust partnerships and effective governance processes can overcome these barriers to support clinical decision making and contribute to holistic care.


Assuntos
Sistemas de Apoio a Decisões Clínicas , Humanos , Atenção à Saúde , Northern Territory , Hospitais , Medição de Risco
19.
Front Digit Health ; 6: 1341475, 2024.
Artigo em Inglês | MEDLINE | ID: mdl-38510279

RESUMO

Introduction: Today, modern technology is used to diagnose and treat cardiovascular disease. These medical devices provide exact measures and raw data such as imaging data or biosignals. So far, the Broad Integration of These Health Data into Hospital Information Technology Structures-Especially in Germany-is Lacking, and if data integration takes place, only non-Evaluable Findings are Usually Integrated into the Hospital Information Technology Structures. A Comprehensive Integration of raw Data and Structured Medical Information has not yet Been Established. The aim of this project was to design and implement an interoperable database (cardio-vascular-information-system, CVIS) for the automated integration of al medical device data (parameters and raw data) in cardio-vascular medicine. Methods: The CVIS serves as a data integration and preparation system at the interface between the various devices and the hospital IT infrastructure. In our project, we were able to establish a database with integration of proprietary device interfaces, which could be integrated into the electronic health record (EHR) with various HL7 and web interfaces. Results: In the period between 1.7.2020 and 30.6.2022, the data integrated into this database were evaluated. During this time, 114,858 patients were automatically included in the database and medical data of 50,295 of them were entered. For technical examinations, more than 4.5 million readings (an average of 28.5 per examination) and 684,696 image data and raw signals (28,935 ECG files, 655,761 structured reports, 91,113 x-ray objects, 559,648 ultrasound objects in 54 different examination types, 5,000 endoscopy objects) were integrated into the database. Over 10.2 million bidirectional HL7 messages (approximately 14,000/day) were successfully processed. 98,458 documents were transferred to the central document management system, 55,154 materials (average 7.77 per order) were recorded and stored in the database, 21,196 diagnoses and 50,353 services/OPS were recorded and transferred. On average, 3.3 examinations per patient were recorded; in addition, there are an average of 13 laboratory examinations. Discussion: Fully automated data integration from medical devices including the raw data is feasible and already creates a comprehensive database for multimodal modern analysis approaches in a short time. This is the basis for national and international projects by extracting research data using FHIR.

20.
Int J Med Inform ; 184: 105352, 2024 Apr.
Artigo em Inglês | MEDLINE | ID: mdl-38330523

RESUMO

BACKGROUND: Evidence-based care processes are not always applied at the bedside in critically ill patients. Numerous studies have assessed the impact of checklists and related strategies on the process of care and patient outcomes. We aimed to evaluate the effects of real-time random safety audits on process-of-care and outcome variables in critical care patients. METHODS: This prospective study used data from the clinical information system to evaluate the impact of real-time random safety audits targeting 32 safety measures in two intensive care units during a 9-month period. We compared endpoints between patients attended with safety audits and those not attended with safety audits. The primary endpoint was mortality, measured by Cox hazard regression after full propensity-score matching. Secondary endpoints were the impact on adherence to process-of-care measures and on quality indicators. RESULTS: We included 871 patients; 228 of these were attended in ≥ 1 real-time random safety audits. Safety audits were carried out on 390 patient-days; most improvements in the process of care were observed in safety measures related to mechanical ventilation, renal function and therapies, nutrition, and clinical information system. Although the group of patients attended in safety audits had more severe disease at ICU admission [APACHE II score 21 (16-27) vs. 20 (15-25), p = 0.023]; included a higher proportion of surgical patients [37.3 % vs. 26.4 %, p = 0.003] and a higher proportion of mechanically ventilated patients [72.8 % vs. 40.3 %, p < 0.001]; averaged more days on mechanical ventilation, central venous catheter, and urinary catheter; and had a longer ICU stay [12.5 (5.5-23.3) vs. 2.9 (1.7-5.9), p < 0.001], ICU mortality did not differ significantly between groups (19.3 % vs. 18.8 % in the group without safety rounds). After full propensity-score matching, Cox hazard regression analysis showed real-time random safety audits were associated with a lower risk of mortality throughout the ICU stay (HR 0.31; 95 %CI 0.20-0.47). CONCLUSIONS: Real-time random safety audits are associated with a reduction in the risk of ICU mortality. Exploiting data from the clinical information system is useful in assessing the impact of them on the care process, quality indicators, and mortality.


Assuntos
Cuidados Críticos , Unidades de Terapia Intensiva , Humanos , Estudos Prospectivos , Pontuação de Propensão , Sistemas de Informação , Estado Terminal
SELEÇÃO DE REFERÊNCIAS
DETALHE DA PESQUISA