RESUMO
Artificial intelligence (AI)-based clinical decision support systems are gaining momentum by relying on a greater volume and variety of secondary use data. However, the uncertainty, variability, and biases in real-world data environments still pose significant challenges to the development of health AI, its routine clinical use, and its regulatory frameworks. Health AI should be resilient against real-world environments throughout its lifecycle, including the training and prediction phases and maintenance during production, and health AI regulations should evolve accordingly. Data quality issues, variability over time or across sites, information uncertainty, human-computer interaction, and fundamental rights assurance are among the most relevant challenges. If health AI is not designed resiliently with regard to these real-world data effects, potentially biased data-driven medical decisions can risk the safety and fundamental rights of millions of people. In this viewpoint, we review the challenges, requirements, and methods for resilient AI in health and provide a research framework to improve the trustworthiness of next-generation AI-based clinical decision support.
Assuntos
Inteligência Artificial , Sistemas de Apoio a Decisões Clínicas , HumanosRESUMO
Global agreement in central nervous system (CNS) tumor classification is essential for predicting patient prognosis and determining the correct course of treatment, as well as for stratifying patients for clinical trials at international level. The last update by the World Health Organization of CNS tumor classification and grading in 2021 considered, for the first time, IDH-wildtype glioblastoma and astrocytoma IDH-mutant grade 4 as different tumors. Mutations in the genes isocitrate dehydrogenase (IDH) 1 and 2 occur early and, importantly, contribute to gliomagenesis. IDH mutation produces a metabolic reprogramming of tumor cells, thus affecting the processes of hypoxia and vascularity, resulting in a clear advantage for those patients who present with IDH-mutated astrocytomas. Despite the clinical relevance of IDH mutation, current protocols do not include full sequencing for every patient. Alternative biomarkers could be useful and complementary to obtain a more reliable classification. In this sense, magnetic resonance imaging (MRI)-perfusion biomarkers, such as relative cerebral blood volume and flow, could be useful from the moment of presurgery, without incurring additional financial costs or requiring extra effort. The main purpose of this work is to analyze the vascular and hemodynamic differences between IDH-wildtype glioblastoma and IDH-mutant astrocytoma. To achieve this, we evaluate and validate the association between dynamic susceptibility contrast-MRI perfusion biomarkers and IDH mutation status. In addition, to gain a deeper understanding of the vascular differences in astrocytomas depending on the IDH mutation, we analyze the transcriptomic bases of the vascular differences.
Assuntos
Astrocitoma , Neoplasias Encefálicas , Glioblastoma , Humanos , Glioblastoma/diagnóstico por imagem , Glioblastoma/genética , Glioblastoma/patologia , Transcriptoma , Neoplasias Encefálicas/diagnóstico por imagem , Neoplasias Encefálicas/genética , Neoplasias Encefálicas/metabolismo , Astrocitoma/diagnóstico por imagem , Astrocitoma/genética , Astrocitoma/metabolismo , Mutação/genética , Isocitrato Desidrogenase/genética , Isocitrato Desidrogenase/metabolismo , BiomarcadoresRESUMO
OBJECTIVES: To assess the combined role of tumor vascularity, estimated from perfusion MRI, and MGMT methylation status on overall survival (OS) in patients with glioblastoma. METHODS: A multicentric international dataset including 96 patients from NCT03439332 clinical study were used to study the prognostic relationships between MGMT and perfusion markers. Relative cerebral blood volume (rCBV) in the most vascularized tumor regions was automatically obtained from preoperative MRIs using ONCOhabitats online analysis service. Cox survival regression models and stratification strategies were conducted to define a subpopulation that is particularly favored by MGMT methylation in terms of OS. RESULTS: rCBV distributions did not differ significantly (p > 0.05) in the methylated and the non-methylated subpopulations. In patients with moderately vascularized tumors (rCBV < 10.73), MGMT methylation was a positive predictive factor for OS (HR = 2.73, p = 0.003, AUC = 0.70). In patients with highly vascularized tumors (rCBV > 10.73), however, there was no significant effect of MGMT methylation (HR = 1.72, p = 0.10, AUC = 0.56). CONCLUSIONS: Our results indicate the existence of complementary prognostic information provided by MGMT methylation and rCBV. Perfusion markers could identify a subpopulation of patients who will benefit the most from MGMT methylation. Not considering this information may lead to bias in the interpretation of clinical studies. KEY POINTS: ⢠MRI perfusion provides complementary prognostic information to MGMT methylation. ⢠MGMT methylation improves prognosis in glioblastoma patients with moderate vascular profile. ⢠Failure to consider these relations may lead to bias in the interpretation of clinical studies.
Assuntos
Neoplasias Encefálicas , Glioblastoma , Antineoplásicos Alquilantes/uso terapêutico , Neoplasias Encefálicas/diagnóstico por imagem , Neoplasias Encefálicas/tratamento farmacológico , Neoplasias Encefálicas/genética , Metilação de DNA , Metilases de Modificação do DNA/genética , Enzimas Reparadoras do DNA/genética , Glioblastoma/diagnóstico por imagem , Glioblastoma/genética , Humanos , Prognóstico , Regiões Promotoras Genéticas , Temozolomida/uso terapêutico , Proteínas Supressoras de Tumor/genéticaRESUMO
Patient Trajectories (PTs) are a method of representing the temporal evolution of patients. They can include information from different sources and be used in socio-medical or clinical domains. PTs have generally been used to generate and study the most common trajectories in, for instance, the development of a disease. On the other hand, healthcare predictive models generally rely on static snapshots of patient information. Only a few works about prediction in healthcare have been found that use PTs, and therefore benefit from their temporal dimension. All of them, however, have used PTs created from single-source information. Therefore, the use of longitudinal multi-scale data to build PTs and use them to obtain predictions about health conditions is yet to be explored. Our hypothesis is that local similarities on small chunks of PTs can identify similar patients concerning their future morbidities. The objectives of this work are (1) to develop a methodology to identify local similarities between PTs before the occurrence of morbidities to predict these on new query individuals; and (2) to validate this methodology on risk prediction of cardiovascular diseases (CVD) occurrence in patients with diabetes. We have proposed a novel formal definition of PTs based on sequences of longitudinal multi-scale data. Moreover, a dynamic programming methodology to identify local alignments on PTs for predicting future morbidities is proposed. Both the proposed methodology for PT definition and the alignment algorithm are generic to be applied on any clinical domain. We validated this solution for predicting CVD in patients with diabetes and we achieved a precision of 0.33, a recall of 0.72 and a specificity of 0.38. Therefore, the proposed solution in the diabetes use case can result of utmost utility to secondary screening.
Assuntos
Algoritmos , Doenças Cardiovasculares , Doenças Cardiovasculares/diagnóstico , Doenças Cardiovasculares/epidemiologia , Humanos , MorbidadeRESUMO
BACKGROUND: Glioblastoma (GBM) is the most aggressive primary brain tumor, characterized by a heterogeneous and abnormal vascularity. Subtypes of vascular habitats within the tumor and edema can be distinguished: high angiogenic tumor (HAT), low angiogenic tumor (LAT), infiltrated peripheral edema (IPE), and vasogenic peripheral edema (VPE). PURPOSE: To validate the association between hemodynamic markers from vascular habitats and overall survival (OS) in glioblastoma patients, considering the intercenter variability of acquisition protocols. STUDY TYPE: Multicenter retrospective study. POPULATION: In all, 184 glioblastoma patients from seven European centers participating in the NCT03439332 clinical study. FIELD STRENGTH/SEQUENCE: 1.5T (for 54 patients) or 3.0T (for 130 patients). Pregadolinium and postgadolinium-based contrast agent-enhanced T1 -weighted MRI, T2 - and FLAIR T2 -weighted, and dynamic susceptibility contrast (DSC) T2 * perfusion. ASSESSMENT: We analyzed preoperative MRIs to establish the association between the maximum relative cerebral blood volume (rCBVmax ) at each habitat with OS. Moreover, the stratification capabilities of the markers to divide patients into "vascular" groups were tested. The variability in the markers between individual centers was also assessed. STATISTICAL TESTS: Uniparametric Cox regression; Kaplan-Meier test; Mann-Whitney test. RESULTS: The rCBVmax derived from the HAT, LAT, and IPE habitats were significantly associated with patient OS (P < 0.05; hazard ratio [HR]: 1.05, 1.11, 1.28, respectively). Moreover, these markers can stratify patients into "moderate-" and "high-vascular" groups (P < 0.05). The Mann-Whitney test did not find significant differences among most of the centers in markers (HAT: P = 0.02-0.685; LAT: P = 0.010-0.769; IPE: P = 0.093-0.939; VPE: P = 0.016-1.000). DATA CONCLUSION: The rCBVmax calculated in HAT, LAT, and IPE habitats have been validated as clinically relevant prognostic biomarkers for glioblastoma patients in the pretreatment stage. This study demonstrates the robustness of the hemodynamic tissue signature (HTS) habitats to assess the GBM vascular heterogeneity and their association with patient prognosis independently of intercenter variability. LEVEL OF EVIDENCE: 3 Technical Efficacy Stage: 2 J. Magn. Reson. Imaging 2020;51:1478-1486.
Assuntos
Neoplasias Encefálicas , Glioblastoma , Neoplasias Encefálicas/diagnóstico por imagem , Meios de Contraste , Glioblastoma/diagnóstico por imagem , Humanos , Imageamento por Ressonância Magnética , Prognóstico , Estudos RetrospectivosRESUMO
BACKGROUND: Migraine is a heterogeneous condition with multiple clinical manifestations. Machine learning algorithms permit the identification of population groups, providing analytical advantages over other modeling techniques. OBJECTIVE: The aim of this study was to analyze critical features that permit the differentiation of subgroups of patients with migraine according to the intensity and frequency of attacks by using machine learning algorithms. METHODS: Sixty-seven women with migraine participated. Clinical features of migraine, related disability (Migraine Disability Assessment Scale), anxiety/depressive levels (Hospital Anxiety and Depression Scale), anxiety state/trait levels (State-Trait Anxiety Inventory), and pressure pain thresholds (PPTs) over the temporalis, neck, second metacarpal, and tibialis anterior were collected. Physical examination included the flexion-rotation test, cervical range of cervical motion, forward head position while sitting and standing, passive accessory intervertebral movements (PAIVMs) with headache reproduction, and joint positioning sense error. Subgrouping was based on machine learning algorithms by using the nearest neighbors algorithm, multisource variability assessment, and random forest model. RESULTS: For migraine intensity, group 2 (women with a regular migraine headache intensity score of 7 on an 11-point Numeric Pain Rating Scale [where 0 = no pain and 10 = maximum pain]) were younger and had lower joint positioning sense error in cervical rotation, greater cervical mobility in rotation and flexion, lower flexion-rotation test scores, positive PAIVMs reproducing migraine, normal PPTs over the tibialis anterior, shorter migraine history, and lower cranio-vertebral angles while standing than the remaining migraine intensity subgroups. The most discriminative variable was the flexion-rotation test score of the symptomatic side. For migraine frequency, no model was able to identify differences between groups (ie, patients with episodic or chronic migraine). CONCLUSIONS: A subgroup of women with migraine who had common migraine intensity was identified with machine learning algorithms.
Assuntos
Aprendizado de Máquina , Transtornos de Enxaqueca/classificação , Exame Físico/métodos , Adulto , Avaliação da Deficiência , Feminino , Humanos , Pessoa de Meia-Idade , Transtornos de Enxaqueca/fisiopatologiaRESUMO
The evidence that quality of life is a positive variable for the survival of cancer patients has prompted the interest of the health and pharmaceutical industry in considering that variable as a final clinical outcome. Sustained improvements in cancer care in recent years have resulted in increased numbers of people living with and beyond cancer, with increased attention being placed on improving quality of life for those individuals. Connected Health provides the foundations for the transformation of cancer care into a patient-centric model, focused on providing fully connected, personalized support and therapy for the unique needs of each patient. Connected Health creates an opportunity to overcome barriers to health care support among patients diagnosed with chronic conditions. This paper provides an overview of important areas for the foundations of the creation of a new Connected Health paradigm in cancer care. Here we discuss the capabilities of mobile and wearable technologies; we also discuss pervasive and persuasive strategies and device systems to provide multidisciplinary and inclusive approaches for cancer patients for mental well-being, physical activity promotion, and rehabilitation. Several examples already show that there is enthusiasm in strengthening the possibilities offered by Connected Health in persuasive and pervasive technology in cancer care. Developments harnessing the Internet of Things, personalization, patient-centered design, and artificial intelligence help to monitor and assess the health status of cancer patients. Furthermore, this paper analyses the data infrastructure ecosystem for Connected Health and its semantic interoperability with the Connected Health economy ecosystem and its associated barriers. Interoperability is essential when developing Connected Health solutions that integrate with health systems and electronic health records. Given the exponential business growth of the Connected Health economy, there is an urgent need to develop mHealth (mobile health) exponentially, making it both an attractive and challenging market. In conclusion, there is a need for user-centered and multidisciplinary standards of practice to the design, development, evaluation, and implementation of Connected Health interventions in cancer care to ensure their acceptability, practicality, feasibility, effectiveness, affordability, safety, and equity.
Assuntos
Inteligência Artificial/normas , Aprendizado de Máquina/normas , Neoplasias/psicologia , Qualidade de Vida/psicologia , Telemedicina/métodos , Humanos , Apoio Social , Dispositivos Eletrônicos VestíveisRESUMO
Purpose To determine if preoperative vascular heterogeneity of glioblastoma is predictive of overall survival of patients undergoing standard-of-care treatment by using an unsupervised multiparametric perfusion-based habitat-discovery algorithm. Materials and Methods Preoperative magnetic resonance (MR) imaging including dynamic susceptibility-weighted contrast material-enhanced perfusion studies in 50 consecutive patients with glioblastoma were retrieved. Perfusion parameters of glioblastoma were analyzed and used to automatically draw four reproducible habitats that describe the tumor vascular heterogeneity: high-angiogenic and low-angiogenic regions of the enhancing tumor, potentially tumor-infiltrated peripheral edema, and vasogenic edema. Kaplan-Meier and Cox proportional hazard analyses were conducted to assess the prognostic potential of the hemodynamic tissue signature to predict patient survival. Results Cox regression analysis yielded a significant correlation between patients' survival and maximum relative cerebral blood volume (rCBVmax) and maximum relative cerebral blood flow (rCBFmax) in high-angiogenic and low-angiogenic habitats (P < .01, false discovery rate-corrected P < .05). Moreover, rCBFmax in the potentially tumor-infiltrated peripheral edema habitat was also significantly correlated (P < .05, false discovery rate-corrected P < .05). Kaplan-Meier analysis demonstrated significant differences between the observed survival of populations divided according to the median of the rCBVmax or rCBFmax at the high-angiogenic and low-angiogenic habitats (log-rank test P < .05, false discovery rate-corrected P < .05), with an average survival increase of 230 days. Conclusion Preoperative perfusion heterogeneity contains relevant information about overall survival in patients who undergo standard-of-care treatment. The hemodynamic tissue signature method automatically describes this heterogeneity, providing a set of vascular habitats with high prognostic capabilities. © RSNA, 2018.
Assuntos
Neoplasias Encefálicas/irrigação sanguínea , Meios de Contraste , Glioblastoma/irrigação sanguínea , Aumento da Imagem/métodos , Imageamento por Ressonância Magnética/métodos , Cuidados Pré-Operatórios/métodos , Adulto , Idoso , Idoso de 80 Anos ou mais , Encéfalo/irrigação sanguínea , Encéfalo/diagnóstico por imagem , Neoplasias Encefálicas/diagnóstico por imagem , Feminino , Glioblastoma/diagnóstico por imagem , Humanos , Imageamento Tridimensional/métodos , Masculino , Pessoa de Meia-Idade , Estudos Retrospectivos , Análise de SobrevidaRESUMO
Advanced MRI and molecular markers have been raised as crucial to improve prognostic models for patients having glioblastoma (GBM) lesions. In particular, different MR perfusion based markers describing vascular intrapatient heterogeneity have been correlated with tumor aggressiveness, and represent key information to understand tumor resistance against effective therapies of these neoplasms. Recently, hemodynamic tissue signature (HTS) markers based on MR perfusion images have been demonstrated to be useful for describing the heterogeneity of GBM at the voxel level, as well as demonstrating significant correlations with the patient's overall survival. In this work, we analyze the abilities of these markers to improve the conventional prognostic models based on clinical, morphological, and demographic features. Our results, in both the regression and classification tests, show that inclusion of the HTS markers improves the reliability of prognostic models. The HTS method is fully automatic and it is available for research use at http://www.oncohabitats.upv.es.
Assuntos
Glioblastoma/diagnóstico , Glioblastoma/fisiopatologia , Hemodinâmica , Imageamento por Ressonância Magnética , Adulto , Idoso , Idoso de 80 Anos ou mais , Feminino , Humanos , Estimativa de Kaplan-Meier , Masculino , Pessoa de Meia-Idade , Prognóstico , Modelos de Riscos ProporcionaisRESUMO
The aim of this work was to develop a new unsupervised exploratory method of characterizing feature extraction and detecting similarity of movement during sleep through actigraphy signals. We here propose some algorithms, based on signal bispectrum and bispectral entropy, to determine the unique features of independent actigraphy signals. Experiments were carried out on 20 randomly chosen actigraphy samples of the Hispanic Community Health Study/Study of Latinos (HCHS/SOL) database, with no information other than their aperiodicity. The Pearson correlation coefficient matrix and the histogram correlation matrix were computed to study the similarity of movements during sleep. The results obtained allowed us to explore the connections between certain sleep actigraphy patterns and certain pathologies.
Assuntos
Actigrafia/métodos , Algoritmos , Entropia , Hispânico ou Latino , Movimento , Sono/fisiologia , Adolescente , Adulto , Humanos , Pessoa de Meia-Idade , Processamento de Sinais Assistido por Computador , Adulto JovemRESUMO
The integration of Artificial Intelligence (AI) in healthcare signifies a substantial shift, offering benefits to patients and healthcare systems while also introducing new risks. The emphasis on patient safety and performance standards is pivotal, especially with the European Union's strides towards regulating AI through the AI Act. This act focuses on classifying AI systems based on risk levels, mandating stringent requirements for high-risk AI, enhancing transparency, and ensuring ethics in AI applications. The concept of an "AI passport" is introduced as a living document detailing the AI system's purpose, ethical declarations, training, evaluation, and potential biases. This passport aims to enhance transparency and safety in medical AI applications, serving as a comprehensive record for patients, clinicians, and stakeholders. The AI passport, structured in JSON format, encapsulates key information about the AI system as a mechanism for continuous performance evaluation and transparency. This initiative may represent a significant step towards mitigating the risks associated with AI in healthcare, emphasizing the importance of accountability, transparency, and patient safety in the development and application of AI technologies.
Assuntos
Inteligência Artificial , Segurança do Paciente , Gestão de Riscos , Humanos , União Europeia , Medição de RiscoRESUMO
The aim of this work is to develop and evaluate a deep classifier that can effectively prioritize Emergency Medical Call Incidents (EMCI) according to their life-threatening level under the presence of dataset shifts. We utilized a dataset consisting of 1982746 independent EMCI instances obtained from the Health Services Department of the Region of Valencia (Spain), with a time span from 2009 to 2019 (excluding 2013). The dataset includes free text dispatcher observations recorded during the call, as well as a binary variable indicating whether the event was life-threatening. To evaluate the presence of dataset shifts, we examined prior probability shifts, covariate shifts, and concept shifts. Subsequently, we designed and implemented four deep Continual Learning (CL) strategies-cumulative learning, continual fine-tuning, experience replay, and synaptic intelligence-alongside three deep CL baselines-joint training, static approach, and single fine-tuning-based on DistilBERT models. Our results demonstrated evidence of prior probability shifts, covariate shifts, and concept shifts in the data. Applying CL techniques had a statistically significant (α=0.05) positive impact on both backward and forward knowledge transfer, as measured by the F1-score, compared to non-continual approaches. We can argue that the utilization of CL techniques in the context of EMCI is effective in adapting deep learning classifiers to changes in data distributions, thereby maintaining the stability of model performance over time. To our knowledge, this study represents the first exploration of a CL approach using real EMCI data.
Assuntos
Aprendizado Profundo , Humanos , Bases de Dados Factuais , Espanha , Serviços Médicos de EmergênciaRESUMO
INTRODUCTION: Inherent variations between inter-center data can undermine the robustness of segmentation models when applied at a specific center (dataset shift). We investigated whether specialized center-specific models are more effective compared to generalist models based on multi-center data, and how center-specific data could enhance the performance of generalist models within a particular center using a fine-tuning transfer learning approach. For this purpose, we studied the dataset shift at center level and conducted a comparative analysis to assess the impact of data source on glioblastoma segmentation models. METHODS & MATERIALS: The three key components of dataset shift were studied: prior probability shift-variations in tumor size or tissue distribution among centers; covariate shift-inter-center MRI alterations; and concept shift-different criteria for tumor segmentation. BraTS 2021 dataset was used, which includes 1251 cases from 23 centers. Thereafter, 155 deep-learning models were developed and compared, including 1) generalist models trained with multi-center data, 2) specialized models using only center-specific data, and 3) fine-tuned generalist models using center-specific data. RESULTS: The three key components of dataset shift were characterized. The amount of covariate shift was substantial, indicating large variations in MR imaging between different centers. Glioblastoma segmentation models tend to perform best when using data from the application center. Generalist models, trained with over 700 samples, achieved a median Dice score of 88.98%. Specialized models surpassed this with 200 cases, while fine-tuned models outperformed with 50 cases. CONCLUSIONS: The influence of dataset shift on model performance is evident. Fine-tuned and specialized models, utilizing data from the evaluated center, outperform generalist models, which rely on data from other centers. These approaches could encourage medical centers to develop customized models for their local use, enhancing the accuracy and reliability of glioblastoma segmentation in a context where dataset shift is inevitable.
RESUMO
Background: The vascular heterogeneity of glioblastomas (GB) remains an important area of research, since tumor progression and patient prognosis are closely tied to this feature. With this study, we aim to identify gene expression profiles associated with MRI-defined tumor vascularity and to investigate its relationship with patient prognosis. Methods: The study employed MRI parameters calculated with DSC Perfusion Quantification of ONCOhabitats glioma analysis software and RNA-seq data from the TCGA-GBM project dataset. In our study, we had a total of 147 RNA-seq samples, which 15 of them also had MRI parameter information. We analyzed the gene expression profiles associated with MRI-defined tumor vascularity using differential gene expression analysis and performed Log-rank tests to assess the correlation between the identified genes and patient prognosis. Results: The findings of our research reveal a set of 21 overexpressed genes associated with the high vascularity pattern. Notably, several of these overexpressed genes have been previously implicated in worse prognosis based on existing literature. Our log-rank test further validates that the collective upregulation of these genes is indeed correlated with an unfavorable prognosis. This set of genes includes a variety of molecules, such as cytokines, receptors, ligands, and other molecules with diverse functions. Conclusions: Our findings suggest that the set of 21 overexpressed genes in the High Vascularity group could potentially serve as prognostic markers for GB patients. These results highlight the importance of further investigating the relationship between the molecules such as cytokines or receptors underlying the vascularity in GB and its observation through MRI and developing targeted therapies for this aggressive disease.
RESUMO
The current challenge in automatic brain tumor classification based on MRS is the improvement of the robustness of the classification models that explicitly account for the probable breach of the independent and identically distributed conditions in the MRS data points. To contribute to this purpose, a new algorithm for the extraction of discriminant MRS features of brain tumors based on a functional approach is presented. Functional data analysis based on region segmentation (RSFDA) is based on the functional data analysis formalism using nonuniformly distributed B splines according to spectral regions that are highly correlated. An exhaustive characterization of the method is presented in this work using controlled and real scenarios. The performance of RSFDA was compared with other widely used feature extraction methods. In all simulated conditions, RSFDA was proven to be stable with respect to the number of variables selected and with respect to the classification performance against noise and baseline artifacts. Furthermore, with real multicenter datasets classification, RSFDA and peak integration (PI) obtained better performance than the other feature extraction methods used for comparison. Other advantages of the method proposed are its usefulness in selecting the optimal number of features for classification and its simplified functional representation of the spectra, which contributes to highlight the discriminative regions of the MR spectrum for each classification task.
Assuntos
Neoplasias Encefálicas/metabolismo , Espectroscopia de Ressonância Magnética/métodos , Algoritmos , Sistemas de Apoio a Decisões Clínicas , Humanos , Curva ROCRESUMO
The analysis of human behavior patterns is increasingly used for several research fields. The individualized modeling of behavior using classical techniques requires too much time and resources to be effective. A possible solution would be the use of pattern recognition techniques to automatically infer models to allow experts to understand individual behavior. However, traditional pattern recognition algorithms infer models that are not readily understood by human experts. This limits the capacity to benefit from the inferred models. Process mining technologies can infer models as workflows, specifically designed to be understood by experts, enabling them to detect specific behavior patterns in users. In this paper, the eMotiva process mining algorithms are presented. These algorithms filter, infer and visualize workflows. The workflows are inferred from the samples produced by an indoor location system that stores the location of a resident in a nursing home. The visualization tool is able to compare and highlight behavior patterns in order to facilitate expert understanding of human behavior. This tool was tested with nine real users that were monitored for a 25-week period. The results achieved suggest that the behavior of users is continuously evolving and changing and that this change can be measured, allowing for behavioral change detection.
Assuntos
Mineração de Dados , Casas de Saúde , Algoritmos , Humanos , Monitorização FisiológicaRESUMO
Objective: Although clinical decision support systems (CDSS) have many benefits for clinical practice, they also have several barriers to their acceptance by professionals. Our objective in this study was to design and validate The Aleph palliative care (PC) CDSS through a user-centred method, considering the predictions of the artificial intelligence (AI) core, usability and user experience (UX). Methods: We performed two rounds of individual evaluation sessions with potential users. Each session included a model evaluation, a task test and a usability and UX assessment. Results: The machine learning (ML) predictive models outperformed the participants in the three predictive tasks. System Usability Scale (SUS) reported 62.7 ± 14.1 and 65 ± 26.2 on a 100-point rating scale for both rounds, respectively, while User Experience Questionnaire - Short Version (UEQ-S) scores were 1.42 and 1.5 on the -3 to 3 scale. Conclusions: The think-aloud method and including the UX dimension helped us to identify most of the workflow implementation issues. The system has good UX hedonic qualities; participants were interested in the tool and responded positively to it. Performance regarding usability was modest but acceptable.
RESUMO
BACKGROUND AND OBJECTIVE: Reusing Electronic Health Records (EHRs) for Machine Learning (ML) leads on many occasions to extremely incomplete and sparse tabular datasets, which can hinder the model development processes and limit their performance and generalization. In this study, we aimed to characterize the most effective data imputation techniques and ML models for dealing with highly missing numerical data in EHRs, in the case where only a very limited number of data are complete, as opposed to the usual case of having a reduced number of missing values. METHODS: We used a case study including full blood count laboratory data, demographic and survival data in the context of COVID-19 hospital admissions and evaluated 30 processing pipelines combining imputation methods with ML classifiers. The imputation methods included missing mask, translation and encoding, mean imputation, k-nearest neighbors' imputation, Bayesian ridge regression imputation and generative adversarial imputation networks. The classifiers included k-nearest neighbors, logistic regression, random forest, gradient boosting and deep multilayer perceptron. RESULTS: Our results suggest that in the presence of highly missing data, combining translation and encoding imputation-which considers informative missingness-with tree ensemble classifiers-random forest and gradient boosting-is a sensible choice when aiming to maximize performance, in terms of area under curve. CONCLUSIONS: Based on our findings, we recommend the consideration of this imputer-classifier configuration when constructing models in the presence of extremely incomplete numerical data in EHR.
Assuntos
Algoritmos , COVID-19 , Humanos , Registros Eletrônicos de Saúde , Teorema de Bayes , Aprendizado de MáquinaRESUMO
Background: Aim of the present study is to investigate whether preoperative neurocognitive status is prognostically associated with overall survival (OS) in newly diagnosed glioblastoma (GBM) patients. Methods: Ninety patients with dominant-hemisphere IDH-wild-type GBM were assessed by Mini Mental Status Exam (MMSE), Trail Making Test (TMT) A and B parts, and Control Word Association Test (COWAT) phonemic and semantic subtests. Demographics, Karnofsky Performance Scale, tumor parameters, type of surgery, and adjuvant therapy data were available for patients. Results: According to Cox proportional hazards model the neurocognitive variables of TMT B (P < .01), COWAT semantic subset (P < .05), and the MMSE (P < .01) were found significantly associated with survival prediction. From all other factors, only tumor volume and operation type (debulking vs biopsy) showed a statistical association (P < .05) with survival prediction. Kaplan Meier Long rank test showed statistical significance (P < .01) between unimpaired and impaired groups for TMT B, with median survival for the unimpaired group 26 months and 10 months for the impaired group, for COWAT semantic (P < .01) with median survival 23 months and 12 months, respectively and for MMSE (P < .01) with medial survival 19 and 12 months respectively. Conclusions: Our study demonstrates that neurocognitive status at baseline-prior to treatment-is an independent prognostic factor for OS in wild-type GBM patients, adding another prognostic tool to assist physicians in selecting the best treatment plan.
RESUMO
Background: High-grade glioma (HGG) patients present with variable impairment in neurocognitive function (NCF). Based on that, isocitrate dehydrogenase 1 (IDH1) wild-type HGGs are more aggressive than IDH1 mutant-type ones, we hypothesized that patients with IDH1 wild-type HGG would exhibit more severe NCF deficits than their IDH1 mutant counterparts. Methods: NCF was assessed by Mini Mental Status Exam (MMSE), Trail Making Test (TMT), Digit Span (DS), and Controlled Word Association Test (COWAT) tests in 147 HGG patients preoperatively. Results: Analyses between IDH1 groups revealed a significant difference on MMSE concentration component (p ≤ .01), DS (p ≤ .01), TMTB (p ≤ .01), and COWAT (p ≤ .01) scores, with the IDH1 wild group performing worse than the IDH1 mutant one. Age and tumor volume were inversely correlated with MMSE concentration component (r = -4.78, p < .01), and with MMSE concentration (r = -.401, p < .01), TMTB (r = -.328, p < .01), and COWAT phonemic scores (r = -.599, p < .01), respectively, but only for the IDH1 wild-type group. Analyses between age-matched subsamples of IDH1 groups revealed no age effect on NCF. Tumor grade showed nonsignificance on NCF (p > .05) between the 2 IDH1 mutation subgroups of grade IV tumor patients. On the contrary, grade III group showed a significant difference in TMTB (p < .01) and DS backwards (p < .01) between IDH1 subgroups, with the mutant one outperforming the IDH1 wild one. Conclusions: Our findings indicate that IDH1 wild-type HGG patients present greater NCF impairment, in executive functions particularly, compared to IDH1 mutant ones, suggesting that tumor growth kinetics may play a more profound role than other tumor and demographic parameters in clinical NCF of HGG patients.