RESUMO
Nowadays, the complexity of disease mechanisms and the inadequacy of single-target therapies in restoring the biological system have inevitably instigated the strategy of multi-target therapeutics with the analysis of each target individually. However, it is not suitable for dealing with the conflicts between targets or between drugs. With the release of high-precision protein structure prediction artificial intelligence, large-scale high-precision protein structure prediction and docking have become possible. In this article, we propose a multi-target drug discovery method by the example of therapeutic hypothermia (TH). First, we performed protein structure prediction for all protein targets of each group by AlphaFold2 and RoseTTAFold. Then, QuickVina 2 is used for molecular docking between the proteins and drugs. After docking, we use PageRank to rank single drugs and drug combinations of each group. The ePharmaLib was used for predicting the side effect targets. Given the differences in the weights of different targets, the method can effectively avoid inhibiting beneficial proteins while inhibiting harmful proteins. So it could minimize the conflicts between different doses and be friendly to chronotherapeutics. Besides, this method also has potential in precision medicine for its high compatibility with bioinformatics and promotes the development of pharmacogenomics and bioinfo-pharmacology.
Assuntos
Inteligência Artificial , Hipotermia Induzida , Cronofarmacoterapia , Descoberta de Drogas/métodos , Simulação de Acoplamento MolecularRESUMO
PURPOSE: Generative AI will become an integral part of education in future. The potential of this technology in different disciplines should be identified to promote effective adoption. This study evaluated the performance of ChatGPT in tutorial and case-based learning questions in physiology and biochemistry for medical undergraduates. Our study mainly focused on the performance of GPT-3.5 version while a subgroup was comparatively assessed on GPT-3.5 and GPT-4 performances. MATERIALS AND METHODS: Answers were generated in GPT-3.5 for 44 modified essay questions (MEQs) in physiology and 43 MEQs in biochemistry. Each answer was graded by two independent examiners. Subsequently, a subset of 15 questions from each subject were selected to represent different score categories of the GPT-3.5 answers; responses were generated in GPT-4, and graded. RESULTS: The mean score for physiology answers was 74.7 (SD 25.96). GPT-3.5 demonstrated a statistically significant (p = .009) superior performance in lower-order questions of Bloom's taxonomy in comparison to higher-order questions. Deficiencies in the application of physiological principles in clinical context were noted as a drawback. Scores in biochemistry were relatively lower with a mean score of 59.3 (SD 26.9) for GPT-3.5. There was no statistically significant difference in the scores for higher and lower-order questions of Bloom's taxonomy. The deficiencies highlighted were lack of in-depth explanations and precision. The subset of questions where the GPT-4 and GPT-3.5 were compared demonstrated a better overall performance in GPT-4 responses in both subjects. This difference between the GPT-3.5 and GPT-4 performance was statistically significant in biochemistry but not in physiology. CONCLUSIONS: The differences in performance across the two versions, GPT-3.5 and GPT-4 across the disciplines are noteworthy. Educators and students should understand the strengths and limitations of this technology in different fields to effectively integrate this technology into teaching and learning.
RESUMO
PURPOSE: Since the beginning of 2023, ChatGPT emerged as a hot topic in healthcare research. The potential to be a valuable tool in clinical practice is compelling, particularly in improving clinical decision support by helping physicians to make clinical decisions based on the best medical knowledge available. We aim to investigate ChatGPT's ability to identify, diagnose and manage patients with otorhinolaryngology-related symptoms. METHODS: A prospective, cross-sectional study was designed based on an idea suggested by ChatGPT to assess the level of agreement between ChatGPT and five otorhinolaryngologists (ENTs) in 20 reality-inspired clinical cases. The clinical cases were presented to the chatbot on two different occasions (ChatGPT-1 and ChatGPT-2) to assess its temporal stability. RESULTS: The mean score of ChatGPT-1 was 4.4 (SD 1.2; min 1, max 5) and of ChatGPT-2 was 4.15 (SD 1.3; min 1, max 5), while the ENTs mean score was 4.91 (SD 0.3; min 3, max 5). The Mann-Whitney U test revealed a statistically significant difference (p < 0.001) between both ChatGPT's and the ENTs's score. ChatGPT-1 and ChatGPT-2 gave different answers in five occasions. CONCLUSIONS: Artificial intelligence will be an important instrument in clinical decision-making in the near future and ChatGPT is the most promising chatbot so far. Despite needing further development to be used with safety, there is room for improvement and potential to aid otorhinolaryngology residents and specialists in making the most correct decision for the patient.
Assuntos
Otolaringologia , Cirurgiões , Humanos , Inteligência Artificial , Estudos Transversais , Estudos Prospectivos , Tomada de Decisão ClínicaRESUMO
Artificial intelligence (AI) technologies are poised to become an increasingly important part of education in the anatomical sciences. OpenAI has also introduced generative pretrained transformers (GPTs), which are customizable versions of the standard ChatGPT application. There is little research that has explored the potential of GPTs to serve as intelligent tutoring systems for learning the anatomical sciences. The objective of this study was to describe the design and explore the performance of AnatomyGPT, a customized artificial intelligence application intended for anatomical sciences education. The AnatomyGPT application was configured with GPT Builder by uploading open-source textbooks as knowledge sources and by providing pedagogical instructions for how to interact with users. The performance of AnatomyGPT was compared with ChatGPT by evaluating the responses of both applications to prompts of the National Board of Medical Examiners (NBME) sample items with respect to accuracy, rationales, and citations. AnatomyGPT achieved high scores on the NBME sample items for Gross Anatomy, Embryology, Histology, and Neuroscience and scored comparably to ChatGPT. In addition, AnatomyGPT provided several citations in the responses that it generated, while ChatGPT provided none. Both GPTs provided rationales for all sample items. The customized AnatomyGPT application demonstrated preliminary potential as an intelligent tutoring system by generating responses with increased citations as compared with the standard ChatGPT application. The findings of this study suggest that instructors and students may wish to create their own custom GPTs for teaching and learning anatomy. Future research is needed to further develop and characterize the potential of GPTs for anatomy education.
Assuntos
Anatomia , Inteligência Artificial , Anatomia/educação , Humanos , Instrução por Computador/métodos , SoftwareRESUMO
OBJECTIVE: Rapid progression of COVID-19 pneumonia may put patients at risk of requiring ventilatory support, such as non-invasive mechanical ventilation or endotracheal intubation. Implementing tools that detect COVID-19 pneumonia can improve the patient's healthcare. We aim to evaluate the efficacy and efficiency of the artificial intelligence (AI) tool GE Healthcare's Thoracic Care Suite (featuring Lunit INSIGHT CXR, TCS) to predict the ventilatory support need based on pneumonic progression of COVID-19 on consecutive chest X-rays. METHODS: Outpatients with confirmed SARS-CoV-2 infection, with chest X-ray (CXR) findings probable or indeterminate for COVID-19 pneumonia, who required a second CXR due to unfavorable clinical course, were collected. The number of affected lung fields for the two CXRs was assessed using the AI tool. RESULTS: One hundred fourteen patients (57.4 ± 14.2 years, 65 -57%- men) were retrospectively collected. Fifteen (13.2%) required ventilatory support. Progression of pneumonic extension ≥ 0.5 lung fields per day compared to pneumonia onset, detected using the TCS tool, increased the risk of requiring ventilatory support by 4-fold. Analyzing the AI output required 26 seconds of radiological time. CONCLUSIONS: Applying the AI tool, Thoracic Care Suite, to CXR of patients with COVID-19 pneumonia allows us to anticipate ventilatory support requirements requiring less than half a minute.
RESUMO
BACKGROUND: Main challenges for COVID-19 include the lack of a rapid diagnostic test, a suitable tool to monitor and predict a patient's clinical course and an efficient way for data sharing among multicenters. We thus developed a novel artificial intelligence system based on deep learning (DL) and federated learning (FL) for the diagnosis, monitoring, and prediction of a patient's clinical course. METHODS: CT imaging derived from 6 different multicenter cohorts were used for stepwise diagnostic algorithm to diagnose COVID-19, with or without clinical data. Patients with more than 3 consecutive CT images were trained for the monitoring algorithm. FL has been applied for decentralized refinement of independently built DL models. RESULTS: A total of 1,552,988 CT slices from 4804 patients were used. The model can diagnose COVID-19 based on CT alone with the AUC being 0.98 (95% CI 0.97-0.99), and outperforms the radiologist's assessment. We have also successfully tested the incorporation of the DL diagnostic model with the FL framework. Its auto-segmentation analyses co-related well with those by radiologists and achieved a high Dice's coefficient of 0.77. It can produce a predictive curve of a patient's clinical course if serial CT assessments are available. INTERPRETATION: The system has high consistency in diagnosing COVID-19 based on CT, with or without clinical data. Alternatively, it can be implemented on a FL platform, which would potentially encourage the data sharing in the future. It also can produce an objective predictive curve of a patient's clinical course for visualization. KEY POINTS: ⢠CoviDet could diagnose COVID-19 based on chest CT with high consistency; this outperformed the radiologist's assessment. Its auto-segmentation analyses co-related well with those by radiologists and could potentially monitor and predict a patient's clinical course if serial CT assessments are available. It can be integrated into the federated learning framework. ⢠CoviDet can be used as an adjunct to aid clinicians with the CT diagnosis of COVID-19 and can potentially be used for disease monitoring; federated learning can potentially open opportunities for global collaboration.
Assuntos
Inteligência Artificial , COVID-19 , Algoritmos , Humanos , Radiologistas , Tomografia Computadorizada por Raios X/métodosRESUMO
Adoption of Artificial Intelligence (AI) algorithms into the clinical realm will depend on their inherent trustworthiness, which is built not only by robust validation studies but is also deeply linked to the explainability and interpretability of the algorithms. Most validation studies for medical imaging AI report the performance of algorithms on study-level labels and lay little emphasis on measuring the accuracy of explanations generated by these algorithms in the form of heat maps or bounding boxes, especially in true positive cases. We propose a new metric - Explainability Failure Ratio (EFR) - derived from Clinical Explainability Failure (CEF) to address this gap in AI evaluation. We define an Explainability Failure as a case where the classification generated by an AI algorithm matches with study-level ground truth but the explanation output generated by the algorithm is inadequate to explain the algorithm's output. We measured EFR for two algorithms that automatically detect consolidation on chest X-rays to determine the applicability of the metric and observed a lower EFR for the model that had lower sensitivity for identifying consolidation on chest X-rays, implying that the trustworthiness of a model should be determined not only by routine statistical metrics but also by novel 'clinically-oriented' models.
Assuntos
Algoritmos , Inteligência Artificial , Diagnóstico por Imagem , Humanos , RadiografiaRESUMO
This study evaluates the effect of complete nationwide lockdown in 2020 on residential electricity demand across 13 Indian cities and the role of digitalisation using a public smart meter dataset. We undertake a data-driven approach to explore the energy impacts of work-from-home norms across five dwelling typologies. Our methodology includes climate correction, dimensionality reduction and machine learning-based clustering using Gaussian Mixture Models of daily load curves. Results show that during the lockdown, maximum daily peak demand increased by 150-200% as compared to 2018 and 2019 levels for one room-units (RM1), one bedroom-units (BR1) and two bedroom-units (BR2) which are typical for low- and middle-income families. While the upper-middle- and higher-income dwelling units (i.e., three (3BR) and more-than-three bedroom-units (M3BR)) saw night-time demand rise by almost 44% in 2020, as compared to 2018 and 2019 levels. Our results also showed that new peak demand emerged for the lockdown period for RM1, BR1 and BR2 dwelling typologies. We found that the lack of supporting socioeconomic and climatic data can restrict a comprehensive analysis of demand shocks using similar public datasets, which informed policy implications for India's digitalisation. We further emphasised improving the data quality and reliability for effective data-centric policymaking.
RESUMO
Chest X-ray (CXR) imaging is a low-cost, easy-to-use imaging alternative that can be used to diagnose/screen pulmonary abnormalities due to infectious diseaseX: Covid-19, Pneumonia and Tuberculosis (TB). Not limited to binary decisions (with respect to healthy cases) that are reported in the state-of-the-art literature, we also consider non-healthy CXR screening using a lightweight deep neural network (DNN) with a reduced number of epochs and parameters. On three diverse publicly accessible and fully categorized datasets, for non-healthy versus healthy CXR screening, the proposed DNN produced the following accuracies: 99.87% on Covid-19 versus healthy, 99.55% on Pneumonia versus healthy, and 99.76% on TB versus healthy datasets. On the other hand, when considering non-healthy CXR screening, we received the following accuracies: 98.89% on Covid-19 versus Pneumonia, 98.99% on Covid-19 versus TB, and 100% on Pneumonia versus TB. To further precisely analyze how well the proposed DNN worked, we considered well-known DNNs such as ResNet50, ResNet152V2, MobileNetV2, and InceptionV3. Our results are comparable with the current state-of-the-art, and as the proposed CNN is light, it could potentially be used for mass screening in resource-constraint regions.
RESUMO
Since December 2019, we have been in the battlefield with a new threat to the humanity known as severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2). In this review, we describe the four main methods used for diagnosis, screening and/or surveillance of SARS-CoV-2: Real-time reverse transcription polymerase chain reaction (RT-PCR); chest computed tomography (CT); and different complementary alternatives developed in order to obtain rapid results, antigen and antibody detection. All of them compare the highlighting advantages and disadvantages from an analytical point of view. The gold standard method in terms of sensitivity and specificity is the RT-PCR. The different modifications propose to make it more rapid and applicable at point of care (POC) are also presented and discussed. CT images are limited to central hospitals. However, being combined with RT-PCR is the most robust and accurate way to confirm COVID-19 infection. Antibody tests, although unable to provide reliable results on the status of the infection, are suitable for carrying out maximum screening of the population in order to know the immune capacity. More recently, antigen tests, less sensitive than RT-PCR, have been authorized to determine in a quicker way whether the patient is infected at the time of analysis and without the need of specific instruments.
RESUMO
Automated segmentation templates can save clinicians time compared to de novo segmentation but may still take substantial time to review and correct. It has not been thoroughly investigated which automated segmentation-corrected segmentation similarity metrics best predict clinician correction time. Bilateral thoracic cavity volumes in 329 CT scans were segmented by a UNet-inspired deep learning segmentation tool and subsequently corrected by a fourth-year medical student. Eight spatial similarity metrics were calculated between the automated and corrected segmentations and associated with correction times using Spearman's rank correlation coefficients. Nine clinical variables were also associated with metrics and correction times using Spearman's rank correlation coefficients or Mann-Whitney U tests. The added path length, false negative path length, and surface Dice similarity coefficient correlated better with correction time than traditional metrics, including the popular volumetric Dice similarity coefficient (respectively ρ = 0.69, ρ = 0.65, ρ = - 0.48 versus ρ = - 0.25; correlation p values < 0.001). Clinical variables poorly represented in the autosegmentation tool's training data were often associated with decreased accuracy but not necessarily with prolonged correction time. Metrics used to develop and evaluate autosegmentation tools should correlate with clinical time saved. To our knowledge, this is only the second investigation of which metrics correlate with time saved. Validation of our findings is indicated in other anatomic sites and clinical workflows. Novel spatial similarity metrics may be preferable to traditional metrics for developing and evaluating autosegmentation tools that are intended to save clinicians time.
Assuntos
Benchmarking , Cavidade Torácica , Humanos , Tomografia Computadorizada por Raios X , Fluxo de TrabalhoRESUMO
COVID-19, responsible of infecting billions of people and economy across the globe, requires detailed study of the trend it follows to develop adequate short-term prediction models for forecasting the number of future cases. In this perspective, it is possible to develop strategic planning in the public health system to avoid deaths as well as managing patients. In this paper, proposed forecast models comprising autoregressive integrated moving average (ARIMA), support vector regression (SVR), long shot term memory (LSTM), bidirectional long short term memory (Bi-LSTM) are assessed for time series prediction of confirmed cases, deaths and recoveries in ten major countries affected due to COVID-19. The performance of models is measured by mean absolute error, root mean square error and r2_score indices. In the majority of cases, Bi-LSTM model outperforms in terms of endorsed indices. Models ranking from good performance to the lowest in entire scenarios is Bi-LSTM, LSTM, GRU, SVR and ARIMA. Bi-LSTM generates lowest MAE and RMSE values of 0.0070 and 0.0077, respectively, for deaths in China. The best r2_score value is 0.9997 for recovered cases in China. On the basis of demonstrated robustness and enhanced prediction accuracy, Bi-LSTM can be exploited for pandemic prediction for better planning and management.
RESUMO
BACKGROUND: We designed a deep learning model for assessing 18F-FDG PET/CT for early prediction of local and distant failures for patients with locally advanced cervical cancer. METHODS: All 142 patients with cervical cancer underwent 18F-FDG PET/CT for pretreatment staging and received allocated treatment. To augment the amount of image data, each tumor was represented as 11 slice sets each of which contains 3 2D orthogonal slices to acquire a total of 1562 slice sets. In each round of k-fold cross-validation, a well-trained proposed model and a slice-based optimal threshold were derived from a training set and used to classify each slice set in the test set into the categories of with or without local or distant failure. The classification results of each tumor were aggregated to summarize a tumor-based prediction result. RESULTS: In total, 21 and 26 patients experienced local and distant failures, respectively. Regarding local recurrence, the tumor-based prediction result summarized from all test sets demonstrated that the sensitivity, specificity, positive predictive value, negative predictive value, and accuracy were 71%, 93%, 63%, 95%, and 89%, respectively. The corresponding values for distant metastasis were 77%, 90%, 63%, 95%, and 87%, respectively. CONCLUSION: This is the first study to use deep learning model for assessing 18F-FDG PET/CT images which is capable of predicting treatment outcomes in cervical cancer patients. KEY POINTS: ⢠This is the first study to use deep learning model for assessing 18 F-FDG PET/CT images which is capable of predicting treatment outcomes in cervical cancer patients. ⢠All 142 patients with cervical cancer underwent 18 F-FDG PET/CT for pretreatment staging and received allocated treatment. To augment the amount of image data, each tumor was represented as 11 slice sets each of which contains 3 2D orthogonal slices to acquire a total of 1562 slice sets. ⢠For local recurrence, all test sets demonstrated that the sensitivity, specificity, positive predictive value, negative predictive value, and accuracy were 71%, 93%, 63%, 95%, and 89%, respectively. The corresponding values for distant metastasis were 77%, 90%, 63%, 95%, and 87%, respectively.
Assuntos
Quimiorradioterapia/métodos , Aprendizado Profundo , Fluordesoxiglucose F18 , Recidiva Local de Neoplasia/diagnóstico por imagem , Tomografia por Emissão de Pósitrons combinada à Tomografia Computadorizada/métodos , Neoplasias do Colo do Útero/diagnóstico por imagem , Neoplasias do Colo do Útero/terapia , Adulto , Idoso , Idoso de 80 Anos ou mais , Colo do Útero/diagnóstico por imagem , Colo do Útero/patologia , Estudos de Coortes , Feminino , Humanos , Pessoa de Meia-Idade , Prognóstico , Compostos Radiofarmacêuticos , Recidiva , Estudos Retrospectivos , Sensibilidade e Especificidade , Resultado do Tratamento , Neoplasias do Colo do Útero/patologiaRESUMO
Cutaneous fungal infections are one of the most common skin conditions, hence, the burden of determining fungal elements upon microscopic examination with periodic acid-Schiff (PAS) and Gomori methenamine silver (GMS) stains, is very time consuming. Despite some morphological variability posing challenges to training artificial intelligence (AI)-based solutions, these structures are favored potential targets, enabling the recruitment of promising AI-based technologies. Herein, we present a novel AI solution for identifying skin fungal infections, potentially providing a decision support system for pathologists. Skin biopsies of patients diagnosed with a cutaneous fungal infection at the Sheba Medical Center, Israel between 2014 and 2023, were used. Samples were stained with PAS and GMS and digitized by the Philips IntelliSite scanner. DeePathology® STUDIO fungal elements were annotated and deemed as ground truth data after an overall revision by two specialist pathologists. Subsequently, they were used to create an AI-based solution, which has been further validated in other regions of interests. The study participants were divided into two cohorts. In the first cohort, the overall sensitivity of the algorithm was 0.8, specificity 0.97, F1 score 0.78; in the second, the overall sensitivity of the algorithm was 0.93, specificity 0.99, F1 score 0.95. The results obtained are encouraging as proof of concept for an AI-based fungi detection algorithm. DeePathology® STUDIO can be employed as a decision support system for pathologists when diagnosing a cutaneous fungal infection using PAS and GMS stains, thereby, saving time and money.
Assuntos
Inteligência Artificial , Dermatomicoses , Humanos , Dermatomicoses/diagnóstico , Dermatomicoses/microbiologia , Dermatomicoses/patologia , Sistemas de Apoio a Decisões Clínicas , Feminino , BiópsiaRESUMO
Background: Joint bleeding can lead to synovitis and arthropathy in people with hemophilia, reducing quality of life. Although early diagnosis is associated with improved therapeutic outcomes, diagnostic ultrasonography requires specialist experience. Artificial intelligence (AI) algorithms may support ultrasonography diagnoses. Objectives: This study will research, develop, and evaluate the diagnostic precision of an AI algorithm for detecting the presence or absence of hemarthrosis and synovitis in people with hemophilia. Methods: Elbow, knee, and ankle ultrasound images were obtained from people with hemophilia from January 2010 to March 2022. The images were used to train and test the AI models to estimate the presence/absence of hemarthrosis and synovitis. The primary endpoint was the area under the curve for the diagnostic precision to diagnose hemarthrosis and synovitis. Other endpoints were the rate of accuracy, precision, sensitivity, and specificity. Results: Out of 5649 images collected, 3435 were used for analysis. The area under the curve for hemarthrosis detection for the elbow, knee, and ankle joints was ≥0.87 and for synovitis, it was ≥0.90. The accuracy and precision for hemarthrosis detection were ≥0.74 and ≥0.67, respectively, and those for synovitis were ≥0.83 and ≥0.74, respectively. Analysis across people with hemophilia aged 10 to 60 years showed consistent results. Conclusion: AI models have the potential to aid diagnosis and enable earlier therapeutic interventions, helping people with hemophilia achieve healthy and active lives. Although AI models show potential in diagnosis, evidence is unclear on required control for abnormal findings. Long-term observation is crucial for assessing impact on joint health.
RESUMO
The global burden of cancer continues to rise, underscoring the urgency of developing more effective and precisely targeted therapies. This comprehensive review explores the confluence of precision medicine and CDC25 phosphatases in the context of cancer research. Precision medicine, alternatively referred to as customized medicine, aims to customize medical interventions by taking into account the genetic, genomic, and epigenetic characteristics of individual patients. The identification of particular genetic and molecular drivers driving cancer helps both diagnostic accuracy and treatment selection. Precision medicine utilizes sophisticated technology such as genome sequencing and bioinformatics to elucidate genetic differences that underlie the proliferation of cancer cells, hence facilitating the development of customized therapeutic interventions. CDC25 phosphatases, which play a crucial role in governing the progression of the cell cycle, have garnered significant attention as potential targets for cancer treatment. The dysregulation of CDC25 is a characteristic feature observed in various types of malignancies, hence classifying them as proto-oncogenes. The proteins in question, which operate as phosphatases, play a role in the activation of Cyclin-dependent kinases (CDKs), so promoting the advancement of the cell cycle. CDC25 inhibitors demonstrate potential as therapeutic drugs for cancer treatment by specifically blocking the activity of CDKs and modulating the cell cycle in malignant cells. In brief, precision medicine presents a potentially fruitful option for augmenting cancer research, diagnosis, and treatment, with an emphasis on individualized care predicated upon patients' genetic and molecular profiles. The review highlights the significance of CDC25 phosphatases in the advancement of cancer and identifies them as promising candidates for therapeutic intervention. This statement underscores the significance of doing thorough molecular profiling in order to uncover the complex molecular characteristics of cancer cells.
RESUMO
PURPOSE: To assess the diagnostic accuracy of ChatGPT-4V in interpreting a set of four chest CT slices for each case of COVID-19, non-small cell lung cancer (NSCLC), and control cases, thereby evaluating its potential as an AI tool in radiological diagnostics. MATERIALS AND METHODS: In this retrospective study, 60 CT scans from The Cancer Imaging Archive, covering COVID-19, NSCLC, and control cases were analyzed using ChatGPT-4V. A radiologist selected four CT slices from each scan for evaluation. ChatGPT-4V's interpretations were compared against the gold standard diagnoses and assessed by two radiologists. Statistical analyses focused on accuracy, sensitivity, specificity, positive predictive value (PPV), and negative predictive value (NPV), along with an examination of the impact of pathology location and lobe involvement. RESULTS: ChatGPT-4V showed an overall diagnostic accuracy of 56.76%. For NSCLC, sensitivity was 27.27% and specificity was 60.47%. In COVID-19 detection, sensitivity was 13.64% and specificity of 64.29%. For control cases, the sensitivity was 31.82%, with a specificity of 95.24%. The highest sensitivity (83.33%) was observed in cases involving all lung lobes. The chi-squared statistical analysis indicated significant differences in Sensitivity across categories and in relation to the location and lobar involvement of pathologies. CONCLUSION: ChatGPT-4V demonstrated variable diagnostic performance in chest CT interpretation, with notable proficiency in specific scenarios. This underscores the challenges of cross-modal AI models like ChatGPT-4V in radiology, pointing toward significant areas for improvement to ensure dependability. The study emphasizes the importance of enhancing these models for broader, more reliable medical use.
RESUMO
PURPOSE: The purposes of the study was to describe the degree of agreement between geriatricians with the answers given by an AI tool (ChatGPT) in response to questions related to different areas in geriatrics, to study the differences between specialists and residents in geriatrics in terms of the degree of agreement with ChatGPT, and to analyse the mean scores obtained by areas of knowledge/domains. METHODS: An observational study was conducted involving 126 doctors from 41 geriatric medicine departments in Spain. Ten questions about geriatric medicine were posed to ChatGPT, and doctors evaluated the AI's answers using a Likert scale. Sociodemographic variables were included. Questions were categorized into five knowledge domains, and means and standard deviations were calculated for each. RESULTS: 130 doctors answered the questionnaire. 126 doctors (69.8% women, mean age 41.4 [9.8]) were included in the final analysis. The mean score obtained by ChatGPT was 3.1/5 [0.67]. Specialists rated ChatGPT lower than residents (3.0/5 vs. 3.3/5 points, respectively, P < 0.05). By domains, ChatGPT ââscored better (M: 3.96; SD: 0.71) in general/theoretical questions rather than in complex decisions/end-of-life situations (M: 2.50; SD: 0.76) and answers related to diagnosis/performing of complementary tests obtained the lowest ones (M: 2.48; SD: 0.77). CONCLUSION: Scores presented big variability depending on the area of knowledge. Questions related to theoretical aspects of challenges/future in geriatrics obtained better scores. When it comes to complex decision-making, appropriateness of the therapeutic efforts or decisions about diagnostic tests, professionals indicated a poorer performance. AI is likely to be incorporated into some areas of medicine, but it would still present important limitations, mainly in complex medical decision-making.
Assuntos
Inteligência Artificial , Geriatria , Humanos , Espanha , Feminino , Masculino , Inquéritos e Questionários , Adulto , Pessoa de Meia-Idade , Idoso , GeriatrasRESUMO
Background and Aim: Eye surgeries often evoke strong negative emotions in patients, including fear and anxiety. Patient education material plays a crucial role in informing and empowering individuals. Traditional sources of medical information may not effectively address individual patient concerns or cater to varying levels of understanding. This study aims to conduct a comparative analysis of the accuracy, completeness, readability, tone, and understandability of patient education material generated by AI chatbots versus traditional Patient Information Leaflets (PILs), focusing on local anesthesia in eye surgery. Methods: Expert reviewers evaluated responses generated by AI chatbots (ChatGPT and Google Gemini) and a traditional PIL (Royal College of Anaesthetists' PIL) based on accuracy, completeness, readability, sentiment, and understandability. Statistical analyses, including ANOVA and Tukey HSD tests, were conducted to compare the performance of the sources. Results: Readability analysis showed variations in complexity among the sources, with AI chatbots offering simplified language and PILs maintaining better overall readability and accessibility. Sentiment analysis revealed differences in emotional tone, with Google Gemini exhibiting the most positive sentiment. AI chatbots demonstrated superior understandability and actionability, while PILs excelled in completeness. Overall, ChatGPT showed slightly higher accuracy (scores expressed as mean ± standard deviation) (4.71 ± 0.5 vs 4.61 ± 0.62) and completeness (4.55 ± 0.58 vs 4.47 ± 0.58) compared to Google Gemini, but PILs performed best (4.84 ± 0.37 vs 4.88 ± 0.33) in terms of both accuracy and completeness (p-value for completeness <0.05). Conclusion: AI chatbots show promise as innovative tools for patient education, complementing traditional PILs. By leveraging the strengths of both AI-driven technologies and human expertise, healthcare providers can enhance patient education and empower individuals to make informed decisions about their health and medical care.
RESUMO
Introduction: In this cross-sectional study, the authors explored the knowledge, attitudes, and practices related to artificial intelligence (AI) among medical students in Sudan. With AI increasingly impacting healthcare, understanding its integration into medical education is crucial. This study aimed to assess the current state of AI awareness, perceptions, and practical experiences among medical students in Sudan. The authors aimed to evaluate the extent of AI familiarity among Sudanese medical students by examining their attitudes toward its application in medicine. Additionally, this study seeks to identify the factors influencing knowledge levels and explore the practical implementation of AI in the medical field. Method: A web-based survey was distributed to medical students in Sudan via social media platforms and e-mail during October 2023. The survey included questions on demographic information, knowledge of AI, attitudes toward its applications, and practical experiences. The descriptive statistics, χ2 tests, logistic regression, and correlations were analyzed using SPSS version 26.0. Results: Out of the 762 participants, the majority exhibited a basic understanding of AI, but detailed knowledge of its applications was limited. Positive attitudes toward the importance of AI in diagnosis, radiology, and pathology were prevalent. However, practical application of these methods was infrequent, with only a minority of the participants having hands-on experience. Factors influencing knowledge included the lack of a formal curriculum and gender disparities. Conclusion: This study highlights the need for comprehensive AI education in medical training programs in Sudan. While participants displayed positive attitudes, there was a notable gap in practical experience. Addressing these gaps through targeted educational interventions is crucial for preparing future healthcare professionals to navigate the evolving landscape of AI in medicine. Recommendations: Policy efforts should focus on integrating AI education into the medical curriculum to ensure readiness for the technological advancements shaping the future of healthcare.