Evaluating Large Language Model (LLM) Performance on Established Breast Classification Systems.

Medical researchers are increasingly utilizing advanced LLMs like ChatGPT-4 and Gemini to enhance diagnostic processes in the medical field. This research focuses on their ability to comprehend and apply complex medical classification systems for breast conditions, which can significantly aid plastic surgeons in making informed decisions for diagnosis and treatment, ultimately leading to improved patient outcomes. Fifty clinical scenarios were created to evaluate the classification accuracy of each LLM across five established breast-related classification systems. Scores from 0 to 2 were assigned to LLM responses to denote incorrect, partially correct, or completely correct classifications. Descriptive statistics were employed to compare the performances of ChatGPT-4 and Gemini. Gemini exhibited superior overall performance, achieving 98% accuracy compared to ChatGPT-4's 71%. While both models performed well in the Baker classification for capsular contracture and UTSW classification for gynecomastia, Gemini consistently outperformed ChatGPT-4 in other systems, such as the Fischer Grade Classification for gender-affirming mastectomy, Kajava Classification for ectopic breast tissue, and Regnault Classification for breast ptosis. With further development, integrating LLMs into plastic surgery practice will likely enhance diagnostic support and decision making.

Identification of Potential Factors Associated with Cellulitis Following Lymphovenous Bypass Surgery in Breast Cancer Survivors.

BACKGROUND: Breast cancer is one of the most common types of cancer, with around 2.3 million cases diagnosed in 2020. One in five cancer patients develops chronic lymphedema caused by multifactorial triggers and treatment-related factors. This can lead to swelling, skin infections, and limb dysfunction, negatively affecting the patient's quality of life. This retrospective cohort study aimed to determine the associations between demographic and breast cancer characteristics and postoperative cellulitis in breast cancer survivors who underwent lymphovenous bypass surgery (LVB) at Mayo Clinic, Florida. METHODS: We performed a retrospective chart review. Data were collected retrospectively from 2016 to 2022. Sixty adult breast cancer survivors who underwent LVB were included in the final analysis based on specific inclusion and exclusion criteria. Patients were excluded if they did not meet the inclusion criteria or had incomplete follow-up data. Demographic and surgical data were extracted, including body mass index (BMI), type of anastomosis, number of anastomoses, and preoperative cellulitis status. Lymphedema measurements were performed using tape measurements. Fisher's exact test was used to determine statistically significant associations between variables and postoperative cellulitis. RESULTS: Postoperative cellulitis was more common in patients aged 60 to 69 years (43.2%), whites (75.0%), overweight or obese (90.9%), with one to four anastomoses (81.8%), and nonsmokers (79.5%). The mean International Society of Lymphology (ISL) criteria for both postoperative cellulitis and no postoperative cellulitis was 1.93. Statistically significant associations with postoperative cellulitis were found for the number of anastomoses (p = 0.021), smoking status (p = 0.049), preoperative cellulitis (p = 0.04), and the length of years with lymphedema diagnosis variable (p = 0.004). CONCLUSION: Our results suggest that a greater number of anastomoses, smoking, preoperative cellulitis, and years with lymphedema are significantly associated with an increased risk of postoperative cellulitis. Awareness of these risk factors is crucial for monitoring and early treatment of infections following surgery.

Clinical and Surgical Applications of Large Language Models: A Systematic Review.

Background: Large language models (LLMs) represent a recent advancement in artificial intelligence with medical applications across various healthcare domains. The objective of this review is to highlight how LLMs can be utilized by clinicians and surgeons in their everyday practice. Methods: A systematic review was conducted following the Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines. Six databases were searched to identify relevant articles. Eligibility criteria emphasized articles focused primarily on clinical and surgical applications of LLMs. Results: The literature search yielded 333 results, with 34 meeting eligibility criteria. All articles were from 2023. There were 14 original research articles, four letters, one interview, and 15 review articles. These articles covered a wide variety of medical specialties, including various surgical subspecialties. Conclusions: LLMs have the potential to enhance healthcare delivery. In clinical settings, LLMs can assist in diagnosis, treatment guidance, patient triage, physician knowledge augmentation, and administrative tasks. In surgical settings, LLMs can assist surgeons with documentation, surgical planning, and intraoperative guidance. However, addressing their limitations and concerns, particularly those related to accuracy and biases, is crucial. LLMs should be viewed as tools to complement, not replace, the expertise of healthcare professionals.

Artificial Intelligence in Postoperative Care: Assessing Large Language Models for Patient Recommendations in Plastic Surgery.

Since their release, the medical community has been actively exploring large language models' (LLMs) capabilities, which show promise in providing accurate medical knowledge. One potential application is as a patient resource. This study analyzes and compares the ability of the currently available LLMs, ChatGPT-3.5, GPT-4, and Gemini, to provide postoperative care recommendations to plastic surgery patients. We presented each model with 32 questions addressing common patient concerns after surgical cosmetic procedures and evaluated the medical accuracy, readability, understandability, and actionability of the models' responses. The three LLMs provided equally accurate information, with GPT-3.5 averaging the highest on the Likert scale (LS) (4.18 ± 0.93) (p = 0.849), while Gemini provided significantly more readable (p = 0.001) and understandable responses (p = 0.014; p = 0.001). There was no difference in the actionability of the models' responses (p = 0.830). Although LLMs have shown their potential as adjunctive tools in postoperative patient care, further refinement and research are imperative to enable their evolution into comprehensive standalone resources.

Large Language Models for Intraoperative Decision Support in Plastic Surgery: A Comparison between ChatGPT-4 and Gemini.

Background and Objectives: Large language models (LLMs) are emerging as valuable tools in plastic surgery, potentially reducing surgeons' cognitive loads and improving patients' outcomes. This study aimed to assess and compare the current state of the two most common and readily available LLMs, Open AI's ChatGPT-4 and Google's Gemini Pro (1.0 Pro), in providing intraoperative decision support in plastic and reconstructive surgery procedures. Materials and Methods: We presented each LLM with 32 independent intraoperative scenarios spanning 5 procedures. We utilized a 5-point and a 3-point Likert scale for medical accuracy and relevance, respectively. We determined the readability of the responses using the Flesch-Kincaid Grade Level (FKGL) and Flesch Reading Ease (FRE) score. Additionally, we measured the models' response time. We compared the performance using the Mann-Whitney U test and Student's t-test. Results: ChatGPT-4 significantly outperformed Gemini in providing accurate (3.59 ± 0.84 vs. 3.13 ± 0.83, p-value = 0.022) and relevant (2.28 ± 0.77 vs. 1.88 ± 0.83, p-value = 0.032) responses. Alternatively, Gemini provided more concise and readable responses, with an average FKGL (12.80 ± 1.56) significantly lower than ChatGPT-4's (15.00 ± 1.89) (p < 0.0001). However, there was no difference in the FRE scores (p = 0.174). Moreover, Gemini's average response time was significantly faster (8.15 ± 1.42 s) than ChatGPT'-4's (13.70 ± 2.87 s) (p < 0.0001). Conclusions: Although ChatGPT-4 provided more accurate and relevant responses, both models demonstrated potential as intraoperative tools. Nevertheless, their performance inconsistency across the different procedures underscores the need for further training and optimization to ensure their reliability as intraoperative decision-support tools.

Comparative Analysis of Large Language Models in Emergency Plastic Surgery Decision-Making: The Role of Physical Exam Data.

In the U.S., diagnostic errors are common across various healthcare settings due to factors like complex procedures and multiple healthcare providers, often exacerbated by inadequate initial evaluations. This study explores the role of Large Language Models (LLMs), specifically OpenAI's ChatGPT-4 and Google Gemini, in improving emergency decision-making in plastic and reconstructive surgery by evaluating their effectiveness both with and without physical examination data. Thirty medical vignettes covering emergency conditions such as fractures and nerve injuries were used to assess the diagnostic and management responses of the models. These responses were evaluated by medical professionals against established clinical guidelines, using statistical analyses including the Wilcoxon rank-sum test. Results showed that ChatGPT-4 consistently outperformed Gemini in both diagnosis and management, irrespective of the presence of physical examination data, though no significant differences were noted within each model's performance across different data scenarios. Conclusively, while ChatGPT-4 demonstrates superior accuracy and management capabilities, the addition of physical examination data, though enhancing response detail, did not significantly surpass traditional medical resources. This underscores the utility of AI in supporting clinical decision-making, particularly in scenarios with limited data, suggesting its role as a complement to, rather than a replacement for, comprehensive clinical evaluation and expertise.

Artificial Intelligence Support for Informal Patient Caregivers: A Systematic Review.

This study aims to explore how artificial intelligence can help ease the burden on caregivers, filling a gap in current research and healthcare practices due to the growing challenge of an aging population and increased reliance on informal caregivers. We conducted a search with Google Scholar, PubMed, Scopus, IEEE Xplore, and Web of Science, focusing on AI and caregiving. Our inclusion criteria were studies where AI supports informal caregivers, excluding those solely for data collection. Adhering to PRISMA 2020 guidelines, we eliminated duplicates and screened for relevance. From 947 initially identified articles, 10 met our criteria, focusing on AI's role in aiding informal caregivers. These studies, conducted between 2012 and 2023, were globally distributed, with 80% employing machine learning. Validation methods varied, with Hold-Out being the most frequent. Metrics across studies revealed accuracies ranging from 71.60% to 99.33%. Specific methods, like SCUT in conjunction with NNs and LibSVM, showcased accuracy between 93.42% and 95.36% as well as F-measures spanning 93.30% to 95.41%. AUC values indicated model performance variability, ranging from 0.50 to 0.85 in select models. Our review highlights AI's role in aiding informal caregivers, showing promising results despite different approaches. AI tools provide smart, adaptive support, improving caregivers' effectiveness and well-being.

AI in Hand Surgery: Assessing Large Language Models in the Classification and Management of Hand Injuries.

Background: OpenAI's ChatGPT (San Francisco, CA, USA) and Google's Gemini (Mountain View, CA, USA) are two large language models that show promise in improving and expediting medical decision making in hand surgery. Evaluating the applications of these models within the field of hand surgery is warranted. This study aims to evaluate ChatGPT-4 and Gemini in classifying hand injuries and recommending treatment. Methods: Gemini and ChatGPT were given 68 fictionalized clinical vignettes of hand injuries twice. The models were asked to use a specific classification system and recommend surgical or nonsurgical treatment. Classifications were scored based on correctness. Results were analyzed using descriptive statistics, a paired two-tailed t-test, and sensitivity testing. Results: Gemini, correctly classifying 70.6% hand injuries, demonstrated superior classification ability over ChatGPT (mean score 1.46 vs. 0.87, p-value < 0.001). For management, ChatGPT demonstrated higher sensitivity in recommending surgical intervention compared to Gemini (98.0% vs. 88.8%), but lower specificity (68.4% vs. 94.7%). When compared to ChatGPT, Gemini demonstrated greater response replicability. Conclusions: Large language models like ChatGPT and Gemini show promise in assisting medical decision making, particularly in hand surgery, with Gemini generally outperforming ChatGPT. These findings emphasize the importance of considering the strengths and limitations of different models when integrating them into clinical practice.

Artificial Intelligence Algorithms for Expert Identification in Medical Domains: A Scoping Review.

With abundant information and interconnectedness among people, identifying knowledgeable individuals in specific domains has become crucial for organizations. Artificial intelligence (AI) algorithms have been employed to evaluate the knowledge and locate experts in specific areas, alleviating the manual burden of expert profiling and identification. However, there is a limited body of research exploring the application of AI algorithms for expert finding in the medical and biomedical fields. This study aims to conduct a scoping review of existing literature on utilizing AI algorithms for expert identification in medical domains. We systematically searched five platforms using a customized search string, and 21 studies were identified through other sources. The search spanned studies up to 2023, and study eligibility and selection adhered to the PRISMA 2020 statement. A total of 571 studies were assessed from the search. Out of these, we included six studies conducted between 2014 and 2020 that met our review criteria. Four studies used a machine learning algorithm as their model, while two utilized natural language processing. One study combined both approaches. All six studies demonstrated significant success in expert retrieval compared to baseline algorithms, as measured by various scoring metrics. AI enhances expert finding accuracy and effectiveness. However, more work is needed in intelligent medical expert retrieval.

Comparative Analysis of Artificial Intelligence Virtual Assistant and Large Language Models in Post-Operative Care.

In postoperative care, patient education and follow-up are pivotal for enhancing the quality of care and satisfaction. Artificial intelligence virtual assistants (AIVA) and large language models (LLMs) like Google BARD and ChatGPT-4 offer avenues for addressing patient queries using natural language processing (NLP) techniques. However, the accuracy and appropriateness of the information vary across these platforms, necessitating a comparative study to evaluate their efficacy in this domain. We conducted a study comparing AIVA (using Google Dialogflow) with ChatGPT-4 and Google BARD, assessing the accuracy, knowledge gap, and response appropriateness. AIVA demonstrated superior performance, with significantly higher accuracy (mean: 0.9) and lower knowledge gap (mean: 0.1) compared to BARD and ChatGPT-4. Additionally, AIVA's responses received higher Likert scores for appropriateness. Our findings suggest that specialized AI tools like AIVA are more effective in delivering precise and contextually relevant information for postoperative care compared to general-purpose LLMs. While ChatGPT-4 shows promise, its performance varies, particularly in verbal interactions. This underscores the importance of tailored AI solutions in healthcare, where accuracy and clarity are paramount. Our study highlights the necessity for further research and the development of customized AI solutions to address specific medical contexts and improve patient outcomes.

The usefulness of artificial intelligence in breast reconstruction: a systematic review.

BACKGROUND: Artificial Intelligence (AI) offers an approach to predictive modeling. The model learns to determine specific patterns of undesirable outcomes in a dataset. Therefore, a decision-making algorithm can be built based on these patterns to prevent negative results. This systematic review aimed to evaluate the usefulness of AI in breast reconstruction. METHODS: A systematic review was conducted in August 2022 following the Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines. MEDLINE, EMBASE, SCOPUS, and Google Scholar online databases were queried to capture all publications studying the use of artificial intelligence in breast reconstruction. RESULTS: A total of 23 studies were full text-screened after removing duplicates, and twelve articles fulfilled our inclusion criteria. The Machine Learning algorithms applied for neuropathic pain, lymphedema diagnosis, microvascular abdominal flap failure, donor site complications associated to muscle sparing Transverse Rectus Abdominis flap, surgical complications, financial toxicity, and patient-reported outcomes after breast surgery demonstrated that AI is a helpful tool to accurately predict patient results. In addition, one study used Computer Vision technology to assist in Deep Inferior Epigastric Perforator Artery detection for flap design, considerably reducing the preoperative time compared to manual identification. CONCLUSIONS: In breast reconstruction, AI can help the surgeon by optimizing the perioperative patients' counseling to predict negative outcomes, allowing execution of timely interventions and reducing the postoperative burden, which leads to obtaining the most successful results and improving patient satisfaction.

AI and Ethics: A Systematic Review of the Ethical Considerations of Large Language Model Use in Surgery Research.

INTRODUCTION: As large language models receive greater attention in medical research, the investigation of ethical considerations is warranted. This review aims to explore surgery literature to identify ethical concerns surrounding these artificial intelligence models and evaluate how autonomy, beneficence, nonmaleficence, and justice are represented within these ethical discussions to provide insights in order to guide further research and practice. METHODS: A systematic review was conducted in accordance with the Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines. Five electronic databases were searched in October 2023. Eligible studies included surgery-related articles that focused on large language models and contained adequate ethical discussion. Study details, including specialty and ethical concerns, were collected. RESULTS: The literature search yielded 1179 articles, with 53 meeting the inclusion criteria. Plastic surgery, orthopedic surgery, and neurosurgery were the most represented surgical specialties. Autonomy was the most explicitly cited ethical principle. The most frequently discussed ethical concern was accuracy (n = 45, 84.9%), followed by bias, patient confidentiality, and responsibility. CONCLUSION: The ethical implications of using large language models in surgery are complex and evolving. The integration of these models into surgery necessitates continuous ethical discourse to ensure responsible and ethical use, balancing technological advancement with human dignity and safety.

Artificial-Intelligence-Based Clinical Decision Support Systems in Primary Care: A Scoping Review of Current Clinical Implementations.

Primary Care Physicians (PCPs) are the first point of contact in healthcare. Because PCPs face the challenge of managing diverse patient populations while maintaining up-to-date medical knowledge and updated health records, this study explores the current outcomes and effectiveness of implementing Artificial Intelligence-based Clinical Decision Support Systems (AI-CDSSs) in Primary Healthcare (PHC). Following the PRISMA-ScR guidelines, we systematically searched five databases, PubMed, Scopus, CINAHL, IEEE, and Google Scholar, and manually searched related articles. Only CDSSs powered by AI targeted to physicians and tested in real clinical PHC settings were included. From a total of 421 articles, 6 met our criteria. We found AI-CDSSs from the US, Netherlands, Spain, and China whose primary tasks included diagnosis support, management and treatment recommendations, and complication prediction. Secondary objectives included lessening physician work burden and reducing healthcare costs. While promising, the outcomes were hindered by physicians' perceptions and cultural settings. This study underscores the potential of AI-CDSSs in improving clinical management, patient satisfaction, and safety while reducing physician workload. However, further work is needed to explore the broad spectrum of applications that the new AI-CDSSs have in several PHC real clinical settings and measure their clinical outcomes.

Predicting Cardiopulmonary Arrest with Digital Biomarkers: A Systematic Review.

(1) Background: Telemetry units allow the continuous monitoring of vital signs and ECG of patients. Such physiological indicators work as the digital signatures and biomarkers of disease that can aid in detecting abnormalities that appear before cardiac arrests (CAs). This review aims to identify the vital sign abnormalities measured by telemetry systems that most accurately predict CAs. (2) Methods: We conducted a systematic review using PubMed, Embase, Web of Science, and MEDLINE to search studies evaluating telemetry-detected vital signs that preceded in-hospital CAs (IHCAs). (3) Results and Discussion: Out of 45 studies, 9 met the eligibility criteria. Seven studies were case series, and 2 were case controls. Four studies evaluated ECG parameters, and 5 evaluated other physiological indicators such as blood pressure, heart rate, respiratory rate, oxygen saturation, and temperature. Vital sign changes were highly frequent among participants and reached statistical significance compared to control subjects. There was no single vital sign change pattern found in all patients. ECG alarm thresholds may be adjustable to reduce alarm fatigue. Our review was limited by the significant dissimilarities of the studies on methodology and objectives. (4) Conclusions: Evidence confirms that changes in vital signs have the potential for predicting IHCAs. There is no consensus on how to best analyze these digital biomarkers. More rigorous and larger-scale prospective studies are needed to determine the predictive value of telemetry-detected vital signs for IHCAs.

Mesenchymal Stromal Cell Healing Outcomes in Clinical and Pre-Clinical Models to Treat Pressure Ulcers: A Systematic Review.

BACKGROUND: Despite numerous measures used to prevent pressure ulcers, their growing prevalence in recent years is expected to continue as the population ages. This review aims to report the outcomes of the regenerative potential of MSCs in treating pressure ulcers, assessing the effectiveness of MSCs in treating pressure ulcers. METHODS: A computerized search for articles on animal models that use MSCs as primary therapy to treat pressure ulcers, published from conception to present, was conducted using PubMed, MEDLINE, Embase, and CINAHL. Our search yielded 52 articles, narrowed to 44 after excluding duplicates. RESULTS: Out of 52 articles collected from four databases, 11 met the inclusion criteria. A total of 11 articles published between 2008 and 2020 met the inclusion criteria. Eight studies were observational descriptive papers in animal models, and three were prospective. Six studies used autologous MSCs, while five used allogenic MSCs. Three studies were conducted in humans, and the remaining eight were conducted in animals. The most common method of cell delivery was an intradermal injection in the margins of the ulcer. All studies reported positive results, including improved wound healing, reduced inflammation, and improved tissue regeneration. CONCLUSIONS: MSCs have shown promising results in treating pressure ulcers in animal and clinical trials. The combination of MSCs and scaffold materials has also been studied and found to be effective in wound healing. A standardized human wound model has been proposed further to investigate the efficacy of cell-based therapies for chronic wounds. However, more research is needed to determine the best quantity of cells to apply for pressure ulcers and to ensure the safety and efficacy of these treatments in clinical settings.

A Review on the Management of Peripheral Neuropathic Pain Following Breast Cancer.

Postmastectomy pain syndrome (PMPS) is a common and debilitating form of postsurgical pain with neuropathic characteristics, presenting as burning, stabbing, or pulling sensations after mastectomy, lumpectomy, or other breast procedures. With a prevalence of 31%, the risk factors for PMPS include younger age, psychosocial factors, radiotherapy, axillary lymph node dissection, and a history of chronic pain. This review evaluates the pharmacological and surgical options for managing PMPS. Pharmacological treatment options include antidepressants, gabapentinoids, levetiracetam, capsaicin, and topical lidocaine. Procedural and surgical options include fat grafting, nerve blocks, radiofrequency ablation, peripheral nerve surgery, serratus plane block, and botulinum toxin injections. Despite the variety of therapeutic options available for patients, further randomized trials are required to conclude whether these treatments reduce the intensity of neuropathic pain in patients with PMPS. In particular, comparative studies and the inclusion of patients across a range of pain intensities will be essential to developing a treatment algorithm for PMPS. In conclusion, current management for these patients should be tailored to their individual requirements.

Artificial Intelligence Models in Health Information Exchange: A Systematic Review of Clinical Implications.

Electronic health record (EHR) systems collate patient data, and the integration and standardization of documents through Health Information Exchange (HIE) play a pivotal role in refining patient management. Although the clinical implications of AI in EHR systems have been extensively analyzed, its application in HIE as a crucial source of patient data is less explored. Addressing this gap, our systematic review delves into utilizing AI models in HIE, gauging their predictive prowess and potential limitations. Employing databases such as Scopus, CINAHL, Google Scholar, PubMed/Medline, and Web of Science and adhering to the PRISMA guidelines, we unearthed 1021 publications. Of these, 11 were shortlisted for the final analysis. A noticeable preference for machine learning models in prognosticating clinical results, notably in oncology and cardiac failures, was evident. The metrics displayed AUC values ranging between 61% and 99.91%. Sensitivity metrics spanned from 12% to 96.50%, specificity from 76.30% to 98.80%, positive predictive values varied from 83.70% to 94.10%, and negative predictive values between 94.10% and 99.10%. Despite variations in specific metrics, AI models drawing on HIE data unfailingly showcased commendable predictive proficiency in clinical verdicts, emphasizing the transformative potential of melding AI with HIE. However, variations in sensitivity highlight underlying challenges. As healthcare's path becomes more enmeshed with AI, a well-rounded, enlightened approach is pivotal to guarantee the delivery of trustworthy and effective AI-augmented healthcare solutions.

Evaluating the exoscope as an alternative to the operating microscope in plastic surgery.

BACKGROUND: Microsurgery is most commonly used in the anastomosis of vessels, flap harvesting, lymphedema, and nerve reconstruction, among others. During the 1920s the first microscope was invented by Nylen and Holmgren, quickly becoming the gold standard for microsurgery. However, technological advances have come forth in the form of exoscopes. METHODS: A search for full-text articles where using an exoscope was compared with a traditional operating microscope was conducted on the databases PubMed, Scopus, Web of Science, and Embase. The following terms were used to guide our search: Microscope AND exoscope AND plastic surgery; Microscope AND exoscope AND microvascular surgery. RESULTS: Our search yielded 69 studies, of which 12 were included. Five exoscope systems were used by the authors. All studies reported the exoscope as a valid alternative to the standard operating microscope. The exoscope was reported as non-inferior to the operating microscope. Although some studies reported lower quality of image, this did not seem to influence the outcome of surgeries. Newer models may have bridged the gap between the operating microscope's image quality and the exoscope. Superior ergonomics was always reported among the included studies. CONCLUSION: Based on our search, we conclude that the exoscope is a safe and valid alternative to the operating microscope in plastic surgery. As newer models are now commercially available, these have overcome difficulties in image quality and zoom capabilities, responsible for the main drawbacks of the first exoscope systems.