ABSTRACT
This paper introduces an approach that combines the language reasoning capabilities of large language models (LLMs) with the benefits of local training to tackle complex language tasks. The authors demonstrate their approach by extracting structured condition codes from pathology reports. The proposed approach utilizes local, fine-tuned LLMs to respond to specific generative instructions and provide structured outputs. Over 150k uncurated surgical pathology reports containing gross descriptions, final diagnoses, and condition codes were used. Different model architectures were trained and evaluated, including LLaMA, BERT, and LongFormer. The results show that the LLaMA-based models significantly outperform BERT-style models across all evaluated metrics. LLaMA models performed especially well with large datasets, demonstrating their ability to handle complex, multi-label tasks. Overall, this work presents an effective approach for utilizing LLMs to perform structured generative tasks on domain-specific language in the medical domain.
ABSTRACT
Machine learning classification problems are widespread in bioinformatics, but the technical knowledge required to perform model training, optimization, and inference can prevent researchers from utilizing this technology. This article presents an automated tool for machine learning classification problems to simplify the process of training models and producing results while providing informative visualizations and insights into the data. This tool supports both binary and multiclass classification problems, and it provides access to a variety of models and methods. Synthetic data can be generated within the interface to fill missing values, balance class labels, or generate entirely new datasets. It also provides support for feature evaluation and generates explainability scores to indicate which features influence the output the most. We present CLASSify, an open-source tool for simplifying the user experience of solving classification problems without the need for knowledge of machine learning.
ABSTRACT
Introduction/Aims: Muscle ultrasound has high utility in clinical practice and research; however, the main challenges are the training and time required for manual analysis to achieve objective quantification of morphometry. This study aimed to develop and validate a software tool powered by artificial intelligence (AI) by measuring its consistency and predictability of expert manual analysis quantifying lower limb muscle ultrasound images across healthy, acute, and chronic illness subjects. Methods: Quadriceps complex (QC [rectus femoris and vastus intermedius]) and tibialis anterior (TA) muscle ultrasound images of healthy, intensive care unit, and/or lung cancer subjects were captured with portable devices. Automated analyses of muscle morphometry were performed using a custom-built deep-learning model (MyoVision-US), while manual analyses were performed by experts. Consistency between manual and automated analyses was determined using intraclass correlation coefficients (ICC), while predictability of MyoVision -US was calculated using adjusted linear regression (adj.R 2 ). Results: Manual analysis took approximately 24 hours to analyze all 180 images, while MyoVision - US took 247 seconds, saving roughly 99.8%. Consistency between the manual and automated analyses by ICC was good to excellent for all QC (ICC:0.85-0.99) and TA (ICC:0.93-0.99) measurements, even for critically ill (ICC:0.91-0.98) and lung cancer (ICC:0.85-0.99) images. The predictability of MyoVision-US was moderate to strong for QC (adj.R 2 :0.56-0.94) and TA parameters (adj.R 2 :0.81-0.97). Discussion: The application of AI automating lower limb muscle ultrasound analyses showed excellent consistency and strong predictability compared with human analysis. Future work needs to explore AI-powered models for the evaluation of other skeletal muscle groups.
ABSTRACT
Digital pathology applications present several challenges, including the processing, storage, and distribution of gigapixel images across distributed computational resources and viewing stations. Individual slides must be available for interactive review, and large repositories must be programmatically accessible for dataset and model building. We present a platform to manage and process multi-modal pathology data (images and case information) across multiple locations. Using an agent-based system coupled with open-source automated machine learning and review tools allows not only dynamic load-balancing and cross-network operation but also the development of research and clinical AI models using the data managed by the platform. The platform presented covers end-to-end AI workflow from data acquisition and curation through model training and evaluation allowing for sharing and review. We conclude with a case study of colon and prostate cancer model development utilizing the presented system.