A convolutional neural network-based system to classify patients using FDG PET/CT examinations.

BACKGROUND: As the number of PET/CT scanners increases and FDG PET/CT becomes a common imaging modality for oncology, the demands for automated detection systems on artificial intelligence (AI) to prevent human oversight and misdiagnosis are rapidly growing. We aimed to develop a convolutional neural network (CNN)-based system that can classify whole-body FDG PET as 1) benign, 2) malignant or 3) equivocal. METHODS: This retrospective study investigated 3485 sequential patients with malignant or suspected malignant disease, who underwent whole-body FDG PET/CT at our institute. All the cases were classified into the 3 categories by a nuclear medicine physician. A residual network (ResNet)-based CNN architecture was built for classifying patients into the 3 categories. In addition, we performed a region-based analysis of CNN (head-and-neck, chest, abdomen, and pelvic region). RESULTS: There were 1280 (37%), 1450 (42%), and 755 (22%) patients classified as benign, malignant and equivocal, respectively. In the patient-based analysis, CNN predicted benign, malignant and equivocal images with 99.4, 99.4, and 87.5% accuracy, respectively. In region-based analysis, the prediction was correct with the probability of 97.3% (head-and-neck), 96.6% (chest), 92.8% (abdomen) and 99.6% (pelvic region), respectively. CONCLUSION: The CNN-based system reliably classified FDG PET images into 3 categories, indicating that it could be helpful for physicians as a double-checking system to prevent oversight and misdiagnosis.

A reliability study using computer-based analysis of finger joint space narrowing in rheumatoid arthritis patients.

The joint space difference index (JSDI) is a newly developed radiographic index which can quantitatively assess joint space narrowing progression of rheumatoid arthritis (RA) patients by using an image subtraction method on a computer. The aim of this study was to investigate the reliability of this method by non-experts utilizing RA image evaluation. Four non-experts assessed JSDI for radiographic images of 510 metacarpophalangeal joints from 51 RA patients twice with an interval of more than 2 weeks. Two rheumatologists and one radiologist as well as the four non-experts examined the joints by using the Sharp-van der Heijde Scoring (SHS) method. The radiologist and four non-experts repeated the scoring with an interval of more than 2 weeks. We calculated intra-/inter-observer reliability using the intra-class correlation coefficients (ICC) for JSDI and SHS scoring, respectively. The intra-/inter-observer reliabilities for the computer-based method were almost perfect (inter-observer ICC, 0.966-0.983; intra-observer ICC, 0.954-0.996). Contrary to this, intra-/inter-observer reliability for SHS by experts was moderate to almost perfect (inter-observer ICC, 0.556-0.849; intra-observer ICC, 0.589-0.839). The results suggest that our computer-based method has high reliability to detect finger joint space narrowing progression in RA patients.

A convolutional neural network-based system to estimate the arterial plasma radioactivity curve in 18 F-FDG dynamic brain PET study.

PURPOSE: Quantitative images of metabolic activity can be derived through dynamic PET. However, the conventional approach necessitates invasive blood sampling to acquire the input function, thus limiting its noninvasive nature. The aim of this study was to devise a system based on convolutional neural network (CNN) capable of estimating the time-radioactivity curve of arterial plasma and accurately quantify the cerebral metabolic rate of glucose (CMRGlc) directly from PET data, thereby eliminating the requirement for invasive sampling. METHODS: This retrospective investigation analyzed 29 patients with neurological disorders who underwent comprehensive whole-body 18 F-FDG-PET/CT examinations. Each patient received an intravenous infusion of 185 MBq of 18 F-FDG, followed by dynamic PET data acquisition and arterial blood sampling. A CNN architecture was developed to accurately estimate the time-radioactivity curve of arterial plasma. RESULTS: The CNN estimated the time-radioactivity curve using the leave-one-out technique. In all cases, there was at least one frame with a prediction error within 10% in at least one frame. Furthermore, the correlation coefficient between CMRGlc obtained from the sampled blood and CNN yielded a highly significant value of 0.99. CONCLUSION: The time-radioactivity curve of arterial plasma and CMRGlc was determined from 18 F-FDG dynamic brain PET data using a CNN. The utilization of CNN has facilitated noninvasive measurements of input functions from dynamic PET data. This method can be applied to various forms of quantitative analysis of dynamic medical image data.

A convolutional neural network-based system to prevent patient misidentification in FDG-PET examinations.

Patient misidentification in imaging examinations has become a serious problem in clinical settings. Such misidentification could be prevented if patient characteristics such as sex, age, and body weight could be predicted based on an image of the patient, with an alert issued when a mismatch between the predicted and actual patient characteristic is detected. Here, we tested a simple convolutional neural network (CNN)-based system that predicts patient sex from FDG PET-CT images. This retrospective study included 6,462 consecutive patients who underwent whole-body FDG PET-CT at our institute. The CNN system was used for classifying these patients by sex. Seventy percent of the randomly selected images were used to train and validate the system; the remaining 30% were used for testing. The training process was repeated five times to calculate the system's accuracy. When images for the testing were given to the learned CNN model, the sex of 99% of the patients was correctly categorized. We then performed an image-masking simulation to investigate the body parts that are significant for patient classification. The image-masking simulation indicated the pelvic region as the most important feature for classification. Finally, we showed that the system was also able to predict age and body weight. Our findings demonstrate that a CNN-based system would be effective to predict the sex of patients, with or without age and body weight prediction, and thereby prevent patient misidentification in clinical settings.