An automated COVID-19 triage pipeline using artificial intelligence based on chest radiographs and clinical data.

While COVID-19 diagnosis and prognosis artificial intelligence models exist, very few can be implemented for practical use given their high risk of bias. We aimed to develop a diagnosis model that addresses notable shortcomings of prior studies, integrating it into a fully automated triage pipeline that examines chest radiographs for the presence, severity, and progression of COVID-19 pneumonia. Scans were collected using the DICOM Image Analysis and Archive, a system that communicates with a hospital's image repository. The authors collected over 6,500 non-public chest X-rays comprising diverse COVID-19 severities, along with radiology reports and RT-PCR data. The authors provisioned one internally held-out and two external test sets to assess model generalizability and compare performance to traditional radiologist interpretation. The pipeline was evaluated on a prospective cohort of 80 radiographs, reporting a 95% diagnostic accuracy. The study mitigates bias in AI model development and demonstrates the value of an end-to-end COVID-19 triage platform.

Translatability Analysis of National Institutes of Health-Funded Biomedical Research That Applies Artificial Intelligence.

Importance: Despite the rapid growth of interest and diversity in applications of artificial intelligence (AI) to biomedical research, there are limited objective ways to characterize the potential for use of AI in clinical practice. Objective: To examine what types of medical AI have the greatest estimated translational impact (ie, ability to lead to development that has measurable value for human health) potential. Design, Setting, and Participants: In this cohort study, research grants related to AI awarded between January 1, 1985, and December 31, 2020, were identified from a National Institutes of Health (NIH) award database. The text content for each award was entered into a Natural Language Processing (NLP) clustering algorithm. An NIH database was also used to extract citation data, including the number of citations and approximate potential to translate (APT) score for published articles associated with the granted awards to create proxies for translatability. Exposures: Unsupervised assignment of AI-related research awards to application topics using NLP. Main Outcomes and Measures: Annualized citations per $1 million funding (ACOF) and average APT score for award-associated articles, grouped by application topic. The APT score is a machine-learning based metric created by the NIH Office of Portfolio Analysis that quantifies the likelihood of future citation by a clinical article. Results: A total of 16 629 NIH awards related to AI were included in the analysis, and 75 applications of AI were identified. Total annual funding for AI grew from $17.4 million in 1985 to $1.43 billion in 2020. By average APT, interpersonal communication technologies (0.488; 95% CI, 0.472-0.504) and population genetics (0.463; 95% CI, 0.453-0.472) had the highest translatability; environmental health (ACOF, 1038) and applications focused on the electronic health record (ACOF, 489) also had high translatability. The category of applications related to biochemical analysis was found to have low translatability by both metrics (average APT, 0.393; 95% CI, 0.388-0.398; ACOF, 246). Conclusions and Relevance: Based on this study's findings, data on grants from the NIH can apparently be used to identify and characterize medical applications of AI to understand changes in academic productivity, funding support, and potential for translational impact. This method may be extended to characterize other research domains.

Willingness to use a wearable device capable of detecting and reversing overdose among people who use opioids in Philadelphia.

BACKGROUND: The incidence of opioid-related overdose deaths has been rising for 30 years and has been further exacerbated amidst the COVID-19 pandemic. Naloxone can reverse opioid overdose, lower death rates, and enable a transition to medication for opioid use disorder. Though current formulations for community use of naloxone have been shown to be safe and effective public health interventions, they rely on bystander presence. We sought to understand the preferences and minimum necessary conditions for wearing a device capable of sensing and reversing opioid overdose among people who regularly use opioids. METHODS: We conducted a combined cross-sectional survey and semi-structured interview at a respite center, shelter, and syringe exchange drop-in program in Philadelphia, Pennsylvania, USA, during the COVID-19 pandemic in August and September 2020. The primary aim was to explore the proportion of participants who would use a wearable device to detect and reverse overdose. Preferences regarding designs and functionalities were collected via a questionnaire with items having Likert-based response options and a semi-structured interview intended to elicit feedback on prototype designs. Independent variables included demographics, opioid use habits, and previous experience with overdose. RESULTS: A total of 97 adults with an opioid use history of at least 3 months were interviewed. A majority of survey participants (76%) reported a willingness to use a device capable of detecting an overdose and automatically administering a reversal agent upon initial survey. When reflecting on the prototype, most respondents (75.5%) reported that they would wear the device always or most of the time. Respondents indicated discreetness and comfort as important factors that increased their chance of uptake. Respondents suggested that people experiencing homelessness and those with low tolerance for opioids would be in greatest need of the device. CONCLUSIONS: The majority of people sampled with a history of opioid use in an urban setting were interested in having access to a device capable of detecting and reversing an opioid overdose. Participants emphasized privacy and comfort as the most important factors influencing their willingness to use such a device. TRIAL REGISTRATION: NCT04530591.

Deep Learning for Classification of Bone Lesions on Routine MRI.

BACKGROUND: Radiologists have difficulty distinguishing benign from malignant bone lesions because these lesions may have similar imaging appearances. The purpose of this study was to develop a deep learning algorithm that can differentiate benign and malignant bone lesions using routine magnetic resonance imaging (MRI) and patient demographics. METHODS: 1,060 histologically confirmed bone lesions with T1- and T2-weighted pre-operative MRI were retrospectively identified and included, with lesions from 4 institutions used for model development and internal validation, and data from a fifth institution used for external validation. Image-based models were generated using the EfficientNet-B0 architecture and a logistic regression model was trained using patient age, sex, and lesion location. A voting ensemble was created as the final model. The performance of the model was compared to classification performance by radiology experts. FINDINGS: The cohort had a mean age of 30±23 years and was 58.3% male, with 582 benign lesions and 478 malignant. Compared to a contrived expert committee result, the ensemble deep learning model achieved (ensemble vs. experts): similar accuracy (0·76 vs. 0·73, p=0·7), sensitivity (0·79 vs. 0·81, p=1·0) and specificity (0·75 vs. 0·66, p=0·48), with a ROC AUC of 0·82. On external testing, the model achieved ROC AUC of 0·79. INTERPRETATION: Deep learning can be used to distinguish benign and malignant bone lesions on par with experts. These findings could aid in the development of computer-aided diagnostic tools to reduce unnecessary referrals to specialized centers from community clinics and limit unnecessary biopsies. FUNDING: This work was funded by a Radiological Society of North America Research Medical Student Grant (#RMS2013) and supported by the Amazon Web Services Diagnostic Development Initiative.

Prognostication of patients with COVID-19 using artificial intelligence based on chest x-rays and clinical data: a retrospective study.

BACKGROUND: Chest x-ray is a relatively accessible, inexpensive, fast imaging modality that might be valuable in the prognostication of patients with COVID-19. We aimed to develop and evaluate an artificial intelligence system using chest x-rays and clinical data to predict disease severity and progression in patients with COVID-19. METHODS: We did a retrospective study in multiple hospitals in the University of Pennsylvania Health System in Philadelphia, PA, USA, and Brown University affiliated hospitals in Providence, RI, USA. Patients who presented to a hospital in the University of Pennsylvania Health System via the emergency department, with a diagnosis of COVID-19 confirmed by RT-PCR and with an available chest x-ray from their initial presentation or admission, were retrospectively identified and randomly divided into training, validation, and test sets (7:1:2). Using the chest x-rays as input to an EfficientNet deep neural network and clinical data, models were trained to predict the binary outcome of disease severity (ie, critical or non-critical). The deep-learning features extracted from the model and clinical data were used to build time-to-event models to predict the risk of disease progression. The models were externally tested on patients who presented to an independent multicentre institution, Brown University affiliated hospitals, and compared with severity scores provided by radiologists. FINDINGS: 1834 patients who presented via the University of Pennsylvania Health System between March 9 and July 20, 2020, were identified and assigned to the model training (n=1285), validation (n=183), or testing (n=366) sets. 475 patients who presented via the Brown University affiliated hospitals between March 1 and July 18, 2020, were identified for external testing of the models. When chest x-rays were added to clinical data for severity prediction, area under the receiver operating characteristic curve (ROC-AUC) increased from 0·821 (95% CI 0·796-0·828) to 0·846 (0·815-0·852; p<0·0001) on internal testing and 0·731 (0·712-0·738) to 0·792 (0·780-0 ·803; p<0·0001) on external testing. When deep-learning features were added to clinical data for progression prediction, the concordance index (C-index) increased from 0·769 (0·755-0·786) to 0·805 (0·800-0·820; p<0·0001) on internal testing and 0·707 (0·695-0·729) to 0·752 (0·739-0·764; p<0·0001) on external testing. The image and clinical data combined model had significantly better prognostic performance than combined severity scores and clinical data on internal testing (C-index 0·805 vs 0·781; p=0·0002) and external testing (C-index 0·752 vs 0·715; p<0·0001). INTERPRETATION: In patients with COVID-19, artificial intelligence based on chest x-rays had better prognostic performance than clinical data or radiologist-derived severity scores. Using artificial intelligence, chest x-rays can augment clinical data in predicting the risk of progression to critical illness in patients with COVID-19. FUNDING: Brown University, Amazon Web Services Diagnostic Development Initiative, Radiological Society of North America, National Cancer Institute and National Institute of Biomedical Imaging and Bioengineering of the National Institutes of Health.

Early detection of SARS-CoV-2 and other infections in solid organ transplant recipients and household members using wearable devices.

The increasing global prevalence of SARS-CoV-2 and the resulting COVID-19 disease pandemic pose significant concerns for clinical management of solid organ transplant recipients (SOTR). Wearable devices that can measure physiologic changes in biometrics including heart rate, heart rate variability, body temperature, respiratory, activity (such as steps taken per day) and sleep patterns, and blood oxygen saturation show utility for the early detection of infection before clinical presentation of symptoms. Recent algorithms developed using preliminary wearable datasets show that SARS-CoV-2 is detectable before clinical symptoms in >80% of adults. Early detection of SARS-CoV-2, influenza, and other pathogens in SOTR, and their household members, could facilitate early interventions such as self-isolation and early clinical management of relevant infection(s). Ongoing studies testing the utility of wearable devices such as smartwatches for early detection of SARS-CoV-2 and other infections in the general population are reviewed here, along with the practical challenges to implementing these processes at scale in pediatric and adult SOTR, and their household members. The resources and logistics, including transplant-specific analyses pipelines to account for confounders such as polypharmacy and comorbidities, required in studies of pediatric and adult SOTR for the robust early detection of SARS-CoV-2, and other infections are also reviewed.

Deep learning-based classification of primary bone tumors on radiographs: A preliminary study.

BACKGROUND: To develop a deep learning model to classify primary bone tumors from preoperative radiographs and compare performance with radiologists. METHODS: A total of 1356 patients (2899 images) with histologically confirmed primary bone tumors and pre-operative radiographs were identified from five institutions' pathology databases. Manual cropping was performed by radiologists to label the lesions. Binary discriminatory capacity (benign versus not-benign and malignant versus not-malignant) and three-way classification (benign versus intermediate versus malignant) performance of our model were evaluated. The generalizability of our model was investigated on data from external test set. Final model performance was compared with interpretation from five radiologists of varying level of experience using the Permutations tests. FINDINGS: For benign vs. not benign, model achieved area under curve (AUC) of 0•894 and 0•877 on cross-validation and external testing, respectively. For malignant vs. not malignant, model achieved AUC of 0•907 and 0•916 on cross-validation and external testing, respectively. For three-way classification, model achieved 72•1% accuracy vs. 74•6% and 72•1% for the two subspecialists on cross-validation (p = 0•03 and p = 0•52, respectively). On external testing, model achieved 73•4% accuracy vs. 69•3%, 73•4%, 73•1%, 67•9%, and 63•4% for the two subspecialists and three junior radiologists (p = 0•14, p = 0•89, p = 0•93, p = 0•02, p < 0•01 for radiologists 1-5, respectively). INTERPRETATION: Deep learning can classify primary bone tumors using conventional radiographs in a multi-institutional dataset with similar accuracy compared to subspecialists, and better performance than junior radiologists. FUNDING: The project described was supported by RSNA Research & Education Foundation, through grant number RSCH2004 to Harrison X. Bai.

Development of a long-acting direct-acting antiviral system for hepatitis C virus treatment in swine.

Chronic hepatitis C virus (HCV) infection is a leading cause of cirrhosis worldwide and kills more Americans than 59 other infections, including HIV and tuberculosis, combined. While direct-acting antiviral (DAA) treatments are effective, limited uptake of therapy, particularly in high-risk groups, remains a substantial barrier to eliminating HCV. We developed a long-acting DAA system (LA-DAAS) capable of prolonged dosing and explored its cost-effectiveness. We designed a retrievable coil-shaped LA-DAAS compatible with nasogastric tube administration and the capacity to encapsulate and release gram levels of drugs while resident in the stomach. We formulated DAAs in drug-polymer pills and studied the release kinetics for 1 mo in vitro and in vivo in a swine model. The LA-DAAS was equipped with ethanol and temperature sensors linked via Bluetooth to a phone application to provide patient engagement. We then performed a cost-effectiveness analysis comparing LA-DAAS to DAA alone in various patient groups, including people who inject drugs. Tunable release kinetics of DAAs was enabled for 1 mo with drug-polymer pills in vitro, and the LA-DAAS safely and successfully provided at least month-long release of sofosbuvir in vivo. Temperature and alcohol sensors could interface with external sources for at least 1 mo. The LA-DAAS was cost-effective compared to DAA therapy alone in all groups considered (base case incremental cost-effectiveness ratio $39,800). We believe that the LA-DAA system can provide a cost-effective and patient-centric method for HCV treatment, including in high-risk populations who are currently undertreated.

A gastric resident drug delivery system for prolonged gram-level dosing of tuberculosis treatment.

Multigram drug depot systems for extended drug release could transform our capacity to effectively treat patients across a myriad of diseases. For example, tuberculosis (TB) requires multimonth courses of daily multigram doses for treatment. To address the challenge of prolonged dosing for regimens requiring multigram drug dosing, we developed a gastric resident system delivered through the nasogastric route that was capable of safely encapsulating and releasing grams of antibiotics over a period of weeks. Initial preclinical safety and drug release were demonstrated in a swine model with a panel of TB antibiotics. We anticipate multiple applications in the field of infectious diseases, as well as for other indications where multigram depots could impart meaningful benefits to patients, helping maximize adherence to their medication.