The Evidence for Using Artificial Intelligence to Enhance Prostate Cancer MR Imaging.

PURPOSE OF REVIEW: The purpose of this review is to summarize the current status of artificial intelligence applied to prostate cancer MR imaging. RECENT FINDINGS: Artificial intelligence has been applied to prostate cancer MR imaging to improve its diagnostic accuracy and reproducibility of interpretation. Multiple models have been tested for gland segmentation and volume calculation, automated lesion detection, localization, and characterization, as well as prediction of tumor aggressiveness and tumor recurrence. Studies show, for example, that very robust automated gland segmentation and volume calculations can be achieved and that lesions can be detected and accurately characterized. Although results are promising, we should view these with caution. Most studies included a small sample of patients from a single institution and most models did not undergo proper external validation. More research is needed with larger and well-design studies for the development of reliable artificial intelligence tools.

An Image Quality-informed Framework for CT Characterization.

Background Lack of standardization in CT protocol choice contributes to radiation dose variation. Purpose To create a framework to assess radiation doses within broad CT categories defined according to body region and clinical imaging indication and to cluster indications according to the dose required for sufficient image quality. Materials and Methods This was a retrospective study using Digital Imaging and Communications in Medicine metadata. CT examinations in adults from January 1, 2016 to December 31, 2019 from the University of California San Francisco International CT Dose Registry were grouped into 19 categories according to body region and required radiation dose levels. Five body regions had a single dose range (ie, extremities, neck, thoracolumbar spine, combined chest and abdomen, and combined thoracolumbar spine). Five additional regions were subdivided according to dose. Head, chest, cardiac, and abdomen each had low, routine, and high dose categories; combined head and neck had routine and high dose categories. For each category, the median and 75th percentile (ie, diagnostic reference level [DRL]) were determined for dose-length product, and the variation in dose within categories versus across categories was calculated and compared using an analysis of variance. Relative median and DRL (95% CI) doses comparing high dose versus low dose categories were calculated. Results Among 4.5 million examinations, the median and DRL doses varied approximately 10 times between categories compared with between indications within categories. For head, chest, abdomen, and cardiac (3 266 546 examinations [72%]), the relative median doses were higher in examinations assigned to the high dose categories than in examinations assigned to the low dose categories, suggesting the assignment of indications to the broad categories is valid (head, 3.4-fold higher [95% CI: 3.4, 3.5]; chest, 9.6 [95% CI: 9.3, 10.0]; abdomen, 2.4 [95% CI: 2.4, 2.5]; and cardiac, 18.1 [95% CI: 17.7, 18.6]). Results were similar for DRL doses (all P < .001). Conclusion Broad categories based on image quality requirements are a suitable framework for simplifying radiation dose assessment, according to expected variation between and within categories. © RSNA, 2021 See also the editorial by Mahesh in this issue.

Multi-institutional Experience with Patient Image Access Through Electronic Health Record Patient Portals.

The objective is to determine patients' utilization rate of radiology image viewing through an online patient portal and to understand its impact on radiologists. IRB approval was waived. In this two-part, multi-institutional study, patients' image viewing rate was retrospectively assessed, and radiologists were anonymously surveyed for the impact of patient imaging access on their workflow. Patient access to web-based image viewing via electronic patient portals was enabled at 3 institutions (all had open radiology reports) within the past 5 years. The number of exams viewed online was compared against the total number of viewable imaging studies. An anonymized survey was distributed to radiologists at the 3 institutions, and responses were collected over 2 months. Patients viewed 14.2% of available exams - monthly open rate varied from 7.3 to 41.0%. A total of 254 radiologists responded to the survey (response rate 32.8%); 204 were aware that patients could view images. The majority (155/204; 76.0%) felt no impact on their role as radiologists; 11.8% felt negative and 9.3% positive. The majority (63.8%) were never approached by patients. Of the 86 who were contacted, 46.5% were contacted once or twice, 46.5% 3-4 times a year, and 4.7% 3-4 times a month. Free text comments included support for healthcare transparency (71), concern for patient confusion and anxiety (45), and need for attention to radiology reports and image annotations (15). A small proportion of patients viewed their radiology images. Overall, patients' image viewing had minimal impact on radiologists. Radiologists were seldom contacted by patients. While many radiologists feel supportive, some are concerned about causing patient confusion and suggest minor workflow modifications.

Effect of shelter-in-place on emergency department radiology volumes during the COVID-19 pandemic.

PURPOSE: The coronavirus disease 2019 (COVID-19) pandemic has led to significant disruptions in the healthcare system including surges of infected patients exceeding local capacity, closures of primary care offices, and delays of non-emergent medical care. Government-initiated measures to decrease healthcare utilization (i.e., "flattening the curve") have included shelter-in-place mandates and social distancing, which have taken effect across most of the USA. We evaluate the immediate impact of the Public Health Messaging and shelter-in-place mandates on Emergency Department (ED) demand for radiology services. METHODS: We analyzed ED radiology volumes from the five University of California health systems during a 2-week time period following the shelter-in-place mandate and compared those volumes with March 2019 and early April 2019 volumes. RESULTS: ED radiology volumes declined from the 2019 baseline by 32 to 40% (p < 0.001) across the five health systems with a total decrease in volumes across all 5 systems by 35% (p < 0.001). Stratifying by subspecialty, the smallest declines were seen in non-trauma thoracic imaging, which decreased 18% (p value < 0.001), while all other non-trauma studies decreased by 48% (p < 0.001). CONCLUSION: Total ED radiology demand may be a marker for public adherence to shelter-in-place mandates, though ED chest radiology demand may increase with an increase in COVID-19 cases.

Between Always and Never: Evaluating Uncertainty in Radiology Reports Using Natural Language Processing.

The ideal radiology report reduces diagnostic uncertainty, while avoiding ambiguity whenever possible. The purpose of this study was to characterize the use of uncertainty terms in radiology reports at a single institution and compare the use of these terms across imaging modalities, anatomic sections, patient characteristics, and radiologist characteristics. We hypothesized that there would be variability among radiologists and between subspecialities within radiology regarding the use of uncertainty terms and that the length of the impression of a report would be a predictor of use of uncertainty terms. Finally, we hypothesized that use of uncertainty terms would often be interpreted by human readers as "hedging." To test these hypotheses, we applied a natural language processing (NLP) algorithm to assess and count the number of uncertainty terms within radiology reports. An algorithm was created to detect usage of a published set of uncertainty terms. All 642,569 radiology report impressions from 171 reporting radiologists were collected from 2011 through 2015. For validation, two radiologists without knowledge of the software algorithm reviewed report impressions and were asked to determine whether the report was "uncertain" or "hedging." The relationship between the presence of 1 or more uncertainty terms and the human readers' assessment was compared. There were significant differences in the proportion of reports containing uncertainty terms across patient admission status and across anatomic imaging subsections. Reports with uncertainty were significantly longer than those without, although report length was not significantly different between subspecialities or modalities. There were no significant differences in rates of uncertainty when comparing the experience of the attending radiologist. When compared with reader 1 as a gold standard, accuracy was 0.91, sensitivity was 0.92, specificity was 0.9, and precision was 0.88, with an F1-score of 0.9. When compared with reader 2, accuracy was 0.84, sensitivity was 0.88, specificity was 0.82, and precision was 0.68, with an F1-score of 0.77. Substantial variability exists among radiologists and subspecialities regarding the use of uncertainty terms, and this variability cannot be explained by years of radiologist experience or differences in proportions of specific modalities. Furthermore, detection of uncertainty terms demonstrates good test characteristics for predicting human readers' assessment of uncertainty.

The RSNA Pediatric Bone Age Machine Learning Challenge.

Purpose The Radiological Society of North America (RSNA) Pediatric Bone Age Machine Learning Challenge was created to show an application of machine learning (ML) and artificial intelligence (AI) in medical imaging, promote collaboration to catalyze AI model creation, and identify innovators in medical imaging. Materials and Methods The goal of this challenge was to solicit individuals and teams to create an algorithm or model using ML techniques that would accurately determine skeletal age in a curated data set of pediatric hand radiographs. The primary evaluation measure was the mean absolute distance (MAD) in months, which was calculated as the mean of the absolute values of the difference between the model estimates and those of the reference standard, bone age. Results A data set consisting of 14 236 hand radiographs (12 611 training set, 1425 validation set, 200 test set) was made available to registered challenge participants. A total of 260 individuals or teams registered on the Challenge website. A total of 105 submissions were uploaded from 48 unique users during the training, validation, and test phases. Almost all methods used deep neural network techniques based on one or more convolutional neural networks (CNNs). The best five results based on MAD were 4.2, 4.4, 4.4, 4.5, and 4.5 months, respectively. Conclusion The RSNA Pediatric Bone Age Machine Learning Challenge showed how a coordinated approach to solving a medical imaging problem can be successfully conducted. Future ML challenges will catalyze collaboration and development of ML tools and methods that can potentially improve diagnostic accuracy and patient care. © RSNA, 2018 Online supplemental material is available for this article. See also the editorial by Siegel in this issue.

Ethics of Artificial Intelligence in Radiology: Summary of the Joint European and North American Multisociety Statement.

This is a condensed summary of an international multisociety statement on ethics of artificial intelligence (AI) in radiology produced by the ACR, European Society of Radiology, RSNA, Society for Imaging Informatics in Medicine, European Society of Medical Imaging Informatics, Canadian Association of Radiologists, and American Association of Physicists in Medicine. AI has great potential to increase efficiency and accuracy throughout radiology, but it also carries inherent pitfalls and biases. Widespread use of AI-based intelligent and autonomous systems in radiology can increase the risk of systemic errors with high consequence and highlights complex ethical and societal issues. Currently, there is little experience using AI for patient care in diverse clinical settings. Extensive research is needed to understand how to best deploy AI in clinical practice. This statement highlights our consensus that ethical use of AI in radiology should promote well-being, minimize harm, and ensure that the benefits and harms are distributed among stakeholders in a just manner. We believe AI should respect human rights and freedoms, including dignity and privacy. It should be designed for maximum transparency and dependability. Ultimate responsibility and accountability for AI remains with its human designers and operators for the foreseeable future. The radiology community should start now to develop codes of ethics and practice for AI that promote any use that helps patients and the common good and should block use of radiology data and algorithms for financial gain without those two attributes. This article is a simultaneous joint publication in Radiology, Journal of the American College of Radiology, Canadian Association of Radiologists Journal, and Insights into Imaging. Published under a CC BY-NC-ND 4.0 license. Online supplemental material is available for this article.

Machine Learning in Neurooncology Imaging: From Study Request to Diagnosis and Treatment.

OBJECTIVE: Machine learning has potential to play a key role across a variety of medical imaging applications. This review seeks to elucidate the ways in which machine learning can aid and enhance diagnosis, treatment, and follow-up in neurooncology. CONCLUSION: Given the rapid pace of development in machine learning over the past several years, a basic proficiency of the key tenets and use cases in the field is critical to assessing potential opportunities and challenges of this exciting new technology.

Ethics of Artificial Intelligence in Radiology: Summary of the Joint European and North American Multisociety Statement.

This is a condensed summary of an international multisociety statement on ethics of artificial intelligence (AI) in radiology produced by the ACR, European Society of Radiology, RSNA, Society for Imaging Informatics in Medicine, European Society of Medical Imaging Informatics, Canadian Association of Radiologists, and American Association of Physicists in Medicine. AI has great potential to increase efficiency and accuracy throughout radiology, but it also carries inherent pitfalls and biases. Widespread use of AI-based intelligent and autonomous systems in radiology can increase the risk of systemic errors with high consequence and highlights complex ethical and societal issues. Currently, there is little experience using AI for patient care in diverse clinical settings. Extensive research is needed to understand how to best deploy AI in clinical practice. This statement highlights our consensus that ethical use of AI in radiology should promote well-being, minimize harm, and ensure that the benefits and harms are distributed among stakeholders in a just manner. We believe AI should respect human rights and freedoms, including dignity and privacy. It should be designed for maximum transparency and dependability. Ultimate responsibility and accountability for AI remains with its human designers and operators for the foreseeable future. The radiology community should start now to develop codes of ethics and practice for AI that promote any use that helps patients and the common good and should block use of radiology data and algorithms for financial gain without those two attributes.

Social Media Tools for Department and Practice Communication and Branding in the Digital Age.

With nearly 70% of adults in the United States using at least one social media platform, a social media presence is increasingly important for departments and practices. Patients, prospective faculty and trainees, and referring physicians look to social media to find information about our organizations. The authors present a stepwise process for planning, executing, and evaluating an organizational social media strategy. This process begins with alignment with a strategic plan to set goals, identification of the target audience(s), selection of appropriate social media channels, tracking effectiveness, and resource allocation. The article concludes with a discussion of advantages and disadvantages of social media through a review of current literature. ©RSNA, 2018.

Learning HL7 FHIR Using the HAPI FHIR Server and Its Use in Medical Imaging with the SIIM Dataset.

Health Level 7's (HL7's) new standard, FHIR (Fast Health Interoperability Resources), is setting healthcare information technology and medical imaging specifically ablaze with excitement. This paper aims to describe the protocol's advantages in some detail and explore an easy path for those unfamiliar with FHIR to begin learning the standard using free, open-source tools, namely the HL7 application programming interface (HAPI) FHIR server and the SIIM Hackathon Dataset.

A Platform for Innovation and Standards Evaluation: a Case Study from the OpenMRS Open-Source Radiology Information System.

Open-source development can provide a platform for innovation by seeking feedback from community members as well as providing tools and infrastructure to test new standards. Vendors of proprietary systems may delay adoption of new standards until there are sufficient incentives such as legal mandates or financial incentives to encourage/mandate adoption. Moreover, open-source systems in healthcare have been widely adopted in low- and middle-income countries and can be used to bridge gaps that exist in global health radiology. Since 2011, the authors, along with a community of open-source contributors, have worked on developing an open-source radiology information system (RIS) across two communities-OpenMRS and LibreHealth. The main purpose of the RIS is to implement core radiology workflows, on which others can build and test new radiology standards. This work has resulted in three major releases of the system, with current architectural changes driven by changing technology, development of new standards in health and imaging informatics, and changing user needs. At their core, both these communities are focused on building general-purpose EHR systems, but based on user contributions from the fringes, we have been able to create an innovative system that has been used by hospitals and clinics in four different countries. We provide an overview of the history of the LibreHealth RIS, the architecture of the system, overview of standards integration, describe challenges of developing an open-source product, and future directions. Our goal is to attract more participation and involvement to further develop the LibreHealth RIS into an Enterprise Imaging System that can be used in other clinical imaging including pathology and dermatology.

Creation and Curation of the Society of Imaging Informatics in Medicine Hackathon Dataset.

In order to support innovation, the Society of Imaging Informatics in Medicine (SIIM) elected to create a collaborative computing experience called a "hackathon." The SIIM Hackathon has always consisted of two components, the event itself and the infrastructure and resources provided to the participants. In 2014, SIIM provided a collection of servers to participants during the annual meeting. After initial server setup, it was clear that clinical and imaging "test" data were also needed in order to create useful applications. We outline the goals, thought process, and execution behind the creation and maintenance of the clinical and imaging data used to create DICOM and FHIR Hackathon resources.

Implementing Machine Learning in Radiology Practice and Research.

OBJECTIVE: The purposes of this article are to describe concepts that radiologists should understand to evaluate machine learning projects, including common algorithms, supervised as opposed to unsupervised techniques, statistical pitfalls, and data considerations for training and evaluation, and to briefly describe ethical dilemmas and legal risk. CONCLUSION: Machine learning includes a broad class of computer programs that improve with experience. The complexity of creating, training, and monitoring machine learning indicates that the success of the algorithms will require radiologist involvement for years to come, leading to engagement rather than replacement.

Medical Image Data and Datasets in the Era of Machine Learning-Whitepaper from the 2016 C-MIMI Meeting Dataset Session.

At the first annual Conference on Machine Intelligence in Medical Imaging (C-MIMI), held in September 2016, a conference session on medical image data and datasets for machine learning identified multiple issues. The common theme from attendees was that everyone participating in medical image evaluation with machine learning is data starved. There is an urgent need to find better ways to collect, annotate, and reuse medical imaging data. Unique domain issues with medical image datasets require further study, development, and dissemination of best practices and standards, and a coordinated effort among medical imaging domain experts, medical imaging informaticists, government and industry data scientists, and interested commercial, academic, and government entities. High-level attributes of reusable medical image datasets suitable to train, test, validate, verify, and regulate ML products should be better described. NIH and other government agencies should promote and, where applicable, enforce, access to medical image datasets. We should improve communication among medical imaging domain experts, medical imaging informaticists, academic clinical and basic science researchers, government and industry data scientists, and interested commercial entities.

Proving Value in Radiology: Experience Developing and Implementing a Shareable Open Source Registry Platform Driven by Radiology Workflow.

Numerous initiatives are in place to support value based care in radiology including decision support using appropriateness criteria, quality metrics like radiation dose monitoring, and efforts to improve the quality of the radiology report for consumption by referring providers. These initiatives are largely data driven. Organizations can choose to purchase proprietary registry systems, pay for software as a service solution, or deploy/build their own registry systems. Traditionally, registries are created for a single purpose like radiation dosage or specific disease tracking like diabetes registry. This results in a fragmented view of the patient, and increases overhead to maintain such single purpose registry system by requiring an alternative data entry workflow and additional infrastructure to host and maintain multiple registries for different clinical needs. This complexity is magnified in the health care enterprise whereby radiology systems usually are run parallel to other clinical systems due to the different clinical workflow for radiologists. In the new era of value based care where data needs are increasing with demand for a shorter turnaround time to provide data that can be used for information and decision making, there is a critical gap to develop registries that are more adapt to the radiology workflow with minimal overhead on resources for maintenance and setup. We share our experience of developing and implementing an open source registry system for quality improvement and research in our academic institution that is driven by our radiology workflow.

Streamlining emergent hand and wrist radiography with a modified four-view protocol.

This study aims to determine whether a modified four-view hand and wrist study performs comparably to the traditional seven views in the evaluation of acute hand and wrist fractures. This retrospective study was approved by the institutional review board with waiver of informed consent. Two hundred forty patients (50 % male; ages 18-92 years) with unilateral three-view hand (posteroanterior, oblique, and lateral) and four-view wrist (posteroanterior, oblique, lateral, and ulnar deviation) radiographs obtained concurrently following trauma were included in this study. Four emergency radiologists interpreted the original seven images, with two radiologists independently evaluating each study. The patients' radiographs were then recombined into four-view series using the three hand images and the ulnar deviated wrist image. These were interpreted by the same radiologists following an 8-week delay. Kappa statistics were generated to measure inter-observer and inter-method agreement. Generalized linear mixed model analysis was performed between the seven- and four-view methods. Of the 480 reports generated in each of the seven- and four-view image sets, 142 (29.6 %) of the seven-view and 126 (26.2 %) of the four-view reports conveyed certain or suspected acute osseous findings. Average inter-observer kappa coefficients were 0.7845 and 0.8261 for the seven- and four-view protocols, respectively. The average inter-method kappa was 0.823. The odds ratio of diagnosing injury using the four-view compared to the seven-view algorithm was 0.69 (CI 0.45-1.06, P = 0.0873). The modified four-view hand and wrist radiographic series produces diagnostic results comparable to the traditional seven views for acute fracture evaluation.

Radiology Quality Measure Compliance Reporting: an Automated Approach.

As part of its ongoing effort to improve healthcare quality, the Center of Medicare and Medicaid Services (CMS) has transitioned from monetary rewards to reimbursement penalties for noncompliance or nonparticipation with its quality measurement initiatives. More specifically, eligible providers who bill for CMS patient care, such as radiologists, will face a 2 % negative payment adjustment, if they fail to report adequate participation and compliance with sufficient CMS quality measures in 2015. Although several methods exist to report participation and compliance, each method requires the gathering of relevant studies and assessing the reports for compliance. To aid in this data gathering and to prevent reduced reimbursements, radiology groups should consider implementing automated processes to monitor compliance with these quality measure standards. This article describes one method of creating an automated report scanner, utilizing an open source interface engine called Mirth Connect, that may facilitate the data gathering and monitoring related to reporting compliance with CMS standard #195 Stenosis measurement in Ultrasound Carotid Imaging Reports. The process described in this article is currently utilized by a large multi-institutional radiology group to assess for report compliance and offers the user near real time surveillance of compliance with the quality measure.

A Practice Quality Improvement Project: Reducing Dose of Routine Chest CT Imaging in a Busy Clinical Practice.

The purpose of this report is to describe our experience with the implementation of a practice quality improvement (PQI) project in thoracic imaging as part of the American Board of Radiology Maintenance of Certification process. The goal of this PQI project was to reduce the effective radiation dose of routine chest CT imaging in a busy clinical practice by employing the iDose(4) (Philips Healthcare) iterative reconstruction technique. The dose reduction strategy was implemented in a stepwise process on a single 64-slice CT scanner with a volume of 1141 chest CT scans during the year. In the first annual quarter, a baseline effective dose was established using the standard filtered back projection (FBP) algorithm protocol and standard parameters such as kVp and mAs. The iDose(4) technique was then applied in the second and third annual quarters while keeping all other parameters unchanged. In the fourth quarter, a reduction in kVp was also implemented. Throughout the process, the images were continually evaluated to assure that the image quality was comparable to the standard protocol from multiple other scanners. Utilizing a stepwise approach, the effective radiation dose was reduced by 23.62 and 43.63 % in quarters two and four, respectively, compared to our initial standard protocol with no perceived difference in diagnostic quality. This practice quality improvement project demonstrated a significant reduction in the effective radiation dose of thoracic CT scans in a busy clinical practice.

Toward Data-Driven Radiology Education-Early Experience Building Multi-Institutional Academic Trainee Interpretation Log Database (MATILDA).

The residency review committee of the Accreditation Council of Graduate Medical Education (ACGME) collects data on resident exam volume and sets minimum requirements. However, this data is not made readily available, and the ACGME does not share their tools or methodology. It is therefore difficult to assess the integrity of the data and determine if it truly reflects relevant aspects of the resident experience. This manuscript describes our experience creating a multi-institutional case log, incorporating data from three American diagnostic radiology residency programs. Each of the three sites independently established automated query pipelines from the various radiology information systems in their respective hospital groups, thereby creating a resident-specific database. Then, the three institutional resident case log databases were aggregated into a single centralized database schema. Three hundred thirty residents and 2,905,923 radiologic examinations over a 4-year span were catalogued using 11 ACGME categories. Our experience highlights big data challenges including internal data heterogeneity and external data discrepancies faced by informatics researchers.