Integrating and Adopting AI in the Radiology Workflow: A Primer for Standards and Integrating the Healthcare Enterprise (IHE) Profiles.

The deployment of artificial intelligence (AI) solutions in radiology practice creates new demands on existing imaging workflow. Accommodating custom integrations creates a substantial operational and maintenance burden. These custom integrations also increase the likelihood of unanticipated problems. Standards-based interoperability facilitates AI integration with systems from different vendors into a single environment by enabling seamless exchange between information systems in the radiology workflow. Integrating the Healthcare Enterprise (IHE) is an initiative to improve how computer systems share information across health care domains, including radiology. IHE integrates existing standards-such as Digital Imaging and Communications in Medicine, Health Level Seven, and health care lexicons and ontologies (ie, LOINC, RadLex, SNOMED Clinical Terms)-by mapping data elements from one standard to another. IHE Radiology manages profiles (standards-based implementation guides) for departmental workflow and information sharing across care sites, including profiles for scaling AI processing traffic and integrating AI results. This review focuses on the need for standards-based interoperability to scale AI integration in radiology, including a brief review of recent IHE profiles that provide a framework for AI integration. This review also discusses challenges and additional considerations for AI integration, including technical, clinical, and policy perspectives.

Gamification in Radiology Training Module Developed During the Society for Imaging Informatics in Medicine Annual Meeting Hackathon.

The purpose of this manuscript is to report our experience in the 2021 SIIM Virtual Hackathon, where we developed a proof-of-concept of a radiology training module with elements of gamification. In the 50 h allotted in the hackathon, we proposed an idea, connected with colleagues from five different countries, and completed an operational proof-of-concept, which was demonstrated live at the hackathon showcase, competing with eight other teams. Our prototype involved participants annotating publicly available chest radiographs of patients with tuberculosis. We showed how we could give experience points to trainees based on annotation precision compared to ground truth radiologists' annotation, ranked in a live leaderboard. We believe that gamification elements could provide an engaging solution for radiology education. Our project was awarded first place out of eight participating hackathon teams.

Learning HL7 FHIR Using the HAPI FHIR Server and Its Use in Medical Imaging with the SIIM Dataset.

Health Level 7's (HL7's) new standard, FHIR (Fast Health Interoperability Resources), is setting healthcare information technology and medical imaging specifically ablaze with excitement. This paper aims to describe the protocol's advantages in some detail and explore an easy path for those unfamiliar with FHIR to begin learning the standard using free, open-source tools, namely the HL7 application programming interface (HAPI) FHIR server and the SIIM Hackathon Dataset.

Creation and Curation of the Society of Imaging Informatics in Medicine Hackathon Dataset.

In order to support innovation, the Society of Imaging Informatics in Medicine (SIIM) elected to create a collaborative computing experience called a "hackathon." The SIIM Hackathon has always consisted of two components, the event itself and the infrastructure and resources provided to the participants. In 2014, SIIM provided a collection of servers to participants during the annual meeting. After initial server setup, it was clear that clinical and imaging "test" data were also needed in order to create useful applications. We outline the goals, thought process, and execution behind the creation and maintenance of the clinical and imaging data used to create DICOM and FHIR Hackathon resources.

The Subgroup Imperative: Chest Radiograph Classifier Generalization Gaps in Patient, Setting, and Pathology Subgroups.

Purpose: To externally test four chest radiograph classifiers on a large, diverse, real-world dataset with robust subgroup analysis. Materials and Methods: In this retrospective study, adult posteroanterior chest radiographs (January 2016-December 2020) and associated radiology reports from Trillium Health Partners in Ontario, Canada, were extracted and de-identified. An open-source natural language processing tool was locally validated and used to generate ground truth labels for the 197 540-image dataset based on the associated radiology report. Four classifiers generated predictions on each chest radiograph. Performance was evaluated using accuracy, positive predictive value, negative predictive value, sensitivity, specificity, F1 score, and Matthews correlation coefficient for the overall dataset and for patient, setting, and pathology subgroups. Results: Classifiers demonstrated 68%-77% accuracy, 64%-75% sensitivity, and 82%-94% specificity on the external testing dataset. Algorithms showed decreased sensitivity for solitary findings (43%-65%), patients younger than 40 years (27%-39%), and patients in the emergency department (38%-60%) and decreased specificity on normal chest radiographs with support devices (59%-85%). Differences in sex and ancestry represented movements along an algorithm's receiver operating characteristic curve. Conclusion: Performance of deep learning chest radiograph classifiers was subject to patient, setting, and pathology factors, demonstrating that subgroup analysis is necessary to inform implementation and monitor ongoing performance to ensure optimal quality, safety, and equity.Keywords: Conventional Radiography, Thorax, Ethics, Supervised Learning, Convolutional Neural Network (CNN), Machine Learning Algorithms Supplemental material is available for this article. © RSNA, 2023See also the commentary by Huisman and Hannink in this issue.