RESUMO
BACKGROUND: Artificial intelligence (AI) based computer-aided detection devices are recommended for screening and triaging of pulmonary tuberculosis (TB) using digital chest x-ray (CXR) images (soft copies). Most AI algorithms are trained using input data from digital CXR Digital Imaging and Communications in Medicine (DICOM) files. There can be scenarios when only digital CXR films (hard copies) are available for interpretation. A smartphone-captured photo of the digital CXR film may be used for AI to process in such a scenario. There is a gap in the literature investigating if there is a significant difference in the performance of AI algorithms when digital CXR DICOM files are used as input for AI to process as opposed to photos of the digital CXR films being used as input. OBJECTIVE: The primary objective was to compare the agreement of AI in detecting radiological signs of TB when using DICOM files (denoted as CXRd) as input versus when using smartphone-captured photos of digital CXR films (denoted as CXRp) with human readers. METHODS: Pairs of CXRd and CXRp images were obtained retrospectively from patients screened for TB. AI results were obtained using both the CXRd and CXRp files. The majority consensus on the presence or absence of TB in CXR pairs was obtained from a panel of 3 independent radiologists. The positive and negative percent agreement of AI in detecting radiological signs of TB in CXRd and CXRp were estimated by comparing with the majority consensus. The distribution of AI probability scores was also compared. RESULTS: A total of 1278 CXR pairs were analyzed. The positive percent agreement of AI was found to be 92.22% (95% CI 89.94-94.12) and 90.75% (95% CI 88.32-92.82), respectively, for CXRd and CXRp images (P=.09). The negative percent agreement of AI was 82.08% (95% CI 78.76-85.07) and 79.23% (95% CI 75.75-82.42), respectively, for CXRd and CXRp images (P=.06). The median of the AI probability score was 0.72 (IQR 0.11-0.97) in CXRd and 0.72 (IQR 0.14-0.96) in CXRp images (P=.75). CONCLUSIONS: We did not observe any statistically significant differences in the output of AI in digital CXRs and photos of digital CXR films.
RESUMO
In resource-limited settings, timely treatment of acute stroke is dependent upon accurate diagnosis that draws on non-contrast computed tomography (NCCT) scans of the head. Artificial Intelligence (AI) based devices may be able to assist non-specialist physicians in NCCT interpretation, thereby enabling faster interventions for acute stroke patients in these settings. We evaluated the impact of an AI device by comparing the time to intervention (TTI) from NCCT imaging to significant intervention before (baseline) and after the deployment of AI, in patients diagnosed with stroke (ischemic or hemorrhagic) through a retrospective interrupted time series analysis at a rural hospital managed by non-specialists in India. Significant intervention was defined as thrombolysis or antiplatelet therapy in ischemic strokes, and mannitol for hemorrhagic strokes or mass effect. We also evaluated the diagnostic accuracy of the software using the teleradiologists' reports as ground truth. Impact analysis in a total of 174 stroke patients (72 in baseline and 102 after deployment) demonstrated a significant reduction of median TTI from 80 minutes (IQR: 56·8-139·5) during baseline to 58·50 (IQR: 30·3-118.2) minutes after AI deployment (Wilcoxon rank sum test-location shift: -21·0, 95% CI: -38·0, -7·0). Diagnostic accuracy evaluation in a total of 864 NCCT scans demonstrated the sensitivity, specificity, positive predictive value (PPV) and negative predictive value (NPV) in detecting intracranial hemorrhage to be 0·89 (95% CI: 0·83-0·93), 0·99 (0·98-1·00), 0·96 (0·91-0·98) and 0·97 (0·96-0·98) respectively, and for infarct these were 0·84 (0·79-0·89), 0·81 (0·77-0·84), 0·58 (0·52-0·63), and 0·94 (0·92-0·96), respectively. AI-based NCCT interpretation supported faster abnormality detection with high accuracy, resulting in persons with acute stroke receiving significantly earlier treatment. Our results suggest that AI-based NCCT interpretation can potentially improve uptake of lifesaving interventions for acute stroke in resource-limited settings.
RESUMO
Artificial Intelligence (AI) based chest X-ray (CXR) screening for tuberculosis (TB) is becoming increasingly popular. Still, deploying such AI tools can be challenging due to multiple real-life barriers like software installation, workflow integration, network connectivity constraints, limited human resources available to interpret findings, etc. To understand these challenges, PATH implemented a TB REACH active case-finding program in a resource-limited setting of Nagpur in India, where an AI software device (qXR) intended for TB screening using CXR images was used. Eight private CXR laboratories that fulfilled prerequisites for AI software installation were engaged for this program. Key lessons about operational feasibility and accessibility, along with the strategies adopted to overcome these challenges, were learned during this program. This program also helped to screen 10,481 presumptive TB individuals using informal providers based on clinical history. Among them, 2,303 individuals were flagged as presumptive for TB by a radiologist or by AI based on their CXR interpretation. Approximately 15.8% increase in overall TB yield could be attributed to the presence of AI alone because these additional cases were not deemed presumptive for TB by radiologists, but AI was able to identify them. Successful implementation of AI tools like qXR in resource-limited settings in India will require solving real-life implementation challenges for seamless deployment and workflow integration.