Diagnostic Accuracy of a Mobile AI-Based Symptom Checker and a Web-Based Self-Referral Tool in Rheumatology: Multicenter Randomized Controlled Trial.

BACKGROUND: The diagnosis of inflammatory rheumatic diseases (IRDs) is often delayed due to unspecific symptoms and a shortage of rheumatologists. Digital diagnostic decision support systems (DDSSs) have the potential to expedite diagnosis and help patients navigate the health care system more efficiently. OBJECTIVE: The aim of this study was to assess the diagnostic accuracy of a mobile artificial intelligence (AI)-based symptom checker (Ada) and a web-based self-referral tool (Rheport) regarding IRDs. METHODS: A prospective, multicenter, open-label, crossover randomized controlled trial was conducted with patients newly presenting to 3 rheumatology centers. Participants were randomly assigned to complete a symptom assessment using either Ada or Rheport. The primary outcome was the correct identification of IRDs by the DDSSs, defined as the presence of any IRD in the list of suggested diagnoses by Ada or achieving a prespecified threshold score with Rheport. The gold standard was the diagnosis made by rheumatologists. RESULTS: A total of 600 patients were included, among whom 214 (35.7%) were diagnosed with an IRD. Most frequent IRD was rheumatoid arthritis with 69 (11.5%) patients. Rheport's disease suggestion and Ada's top 1 (D1) and top 5 (D5) disease suggestions demonstrated overall diagnostic accuracies of 52%, 63%, and 58%, respectively, for IRDs. Rheport showed a sensitivity of 62% and a specificity of 47% for IRDs. Ada's D1 and D5 disease suggestions showed a sensitivity of 52% and 66%, respectively, and a specificity of 68% and 54%, respectively, concerning IRDs. Ada's diagnostic accuracy regarding individual diagnoses was heterogenous, and Ada performed considerably better in identifying rheumatoid arthritis in comparison to other diagnoses (D1: 42%; D5: 64%). The Cohen κ statistic of Rheport for agreement on any rheumatic disease diagnosis with Ada D1 was 0.15 (95% CI 0.08-0.18) and with Ada D5 was 0.08 (95% CI 0.00-0.16), indicating poor agreement for the presence of any rheumatic disease between the 2 DDSSs. CONCLUSIONS: To our knowledge, this is the largest comparative DDSS trial with actual use of DDSSs by patients. The diagnostic accuracies of both DDSSs for IRDs were not promising in this high-prevalence patient population. DDSSs may lead to a misuse of scarce health care resources. Our results underscore the need for stringent regulation and drastic improvements to ensure the safety and efficacy of DDSSs. TRIAL REGISTRATION: German Register of Clinical Trials DRKS00017642; https://drks.de/search/en/trial/DRKS00017642.

Drug survival superiority of tumor necrosis factor inhibitors and interleukin-17 inhibitors over Janus kinase inhibitors and interleukin-12/23 inhibitors in German psoriatic arthritis outpatients: retrospective analysis of the RHADAR database.

Objective: Treatment options with disease-modifying antirheumatic drugs (DMARDs) for psoriatic arthritis (PsA) have evolved over recent years. In addition to Janus kinase inhibitors (JAKi), four classes of biologic DMARDs (bDMARDs; interleukin [IL]-23 inhibitors [IL-23i], IL-12/23 inhibitors [IL-12/23i], tumor necrosis factor inhibitors [TNFi], and IL-17 inhibitors [IL-17i]) are currently approved for moderate to severe PsA treatment. There is minimal evidence of the persistence of these drugs among PsA outpatients in a real-world scenario during the period following the approval of JAKi. Therefore, we aimed to analyze the drug survival rates of biologic and JAKi therapies among German PsA outpatients during routine clinical care. Methods: We retrospectively analyzed PsA patients with a new prescription for a biologic or JAKi in the RHADAR database between January 2015 and October 2023. Kaplan-Meier Curves and Cox regression modelling were used to compare drug survival rates. Results: 1352 new prescriptions with bDMARDs (IL-12/23i [n=50], IL-23i [n=31], TNFi [n=774], IL-17i [n=360]) or JAKi (n=137) were identified. The 5-year drug survival rate was 67.8% for IL-17i, 62.3% for TNFi, 53.3% for JAKi, and 46.0% for IL-12/23i. Discontinuation probabilities for JAKi and IL-12/23i were significantly higher compared with TNFi (JAKi hazard ratio [HR] 1.66, [95% CI 1.23-2.24], p=0.001; IL-12/23i HR 1.54, [95% CI 1.02-2.33], p=0.042) and IL-17i (JAKi HR 1.77, [95% CI 1.27-2.47], p=0.001; IL-12/23i HR 1.64, [95% CI 1.06-2.55], p=0.027). JAKi-treated patients had more severe disease and more osteoarthritis (OA) compared to TNFi and more OA compared to IL-17i. Conclusion: German PsA outpatients might persist longer with TNFi and IL-17i compared with IL-12/23i or JAKi. For TNFi, differences in subgroup characteristics and comorbidities (OA) may have affected drug survival rates. For IL-17i, the longer drug survival might not only be related to less OA compared to JAKi and, therefore, might be affected by other factors.

Radiographic and non-radiographic axial spondyloarthritis are not routinely distinguished in everyday clinical care: an analysis of real-world data from rheumatology practices.

The categorization of axial spondyloarthritis (axSpA) into radiographic (r-axSpA) and non-radiographic (nr-axSpA) subtypes is important in clinical trials but may be of less value in clinical practice. This exploratory cross-sectional, multi-center study evaluated patients with axSpA under routine care at German clinical rheumatology sites (RHADAR real-world database), with a focus on imaging data used for diagnostic classifications. Our analyses included 371 patients with axSpA. The mean (standard deviation [SD]) age was 50.9 (14.0) years, disease duration was 16.4 (13.5) years, and 39.6% were female. Based on the rheumatologist's final assessment, almost half of patients had definite r-axSpA (n = 179; 48.2%), 53 (14.3%) had suspected r-axSpA, 112 (30.2%) had non-radiographic-axSpA (nr-axSpA), and 27 (7.3%) had undefined axSpA. Patients assessed with definite or suspected r-axSpA were more likely to be treated with disease-modifying antirheumatic drugs (DMARDs) (62.0% and 64.2%, respectively) compared with nr-axSpA or undefined axSpA patients (37.5% and 48.1%, respectively). Almost all patients (348/371; 93.8%) had sacroiliac joint imaging data (radiographs or magnetic resonance imaging) documented in their charts, but only 216 (58.2%) had conventional radiographs required for formal diagnosis of r-axSpA by modified New York criteria. Follow-up radiographic imaging in nr-axSpA patients was uncommon (23/216 [25.0%]) but confirmed r-axSpA in 9/23 patients (39.1%). In conclusion, radiographs were available for slightly more than half of axSpA patients. Follow-up imaging was infrequent during rheumatology care in Germany but confirmed r-axSpA in ~ 40% of patients originally considered to have nr-axSpA. The distinction between r-axSpA and nr-axSpA may be ill-defined in routine clinical practice.

Impairment in cognitive function in patients with axial spondyloarthritis and psoriatic arthritis.

Spondyloarthritis may contribute to deficits in cognition. The objective of this study was to compare cognitive abilities in patients with axial spondyloarthritis (axSpA) or psoriatic arthritis (PsA) with matched reference groups. This investigator-initiated, cross-sectional, exploratory study of adults with axSpA or PsA was conducted at two German rheumatology centres (November 2018-September 2019). All data on patient and disease characteristics and cognitive abilities were collected at a single visit. Cognitive function was assessed by the previously validated Memory and Attention Test subscores of selective attention, episodic working memory, and episodic short-term memory and compared with subscores from healthy age-, sex-, and education-matched reference subjects. The mean patient age was 51.1 and 55.8 years in the axSpA (n = 101) and PsA (n = 117) groups, respectively, and mean symptom duration was 13.7 and 10.3 years. Compared with matched reference subjects, axSpA and PsA patients showed significant impairments in selective attention (mean difference of -6.5 and -4.5, respectively, on a 45-point scale; P < 0.001 for both) and no significant differences in episodic working memory. The PsA cohort, but not the axSpA cohort, had significantly better episodic short-term memory subscores compared with matched reference subjects (mean change of 2.0 on a 15-point scale; P < 0.001). Explorative subgroup analyses were unable to identify factors influencing cognitive changes, including disease activity, pain, and function, but may have been underpowered. We conclude that impairments in selective attention may impact the ability of axSpA and PsA patients to process information. These findings warrant additional studies, including longitudinal analyses, in patients with spondyloarthritis.

Diagnostic delay stages and pre-diagnostic treatment in patients with suspected rheumatic diseases before special care consultation: results of a multicenter-based study.

Early and effective discrimination (triage) of patients with inflammatory rheumatic diseases (IRD) and other diseases (non-IRD) is essential for successful treatment and preventing damage. The aim of this study was to investigate diagnostic delays and pre-diagnosis treatment in patients newly presenting to rheumatology outpatient clinics. A total of 600 patients newly presenting to one university hospital and two non-academic centers were included. Time from onset of symptoms to rheumatology consultation "total delay" as well as medical treatment before consultation were recorded. Median time from symptom onset to rheumatologist appointment (total delay) was 30 weeks. Median time to online search, first physician appointment request and first physician appointment was 2, 4 and 5 weeks, respectively. Total delay was significantly shorter for IRD patients compared to non-IRD patients, 26 vs 35 weeks (p = 0.007). Only 17.7% of all patients and 22.9% of IRD patients had a delay of less than 12 weeks. Total delay was significantly lower in patients seen in non-academic centers compared to the university center, 20 vs 50 weeks (p < 0.0001). 32.2% of IRD patients received medical treatment that eased their symptoms prior to the rheumatology appointment. These findings highlight the persistent diagnostic delays in rheumatology; however, they also suggest that current triage strategies effectively lead to earlier appointments for IRD patients. Improvement of triage methods and pre-diagnosis treatment could decrease overall burden of disease in IRD patients.

Machine learning-based improvement of an online rheumatology referral and triage system.

Introduction: Rheport is an online rheumatology referral system allowing automatic appointment triaging of new rheumatology patient referrals according to the respective probability of an inflammatory rheumatic disease (IRD). Previous research reported that Rheport was well accepted among IRD patients. Its accuracy was, however, limited, currently being based on an expert-based weighted sum score. This study aimed to evaluate whether machine learning (ML) models could improve this limited accuracy. Materials and methods: Data from a national rheumatology registry (RHADAR) was used to train and test nine different ML models to correctly classify IRD patients. Diagnostic performance was compared of ML models and the current algorithm was compared using the area under the receiver operating curve (AUROC). Feature importance was investigated using shapley additive explanation (SHAP). Results: A complete data set of 2265 patients was used to train and test ML models. 30.5% of patients were diagnosed with an IRD, 69.3% were female. The diagnostic accuracy of the current Rheport algorithm (AUROC of 0.534) could be improved with all ML models, (AUROC ranging between 0.630 and 0.737). Targeting a sensitivity of 90%, the logistic regression model could double current specificity (17% vs. 33%). Finger joint pain, inflammatory marker levels, psoriasis, symptom duration and female sex were the five most important features of the best performing logistic regression model for IRD classification. Conclusion: In summary, ML could improve the accuracy of a currently used rheumatology online referral system. Including further laboratory parameters and enabling individual feature importance adaption could increase accuracy and lead to broader usage.

Patient's Perception of Digital Symptom Assessment Technologies in Rheumatology: Results From a Multicentre Study.

Introduction: An increasing number of digital tools, including dedicated diagnostic decision support systems (DDSS) exist to better assess new symptoms and understand when and where to seek medical care. The aim of this study was to evaluate patient's previous online assessment experiences and to compare the acceptability, usability, usefulness and potential impact of artificial intelligence (AI)-based symptom checker (Ada) and an online questionnaire-based self-referral tool (Rheport). Materials and Methods: Patients newly presenting to three German secondary rheumatology outpatient clinics were randomly assigned in a 1:1 ratio to complete consecutively Ada or Rheport in a prospective non-blinded multicentre controlled crossover randomized trial. DDSS completion time was recorded by local study personnel and perceptions on DDSS and previous online assessment were collected through a self-completed study questionnaire, including usability measured with the validated System Usability Scale (SUS). Results: 600 patients (median age 52 years, 418 women) were included. 277/600 (46.2%) of patients used an online search engine prior to the appointment. The median time patients spent assessing symptoms was 180, 7, and 8 min, respectively using online using search engines, Ada and Rheport. 111/275 (40.4%), 266/600 (44.3%) and 395/600 (65.8%) of patients rated the respective symptom assessment as very helpful or helpful, using online search engines, Ada and Rheport, respectively. Usability of both diagnostic decision support systems (DDSS) was "good" with a significantly higher mean SUS score (SD) of Rheport 77.1/100 (16.0) compared to Ada 74.4/100 (16.8), (p < 0.0001). In male patients, usability of Rheport was rated higher than Ada (p = 0.02) and the usability rating of older (52 years ≥) patients of both DDSS was lower than in younger participants (p = 0.005). Both effects were independent of each other. 440/600 (73.3%) and 475/600 (79.2%) of the patients would recommend Ada and Rheport to friends and other patients, respectively. Conclusion: In summary, patients increasingly assess their symptoms independently online, however only a minority used dedicated symptom assessment websites or DDSS. DDSS, such as Ada an Rheport are easy to use, well accepted among patients with musculoskeletal complaints and could replace online search engines for patient symptom assessment, potentially saving time and increasing helpfulness.

Prevalence of Depressive Symptoms in Patients With Psoriatic Arthritis: Have Numbers Changed During the COVID-19 Pandemic?

This longitudinal analysis compares the prevalence of depressive symptoms in patients with psoriatic arthritis in the context of the COVID-19 pandemic. Data from a national patient register in Germany were analyzed regarding the Patient Health Questionnaire 2 (PHQ-2) to identify cases suspicious for depression at two time points, i.e., before and during the COVID-19 pandemic. Only patients with complete concurrent information on the Disease Activity in Psoriatic Arthritis Score (DAPSA) were included in the analysis. The frequency of depressive symptoms in psoriatic arthritis patients during the COVID-19 pandemic did not differ from the prevalence rates measured before. In addition, prevalence rates for depressive symptoms did not differ when stratifying the patient sample for DAPSA levels of disease activity measured before the pandemic. These results were confirmed further in a sensitivity analysis, limiting the second PHQ-2 assessment to lockdown periods only. However, longitudinal data on the prevalence of depressive symptoms in patients with rheumatic diseases, in general, and psoriatic arthritis, in particular, are scarce in the context of the COVID-19 pandemic. For a sensible comparison of prevalence rates for depressive symptoms in the future, underlying SARS-CoV-2 infection rates and resulting local healthcare disruptions need to be taken into account, besides the potential use of different depression screening tools to evaluate resulting numbers sensibly and draw corresponding conclusions for patient care.

A Real-World Rheumatology Registry and Research Consortium: The German RheumaDatenRhePort (RHADAR) Registry.

Real-world data are crucial to continuously improve the management of patients with rheumatic and musculoskeletal diseases (RMDs). The German RheumaDatenRhePort (RHADAR) registry encompasses a network of rheumatologists and researchers in Germany providing pseudonymized real-world patient data and allowing timely and continuous improvement in the care of RMD patients. The RHADAR modules allow automated anamnesis and adaptive coordination of appointments regarding individual urgency levels. Further modules focus on the collection and integration of electronic patient-reported outcomes in between consultations. The digital RHADAR modules ultimately allow a patient-centered adaptive approach to integrated medical care starting as early as possible in the disease course. Such a closed-loop system consisting of various modules along the whole patient pathway enables comprehensive and timely patient management in an unprecedented manner.

Accuracy, patient-perceived usability, and acceptance of two symptom checkers (Ada and Rheport) in rheumatology: interim results from a randomized controlled crossover trial.

BACKGROUND: Timely diagnosis and treatment are essential in the effective management of inflammatory rheumatic diseases (IRDs). Symptom checkers (SCs) promise to accelerate diagnosis, reduce misdiagnoses, and guide patients more effectively through the health care system. Although SCs are increasingly used, there exists little supporting evidence. OBJECTIVE: To assess the diagnostic accuracy, patient-perceived usability, and acceptance of two SCs: (1) Ada and (2) Rheport. METHODS: Patients newly presenting to a German secondary rheumatology outpatient clinic were randomly assigned in a 1:1 ratio to complete Ada or Rheport and consecutively the respective other SCs in a prospective non-blinded controlled randomized crossover trial. The primary outcome was the accuracy of the SCs regarding the diagnosis of an IRD compared to the physicians' diagnosis as the gold standard. The secondary outcomes were patient-perceived usability, acceptance, and time to complete the SC. RESULTS: In this interim analysis, the first 164 patients who completed the study were analyzed. 32.9% (54/164) of the study subjects were diagnosed with an IRD. Rheport showed a sensitivity of 53.7% and a specificity of 51.8% for IRDs. Ada's top 1 (D1) and top 5 disease suggestions (D5) showed a sensitivity of 42.6% and 53.7% and a specificity of 63.6% and 54.5% concerning IRDs, respectively. The correct diagnosis of the IRD patients was within the Ada D1 and D5 suggestions in 16.7% (9/54) and 25.9% (14/54), respectively. The median System Usability Scale (SUS) score of Ada and Rheport was 75.0/100 and 77.5/100, respectively. The median completion time for both Ada and Rheport was 7.0 and 8.5 min, respectively. Sixty-four percent and 67.1% would recommend using Ada and Rheport to friends and other patients, respectively. CONCLUSIONS: While SCs are well accepted among patients, their diagnostic accuracy is limited to date. TRIAL REGISTRATION: DRKS.de, DRKS00017642 . Registered on 23 July 2019.