ABSTRACT
OBJECTIVE: The prototype "Oldenburger Logopädie App" (OLA) was designed to support voice therapy for patients with recurrent paresis, such as to accompany homework or as a short-term substitute for regular therapy due to dropouts, such as during the COVID-19 pandemic. The treating speech and language pathologists (SLPs) unlocks videos individually applicable to the respective patients, in which the SLPs instruct the individual exercises. The app can be used without information technology knowledge or detailed instructions. MATERIALS AND METHODS: The prototype's usability was evaluated through a usability test battery (AttrakDiff questionnaire, System Usability Scale, Visual Aesthetics of Websites Inventory questionnaire) and informal interviews from the perspective of patients and SLPs. RESULTS: The acceptance, usability, user experience, self-descriptiveness, and user behavior of OLA were consistently given and mostly rated as positive. Both user groups rated OLA as practical and easy to use (eg, System Usability Scale: "practical" (agree: ∅ 49.5%), "cumbersome to use" (total: strongly disagree: ∅ 60.0%). However, the monotonous layout of the app and the instructional and exercise videos should be modified in the next editing step. An overview of relevant criteria for a voice therapy app, regarding design and functions, was derived from the results. CONCLUSION: This user-oriented feedback on the usability of the voice app provides the proof of concept and the basis for the further development of the Artificial intelligence-based innovative follow-up app LAOLA. In the future, it should be possible to support the treatment of all voice disorders with such an app. For the further development of the voice app, the therapeutic content and the effectiveness of the training should also be investigated.
ABSTRACT
BACKGROUND: Decision support systems (DSSs) for suggesting optimal treatments for individual patients with low back pain (LBP) are currently insufficiently accurate for clinical application. Most of the input provided to train these systems is based on patient-reported outcome measures. However, with the appearance of electronic health records (EHRs), additional qualitative data on reasons for referrals and patients' goals become available for DSSs. Currently, no decision support tools cover a wide range of biopsychosocial factors, including referral letter information to help clinicians triage patients to the optimal LBP treatment. OBJECTIVE: The objective of this study was to investigate the added value of including qualitative data from EHRs and referral letters to the accuracy of a quantitative DSS for patients with LBP. METHODS: A retrospective study was conducted in a clinical cohort of Dutch patients with LBP. Patients filled out a baseline questionnaire about demographics, pain, disability, work status, quality of life, medication, psychosocial functioning, comorbidity, history, and duration of pain. Referral reasons and patient requests for help (patient goals) were extracted via natural language processing (NLP) and enriched in the data set. For decision support, these data were considered independent factors for triage to neurosurgery, anesthesiology, rehabilitation, or minimal intervention. Support vector machine, k-nearest neighbor, and multilayer perceptron models were trained for 2 conditions: with and without consideration of the referral letter content. The models' accuracies were evaluated via F1-scores, and confusion matrices were used to predict the treatment path (out of 4 paths) with and without additional referral parameters. RESULTS: Data from 1608 patients were evaluated. The evaluation indicated that 2 referral reasons from the referral letters (for anesthesiology and rehabilitation intervention) increased the F1-score accuracy by up to 19.5% for triaging. The confusion matrices confirmed the results. CONCLUSIONS: This study indicates that data enriching by adding NLP-based extraction of the content of referral letters increases the model accuracy of DSSs in suggesting optimal treatments for individual patients with LBP. Overall model accuracies were considered low and insufficient for clinical application.
