Evaluating AI Models: Performance Validation Using Formal Multiple-Choice Questions in Neuropsychology.

High-quality and accessible education is crucial for advancing neuropsychology. A recent study identified key barriers to board certification in clinical neuropsychology, such as time constraints and insufficient specialized knowledge. To address these challenges, this study explored the capabilities of advanced Artificial Intelligence (AI) language models, GPT-3.5 (free-version) and GPT-4.0 (under-subscription version), by evaluating their performance on 300 American Board of Professional Psychology in Clinical Neuropsychology-like questions. The results indicate that GPT-4.0 achieved a higher accuracy rate of 80.0% compared to GPT-3.5's 65.7%. In the "Assessment" category, GPT-4.0 demonstrated a notable improvement with an accuracy rate of 73.4% compared to GPT-3.5's 58.6% (p = 0.012). The "Assessment" category, which comprised 128 questions and exhibited the highest error rate by both AI models, was analyzed. A thematic analysis of the 26 incorrectly answered questions revealed 8 main themes and 17 specific codes, highlighting significant gaps in areas such as "Neurodegenerative Diseases" and "Neuropsychological Testing and Interpretation."

Enriched music-supported therapy for individuals with chronic stroke: a randomized controlled trial.

OBJECTIVE: Many stroke survivors still present with upper-limb paresis six months post-stroke, impacting their autonomy and quality of life (QoL). We designed an enriched Music-supported Therapy (eMST) program to reduce disability in this population. We evaluated the eMST's effectiveness in improving functional abilities and QoL in chronic stroke individuals compared to the conventional motor program Graded Repetitive Arm Supplementary Program (GRASP). METHODS: We conducted a pragmatic two-arm parallel-group randomized controlled trial with a 3-month follow-up and masked assessment. The eMST involved playing instruments during individual self-administered and group music therapy sessions. The GRASP consisted of self-administered motor exercises using daily objects. Both interventions were completed at home with telemonitoring and involved four one-hour weekly sessions for 10 weeks. The primary outcome was upper-limb motor function measured with the Action Research Arm Test. Secondary outcomes included motor impairment, daily life motor performance, cognitive functions, emotional well-being, QoL, self-regulation, and self-efficacy. Intention-to-treat (ITT) and per-protocol (PP) analyses were conducted including participants who discontinued the intervention and those who completed it entirely, respectively. RESULTS: Fifty-eight chronic stroke patients were randomized to the eMST-group (n = 26; age: 64.2 ± 12.5; 6 [23.1%] females; 2.8 ± 2.9 years post-stroke), and the control group (n = 32; age: 62.2 ± 12; 8 [25%] females; 1.8 ± 6.2 years post-stroke). The eMST-group had more participants achieving a clinically relevant improvement in motor impairment post-intervention than the control group for the ITT (55% vs 21.6%; OR = 4.5 (95% CI 1.4-14); p = .019) and PP analyses (60% vs 20%; OR = 6 (95% CI 1.5-24.7); p = .024), sustained at follow-up. The eMST-group reported greater improvements in emotion (difference = 11.1 (95% CI 0.8-21.5; p = 0.36) and participation (difference = 10.3 (95% CI 0.6-25.9); p = 0.41) subscales of QoL, and higher enjoyment during the sessions (difference = 1 (95% CI 0.3-1.5); p = 0.12). No changes were found in other outcomes. CONCLUSION: eMST demonstrated superiority over conventional motor rehabilitation program in enhancing upper-limb functions and QoL in chronic stroke individuals. TRIAL REGISTRATION: ClinicalTrials.gov (ID: NCT04507542).

Designing an app for home-based enriched Music-supported Therapy in the rehabilitation of patients with chronic stroke: a pilot feasibility study.

OBJECTIVE: After completing formal stroke rehabilitation programs, most patients do not achieve full upper limb motor function recovery. Music-supported Therapy (MST) can improve motor functionality post stroke through musical training. We designed a home-based enriched Music-supported Therapy (eMST) program to provide patients with chronic stroke the opportunity of continuing rehabilitation by themselves. We developed an app to conduct the eMST sessions at home with a MIDI-piano and percussion instruments. Here, we tested the feasibility of the eMST intervention using the novel app. METHOD: This is a pilot study where five patients with chronic stroke underwent a 10-week intervention of 3 sessions per week. Patients answered feasibility questionnaires throughout the intervention to modify aspects of the rehabilitation program and the app according to their feedback. Upper limb motor functions were evaluated pre- and post-intervention as well as speed and force tapping during daily piano performance. RESULTS: Patients clinically improved in upper limb motor function achieving the Minimal Detectable Change (MDC) or Minimal Clinically Important Difference (MCID) in most of motor tests. The app received high usability ratings post-intervention. CONCLUSION: The eMST program is a feasible intervention for patients with chronic stroke and its efficacy should be assessed in a clinical trial.

Enriched Music-supported Therapy for chronic stroke patients: a study protocol of a randomised controlled trial.

BACKGROUND: Residual motor deficits of the upper limb in patients with chronic stroke are common and have a negative impact on autonomy, participation and quality of life. Music-Supported Therapy (MST) is an effective intervention to enhance motor and cognitive function, emotional well-being and quality of life in chronic stroke patients. We have adapted the original MST training protocol to a home-based intervention, which incorporates increased training intensity and variability, group sessions, and optimisation of learning to promote autonomy and motivation. METHODS: A randomised controlled trial will be conducted to test the effectiveness of this enriched MST (eMST) protocol in improving motor functions, cognition, emotional well-being and quality of life of chronic stroke patients when compared to a program of home-based exercises utilizing the Graded Repetitive Arm Supplementary Program (GRASP). Sixty stroke patients will be recruited and randomly allocated to an eMST group (n = 30) or a control GRASP intervention group (n = 30). Patients will be evaluated before and after a 10-week intervention, as well as at 3-month follow-up. The primary outcome of the study is the functionality of the paretic upper limb measured with the Action Research Arm Test. Secondary outcomes include other motor and cognitive functions, emotional well-being and quality of life measures as well as self-regulation and self-efficacy outcomes. DISCUSSION: We hypothesize that patients treated with eMST will show larger improvements in their motor and cognitive functions, emotional well-being and quality of life than patients treated with a home-based GRASP intervention. TRIAL REGISTRATION: The trial has been registered at ClinicalTrials.gov and identified as NCT04507542 on 8 August 2020.

Subacute stroke physical rehabilitation evidence in activities of daily living outcomes: A systematic review of meta-analyses of randomized controlled trials.

BACKGROUND: Stroke is a leading cause of disabilities worldwide. One of the key disciplines in stroke rehabilitation is physical therapy which is primarily aimed at restoring and maintaining activities of daily living (ADL). Several meta-analyses have found different interventions improving functional capacity and reducing disability. OBJECTIVES: To systematically evaluate existing evidence, from published systematic reviews of meta-analyses, of subacute physical rehabilitation interventions in (ADLs) for stroke patients. METHODS: Umbrella review on meta-analyses of RCTs ADLs in MEDLINE, Web of Science, Scopus, Cochrane, and Google Scholar up to April 2018. Two reviewers independently applied inclusion criteria to select potential systematic reviews of meta-analyses of randomized controlled trials (RCTs) of physical rehabilitation interventions (during subacute phase) reporting results in ADLs. Two reviewers independently extracted name of the 1st author, year of publication, physical intervention, outcome(s), total number of participants, and number of studies from each eligible meta-analysis. The number of subjects (intervention and control), ADL outcome, and effect sizes were extracted from each study. RESULTS: Fifty-five meta-analyses on 21 subacute rehabilitation interventions presented in 30 different publications involving a total of 314 RCTs for 13,787 subjects were identified. Standardized mean differences (SMDs), 95% confidence intervals (fixed and random effects models), 95% prediction intervals, and statistical heterogeneity (I and Q test) were calculated. Virtual reality, constraint-induced movement, augmented exercises therapy, and transcranial direct current stimulation interventions resulted statistically significant (P < .05) with moderate improvements (0.5 ≤ SMD ≤ 0.8) and no heterogeneity (I = 0%). Moxibustion, Tai Chi, and acupuncture presented best improvements (SMD > 0.8) but with considerable heterogeneity (I2 > 75%). Only acupuncture reached "suggestive" level of evidence. CONCLUSION: Despite the range of interventions available for stroke rehabilitation in subacute phase, there is lack of high-quality evidence in meta-analyses, highlighting the need of further research reporting ADL outcomes.