Gamified assessment of cognitive performance during moderate hypoxia.

INTRODUCTION: There is a need for rapid and objective assessment tools to identify people at risk of impaired cognitive function during hypoxia. PURPOSE: To test the hypotheses that performance on gamified cognitive tests examining the cognitive domains of executive function (Gridshot), working memory (Capacity) and spatial tracking (Multitracker) will be reduced during normobaric exposure to moderate normobaric hypoxia. METHODS: Following three consecutive days of practice, twenty-one healthy adults (27 ± 5 y, 9 females) completed five 1-min rounds of the tablet-based games Gridshot, Capacity, and Multitracker (Statespace Labs, Inc.) at Baseline and 60 and 90 min after exposure to 14.0 ± 0.2% (hypoxia) and 20.6 ± 0.3% (normoxia) oxygen. Both conditions were completed on the same day and were administered in a single-blind, block randomized manner. Arterial oxyhemoglobin saturation was estimated via forehead pulse oximetry (SpO2). Data were analyzed using ANCOVA with a covariate of Baseline. RESULTS: Compared to normoxia (98 ± 1%), SpO2 was lower (p < 0.001) at 60 (91 ± 3%) and 90 (91 ± 2%) min of hypoxia. No condition x time interaction effects were identified for any gamified cognitive tests (p ≥ 0.32). A main effect of condition was identified for Capacity (p = 0.05) and Multitracker (p = 0.04), but not Gridshot (p = 0.33). Post hoc analyses of the composite scores for both Capacity (p = 0.11) and Multitracker (p = 0.73) demonstrated no difference between conditions. CONCLUSION: Performance on gamified cognitive tests was not consistently affected by acute normobaric moderate hypoxic exposure.

Utility of VOMS, SCAT3, and ImPACT Baseline Evaluations for Acute Concussion Identification in Collegiate Athletes: Findings From the NCAA-DoD Concussion Assessment, Research and Education (CARE) Consortium.

BACKGROUND: The Vestibular/Ocular-Motor Screening (VOMS) is a valuable component of acute (<72 hours) sports-related concussion (SRC) assessments and is increasingly used with the Immediate Post-concussion Assessment and Cognitive Testing (ImPACT) instrument and the third edition of the Sport Concussion Assessment Tool (SCAT3). Research has suggested that VOMS acute postinjury scores are useful in identifying acute concussion. However, the utility of preseason baseline measurements to improve diagnostic accuracy remains ambiguous. To this end, there is a need to determine how reliable VOMS baseline assessments are across years and whether incorporating individuals' baseline performance improves diagnostic yield for acute concussions. PURPOSE: To analyze VOMS, SCAT3, and ImPACT to evaluate the test-retest reliability of consecutive-year preseason baseline assessments to directly compare the diagnostic utility of these tools when incorporating baseline assessments versus using postinjury data alone to identify acute SRC. STUDY DESIGN: Cohort study (diagnosis); Level of evidence, 2. METHODS: Preseason and postinjury VOMS, SCAT3, ImPACT Post-Concussion Symptom Scale (PCSS), and ImPACT composite scores were analyzed for 3958 preseason (47.7% female) and 496 acute (≤48 hours) SRC (37.5% female) collegiate athlete evaluations in the National Collegiate Athletic Association-Department of Defense Concussion Assessment Research and Education Consortium. Descriptive statistics, Kolmogorov-Smirnov significance, and Cohen d effect size were calculated. Consecutive-year baseline reliability was evaluated for a subset of 447 athlete encounters using Pearson r, Cohen κ, Cohen d, and 2-way mixed intraclass correlation coefficients (ICCs). Wilcoxon signed rank tests were used to determine the statistical significance between population performances, and the 90% reliable change index (RCI) was calculated from the test-retest results. Preseason to postinjury change scores were then calculated from each tool's RCI. Finally, receiver operating characteristic (ROC) curve analyses were conducted, and DeLong method was used to compare the area under the curve (AUC) of raw postinjury scores versus change scores from preseason baseline assessments. Potential effects of sex, medical history (learning disorders or attention-deficit/hyperactivity disorder), and outlier data were also explored. RESULTS: Effect sizes were large, and overall predictive utilities were clinically useful for postinjury VOMS Total (d = 2.44; AUC = 0.85), the SCAT3 Symptom Evaluation total severity score (d = 1.74; AUC = 0.82), and the ImPACT PCSS total severity score (d = 1.67; AUC = 0.80). Comparatively, effect sizes were small and predictive utilities were poor for Standardized Assessment of Concussion (SAC), modified Balance Error Scoring System (mBESS), and all ImPACT composites (d = 0.11-0.46; AUC = 0.48-0.59). Preseason baseline test-retest reliability was poor to moderate (r = 0.23-0.52; κ = 0.32-0.36; ICC = 0.36-0.68) for all assessments except ImPACT Visual Motion Sensitivity (r = 0.73; ICC = 0.85). Incorporating baseline scores for VOMS Total, SCAT3 (Symptom Evaluation, SAC, mBESS), ImPACT PCSS, or ImPACT composites did not significantly improve AUCs. CONCLUSION: VOMS Total and symptom severity (SCAT3, PCSS) total scores had large effect sizes and clinically useful AUCs for identifying acute concussion. However, all tools demonstrated high within-patient test-retest variability, resulting in poor reliability. The findings in this sample of collegiate athletes suggest that incorporating baseline assessments does not significantly increase diagnostic yield for acute concussion.

Predictive Accuracy of the Sport Concussion Assessment Tool 3 and Vestibular/Ocular-Motor Screening, Individually and In Combination: A National Collegiate Athletic Association-Department of Defense Concussion Assessment, Research and Education Consortium Analysis.

BACKGROUND: Vestibular and ocular symptoms in sport-related concussions are common. The Vestibular/Ocular-Motor Screening (VOMS) tool is a rapid, free, pen-and-paper tool that directly assesses these symptoms and shows consistent utility in concussion identification, prognosis, and management. However, a VOMS validation study in the acute concussion period of a large sample is lacking. PURPOSE: To examine VOMS validity among collegiate student-athletes, concussed and nonconcussed, from the multisite National Collegiate Athletic Association-Department of Defense Concussion Assessment, Research and Education (CARE) Consortium. A secondary aim was to utilize multidimensional machine learning pattern classifiers to deduce the additive power of the VOMS in relation to components of the Sport Concussion Assessment Tool 3 (SCAT3). STUDY DESIGN: Cohort study (diagnosis); Level of evidence, 3. METHODS: Preseason and acute concussion assessments were analyzed for 419 student-athletes. Variables in the analysis included the VOMS, Balance Error Scoring System, Standardized Assessment of Concussion, and SCAT3 symptom evaluation score. Descriptive statistics were calculated for all tools, including Kolmogorov-Smirnov significance and Cohen d effect size. Correlations between tools were analyzed with Spearman r, and predictive accuracy was evaluated through an Ada Boosted Tree machine learning model's generated receiver operating characteristic curves. RESULTS: Total VOMS scores and SCAT3 symptom scores demonstrated significant increases in the acute concussion time frame (Cohen d = 1.23 and 1.06; P < .0001), whereas the Balance Error Scoring System lacked clinical significance (Cohen d = 0.17). Incorporation of VOMS into the full SCAT3 significantly boosted overall diagnostic ability by 4.4% to an area under the curve of 0.848 (P < .0001) and produced a 9% improvement in test sensitivity over the existing SCAT3 battery. CONCLUSION: The results from this study highlight the relevance of the vestibular and oculomotor systems to concussion and the utility of the VOMS tool. Given the 3.8 million sports-related and 45,121 military-related concussions per year, the addition of VOMS to the SCAT3 is poised to identify up to an additional 304,000 athletes and 3610 servicemembers annually who are concussed, thereby improving concussion assessment and diagnostic rates. Health care providers should consider the addition of VOMS to their concussion assessment toolkits, as its use can positively affect assessment and management of concussions, which may ultimately improve outcomes for this complex and common injury.