Response Rate Patterns in Adolescents With Concussion Using Mobile Health and Remote Patient Monitoring: Observational Study.

Background: A concussion is a common adolescent injury that can result in a constellation of symptoms, negatively affecting academic performance, neurobiological development, and quality of life. Mobile health (mHealth) technologies, such as apps for patients to report symptoms or wearables to measure physiological metrics like heart rate, have been shown to be promising in health maintenance. However, there is limited evidence about mHealth engagement in adolescents with a concussion during their recovery course. Objective: This study aims to determine the response rate and response rate patterns in concussed adolescents reporting their daily symptoms through mHealth technology. It will also examine the effect of time-, demographic-, and injury-related characteristics on response rate patterns. Methods: Participants aged between 11-18 years (median days since injury at enrollment: 11 days) were recruited from the concussion program of a tertiary care academic medical center and a suburban school's athletic teams. They were asked to report their daily symptoms using a mobile app. Participants were prompted to complete the Post-Concussion Symptom Inventory (PCSI) 3 times (ie, morning, afternoon, and evening) per day for 4 weeks following enrollment. The primary outcome was the response rate pattern over time (by day since initial app use and the day since injury). Time-, demographic-, and injury-related differences in reporting behaviors were compared using Mann Whitney U tests. Results: A total of 56 participants were enrolled (mean age 15.3, SD 1.9 years; n=32, 57% female). The median response rate across all days of app use in the evening was 37.0% (IQR 27.2%-46.4%), which was significantly higher than the morning (21.2%, IQR 15.6%-30.5%) or afternoon (26.4%, IQR 21.1%-31.5%; P<.001). The median daily response was significantly different by sex (female: 53.8%, IQR 46.2%-64.2% vs male: 42.0%, IQR 28.6%-51.1%; P=.003), days since injury to app use (participants starting to use the app >7 days since injury: 54.1%, IQR 47.4%-62.2% vs starting to use the app ≤7 days since injury: 38.0%, IQR 26.0%-53.3%; P=.002), and concussion history (participants with a history of at least one prior concussion: 57.4%, IQR 44.5%-70.5% vs participants without concussion history: 42.3%, IQR 36.8%-53.5%; P=.03). There were no significant differences by age. Differences by injury mechanism (sports- and recreation-related injury: 39.6%, IQR 36.1%-50.4% vs non-sports- or recreation-related injury: 30.6%, IQR 20.0%-42.9%; P=.04) and initial symptom burden (PCSI scores greater than the median score of 47: 40.9%, IQR 35.2%-53.8% vs PCSI scores less than or equal to the median score: 31.9%, IQR 24.6%-40.6%; P=.04) were evident in the evening response rates; however, daily rates were not statistically different. Conclusions: Evening may be the optimal time to prompt for daily concussion symptom assessment among concussed adolescents compared with morning or afternoon. Multiple demographic- and injury-related characteristics were associated with higher daily response rates, including for female participants, those with more than 1 week from injury to beginning mHealth monitoring, and those with a history of at least one previous concussion. Future studies may consider incentive strategies or adaptive digital concussion assessments to increase response rates in populations with low engagement.

A Randomized Trial of Incentivization to Maximize Retention for Real-Time Symptom and Activity Monitoring Using Ecological Momentary Assessment in Pediatric Concussion.

OBJECTIVE: The aims of this study were to determine the incentivization strategy that maximizes patient adherence to report symptoms and activity via ecological momentary assessment (EMA) after pediatric concussion, and assess the feasibility of tracking concussed youth using EMA from the emergency department (ED) setting. METHODS: This study was a randomized controlled trial of participants ages 13 to 18 years with concussion presenting to an urban, academic pediatric ED within 5 days of injury. Participants were randomized to 1 of 4 incentive arms: 2 dynamic (loss-based and streak) and 2 control flat-rate (monetary and electronic device). Participants reported symptoms 3 times per day and cognitive activity once each evening for 3 weeks. Physical activity (step count) and sleep were monitored using a Fitbit (kept by participants in the device flat-rate arm). The primary outcome was proportion of prompts to which participants responded. Secondary outcomes included differential response rates by demographics, and comparison of outcome determination between EMA and subsequent clinical visits. RESULTS: Thirty participants were enrolled, with a median age of 15.5 years and 60% female. Median cumulative proportion of prompts responded to was 68.3% (interquartile range, 47.6%-82.5%) in the dynamic arms versus 54.0% (interquartile range. 20.6%-68.3%) in the flat-rate arms, P = 0.065. There were nonsignificant differences in median response by sex (65.9% for female vs 40.0% for male, P = 0.072), race/ethnicity (61.9% for non-Hispanic White vs 43.7% for non-Hispanic Black participants, P = 0.097), and insurance (61.9% for private insurance vs 47.6% for public insurance, P = 0.305). Recovery at 3 weeks was discernible for all but 2 participants (93.3%) using EMA data, compared with only 9 participants (30.0%) ( P < 0.001) from clinical visits. CONCLUSIONS: Dynamic incentivization showed higher rates of response to tridaily symptom prompts compared with flat-rate incentivization. These data show tracking concussed youth using EMA from the ED is feasible using a dynamic incentivization strategy, with improved ability to discern outcomes compared with prospective monitoring using follow-up clinical visits.

Disparities in Adherence to Concussion Clinical Care Recommendations in a Pediatric Population.

OBJECTIVE: To characterize the relationship of sociodemographic factors to adherence to provider recommendations for pediatric concussion. SETTING: Primary care (PC) practices within the Children's Hospital of Philadelphia network. PARTICIPANTS: Patients aged 5 to 18 years old who presented to any PC site for concussion from September 26, 2019, to December 31, 2019. DESIGN: Retrospective medical record review. MAIN MEASURES: The primary outcome was adherence to follow-up recommendations as defined by (1) continued follow-up until provider clearance to return to full activity; (2) no more than 2 no-show visits; and (3) for those referred to specialty care (SC), attending at least 1 visit. We compared adherence by race/ethnicity, insurance, age, sex, injury mechanism, and repeat head injury using bivariate and multivariate analyses. A secondary outcome of referral to SC was compared by sociodemographic factors. RESULTS: A total of 755 patients were included. Overall, 80.5% of the patients met adherence criteria. Following adjustment, non-Hispanic Black patients and publicly insured/self-pay patients were less likely to adhere to recommendations than non-Hispanic White patients (adjusted odds ratio [AOR] = 0.60; 95% CI, 0.37-1.00) and privately insured patients (AOR = 0.48; 95% CI, 0.30-0.75), respectively. When assessing differences in referral to SC, non-Hispanic Black patients and publicly insured/self-pay patients were more likely to receive a referral than their non-Hispanic White peers (OR = 1.56; 95% CI, 1.00-2.45) and privately insured patients (OR = 1.56; 95% CI, 1.05-2.32), respectively. CONCLUSION: This study highlights disparities in adherence to concussion care recommendations, with non-Hispanic Black and publicly insured/self-pay patients less likely to adhere to follow-up recommendations than non-Hispanic White and privately insured patients, respectively. These disparities may impact recovery trajectories. Future studies should aim to identify specific individual- and system-level barriers preventing adherence to care in order to ultimately inform targeted interventions to achieve equity in care delivery and outcomes.

Maximizing the Accuracy of Adolescent Concussion Diagnosis Using Individual Elements of Common Standardized Clinical Assessment Tools.

CONTEXT: Multiple clinical evaluation tools exist for adolescent concussion with various degrees of correlation, presenting challenges for clinicians in identifying which elements of these tools provide the greatest diagnostic utility. OBJECTIVE: To determine the combination of elements from 4 commonly used clinical concussion batteries that maximize discrimination of adolescents with concussion from those without concussion. DESIGN: Cross-sectional study. SETTING: Suburban school and concussion program of a tertiary care academic center. PATIENTS OR OTHER PARTICIPANTS: A total of 231 participants with concussion (from a suburban school and a concussion program) and 166 participants without concussion (from a suburban school) between the ages of 13 and 19 years. MAIN OUTCOME MEASURE(S): Individual elements of the visio-vestibular examination (VVE), Sport Concussion Assessment Tool, fifth edition (SCAT5; including the modified Balance Error Scoring System), King-Devick test (K-D), and Postconcussion Symptom Inventory (PCSI) were evaluated. The 24 subcomponents of these tests were grouped into interpretable factors using sparse principal component analysis. The 13 resultant factors were combined with demographic and clinical covariates into a logistic regression model and ranked by frequency of inclusion into the ideal model, and the predictive performance of the ideal model was compared with each of the clinical batteries using the area under the receiver operating characteristic curve (AUC). RESULTS: A cluster of 4 factors (factor 1 [VVE saccades and vestibulo-ocular reflex], factor 2 [modified Balance Error Scoring System double-legged stance], factor 3 [SCAT5/PCSI symptom scores], and factor 4 [K-D completion time]) emerged. A model fit with the top factors performed as well as each battery in predicting concussion status (AUC = 0.816 [95% CI = 0.731, 0.889]) compared with the SCAT5 (AUC = 0.784 [95% CI = 0.692, 0.866]), PCSI (AUC = 0.776 [95% CI = 0.674, 0.863]), VVE (AUC = 0.711 [95% CI = 0.602, 0.814]), and K-D (AUC = 0.708 [95% CI = 0.590, 0.819]). CONCLUSIONS: A multifaceted assessment for adolescents with concussion, comprising symptoms, attention, balance, and the visio-vestibular system, is critical. Current diagnostic batteries likely measure overlapping domains, and the sparse principal component analysis demonstrated strategies for streamlining comprehensive concussion assessment across a variety of settings.

Assessment of Saccades and Gaze Stability in the Diagnosis of Pediatric Concussion.

OBJECTIVE: To evaluate the discriminatory ability of different repetition increments of saccades and gaze stability testing for diagnosing concussion in adolescents. DESIGN: Cross-sectional. SETTING: Suburban high school and academic pediatric tertiary care center. PARTICIPANTS: Sixty-nine adolescent athletes within 28 days of a sports- or recreation-related concussion and 69 adolescent athletes without recent concussion. ASSESSMENT OF INDEPENDENT VARIABLES: Symptom provocation with horizontal and vertical saccades and gaze stability testing performed up to 30 repetitions. MAIN OUTCOME MEASURES: Sensitivity and specificity at 10-repetition increments (≤10, ≤20, ≤30) and area under the receiver operating characteristic curves (AUC) of a visio-vestibular examination (VVE) subscore, scored 0 to 4 based on the number of assessments with symptom provocation, at each repetition increment. RESULTS: Sensitivity improved when increasing from ≤10 to ≤20 to ≤30 repetitions for horizontal (25% to 50% to 69%) and vertical (32% to 52% to 74%) saccades and horizontal (19% to 45% to 71%) and vertical (23% to 45% to 72%) gaze stability. Specificity was comparable at ≤10 and ≤20 repetitions, but decreased at ≤30 repetitions across assessments. For a VVE subscore (0-4) based on the number of symptomatic assessments, the discriminatory ability of the test was highest at ≤20 repetitions (AUC of 0.79) with an optimal subscore of one (sensitivity 59%, specificity 96%). CONCLUSIONS: A VVE including a higher threshold level of repetitions for saccades and gaze stability has improved discriminatory ability for concussion, with an optimized AUC of 0.79 at ≤20 repetitions. CLINICAL RELEVANCE: The findings in this study suggest that a higher threshold level of repetitions of 2 commonly used visio-vestibular assessments enables clinicians to more accurately diagnose youth concussion.

The Economic Burden of Pediatric Postconcussive Syndrome.

OBJECTIVE: To estimate the direct costs of pediatric postconcussive syndrome (PCS). DESIGN: Retrospective cohort study. SETTING: Subspecialty sports medicine clinics of a large pediatric tertiary care network in the United States. PATIENTS: One hundred fifty-four patients aged 5 to 18 years with PCS, evaluated between 2010 and 2011. ASSESSMENT OF INDEPENDENT VARIABLES: Direct costs included visits to sports medicine clinic, visio-vestibular therapy, homebound education, subspecialist referral, and prescription-only medications (amantadine and amitriptyline), all measured beginning at 28 days after injury. MAIN OUTCOME MEASURES: Postconcussive syndrome was defined as persistence beyond 28 days from injury. RESULTS: The cost incurred by each PCS patient for sports medicine visits was $1575, for visio-vestibular therapy was $985, for homebound tutoring was $55, for prescription medications was $22, and for subspecialist referral was $120, totaling $3557 per patient, with a 95% confidence interval range of $2886 to $4257. CONCLUSIONS: Given the high economic costs of PCS determined in this study, therapies that mitigate this syndrome may have the potential to be cost-effective and even cost saving.