Digital Attention-Related Augmented-Reality Game: Significant Correlation between Student Game Performance and Validated Clinical Measures of Attention-Deficit/Hyperactivity Disorder (ADHD).

As many as half of school children with autism spectrum disorder (ASD) exhibit symptoms of attention-deficit/hyperactivity disorder (ADHD), resulting in marked negative academic, social, and behavioral outcomes. The focus of the US Food and Drug Administration (FDA) on real-world data from novel digital sources, and the emergence of Current Procedural Terminology (CPT) codes to reimburse for digital monitoring and neurobehavioral testing suggest an increasing acceptance of the role of technology in augmenting clinical care and research. Empowered Brain is an augmented reality and artificial intelligence-based social-emotional communication aid for students with ASD. In this study, student performance on Empowered Brain is correlated to validated clinical measures of ADHD. Seven high school students with a diagnosis of ASD were recruited from a public high school. All students were assessed for severity of ADHD-related symptoms via three clinical gold-standard assessments, namely the Aberrant Behavioral Checklist (ABC), Social Responsiveness Scale 2 (SRS-2), and Teacher Report Form (TRF). Students used Empowered Brain over a one-week period. We measured the correlation of student in-game performance (as measured by point- and star-based rewards) relative to the hyperactivity subscale of the ABC (ABC-H), and the ADHD-subscale of the TRF. All seven students completed the study and managed to successfully use Empowered Brain. Students received a culminative total of 32 sessions, an average of 4.6 sessions per student (range 2-8). Student in-game performance demonstrated highly significant correlation relative to ABC-H (points: p = 0.0013; stars: p = 0.0013)., and significant correlation to TRF ADHD scores (points: p = 0.012; stars: p = 0.012). No adverse effects were noted among students who used Empowered Brain. New technologies may herald novel ways of identifying and characterizing symptoms of ADHD in student populations. This study provides evidence that Empowered Brain in-game performance correlates with ADHD symptom severity in students with ASD. Larger samples are required to validate these findings, with more diverse participants that can also widen the generalizability of these findings to a broader range of brain conditions that manifest with inattention, impulsivity, and hyperactivity. Through further research, we may find that such technologies can help us to identify and longitudinally monitor such symptoms, and potentially aid in severity stratification and digital phenotyping.

Improved Socio-Emotional and Behavioral Functioning in Students with Autism Following School-Based Smartglasses Intervention: Multi-Stage Feasibility and Controlled Efficacy Study.

Background: Students with Autism Spectrum Disorder (ASD) commonly demonstrate prominent social communication deficits, symptoms of attention-deficit/hyperactivity disorder, and chronic irritability. These challenges hinder academic progress and frequently persist despite educational, behavioral, and medical interventions. An assistive smartglasses technology may aid these individuals, especially if the technology is efficacious in ecologically-valid school settings. This study explored the feasibility and efficacy of Empowered Brain, a computerized smartglasses intervention designed as a socio-emotional behavioral aid for students with ASD. Methods: This two-part six-week study involved four school children with ASD from a public elementary school. The study incorporated an initial three-week feasibility stage followed by a three-week controlled longitudinal efficacy stage. Both stages involved the use of a twice-daily socio-emotional intervention with the smartglasses. Educators completed pre-intervention and post-intervention Aberrant Behavioral Checklist (ABC) ratings at the start of the feasibility stage, and weekly during the efficacy stage. Primary outcome measures were improvements in the ABC subscales of irritability, hyperactivity, and social withdrawal. Results: Students in both feasibility and efficacy stages demonstrated improvements (decreases) in irritability, hyperactivity, and social withdrawal compared to a baseline period and control periods, respectively. Participants in the controlled efficacy stage demonstrated decreased ABC subscale scores of 90% for irritability, 41.6% for hyperactivity, and 45.6% for social withdrawal. An intervention exposure-response improvement in irritability and hyperactivity was found during the efficacy stage. Educators rated the technology as superior or vastly superior compared to other assistive technologies. Conclusion: A substantial number of school children with ASD demonstrate chronic and impairing cognitive and behavioral challenges. This study provides evidence that Empowered Brain, a smartglasses-based socio-emotional aid for autism, is both feasible and efficacious in improving symptoms of social withdrawal, irritability, and hyperactivity in students with autism. The improvement is demonstrated as part of a longitudinal school-based intervention. Further studies involving larger samples and incorporation of randomized controlled trial methodology are underway to further elucidate the impact of this technology.

Safety and Lack of Negative Effects of Wearable Augmented-Reality Social Communication Aid for Children and Adults with Autism.

There is a growing interest in the use of augmented reality (AR) to assist children and adults with autism spectrum disorders (ASD); however, little investigation has been conducted into the safety of AR devices, such as smartglasses. The objective of this report was to assess the safety and potential negative effects of the Empowered Brain system, a novel AR smartglasses-based social communication aid for people with ASD. The version of the Empowered Brain in this report utilized Google Glass (Google, Mountain View, CA, USA) as its hardware platform. A sequential series of 18 children and adults, aged 4.4 to 21.5 years (mean 12.2 years), with clinically diagnosed ASD of varying severity used the system. Users and caregivers were interviewed about the perceived negative effects and design concerns. Most users were able to wear and use the Empowered Brain (n = 16/18, 89%), with most of them reporting no negative effects (n = 14/16, 87.5%). Caregivers observed no negative effects in users (n = 16/16, 100%). Most users (77.8%) and caregivers (88.9%) had no design concerns. This report found no major negative effects in using an AR smartglasses-based social communication aid across a wide age and severity range of people with ASD. Further research is needed to explore longer-term effects of using AR smartglasses in this population.

Improvement of Attention-Deficit/Hyperactivity Disorder Symptoms in School-Aged Children, Adolescents, and Young Adults With Autism via a Digital Smartglasses-Based Socioemotional Coaching Aid: Short-Term, Uncontrolled Pilot Study.

BACKGROUND: People with autism spectrum disorder (ASD) commonly experience symptoms related to attention-deficit/hyperactivity disorder (ADHD), including hyperactivity, inattention, and impulsivity. One-third of ASD cases may be complicated by the presence of ADHD. Individuals with dual diagnoses face greater barriers to accessing treatment for ADHD and respond less positively to primary pharmacologic interventions. Nonpharmacologic technology-aided tools for hyperactivity and inattention in people with ASD are being developed, although research into their efficacy and safety remains limited. OBJECTIVE: The objective of this preliminary study was to describe the changes in ADHD-related symptoms in children, adolescents, and young adults with ASD immediately after use of the Empowered Brain system, a behavioral and social communication aid for ASD running on augmented reality smartglasses. METHODS: We recruited 8 children, adolescents, and young adults with ASD (male to female ratio of 7:1, mean age 15 years, range 11.7-20.5 years) through a Web-based research signup form. The baseline score on the hyperactivity subscale of the Aberrant Behavioral Checklist (ABC-H), a measure of hyperactivity, inattention, and impulsivity, determined their classification into a high ADHD-related symptom group (n=4, ABC-H≥13) and a low ADHD-related symptom group (n=4, ABC-H<13). All participants received an intervention with Empowered Brain, where they used smartglasses-based social communication and behavioral modules while interacting with their caregiver. We then calculated caregiver-reported ABC-H scores at 24 and 48 hours after the session. RESULTS: All 8 participants were able to complete the intervention session. Postintervention ABC-H scores were lower for most participants at 24 hours (n=6, 75%) and for all participants at 48 hours (n=8, 100%). At 24 hours after the session, average participant ABC-H scores decreased by 54.9% in the high ADHD symptom group and by 20% in the low ADHD symptom group. At 48 hours after the session, ABC-H scores compared with baseline decreased by 56.4% in the high ADHD symptom group and by 66.3% in the low ADHD symptom group. CONCLUSIONS: This study provides initial evidence for the possible potential of the Empowered Brain system to reduce ADHD-related symptoms, such as hyperactivity, inattention, and impulsivity, in school-aged children, adolescents, and young adults with ASD. This digital smartglasses intervention can potentially be targeted at a broader array of mental health conditions that exhibit transdiagnostic attentional and social communication deficits, including schizophrenia and bipolar disorder. Further research is required to understand the clinical importance of these observed changes and to conduct longitudinal studies on this intervention with control groups and larger sample sizes.

Concussion Assessment With Smartglasses: Validation Study of Balance Measurement Toward a Lightweight, Multimodal, Field-Ready Platform.

BACKGROUND: Lightweight and portable devices that objectively measure concussion-related impairments could improve injury detection and critical decision-making in contact sports and the military, where brain injuries commonly occur but remain underreported. Current standard assessments often rely heavily on subjective methods such as symptom self-reporting. Head-mounted wearables, such as smartglasses, provide an emerging platform for consideration that could deliver the range of assessments necessary to develop a rapid and objective screen for brain injury. Standing balance assessment, one parameter that may inform a concussion diagnosis, could theoretically be performed quantitatively using current off-the-shelf smartglasses with an internal accelerometer. However, the validity of balance measurement using smartglasses has not been investigated. OBJECTIVE: This study aimed to perform preliminary validation of a smartglasses-based balance accelerometer measure (BAM) compared with the well-described and characterized waist-based BAM. METHODS: Forty-two healthy individuals (26 male, 16 female; mean age 23.8 [SD 5.2] years) participated in the study. Following the BAM protocol, each subject performed 2 trials of 6 balance stances while accelerometer and gyroscope data were recorded from smartglasses (Glass Explorer Edition). Test-retest reliability and correlation were determined relative to waist-based BAM as used in the National Institutes of Health's Standing Balance Toolbox. RESULTS: Balance measurements obtained using a head-mounted wearable were highly correlated with those obtained through a waist-mounted accelerometer (Spearman rho, ρ=.85). Test-retest reliability was high (intraclass correlation coefficient, ICC2,1=0.85, 95% CI 0.81-0.88) and in good agreement with waist balance measurements (ICC2,1=0.84, 95% CI 0.80-0.88). Considering the normalized path length magnitude across all 3 axes improved interdevice correlation (ρ=.90) while maintaining test-retest reliability (ICC2,1=0.87, 95% CI 0.83-0.90). All subjects successfully completed the study, demonstrating the feasibility of using a head-mounted wearable to assess balance in a healthy population. CONCLUSIONS: Balance measurements derived from the smartglasses-based accelerometer were consistent with those obtained using a waist-mounted accelerometer. Additional research is necessary to determine to what extent smartglasses-based accelerometry measures can detect balance dysfunction associated with concussion. However, given the potential for smartglasses to perform additional concussion-related assessments in an integrated, wearable platform, continued development and validation of a smartglasses-based balance assessment is warranted. This approach could lead to a wearable platform for real-time assessment of concussion-related impairments that could be further augmented with telemedicine capabilities to integrate professional clinical guidance. Smartglasses may be superior to fully immersive virtual reality headsets for this application, given their lighter weight and reduced likelihood of potential safety concerns.

Second Version of Google Glass as a Wearable Socio-Affective Aid: Positive School Desirability, High Usability, and Theoretical Framework in a Sample of Children with Autism.

BACKGROUND: Computerized smartglasses are being developed as an assistive technology for daily activities in children and adults with autism spectrum disorder (ASD). While smartglasses may be able to help with educational and behavioral needs, their usability and acceptability in children with ASD is largely unknown. There have been reports of negative social perceptions surrounding smartglasses use in mainstream populations, a concern given that assistive technologies may already carry their own stigma. Children with ASD may also have a range of additional behavioral, developmental, and social challenges when asked to use this emerging technology in school and home settings. OBJECTIVE: The usability and acceptability of Glass Enterprise Edition (Glass), the successor to Google Glass smartglasses, were explored in children with ASD and their caregivers. METHODS: Eight children with ASD and their caregivers were recruited to attend a demonstration session with Glass smartglasses the week they were publicly released. The children had a wide range of ability, including limited speech to speaking, and represented a full range of school ages (6 to 17 years). Children and caregivers were interviewed about their experience of using the smartglasses and whether they would use them at school and home. RESULTS: All 8 children succeeded in using Glass and did not feel stressed (8/8, 100%) or experience any overwhelming sensory or emotional issues during the session (8/8, 100%). All 8 children (8/8, 100%) endorsed that they would be willing to wear and use the device in both home and school settings. Caregivers felt the experience was fun for the children (8/8, 100%), and most caregivers felt the experience was better than they had expected (6/8, 75%). CONCLUSIONS: A wide age and ability range of children with ASD used Glass immediately after it was released and found it to be usable and acceptable. Despite concerns about potential stigma or social acceptability, all of the children were prepared to use the technology in both home and school settings. Encouragingly, most caregivers noted a very positive response. There were no behavioral, developmental, or social- or stigma-related concerns during or after the session. Smartglasses may be a useful future technology for children with ASD and are readily accepted for use by children with ASD and their caregivers.

Social Communication Coaching Smartglasses: Well Tolerated in a Diverse Sample of Children and Adults With Autism.

BACKGROUND: Augmented reality (AR) smartglasses are an emerging technology that is under investigation as a social communication aid for children and adults with autism spectrum disorder (ASD) and as a research tool to aid with digital phenotyping. Tolerability of this wearable technology in people with ASD is an important area for research, especially as these individuals may experience sensory, cognitive, and attentional challenges. OBJECTIVE: The aim of this study was to assess the tolerability and usability of a novel smartglasses system that has been designed as a social communication aid for children and adults with autism (the Brain Power Autism System [BPAS]). BPAS runs on Google Glass Explorer Edition and other smartglasses, uses both AR and affective artificial intelligence, and helps users learn key social and emotional skills. METHODS: A total of 21 children and adults with ASD across a spectrum of severity used BPAS for a coaching session. The user's tolerability to the smartglasses, user being able to wear the smartglasses for 1 minute (initial tolerability threshold), and user being able to wear the smartglasses for the entire duration of the coaching session (whole session tolerability threshold) were determined through caregiver report. RESULTS: Of 21 users, 19 (91%) demonstrated tolerability on all 3 measures. Caregivers reported 21 out of 21 users (100%) as tolerating the experience, while study staff found only 19 out of 21 users managed to demonstrate initial tolerability (91%). Of the 19 users who demonstrated initial tolerability, all 19 (100%) were able to use the smartglasses for the entire session (whole session tolerability threshold). Caregivers reported that 19 out of 21 users (91%) successfully used BPAS, and users surpassed caregiver expectations in 15 of 21 cases (71%). Users who could communicate reported BPAS as being comfortable (94%). CONCLUSIONS: This preliminary report suggests that BPAS is well tolerated and usable to a diverse age- and severity-range of people with ASD. This is encouraging as these devices are being developed as assistive technologies for people with ASD. Further research should focus on improving smartglasses design and exploring their efficacy in helping with social communication in children and adults with ASD.

Feasibility of an Autism-Focused Augmented Reality Smartglasses System for Social Communication and Behavioral Coaching.

BACKGROUND: Autism spectrum disorder (ASD) is a childhood-onset neurodevelopmental disorder with a rapidly rising prevalence, currently affecting 1 in 68 children, and over 3.5 million people in the United States. Current ASD interventions are primarily based on in-person behavioral therapies that are both costly and difficult to access. These interventions aim to address some of the fundamental deficits that clinically characterize ASD, including deficits in social communication, and the presence of stereotypies, and other autism-related behaviors. Current diagnostic and therapeutic approaches seldom rely on quantitative data measures of symptomatology, severity, or condition trajectory. METHODS: Given the current situation, we report on the Brain Power System (BPS), a digital behavioral aid with quantitative data gathering and reporting features. The BPS includes customized smartglasses, providing targeted personalized coaching experiences through a family of gamified augmented-reality applications utilizing artificial intelligence. These applications provide children and adults with coaching for emotion recognition, face directed gaze, eye contact, and behavioral self-regulation. This preliminary case report, part of a larger set of upcoming research reports, explores the feasibility of the BPS to provide coaching in two boys with clinically diagnosed ASD, aged 8 and 9 years. RESULTS: The coaching intervention was found to be well tolerated and rated as being both engaging and fun. Both males could easily use the system, and no technical problems were noted. During the intervention, caregivers reported improved non-verbal communication, eye contact, and social engagement during the intervention. Both boys demonstrated decreased symptoms of ASD, as measured by the aberrant behavior checklist at 24-h post-intervention. Specifically, both cases demonstrated improvements in irritability, lethargy, stereotypy, hyperactivity/non-compliance, and inappropriate speech. CONCLUSION: Smartglasses using augmented reality may have an important future role in helping address the therapeutic needs of children with ASD. Quantitative data gathering from such sensor-rich systems may allow for digital phenotyping and the refinement of social communication constructs of the research domain criteria. This report provides evidence for the feasibility, usability, and tolerability of one such specialized smartglasses system.

Dynamic circuit motifs underlying rhythmic gain control, gating and integration.

Brain circuitry processes information by rapidly and selectively engaging functional neuronal networks. The dynamic formation of networks is often evident in rhythmically synchronized neuronal activity and tightly correlates with perceptual, cognitive and motor performances. But how synchronized neuronal activity contributes to network formation and how it relates to the computation of behaviorally relevant information has remained difficult to discern. Here we structure recent empirical advances that link synchronized activity to the activation of so-called dynamic circuit motifs. These motifs explicitly relate (1) synaptic and cellular properties of circuits to (2) identified timescales of rhythmic activation and to (3) canonical circuit computations implemented by rhythmically synchronized circuits. We survey the ubiquitous evidence of specific cell and circuit properties underlying synchronized activity across theta, alpha, beta and gamma frequency bands and show that their activation likely implements gain control, context-dependent gating and state-specific integration of synaptic inputs. This evidence gives rise to the dynamic circuit motifs hypothesis of synchronized activation states, with its core assertion that activation states are linked to uniquely identifiable local circuit structures that are recruited during the formation of functional networks to perform specific computational operations.

Sequential processing of lexical, grammatical, and phonological information within Broca's area.

Words, grammar, and phonology are linguistically distinct, yet their neural substrates are difficult to distinguish in macroscopic brain regions. We investigated whether they can be separated in time and space at the circuit level using intracranial electrophysiology (ICE), namely by recording local field potentials from populations of neurons using electrodes implanted in language-related brain regions while people read words verbatim or grammatically inflected them (present/past or singular/plural). Neighboring probes within Broca's area revealed distinct neuronal activity for lexical (approximately 200 milliseconds), grammatical (approximately 320 milliseconds), and phonological (approximately 450 milliseconds) processing, identically for nouns and verbs, in a region activated in the same patients and task in functional magnetic resonance imaging. This suggests that a linguistic processing sequence predicted on computational grounds is implemented in the brain in fine-grained spatiotemporally patterned activity.

Abstract grammatical processing of nouns and verbs in Broca's area: evidence from fMRI.

The role of Broca's area in grammatical computation is unclear, because syntactic processing is often confounded with working memory, articulation, or semantic selection. Morphological processing potentially circumvents these problems. Using event-related functional magnetic resonance imaging (fMRI), we had 18 subjects silently inflect words or read them verbatim. Subtracting the activity pattern for reading from that for inflection, which indexes processes involved in inflection (holding constant lexical processing and articulatory planning) highlighted left Brodmann area (BA) 44/45 (Broca's area), BA 47, anterior insula, and medial supplementary motor area. Subtracting activity during zero inflection (the hawk; they walk) from that during overt inflection (the hawks; they walked), which highlights manipulation of phonological content, implicated subsets of the regions engaged by inflection as a whole. Subtracting activity during verbatim reading from activity during zero inflection (which highlights the manipulation of inflectional features) implicated distinct regions of BA 44, 47, and a premotor region (thereby tying these regions to grammatical features), but failed to implicate the insula or BA 45 (thereby tying these to articulation). These patterns were largely similar in nouns and verbs and in regular and irregular forms, suggesting these regions implement inflectional features cutting across word classes. Greater activity was observed for irregular than regular verbs in the anterior cingulate and supplementary motor area (SMA), possibly reflecting the blocking of regular or competing irregular candidates. The results confirm a role for Broca's area in abstract grammatical processing, and are interpreted in terms of a network of regions in left prefrontal cortex (PFC) that are recruited for processing abstract morphosyntactic features and overt morphophonological content.