Using Neuropsychological Profiling to Tailor Mental Health Care for Children and Youth: a Quality Improvement Project to Measure Feasibility.

OBJECTIVE: Precision child and youth mental healthcare has great potential to improve treatment success by tailoring interventions to individual needs. An innovative care pathway in a pediatric mental health outpatient clinic was designed to allow for neuropsychology data to be integrated in psychotherapeutic care. This paper describes the feasibility of this new pathway, including implementation outcomes, acceptability, and potential for future integration. METHOD: The target population was outpatients 6-17 years old referred for individual treatment to a tertiary outpatient mental health (OPMH) clinic. The new care pathway was co-developed by neuropsychologists and mental health practitioners. A logic model was created to guide the evaluation, which was informed by the Reach Effectiveness Adoption Implementation Maintenance framework. As part of the logic model, a stepped assessment protocol was implemented, and reports on neuropsychological function were shared with patients, caregivers, and care providers. Evaluation data were collected from phone surveys, questionnaires, a focus group, and administrative records. RESULTS: Forty-two patients scheduled to receive therapy over a 6-month period were offered the opportunity to participate in the new care pathway and 39 (93%) agreed. Self-reported outcome data showed that 83% of patients and 94% of caregivers valued neuropsychology-informed care, with some describing it as transformative. Almost all practitioners (91%) reported that the project added value to their clinical care. There were no adverse effects on participants nor the flow of patients through the system. CONCLUSIONS: Neuropsychology-informed pediatric OPMH care was feasible and well-received. Clinical effectiveness should be studied in an experimental trial.

Measuring executive functioning with the Multidimensional Everyday Memory Ratings for Youth (MEMRY): concurrent validity with the BRIEF-2 in a large neurological and medical sample.

Executive skills are critical cognitive skills for everyday functioning in children; accurate measurement using validated tools is thus important. The purpose of this study was to examine concurrent validity between the MEMRY Executive/Working Memory scale and the BRIEF2. Participants included a large pediatric clinical sample who completed parent (n = 567), teacher (n = 148), and self-report (n = 88) scales. All correlations were significant between the MEMRY Executive/Working Memory and the BRIEF2 Global Executive Composite, Cognitive Regulation Index, and Working Memory scale (all r's > .80). Classification agreement metrics ranged from fair to excellent. This study provides evidence of strong concurrent validity of the MEMRY Executive/Working Memory scale as a brief, useful tool for assessing executive functioning using parent, teacher, and self-report versions.

Patterns of WISC-V Performance in Children with Congenital Heart Disease.

Congenital heart disease (CHD) is one of the most common congenital birth defects. As surgical and interventional techniques have improved, the mortality has been greatly reduced and the focus has shifted to quality of life and long-term outcomes. The impact of CHD on development and cognition is becoming increasingly recognized. However, more research is needed to understand how children with CHD perform across various cognitive and intellectual domains. This study explored the performance of children with CHD on the newest version of the Wechsler Intelligence Scale for Children compared to normative controls. Children with CHD performed more poorly than normal controls across all indices and most subtests with large effect sizes. Additionally, we explored the patterns of impairment across indices and subtests, as well as the relationships between heard disease variables and WISC-V performance. Block design, Digit Span, and Similarities were the most commonly impaired scores in children with CHD, while Symbol Search, Picture Span, Figure Weights, and Vocabulary were least likely to be impaired.

Brief memory assessment in children: can the ChAMP Screening Index detect memory impairment?

Abbreviated memory batteries play a role in some clinical and research assessments, but their validity and accuracy need to be well supported. The purpose of this study was to examine the accuracy of the ChAMP Screening Index for detecting memory impairment. The sample included N = 804 youths (ages 5-21 years) with medical and neurological diagnoses who were presented for a clinical neuropsychological assessment. All completed the full Child and Adolescent Memory Profile and had valid data. The ChAMP Screening Index contains the first two subtests of the battery (Lists and Objects) and takes about 10 min to administer (full ChAMP is about 35 min). Analyses to examine the accuracy of the ChAMP Screening Index with both the Total Memory Index and Delayed Memory Index included Intraclass correlations, Cohen's Kappa coefficients, receiver operating characteristics, and classification metrics (e.g., sensitivity, specificity, positive predictive values [PPV], and negative predictive values [NPV]). Very strong correlations, minimal mean difference scores, substantial agreement on kappa coefficients, and outstanding receiver operating characteristics all support the Screening Index accuracy. A cutoff score on the Screening Index of 70 provides a good balance between a high PPV (.91) and a high NPV (.96) for the Total Memory Index. When detecting impairment on the Delayed Memory Index, a Screening Index cutoff score of 65 provides a balance between a high PPV (.92) and a high NPV (.94). This study supports the accuracy, validity, and utility of the 10-min ChAMP Screening Index in those clinical and research situations where a brief evaluation of memory is desired.

New Child and Adolescent Memory Profile Embedded Performance Validity Test.

OBJECTIVE: It is essential to interpret performance validity tests (PVTs) that are well-established and have strong psychometrics. This study evaluated the Child and Adolescent Memory Profile (ChAMP) Validity Indicator (VI) using a pediatric sample with traumatic brain injury (TBI). METHOD: A cross-sectional sample of N = 110 youth (mean age = 15.1 years, standard deviation [SD] = 2.4 range = 8-18) on average 32.7 weeks (SD = 40.9) post TBI (71.8% mild/concussion; 3.6% complicated mild; 24.6% moderate-to-severe) were administered the ChAMP and two stand-alone PVTs. Criterion for valid performance was scores above cutoffs on both PVTs; criterion for invalid performance was scores below cutoffs on both PVTs. Classification statistics were used to evaluate the existing ChAMP VI and establish a new VI cutoff score if needed. RESULTS: There were no significant differences in demographics or time since injury between those deemed valid (n = 96) or invalid (n = 14), but all ChAMP scores were significantly lower in those deemed invalid. The original ChAMP VI cutoff score was highly specific (no false positives) but also highly insensitive (sensitivity [SN] = .07, specificity [SP] = 1.0). Based on area under the curve (AUC) analysis (0.94), a new cutoff score was established using the sum of scaled scores (VI-SS). A ChAMP VI-SS score of 32 or lower achieved strong SN (86%) and SP (92%). Using a 15% base rate, positive predictive value was 64% and negative predictive value was 97%. CONCLUSIONS: The originally proposed ChAMP VI has insufficient SN in pediatric TBI. However, this study yields a promising new ChAMP VI-SS, with classification metrics that exceed any other current embedded PVT in pediatrics.

Parent ratings on the MEMRY questionnaire predict children's academic performance.

Given the high rates of learning challenges in children with medical conditions, efficient and reliable screening methods are crucial. This study examined whether parent report of daily learning and memory predicts academic achievement in youth. Parents of 213 youth (aged 6-18) with varied medical diagnoses completed the Multidimensional Everyday Memory Ratings for Youth (MEMRY), and youth completed subtests from the Wechsler Individual Achievement Test-Third Edition (WIAT-III) as part of a comprehensive assessment. All scales of the MEMRY (Learning, Daily Memory, Executive/Working Memory) correlated significantly with WIAT-III Spelling, Word Reading, and Numerical Operations, while only the MEMRY Learning subscale correlated significantly with WIAT-III Pseudoword Decoding. Regression analyses indicated that MEMRY Learning significantly predicted WIAT-III Word Reading and Spelling, while both the MEMRY Learning and MEMRY Daily Memory scales significantly predicted WIAT-III Numerical Operations. When Full Scale IQ was entered into the models first, the MEMRY Learning subscale accounted for an additional 4% of variance in WIAT-III Word Reading and 7% of variance in WIAT-III Spelling, but did not account for additional variance in WIAT-III Numerical Operations or Pseudoword Decoding. Analyses in a subset of children with broadly normal intellectual functioning demonstrated very similar results, with even higher variance in academic testing accounted for by the MEMRY. In sum, the MEMRY questionnaire may serve as an efficient screen to identify children at risk for reading, spelling, and math deficits.

Neuropsychological, behavioral, and quality-of-life outcomes in children and adolescents with sickle cell disease treated with nonmyeloablative matched sibling donor hematopoietic cell transplantation: A case series.

BACKGROUND/OBJECTIVES: Despite advances in the treatment of sickle cell disease (SCD), cerebrovascular and cognitive insults can have lifelong consequences. Hematopoietic cell transplantation (HCT) is an established curative therapy, and recent studies have demonstrated efficacy with reduced toxicity nonmyeloablative (NMA) regimens, but little is known about neuropsychological outcomes. The objective of this study was to describe neuropsychological, behavioral, and quality-of-life outcomes with medical correlates in children with SCD who received an NMA matched sibling donor (MSD) HCT. DESIGN/METHODS: Retrospective cohort analysis of nine recipients with hemoglobin SS SCD who underwent MSD HCT using the National Institutes of Health (NIH) NMA protocol. RESULTS: Mean full-scale intellectual functioning (FSIQ) was average pre-HCT (FSIQ = 92.1, SD 9.0; n = 8) and 2 years post-HCT (mean FSIQ = 96.6; SD 11.1; N = 9). Neuropsychological functioning was largely average across all cognitive domains, and no pre/post-HCT differences were found to be statistically significant given the small sample size. However, effect sizes revealed moderate improvements in processing speed (Cohen's d = .72) and verbal memory (Cohen's d = .60) post-HCT, and declines in measures of attention (Cohen's d = -.54) and fine motor speed and dexterity (Cohen's d = -.94). Parents endorsed better quality of life (Cohen's d = .91), less impact of SCD on their family, and less worry about their child's future (Cohen's d = 1.44). CONCLUSION: Neuropsychological functioning in a sample of children and adolescents treated uniformly with NMA MSD HCT remained stable or improved in most cognitive domains, and improvements in quality of life and family functioning were observed.

The use of the MSVT in children and adolescents with epilepsy.

Pediatric neuropsychologists are increasingly recognizing the importance of performance validity testing during evaluations. The use of such measures to detect insufficient effort is of particular importance in pediatric epilepsy evaluations, where test results are often used to guide surgical decisions and failure to detect poor task engagement can result in postsurgical cognitive decline. The present investigation assesses the utility of the Medical Symptom Validity Test (MSVT) in 104 clinically referred children and adolescents with epilepsy. Though the overall failure rate was 15.4% of the total group, children with 2nd grade or higher reading skills (a requirement of the task) passed at a very high rate (96.6%). Of the three failures, two were unequivocally deemed true positives, while the third failed due to extreme somnolence during testing. Notably, for those with ≥2nd grade reading levels, MSVT validity indices were unrelated to patient age, intellectual functioning, or age of epilepsy onset, while modest relations were seen with specific memory measures, number of epilepsy medications, and seizure frequency. Despite these associations, however, this did not result in more failures in this population of children and adolescents with substantial neurologic involvement, as pass rates exceeded 92% for those with intellectual disability, high seizure frequency, high medication burden, and even prior surgical resection of critical memory structures.

Are we documenting performance validity testing in pediatric neuropsychological assessments? A brief report.

A 2016 survey of pediatric neuropsychologists found that 92% of clinicians reported use of "at least one" performance validity test (PVT) in each assessment. The present investigation sought to verify documented PVT use among clinicians by review of actual reports. A convenience sample of pediatric neuropsychological reports of children ages 6-17 were reviewed over an 24-month period (January 2015-January 2017); reports were those seen as part of our routine practice, including reports on children we were reevaluating, cases that we consulted on, or cases evaluated elsewhere presenting to our centers that required record review for clinical decision making (e.g., presurgical epilepsy evaluations). A total of 131 reports, from 102 unique neuropsychologists were reviewed. PVT usage was documented in only six reports, from six unique clinicians, representing only 4.58% of the reports (or 5.88% of clinicians), far below expectations recent survey results. Though sampling differences and documentation factors may account for some of this disparity, a "social desirability bias" on surveys is likely a major factor in explaining these discordant findings.

The WISC-V in children and adolescents with epilepsy.

Despite its popularity in the neuropsychological evaluation of children, the utility of the Wechsler Intelligence Scale for Children - Fifth Edition (WISC-V) has not yet been investigated in children with epilepsy. Eighty clinically referred children and adolescents with epilepsy were administered the WISC-V as part of a comprehensive assessment and scores were compared to matched controls from the WISC-V standardization sample. T tests compared WISC-V indices and subtests between patients and controls and Chi-square analyses compared the rates of low scores. Correlational analyses assessed the relationships between epilepsy severity variables (e.g., age of onset, duration of epilepsy, number of antiepileptic drugs, seizure frequency). All WISC-V composites and subtests were significantly lower in patients versus controls and the rate of low scores was higher in patients than controls for all composites and subtests with the exception of Figure Weights. The Working Memory Index and Processing Speed Index were most sensitive to impairment, while the Verbal Comprehension Index and Fluid Reasoning Index were least sensitive. Of the epilepsy severity variables, age of seizure onset and number of antiepileptic drugs were strong predictors of deficits, whereas seizure frequency was the weakest predictor. Importantly, no significant differences were seen in children with right hemisphere epilepsy versus left on the five WISC-V composites, though a trend was seen towards a lower Visual-Spatial Index in those with right-sided focal seizures.

Derivation of New Embedded Performance Validity Indicators for the Child and Adolescent Memory Profile (ChAMP) Objects Subtest in Youth with Mild Traumatic Brain Injury.

BACKGROUND: Development of an embedded performance validity test (PVT) is desired for visual memory tests. The goal of this study was to derive an embedded PVT for the Child and Adolescent Memory Profile (ChAMP) Objects visual memory subtest in youth with mild traumatic brain injury (MTBI). METHODS: Children and adolescents (N = 91; mean age = 14.9 years, SD = 2.2, range = 8-18) on average 25.2 weeks (SD = 15.4) post-MTBI were administered ChAMP Objects. Two stand-alone PVTs (Test of Memory Malingering and Medical Symptom Validity Test) were administered, which allowed for grouping into valid (zero failed stand-alone PVTs) and invalid (both stand-alone PVTs failed). Cutoff scores for invalid performance on ChAMP Objects and Objects Delayed were established using failure on two PVTs as the criterion. RESULTS: One in five youth (n = 19) failed both PVTs. Invalid performance was not associated with demographics or time since injury, but was significantly correlated with both ChAMP Objects (r = .53, p<.001) and Objects Delayed (r = -.63, p<.001). Area under the curve suggested adequate discrimination by Objects (.87) and excellent discrimination by Objects Delayed (.91). A cutoff scaled score of 5 or less on ChAMP Objects provided sensitivity of 58% for detecting invalid performance with 96% sensitivity. A cutoff scaled score of 5 or less on ChAMP Objects Delayed achieved sensitivity of 63% and specificity of 96%. Interpreting the two embedded PVTs simultaneously improved sensitivity to 79% with 93% specificity. CONCLUSION: This study yields promising new embedded PVTs for the ChAMP Objects subtest with strong sensitivity and specificity for detecting invalid performance in youth with MTBI.

A new kid on the block: The Memory Validity Profile (MVP) in children with neurological conditions.

Determining the validity of obtained data is an inherent part of a neuropsychological assessment. The purpose of this study was investigate the failure rate of the Memory Validity Profile (MVP) in a large clinical sample of children and adolescents with neurological diagnoses. Data were obtained from 261 consecutive patients (mean age = 12.0, SD = 3.9, range = 5-19) who were referred for a neuropsychological assessment in a tertiary care pediatric hospital and were administered the MVP. In this sample, 4.6% of youth failed the MVP. Mean administration time for the MVP was 7.4 min, although time to complete was not associated with failure rates. Failure rates were held relatively consistent at approximately 5% across age ranges, diagnoses, and psychomotor processing speed abilities. Having very low, below normal, or above normal intellectual abilities did not alter failure rate on the MVP. However, those with intellectual disability (i.e., IQ<70) had a higher fail rate at 12% on MVP Total Score, but only 6% on the MVP Visual portion. Failure rates on the MVP were associated with lower scores on memory tests. This study provides support for using the MVP in children as young as 5 years with neurological diagnoses.

Sensitivity of the Wisconsin Card Sorting Test (64-Card Version) versus the Tower of London (Drexel Version) for detecting executive dysfunction in children with epilepsy.

Executive function deficits are common in children and adolescents with epilepsy. Though the Wisconsin Card Sorting Task (WCST) is often considered the "gold standard" for executive function assessment, its sensitivity-particularly in the case of the 64-card version (WCST-64)-is insufficiently established in pediatric samples, including children and adolescents with epilepsy. The present investigation assesses the sensitivity of the WCST-64 in children and adolescents with epilepsy in comparison to another measure: the Tower of London - Drexel Version (TOL-DX). A total of 88 consecutively referred children and adolescents with epilepsy were administered both the WCST-64 and TOL-DX as part of a comprehensive neuropsychological evaluation. The sensitivity of WCST-64 and TOL-DX variables were established and relations with epilepsy severity measures and other executive function measures were assessed. Of the WCST-64 variables, Perseverative Responses is the most sensitive, but detected executive function impairment in only 19% of this clinically referred sample; in contrast, the TOL-DX Rule Violations detected executive function impairment in half of the sample. Further, TOL-DX performances are more strongly related to epilepsy severity variables and other executive function measures in comparison to the WCST-64. Despite its popularity amongst clinicians, the WCST-64 is not as sensitive to executive dysfunction in comparison to other measures of comparable administration time, such as the TOL-DX.

Utility of the Behavior Rating Inventory of Executive Function - Preschool version (BRIEF-P) in young children with epilepsy.

Executive functioning deficits are prominent in children with epilepsy. Although instruments, such as the Behavior Rating Inventory of Executive Function (BRIEF), are useful in detecting executive dysfunction in school-age children with epilepsy, little data are available for younger children. The present study evaluates the ability of the Behavior Rating Inventory of Executive Function - Preschool Version (BRIEF-P) to detect executive dysfunction in preschool-age children with epilepsy. Parents of 51 clinically referred children with epilepsy (age: M = 1.99 years, SD = 1.29 years, range = 2-5 years) completed the BRIEF-P. Using a cutoff t score of ≥65 as the threshold for impairment, the BRIEF-P's ability to detect executive dysfunction within this clinical population was established. Additionally, correlational analyses were used to assess the relations between epilepsy severity factors and BRIEF-P indices. Epilepsy severity variables that were significantly related to BRIEF-P indices were entered into a linear regression model to explore their predictive ability. Emergent metacognition (emergent metacognition index [EMI]; 59%) and the global executive composite (43%) were the most frequently elevated indices. The most commonly elevated subscales were working memory (65%), inhibition (37%), and planning/organization (35%). Age of seizure onset, seizure frequency, and number of antiepileptic drugs were not significantly correlated with BRIEF-P indices. However, children with lower intellectual ability were rated as having greater executive dysfunction, specifically with EMI (r = -.30). Still, intellectual functioning only accounted for a small percentage (9%) of the variance in EMI scores. The current pilot study demonstrates that the BRIEF-P shows promise in identifying executive dysfunction in preschool-age children with epilepsy.

Cognitive estimations as a measure of executive dysfunction in childhood epilepsy.

Children and adolescents with epilepsy are known to demonstrate executive function deficits. Despite prior work that has shown that cognitive estimation tasks are sensitive to executive dysfunction in children, such tasks have not been studied in children with epilepsy. This is particularly important given the fact that executive tasks have heretofore shown poor ecological validity, and it has been speculated that estimation tasks may show stronger ecological validity than other executive tests. One hundred and thirteen clinically referred children and adolescents with epilepsy were included. The Biber Cognitive Estimations Test was sensitive to cognitive dysfunction, with about half showing impairments on this task in comparison to age-matched normative data; the most frequently impaired subscales were quantity estimation and time estimation. Moreover, the Biber Cognitive Estimation Test showed moderate correlations with not only overall intellectual functions and academic achievement but also other commonly administered tests of executive functions, including digit span, Trailmaking, and the Tower of London but not with the contingency naming test. Cognitive estimations were also modestly correlated with age of epilepsy onset but not other epilepsy-severity variables such as number of antiepilepsy drugs (AEDs) or seizure frequency. Unfortunately, the hypothesis that the Biber Cognitive Estimation Test would show strong ecological validity was not supported, as it showed weak relations with parent-reported executive function deficits. The significance and limitations of this investigation are discussed.

Motor skills development in children with inattentive versus combined subtypes of ADHD.

The relations between attention-deficit hyperactivity disorder (ADHD) and motor skills are well documented, with research indicating both early and lifelong motor deficits in children with this disorder. Despite neuroanatomical and neurodevelopmental differences, which may predict differential rates of motor impairment between ADHD subtypes, evaluation of motor skill deficits in children with different presentations are limited in scope and equivocal in findings. The present investigation evaluated early motor development history and objectively measured motor skills in children with ADHD-Inattentive subtype (ADHD-I) and ADHD-Combined subtype (ADHD-C). One hundred and one children with ADHD-I (n = 53) and ADHD-C (n = 48) were included. Variables included Full-Scale IQ (FSIQ), history of motor delays, and utilization of early intervention services, as well as objectively measured motor impairment as assessed via tasks of fine-motor coordination. No between-group differences were found for FSIQ, but differences in age emerged, with the ADHD-I group being older. No differences in early motor delays were observed, though a considerably higher percentage of children with ADHD-C demonstrated early difficulties. Surprisingly, although children and adolescents with ADHD-C reported more frequent utilization of early intervention services, those with ADHD-I exhibited greater levels of current motor impairment on objective tasks. Given the over-representation of older children in the ADHD-I group, data were reanalyzed after excluding participants older than 10 years of age. Although the between-group differences were no longer significant, more than twice the number of parents of children with ADHD-C reported early motor delays, as compared with the ADHD-I group. Overall, children with ADHD-I were more likely to exhibit current objectively measured motor impairment, possibly due to later identification, less intervention, and/or different neurodevelopmental substrates underlying this disorder subtype.

Attention and executive functions in children with epilepsy: what, why, and what to do.

Attention and executive function deficits are a common sequelae of many neurological conditions of childhood. Those with epilepsy frequently show such deficits, as executive dysfunction is common in all epilepsy syndromes of childhood. The purpose of this article is to review what is known about attention and executive functions, including the neurological underpinnings of these skills. Then, general cognitive function and dysfunction in childhood epilepsy is discussed with a special focus on attention and executive function impairment. Finally, treatment considerations for children and adolescents with these deficits are reviewed and future directions are discussed.

Clinical utility of reliable digit span in assessing effort in children and adolescents with epilepsy.

The assessment of effort is an important aspect of a comprehensive neuropsychological evaluation, as this can significantly impact data interpretation. While recent work has validated the appropriateness of adult-derived cutoffs for standalone effort measures in younger populations, little research has focused on embedded effort measures in children. The present study includes 54 clinically referred children and adolescents (32 males/22 females; aged 6-17) with a confirmed diagnosis of epilepsy. Reliable Digit Spans (RDSs) were calculated and the Test of Memory Malingering (TOMM) was administered in the context of a comprehensive neuropsychological evaluation. Using a previously published RDS cutoff of ≤6, a pass rate of only 65% was obtained, well below the recommended 90% pass rate for an effective effort index. In contrast, when adult criteria were used on TOMM Trial 2, a 90% pass rate was observed. RDS scores were significantly correlated with IQ estimates (r = .59, p < .001) and age (r = .61, p < .001). The difference between RDS and the TOMM on the participant outcome was statistically significant (χ(2) = 9.05, p = .003). These results suggest that RDS appears to yield a large number of false positives and, therefore, may be of limited utility in detecting poor effort in a pediatric epilepsy population. These findings likely extend to other pediatric populations that are known to have significant cognitive loss.

Neuropsychological endophenotypes in ADHD with and without epilepsy.

Attention-deficit hyperactivity disorder (ADHD) is a frequent comorbidity in children with epilepsy. Despite similarities in behavioral manifestations of inattention and hyperactivity, it is unclear whether the neuropsychological endophenotypes of children with developmental ADHD differ from those with ADHD in the context of epilepsy. The present study compared groups of clinically referred children with both ADHD-Inattentive subtype (ADHD-I) and ADHD-Combined subtype (ADHD-C) to children with ADHD-I and ADHD-C and epilepsy on neuropsychological measures of intellectual functioning, auditory attention, working memory, and sustained attention and response inhibition. Those with ADHD and epilepsy performed more poorly on measures of intellectual function (e.g., Full-Scale IQ, Verbal IQ, Performance IQ) as well as auditory attention and working memory. Differences across the groups were also seen on a continuous performance test. Follow-up correlational analyses showed that variables such as seizure frequency and number of antiepilepsy medications predicted cognitive dysfunction in the epilepsy groups. Overall results suggest that the neuropsychological endophenotypes in developmental ADHD versus ADHD in epilepsy differ with seizure-related variables predicting cognitive dysfunction.