ABSTRACT
Executive skills are critical cognitive skills for everyday functioning in children; accurate measurement using validated tools is thus important. The purpose of this study was to examine concurrent validity between the MEMRY Executive/Working Memory scale and the BRIEF2. Participants included a large pediatric clinical sample who completed parent (n = 567), teacher (n = 148), and self-report (n = 88) scales. All correlations were significant between the MEMRY Executive/Working Memory and the BRIEF2 Global Executive Composite, Cognitive Regulation Index, and Working Memory scale (all r's > .80). Classification agreement metrics ranged from fair to excellent. This study provides evidence of strong concurrent validity of the MEMRY Executive/Working Memory scale as a brief, useful tool for assessing executive functioning using parent, teacher, and self-report versions.
ABSTRACT
Congenital heart disease (CHD) is one of the most common congenital birth defects. As surgical and interventional techniques have improved, the mortality has been greatly reduced and the focus has shifted to quality of life and long-term outcomes. The impact of CHD on development and cognition is becoming increasingly recognized. However, more research is needed to understand how children with CHD perform across various cognitive and intellectual domains. This study explored the performance of children with CHD on the newest version of the Wechsler Intelligence Scale for Children compared to normative controls. Children with CHD performed more poorly than normal controls across all indices and most subtests with large effect sizes. Additionally, we explored the patterns of impairment across indices and subtests, as well as the relationships between heard disease variables and WISC-V performance. Block design, Digit Span, and Similarities were the most commonly impaired scores in children with CHD, while Symbol Search, Picture Span, Figure Weights, and Vocabulary were least likely to be impaired.
Subject(s)
Heart Defects, Congenital , Quality of Life , Child , Humans , Wechsler Scales , Heart Defects, Congenital/surgeryABSTRACT
Abbreviated memory batteries play a role in some clinical and research assessments, but their validity and accuracy need to be well supported. The purpose of this study was to examine the accuracy of the ChAMP Screening Index for detecting memory impairment. The sample included N = 804 youths (ages 5-21 years) with medical and neurological diagnoses who were presented for a clinical neuropsychological assessment. All completed the full Child and Adolescent Memory Profile and had valid data. The ChAMP Screening Index contains the first two subtests of the battery (Lists and Objects) and takes about 10 min to administer (full ChAMP is about 35 min). Analyses to examine the accuracy of the ChAMP Screening Index with both the Total Memory Index and Delayed Memory Index included Intraclass correlations, Cohen's Kappa coefficients, receiver operating characteristics, and classification metrics (e.g., sensitivity, specificity, positive predictive values [PPV], and negative predictive values [NPV]). Very strong correlations, minimal mean difference scores, substantial agreement on kappa coefficients, and outstanding receiver operating characteristics all support the Screening Index accuracy. A cutoff score on the Screening Index of 70 provides a good balance between a high PPV (.91) and a high NPV (.96) for the Total Memory Index. When detecting impairment on the Delayed Memory Index, a Screening Index cutoff score of 65 provides a balance between a high PPV (.92) and a high NPV (.94). This study supports the accuracy, validity, and utility of the 10-min ChAMP Screening Index in those clinical and research situations where a brief evaluation of memory is desired.
ABSTRACT
OBJECTIVE: Epilepsy is one of the most common reasons for referral for a pediatric neuropsychological evaluation due its high prevalence in childhood and our well-established clinical role in tertiary care settings. Emerging evidence indicates that racial and ethnic minority populations experience increased epilepsy burden compared with White peers. Although there has been heightened recognition in our specialty regarding the dire need for culturally and linguistically responsive evaluations, the scientific evidence to support effective neuropsychological service delivery for bi/multilingual and bi/multicultural youth with epilepsy is comparatively scant and of poor quality. As a result, significant patient and clinical challenges exist, particularly in high stakes presurgical pediatric epilepsy evaluations of bi/multilingual and bi/multicultural children. METHOD: Given that Spanish is the most common language spoken in the United States after English, this paper will focus on Spanish and English measures, but will provide evidence-based practice considerations that can inform practices with other non-English speaking communities. Cultural and linguistic factors that affect clinical decision-making regarding test selection, test interpretation, and feedback with families are highlighted. RESULTS: We offer a review of neuropsychological profiles associated with pediatric epilepsy as well as a flexible, multimodal approach for the assessment of linguistically and culturally diverse children with epilepsy based on empirical evidence and the clinical experiences of pediatric neuropsychologists from diverse backgrounds who work with children with epilepsy. CONCLUSION: Limitations to this approach are discussed, including the lack of available measures and resources for culturally and linguistically diverse pediatric populations. A case illustration highlights a culturally informed assessment approach.
Subject(s)
Ethnicity , Minority Groups , Adolescent , Humans , Child , United States , Neuropsychological Tests , Language , Evidence-Based PracticeABSTRACT
OBJECTIVE: It is essential to interpret performance validity tests (PVTs) that are well-established and have strong psychometrics. This study evaluated the Child and Adolescent Memory Profile (ChAMP) Validity Indicator (VI) using a pediatric sample with traumatic brain injury (TBI). METHOD: A cross-sectional sample of N = 110 youth (mean age = 15.1 years, standard deviation [SD] = 2.4 range = 8-18) on average 32.7 weeks (SD = 40.9) post TBI (71.8% mild/concussion; 3.6% complicated mild; 24.6% moderate-to-severe) were administered the ChAMP and two stand-alone PVTs. Criterion for valid performance was scores above cutoffs on both PVTs; criterion for invalid performance was scores below cutoffs on both PVTs. Classification statistics were used to evaluate the existing ChAMP VI and establish a new VI cutoff score if needed. RESULTS: There were no significant differences in demographics or time since injury between those deemed valid (n = 96) or invalid (n = 14), but all ChAMP scores were significantly lower in those deemed invalid. The original ChAMP VI cutoff score was highly specific (no false positives) but also highly insensitive (sensitivity [SN] = .07, specificity [SP] = 1.0). Based on area under the curve (AUC) analysis (0.94), a new cutoff score was established using the sum of scaled scores (VI-SS). A ChAMP VI-SS score of 32 or lower achieved strong SN (86%) and SP (92%). Using a 15% base rate, positive predictive value was 64% and negative predictive value was 97%. CONCLUSIONS: The originally proposed ChAMP VI has insufficient SN in pediatric TBI. However, this study yields a promising new ChAMP VI-SS, with classification metrics that exceed any other current embedded PVT in pediatrics.
Subject(s)
Brain Concussion , Brain Injuries, Traumatic , Humans , Adolescent , Child , Infant , Cross-Sectional Studies , Neuropsychological Tests , Reproducibility of Results , Brain Concussion/complications , Brain Injuries, Traumatic/complications , Brain Injuries, Traumatic/diagnosis , MalingeringABSTRACT
Given the high rates of learning challenges in children with medical conditions, efficient and reliable screening methods are crucial. This study examined whether parent report of daily learning and memory predicts academic achievement in youth. Parents of 213 youth (aged 6-18) with varied medical diagnoses completed the Multidimensional Everyday Memory Ratings for Youth (MEMRY), and youth completed subtests from the Wechsler Individual Achievement Test-Third Edition (WIAT-III) as part of a comprehensive assessment. All scales of the MEMRY (Learning, Daily Memory, Executive/Working Memory) correlated significantly with WIAT-III Spelling, Word Reading, and Numerical Operations, while only the MEMRY Learning subscale correlated significantly with WIAT-III Pseudoword Decoding. Regression analyses indicated that MEMRY Learning significantly predicted WIAT-III Word Reading and Spelling, while both the MEMRY Learning and MEMRY Daily Memory scales significantly predicted WIAT-III Numerical Operations. When Full Scale IQ was entered into the models first, the MEMRY Learning subscale accounted for an additional 4% of variance in WIAT-III Word Reading and 7% of variance in WIAT-III Spelling, but did not account for additional variance in WIAT-III Numerical Operations or Pseudoword Decoding. Analyses in a subset of children with broadly normal intellectual functioning demonstrated very similar results, with even higher variance in academic testing accounted for by the MEMRY. In sum, the MEMRY questionnaire may serve as an efficient screen to identify children at risk for reading, spelling, and math deficits.
Subject(s)
Academic Performance , Achievement , Adolescent , Child , Humans , Wechsler Scales , Reading , Surveys and QuestionnairesABSTRACT
BACKGROUND/OBJECTIVES: Despite advances in the treatment of sickle cell disease (SCD), cerebrovascular and cognitive insults can have lifelong consequences. Hematopoietic cell transplantation (HCT) is an established curative therapy, and recent studies have demonstrated efficacy with reduced toxicity nonmyeloablative (NMA) regimens, but little is known about neuropsychological outcomes. The objective of this study was to describe neuropsychological, behavioral, and quality-of-life outcomes with medical correlates in children with SCD who received an NMA matched sibling donor (MSD) HCT. DESIGN/METHODS: Retrospective cohort analysis of nine recipients with hemoglobin SS SCD who underwent MSD HCT using the National Institutes of Health (NIH) NMA protocol. RESULTS: Mean full-scale intellectual functioning (FSIQ) was average pre-HCT (FSIQ = 92.1, SD 9.0; n = 8) and 2 years post-HCT (mean FSIQ = 96.6; SD 11.1; N = 9). Neuropsychological functioning was largely average across all cognitive domains, and no pre/post-HCT differences were found to be statistically significant given the small sample size. However, effect sizes revealed moderate improvements in processing speed (Cohen's d = .72) and verbal memory (Cohen's d = .60) post-HCT, and declines in measures of attention (Cohen's d = -.54) and fine motor speed and dexterity (Cohen's d = -.94). Parents endorsed better quality of life (Cohen's d = .91), less impact of SCD on their family, and less worry about their child's future (Cohen's d = 1.44). CONCLUSION: Neuropsychological functioning in a sample of children and adolescents treated uniformly with NMA MSD HCT remained stable or improved in most cognitive domains, and improvements in quality of life and family functioning were observed.
Subject(s)
Anemia, Sickle Cell , Hematopoietic Stem Cell Transplantation , Adolescent , Anemia, Sickle Cell/therapy , Child , Hematopoietic Stem Cell Transplantation/methods , Humans , Quality of Life , Retrospective Studies , Siblings , Treatment OutcomeABSTRACT
Motor skill deficits are common in epilepsy. The Grooved Pegboard Test (GPT) is the most commonly used fine motor task and is included in the NIH Common Data Elements Battery for the assessment of epilepsy. However, there are limited data on its utility in children and adolescents. The present study investigated the effectiveness of this task in children and adolescents with epilepsy clinically referred for neuropsychological evaluation in a tertiary medical center. Two hundred and two children and adolescents (ages 6-16, 104 males, 98 females) completed the GPT. Base rates of impairment were calculated, correlational analyses determined relations with clinical variables, and ANOVAs and t-tests assessed for differences by seizure type, gender, and lateralized deficits in those with lateralized focal epilepsy. The GPT was sensitive to fine motor impairment in these children and adolescents, with over 60% having impaired performances. Further, performance was significantly correlated with IQ, age of epilepsy onset, number of medications, and seizure frequency. At the group level, those with lateralized focal epilepsy did not show significant differences between left and right hands, though the GPT correctly lateralized 63% of those with large between-hand performance disparities (i.e., one standard deviation or greater). In sum, the GPT is sensitive to fine motor deficits in pediatric epilepsy and is related to known epilepsy severity factors. However, the ability of the task to lateralize epilepsy onset is not robust.
Subject(s)
Epilepsies, Partial , Epilepsy , Motor Disorders , Adolescent , Child , Epilepsy/complications , Female , Humans , Male , Neuropsychological Tests , Seizures/complications , Seizures/diagnosisABSTRACT
The impact of gene-related early infancy onset epilepsies in cognitive development can be potentially devastating. Here we report two cases of SCN8A-related epilepsy that highlight the neuropsychological heterogeneity seen with differing de-novo pathogenic variants. Case 1 is a 6-year-old right-handed girl who presented with SCN8A-developmental and epileptic encephalopathy (SCN8A-DEE) and a missense pathogenic variant (c.802A > C), not previously documented in the literature. Her history includes speech and motor delay, with focal motor seizures starting at 4-months. Early EEG showed bilateral centroparietal epileptiform discharges. She shows motor and language delays and prominent motor tics. Testing documented Intellectual Disability (ID) (Mild) with widespread neuropsychological deficits (i.e., academics, attention/executive functions, memory, visual-spatial skills, fine motor, language). Case 2 is an 8-year-old right-handed girl who presented with SCN8A-related epilepsy with c.5630A > G pathogenic variant with seizure onset at 5-months. Her initial EEG showed right occipital spikes. She shows low average intellect and average academics, but evaluation documented attention deficits, fine motor delays, and behavioral issues in addition to tics; she was diagnosed with Attention-Deficit/Hyperactivity Disorder, Oppositional Defiant Disorder, Obsessive Compulsive Disorder, and Tourette's. These cases expand limited knowledge regarding neuropsychological functioning of children with SCN8A-related epilepsy with unique de-novo pathogenic variants. While SCN8A-DEE is clearly associated with ID, other pathogenic variants may show better preserved intellect, despite other neuropsychological and behavioral concerns.
Subject(s)
Epilepsy , Intellectual Disability , Child , Epilepsy/complications , Female , Humans , Intellectual Disability/complications , Mutation, Missense , NAV1.6 Voltage-Gated Sodium Channel/genetics , Seizures/complicationsABSTRACT
Though it is wellknown that psychiatric concerns are common in children with epilepsy, factors predicting such problems are not well understood. The present investigation studied rates of parent-reported psychological concerns in clinically referred children with epilepsy. Further, it investigated differences in psychological distress across epilepsy subtypes (i.e., focal, generalized, mixed), relationships with epilepsy severity variables, gender, and lateralization of seizure foci. The parents of 170 children and adolescents (ages 6-18â¯years, 78 girls, 92 boys) completed the Child Behavior Checklist (CBCL). Scale elevation frequencies (T-scoresâ¯≥â¯65) were calculated and Chi square analyses examined rates of elevations between epilepsy groups. Internalizing problems (32.4%) were more common than externalizing problems (17.1%) for the sample, with attention problems being the most common concern across all epilepsy types (48.8%). While there were no significant relationships between epilepsy severity variables and CBCL broadband scales, the Total Problems scale was inversely related to intellectual functioning (râ¯=â¯-0.174, pâ¯=â¯0.023). Rates of anxiety and depression did not differ across epilepsy subtypes and no gender differences were found. Those with left-sided epilepsy had higher rates of externalizing problems (33.2%) than those with right (14.0%; χ2[1, 88]â¯=â¯4.55, pâ¯=â¯0.03), with rule-breaking behaviors (15.4%) being more common in left-hemisphere epilepsy (15.4% versus 2.3%; χ2[1,88]â¯=â¯4.66, pâ¯=â¯0.03). In summary, while no significant differences were found across epilepsy groups, the current study adds to the literature regarding lateralization effects and mood/behavior, with more externalizing problems in those with left hemisphere epilepsy.
Subject(s)
Child Behavior Disorders , Epilepsy , Adolescent , Child , Child Behavior Disorders/etiology , Emotions , Epilepsy/complications , Epilepsy/epidemiology , Female , Humans , Male , Parents , SeizuresABSTRACT
OBJECTIVE: The Repeatable Battery for the Assessment of Neuropsychological Status (RBANS) is a brief neuropsychological battery that has been validated in the assessment of dementia and other clinical populations. The current study examines the utility of the RBANS in patients with epilepsy. METHODS: Ninety-eight patients with epilepsy completed the RBANS as part of a more comprehensive neuropsychological evaluation. Performance on the RBANS was evaluated for patients with a diagnosis of temporal lobe epilepsy (TLE; n = 51) and other epilepsy patients (non-TLE, n = 47) in comparison to published norms. Multivariate analysis of variance compared group performances on RBANS indices. Rates of impairment were also compared across groups using cutoff scores of ≤1.0 and ≤1.5 standard deviations below the normative mean. Exploratory hierarchical regressions were used to examine the relations between epilepsy severity factors (i.e., age of onset, disease duration, and number of antiepileptic drugs [AEDs]) and RBANS performance. RESULTS: TLE and non-TLE patients performed below the normative sample across all RBANS indices. Those with TLE performed worse than non-TLE patients on the Immediate and Delayed Memory indices and exhibited higher rates of general cognitive impairment. Number of AEDs was the only epilepsy severity factor that significantly predicted RBANS total performance, accounting for 14% of the variance. CONCLUSIONS: These findings suggest that the RBANS has utility in evaluating cognition in patients with epilepsy and can differentiate TLE and non-TLE patients. Additionally, number of AEDs appears to be associated with global cognitive performance in adults with epilepsy.
Subject(s)
Cognition Disorders , Cognitive Dysfunction , Epilepsy, Temporal Lobe , Adult , Cognition , Cognitive Dysfunction/complications , Cognitive Dysfunction/diagnosis , Epilepsy, Temporal Lobe/complications , Humans , Neuropsychological TestsABSTRACT
Growing recognition and concerns of non-credible performance in pediatric populations have led clinicians to investigate the utility of performance and symptom validity tests (PVT/SVTs) among children and adolescents. Yet current research has indicated that a minority of clinicians routinely utilize a free-standing PVT in pediatric neuropsychological evaluations. The current article investigates the rationale for using PVT/SVTs, and the impact that failure of such exams have on other neurocognitive tests. A review of common adult PVTs and their appropriateness for use with specific pediatric clinical populations is presented, as well as empirical evidence for evaluating embedded validity indicators. The limited literature on SVTs with youth is also reviewed and provides additional insight into symptom exaggeration. There are various reasons children would provide noncredible performance, many of which are different from adults. A review of how the clinician should handle this behavior in pediatric evaluations is provided and what patient populations may present with a higher base rate of failure. Finally, various approaches are offered on how to explain these results to children and their caregivers.
Subject(s)
Malingering/diagnosis , Malingering/psychology , Memory and Learning Tests/standards , Population Surveillance , Child , Humans , Neuropsychological Tests/standards , Population Surveillance/methods , Reproducibility of Results , Symptom Assessment/methods , Symptom Assessment/standards , Wisconsin Card Sorting Test/standardsABSTRACT
Pediatric neuropsychologists are increasingly recognizing the importance of performance validity testing during evaluations. The use of such measures to detect insufficient effort is of particular importance in pediatric epilepsy evaluations, where test results are often used to guide surgical decisions and failure to detect poor task engagement can result in postsurgical cognitive decline. The present investigation assesses the utility of the Medical Symptom Validity Test (MSVT) in 104 clinically referred children and adolescents with epilepsy. Though the overall failure rate was 15.4% of the total group, children with 2nd grade or higher reading skills (a requirement of the task) passed at a very high rate (96.6%). Of the three failures, two were unequivocally deemed true positives, while the third failed due to extreme somnolence during testing. Notably, for those with ≥2nd grade reading levels, MSVT validity indices were unrelated to patient age, intellectual functioning, or age of epilepsy onset, while modest relations were seen with specific memory measures, number of epilepsy medications, and seizure frequency. Despite these associations, however, this did not result in more failures in this population of children and adolescents with substantial neurologic involvement, as pass rates exceeded 92% for those with intellectual disability, high seizure frequency, high medication burden, and even prior surgical resection of critical memory structures.
Subject(s)
Epilepsy/diagnosis , Epilepsy/psychology , Neuropsychological Tests/standards , Adolescent , Child , Electroencephalography/standards , Epilepsy/physiopathology , Female , Humans , Male , Reproducibility of Results , Young AdultABSTRACT
A 2016 survey of pediatric neuropsychologists found that 92% of clinicians reported use of "at least one" performance validity test (PVT) in each assessment. The present investigation sought to verify documented PVT use among clinicians by review of actual reports. A convenience sample of pediatric neuropsychological reports of children ages 6-17 were reviewed over an 24-month period (January 2015-January 2017); reports were those seen as part of our routine practice, including reports on children we were reevaluating, cases that we consulted on, or cases evaluated elsewhere presenting to our centers that required record review for clinical decision making (e.g., presurgical epilepsy evaluations). A total of 131 reports, from 102 unique neuropsychologists were reviewed. PVT usage was documented in only six reports, from six unique clinicians, representing only 4.58% of the reports (or 5.88% of clinicians), far below expectations recent survey results. Though sampling differences and documentation factors may account for some of this disparity, a "social desirability bias" on surveys is likely a major factor in explaining these discordant findings.
Subject(s)
Neuropsychological Tests/standards , Adolescent , Child , Female , Humans , Male , Reproducibility of Results , Surveys and QuestionnairesABSTRACT
Despite its popularity in the neuropsychological evaluation of children, the utility of the Wechsler Intelligence Scale for Children - Fifth Edition (WISC-V) has not yet been investigated in children with epilepsy. Eighty clinically referred children and adolescents with epilepsy were administered the WISC-V as part of a comprehensive assessment and scores were compared to matched controls from the WISC-V standardization sample. T tests compared WISC-V indices and subtests between patients and controls and Chi-square analyses compared the rates of low scores. Correlational analyses assessed the relationships between epilepsy severity variables (e.g., age of onset, duration of epilepsy, number of antiepileptic drugs, seizure frequency). All WISC-V composites and subtests were significantly lower in patients versus controls and the rate of low scores was higher in patients than controls for all composites and subtests with the exception of Figure Weights. The Working Memory Index and Processing Speed Index were most sensitive to impairment, while the Verbal Comprehension Index and Fluid Reasoning Index were least sensitive. Of the epilepsy severity variables, age of seizure onset and number of antiepileptic drugs were strong predictors of deficits, whereas seizure frequency was the weakest predictor. Importantly, no significant differences were seen in children with right hemisphere epilepsy versus left on the five WISC-V composites, though a trend was seen towards a lower Visual-Spatial Index in those with right-sided focal seizures.
Subject(s)
Epilepsy/psychology , Neuropsychological Tests/standards , Wechsler Scales/standards , Adolescent , Child , Female , Humans , MaleABSTRACT
Computerized cognitive batteries, such as CNS Vital Signs (CNSVS), can provide valuable information in clinical and research settings. However, psychometric properties, especially in children and adolescents, remain relatively understudied. The aim of this study was to investigate the factor structure of CNSVS in children and adolescents with neurological diagnoses. Participants with neurological diagnoses (N = 280) age 7-19 years were assessed as part of their clinical care at a tertiary hospital. All participants received the full CNSVS computerized cognitive battery, which contains seven subtests designed to measure attention, executive functioning, psychomotor speed, and memory. Principal components analyses were used to examine factor structure. Scores from CNSVS subtests loaded onto a three-component solution and accounted for 46% of the variance. The three components were deemed to best represent (1) speed, (2) memory, and (3) inhibition, with subtest scores loading differently than the original 11 primary and secondary domain scores would have suggested. Although the CNSVS program generates numerous primary and secondary domain scores, a three-component solution represents a more parsimonious approach to interpreting performance on the CNSVS in youth with neurological diagnoses. Confirmation of this factor solution in other samples is warranted.
Subject(s)
Central Nervous System/physiopathology , Nervous System Diseases/diagnosis , Neuropsychological Tests/standards , Psychometrics/methods , Vital Signs/physiology , Adolescent , Adult , Child , Female , Humans , Male , Reproducibility of Results , Young AdultABSTRACT
OBJECTIVE: With this prospective, observational study, we aimed to determine whether noninvasive language tasks, developed specifically for children, could reliably identify the hemisphere of seizure onset in pediatric epilepsy. METHODS: Seventy-eight children with unilateral epilepsy (44 left), aged 6-15 years (mean age = 11.8, SD = 2.6), completed the Children's Auditory Naming and Visual Naming Tests, the Boston Naming Test, and other verbal and nonverbal tasks. Multivariate analysis of variance was used to compare test performance between left and right hemisphere epilepsy groups, and χ2 analyses and odds ratios were used to examine classification of left vs right hemisphere epilepsy for individual patients based on test performance. RESULTS: Group comparisons revealed poorer auditory naming in children with left hemisphere epilepsy (p = 0.02), yet no significant differences on measures of visual naming, general intelligence, or other cognitive functions. Moreover, χ2 analyses using auditory naming cutoff scores to define intact vs impaired performance correctly classified seizure laterality in a significant proportion of children (p = 0.004). The odds of left hemisphere epilepsy were 4.2 times higher (95% confidence interval 1.4-11.7) than the odds of right hemisphere epilepsy with poor auditory naming performance. In the subset of patients with temporal lobe epilepsy (TLE), the odds of left TLE were 11.3 times higher (95% confidence interval 2.00-63.17) than the odds of right TLE with poor auditory naming performance. CONCLUSION: Contrary to previous findings, naming performance can lateralize hemisphere of seizure onset in children with epilepsy, thereby assisting in the preoperative workup for pediatric epilepsy surgery.
Subject(s)
Epilepsy/diagnosis , Functional Laterality , Language , Names , Neuropsychological Tests , Acoustic Stimulation , Adolescent , Child , Female , Humans , Language Tests , Male , Photic StimulationABSTRACT
OBJECTIVE: Assessment of performance validity is a necessary component of any neuropsychological evaluation. Prior research has shown that cutoff scores of ≤6 or ≤7 on Reliable Digit Span (RDS) can detect suboptimal effort across numerous adult clinical populations; however, these scores have not been validated for that purpose in an adult epilepsy population. This investigation aims to determine whether these previously established RDS cutoff scores could detect suboptimal effort in adults with epilepsy. METHOD: Sixty-three clinically referred adults with a diagnosis of epilepsy or suspected seizures were administered the Digit Span subtest of the Wechsler Adult Intelligence Scale (WAIS-III or WAIS-IV). Most participants (98%) passed Trial 2 of the Test of Memory Malingering (TOMM), achieving a score of ≥45. RESULTS: Previously established cutoff scores of ≤6 and ≤7 on RDS yielded a specificity rate of 85% and 77% respectively. Findings also revealed that RDS scores were positively related to attention and intellectual functioning. Given the less than ideal specificity rate associated with each of these cutoff scores, together with their strong association to cognitive factors, secondary analyses were conducted to identify more optimal cutoff scores. Preliminary results suggest that an RDS cutoff score of ≤4 may be more appropriate in a clinically referred adult epilepsy population with a low average IQ or lower. CONCLUSIONS: Preliminary findings indicate that cutoff scores of ≤6 and ≤7 on RDS are not appropriate in adults with epilepsy, especially in individuals with low average IQ or below.
Subject(s)
Epilepsy/complications , Malingering/diagnosis , Memory Disorders/diagnosis , Adolescent , Adult , Aged , Epilepsy/psychology , Female , Humans , Male , Malingering/complications , Malingering/psychology , Memory Disorders/complications , Memory Disorders/psychology , Middle Aged , Neuropsychological Tests , Reproducibility of Results , Retrospective Studies , Sensitivity and Specificity , Young AdultABSTRACT
Determining the validity of obtained data is an inherent part of a neuropsychological assessment. The purpose of this study was investigate the failure rate of the Memory Validity Profile (MVP) in a large clinical sample of children and adolescents with neurological diagnoses. Data were obtained from 261 consecutive patients (mean age = 12.0, SD = 3.9, range = 5-19) who were referred for a neuropsychological assessment in a tertiary care pediatric hospital and were administered the MVP. In this sample, 4.6% of youth failed the MVP. Mean administration time for the MVP was 7.4 min, although time to complete was not associated with failure rates. Failure rates were held relatively consistent at approximately 5% across age ranges, diagnoses, and psychomotor processing speed abilities. Having very low, below normal, or above normal intellectual abilities did not alter failure rate on the MVP. However, those with intellectual disability (i.e., IQ<70) had a higher fail rate at 12% on MVP Total Score, but only 6% on the MVP Visual portion. Failure rates on the MVP were associated with lower scores on memory tests. This study provides support for using the MVP in children as young as 5 years with neurological diagnoses.
Subject(s)
Memory/physiology , Neuropsychological Tests/standards , Adolescent , Adult , Child , Female , Humans , Male , Young AdultABSTRACT
BACKGROUND: Development of an embedded performance validity test (PVT) is desired for visual memory tests. The goal of this study was to derive an embedded PVT for the Child and Adolescent Memory Profile (ChAMP) Objects visual memory subtest in youth with mild traumatic brain injury (MTBI). METHODS: Children and adolescents (N = 91; mean age = 14.9 years, SD = 2.2, range = 8-18) on average 25.2 weeks (SD = 15.4) post-MTBI were administered ChAMP Objects. Two stand-alone PVTs (Test of Memory Malingering and Medical Symptom Validity Test) were administered, which allowed for grouping into valid (zero failed stand-alone PVTs) and invalid (both stand-alone PVTs failed). Cutoff scores for invalid performance on ChAMP Objects and Objects Delayed were established using failure on two PVTs as the criterion. RESULTS: One in five youth (n = 19) failed both PVTs. Invalid performance was not associated with demographics or time since injury, but was significantly correlated with both ChAMP Objects (r = .53, p<.001) and Objects Delayed (r = -.63, p<.001). Area under the curve suggested adequate discrimination by Objects (.87) and excellent discrimination by Objects Delayed (.91). A cutoff scaled score of 5 or less on ChAMP Objects provided sensitivity of 58% for detecting invalid performance with 96% sensitivity. A cutoff scaled score of 5 or less on ChAMP Objects Delayed achieved sensitivity of 63% and specificity of 96%. Interpreting the two embedded PVTs simultaneously improved sensitivity to 79% with 93% specificity. CONCLUSION: This study yields promising new embedded PVTs for the ChAMP Objects subtest with strong sensitivity and specificity for detecting invalid performance in youth with MTBI.