RESUMO
Purpose: Determine the prevalence of symptoms of neurodevelopmental problems (NDPs) with a semi-structured review of fourth grade students' medical records, its interrater agreement and validity as compared with clinical assessment. Methods: A school-based sample of 11-year-old children provided child health care (CHC) records and school health care (SHC) records. A pediatric neurologist, child psychiatrist and an adult psychiatrist scored the records, with the "Early Symptomatic Syndromes Eliciting Neurodevelopmental Clinical Examinations-Questionnaire" (ESSENCE-Q, 12 items scored 0-2, summary score range 0-24). Agreement was measured with model-based kappa and intraclass correlation coefficient (ICC). Ratings were validated against a multidisciplinary assessment involving a physician, psychologist, teacher- and parental behavioral rating scales rendering a clinical global impression severity rating (CGI-S, range 1-7) of NDPs. Results: Out of 223 participants, medical charts were available from 201, of whom 169 were rated by all three raters. Kappa agreement was moderate/strong (~0.8) for 7 of the 12 questionnaire items. Measured with the ICC, concordance in the summary score was good for agreement (~0.8) and excellent (~0.9) for consistency. Test-retest reliability was excellent (ICC = ~0.9). Area under the curve for the ESSENCE-Q in predicting clinical-level problems (CGI ≥4) was ~80% for all three raters, albeit with differing optimal cutoffs. Conclusion: Using the ESSENCE-Q as a template, NDPs appear to be common in medical records, are identified reliably, and predict clinical-level concern. Medical records screening may facilitate a structured review of medical records in work-ups or be applied in conjunction with other screening measures for neurodevelopmental disorders. However, differences in calibration currently preclude defining a universal cutoff for using the ESSENCE-Q for medical records screening.
RESUMO
Purpose: To determine the prevalence of parent-rated developmental concern using the ESSENCE-Q (Early Symptomatic Syndromes Eliciting Neurodevelopmental Clinical Examinations-Questionnaire, 12-items, score range 0-24) and to ascertain the predictive validity and optimal cutoff level of the instrument in a school-based sample of 11-year-old children. Methods: In a cross-sectional, school-based study, participants underwent a clinical assessment by a physician and a psychologist, teachers and parents completed the SDQ (Strength and Difficulties Questionnaire), medical health records and national tests were reviewed, and parents independently completed the ESSENCE-Q. In a case-conference outcomes were defined as a) the need for further clinical work-up due to suspected neurodevelopmental problems (NDPs) and b) degree of investigator-rated symptoms/impairment from NDPs on the CGI-S (Clinical Global Impression-Severity instrument, range 1-7, 4-7 defined as clinically symptomatic). Classification and optimal cutoffs of the ESSENCE-Q were determined using ROC (Receiver Operating Characteristic) analysis. Results: Out of 343 eligible children, 223 enrolled, of whom 173 (50% of all eligible) had a parent-rated ESSENCE-Q. At least one of the 12 possible concerns was reported by parents of 36% of participants. Overall, in 101 (57%) participants a work-up was warranted, and 64 (37%) were clinically symptomatic from NDPs. The AUC of the ESSENCE-Q in detecting need for work-up was 0.70 (95% confidence interval [CI] 0.63-0.77), and the AUC in detecting clinically symptomatic participants was 0.82 (95% CI 0.76-0.88). ESSENCE-Q ratings correlated positively with CGI-S scores (r=0.48, p<0.05). A cutoff of ≥3 had the highest accuracy (78%) with a negative predictive value of 82%. Ratings >6 conferred few false positives cases with positive likelihood ratios >10 and positive predictive values of 86% or more. Significance: This study of the ESSENCE-Q in 11-year-old children suggests it might be an acceptable instrument for screening of NDPs in children in middle school, optimally in conjunction with other methods.