A study on the applicability of the Strengths and Difficulties Questionnaire among low- and higher-educated adolescents.

Aim: The Strengths and Difficulties Questionnaire self-report (SDQ-SR) is a valid instrument for detection of emotional and behavioral problems. The aim of this study was to compare the psychometric properties of the SDQ-SR for low and higher educated adolescents, and to explore its suitability. Methods: We included 426 adolescents. We compared internal consistency for low-educated, i.e., at maximum pre-vocational secondary education, and higher educated adolescents and assessed whether the five-factor structure of the SDQ holds across educational levels. We also interviewed 24 low-educated adolescents, and 17 professionals. Results: On most SDQ subscales the low-educated adolescents had more problematic mean scores than the higher educated adolescents. Findings on the invariance factor analyses were inconsistent, with some measures showing a bad fit of the five factor model, and this occurring relatively more for the low-educated adolescents. Professionals and adolescents reported that the SDQ included difficult wordings. Discussion: Our findings imply that the scale structure of the SDQ-SR is slightly poorer for low educated adolescents. Given this caveat, psychometric properties of the SDQ-SR are generally sufficient for use, regardless of educational level.

Computerized adaptive testing to screen pre-school children for emotional and behavioral problems.

Questionnaires to detect emotional and behavioral (EB) problems in preventive child healthcare (PCH) should be short; this potentially affects their validity and reliability. Computerized adaptive testing (CAT) could overcome this weakness. The aim of this study was to (1) develop a CAT to measure EB problems among pre-school children and (2) assess the efficiency and validity of this CAT. We used a Dutch national dataset obtained from parents of pre-school children undergoing a well-child care assessment by PCH (n = 2192, response 70%). Data regarded 197 items on EB problems, based on four questionnaires, the Strengths and Difficulties Questionnaire (SDQ), the Child Behavior Checklist (CBCL), the Ages and Stages Questionnaire: Social Emotional (ASQ:SE), and the Brief Infant-Toddler Social and Emotional Assessment (BITSEA). Using 80% of the sample, we calculated item parameters necessary for a CAT and defined a cutoff for EB problems. With the remaining part of the sample, we used simulation techniques to determine the validity and efficiency of this CAT, using as criterion a total clinical score on the CBCL. Item criteria were met by 193 items. This CAT needed, on average, 16 items to identify children with EB problems. Sensitivity and specificity compared to a clinical score on the CBCL were 0.89 and 0.91, respectively, for total problems; 0.80 and 0.93 for emotional problems; and 0.94 and 0.91 for behavioral problems.    Conclusion: A CAT is very promising for the identification of EB problems in pre-school children, as it seems to yield an efficient, yet high-quality identification. This conclusion should be confirmed by real-life administration of this CAT. What is Known: • Studies indicate the validity of using computerized adaptive test (CAT) applications to identify emotional and behavioral problems in school-aged children. • Evidence is as yet limited on whether CAT applications can also be used with pre-school children. What is New: • The results of this study show that a computerized adaptive test is very promising for the identification of emotional and behavior problems in pre-school children, as it appears to yield an efficient and high-quality identification.

Developmental monitoring: benefits of a preventive health care system.

This study aims to assess the identification rates in a developmental monitoring system (i.e., preventive child healthcare, PCH system) regarding identification of emotional, behavioral (EB) problems, cognitive developmental and family problems in children, and the contribution of such a system to referral to (specialized) mental health and social care services. Over a predetermined period of 6 months, we retrieved data from a random sample of 1370 children aged 0 to 18 years from the registries of two PCH organizations in the Netherlands. We assessed the degree to which PCH professionals identify EB and cognitive developmental and family problems and invite children with these problems for follow-up PCH assessments or refer them to (specialized) mental health and social care services. Among preschool-aged children, we identified 22% with EB problems, cognitive developmental and/or family problems (mainly EB and family problems). Among school-aged children, numbers varied from 10 to 14% (mainly EB). PCH invited 3 to 10%, varying in proportions of child age, for a follow-up assessment, and referred 0 to 4% of the children to external services. CONCLUSION: A developmental monitoring system with only preventive tasks may help to identify children with EB, cognitive developmental, and/or family problems. This can lead to early support for most of these children, with low referral rates to (more specialized) mental health and social care services. Our findings deserve validation in comparable settings and in other countries. WHAT IS KNOWN: • Well-child care requires monitoring of the health and development of children for timely identification of problems and subsequent intervention. • The Dutch Preventive Child Healthcare system is an example of a developmental monitoring system with only preventive tasks. WHAT IS NEW: • A developmental monitoring system with only preventive tasks may help to identify children with problems, resulting in early support for the majority. • This may reduce referral rates to (more specialized) mental/social health services.

The Strengths and Difficulties Questionnaire Parent Form: Dutch norms and validity.

OBJECTIVE: This study provides Dutch national norms for the parent-reported Strengths and Difficulties Questionnaire (SDQ) for children aged 3-14 years, and assesses the test performance of the SDQ Total Difficulties Scale (TDS) and impairment Scale. We further compared Dutch SDQ norms with those of the United Kingdom (UK), to determine potential variation in country-specific norms. STUDY DESIGN: We analyzed data of 3384 children aged 3 to 14 years. The data were obtained in schools, and in the context of Preventive Child Healthcare. Parents completed the SDQ parent form and the Child Behavior Checklist (CBCL). We determined clinical (10% elevated scores) and borderline (20% elevated scores) SDQ TDS norms. We assessed the test performance (validity) of the SDQ TDS and Impairment Score using the CBCL as criterion. RESULTS: The clinical SDQ TDS norms varied between > 10 and > 14 depending on the age group. The SDQ TDS discriminated between children with and without problems, as measured by the CBCL, for all age groups (AUCs varied from 0.92 to 0.96). The SDQ Impairment Score had added value (beyond the SDQ TDS) only for the age group 12-14 years. For the Netherlands we found lower clinical SDQ TDS norms than those previously reported for the UK (i.e. > 16). CONCLUSION: The clinical SDQ TDS norms varied between > 10 and > 14 depending on the age groups. We found good test performance at these proposed norms. Dutch norms differed somewhat from UK norms. In the Netherlands, the SDQ performed better with Dutch-specific norms than with UK-specific norms.

Computerized adaptive testing to screen children for emotional and behavioral problems by preventive child healthcare.

BACKGROUND: Questionnaires to detect emotional and behavioral problems (EBP) in Preventive Child Healthcare (PCH) should be short which potentially affects validity and reliability. Simulation studies have shown that Computerized Adaptive Testing (CAT) could overcome these weaknesses. We studied the applicability (using the measures participation rate, satisfaction, and efficiency) and the validity of CAT in routine PCH practice. METHODS: We analyzed data on 461 children aged 10-11 years (response 41%), who were assessed during routine well-child examinations by PCH professionals. Before the visit, parents completed the CAT and the Child Behavior Checklist (CBCL). Satisfaction was measured by parent- and PCH professional-report. Efficiency of the CAT procedure was measured as number of items needed to assess whether a child has serious problems or not. Its validity was assessed using the CBCL as the criterion. RESULTS: Parents and PCH professionals rated the CAT on average as good. The procedure required at average 16 items to assess whether a child has serious problems or not. Agreement of scores on the CAT scales with corresponding CBCL scales was high (range of Spearman correlations 0.59-0.72). Area Under Curves (AUC) were high (range: 0.95-0.97) for the Psycat total, externalizing, and hyperactivity scales using corresponding CBCL scale scores as criterion. For the Psycat internalizing scale the AUC was somewhat lower but still high (0.86). CONCLUSIONS: CAT is a valid procedure for the identification of emotional and behavioral problems in children aged 10-11 years. It may support the efficient and accurate identification of children with overall, and potentially also specific, emotional and behavioral problems in routine PCH.

The Strengths and Difficulties Questionnaire Self-Report: A Valid Instrument for the Identification of Emotional and Behavioral Problems.

OBJECTIVE: Validated questionnaires help community pediatric services to identify emotional and behavioral problems (EBPs). This study assesses the psychometric properties of the self-report version of the Strengths and Difficulties Questionnaire (SDQ) for the identification of EBPs in adolescents (13 to 14years old) and the added value of the SDQ parent-form version. METHODS: We obtained data on 500 adolescents (mean age 13.5 years) from community well-child services and schools. Adolescents completed the SDQ self-report and the Youth Self-Report (YSR). Parents completed the SDQ parent-form and the Child Behavior Checklist (CBCL) for their children. We assessed the internal consistency and validity using the YSR and CBCL as the criteria, and the degree to which the SDQ parent-form provides additional information by comparison with the self-report. RESULTS: The internal consistency of the SDQ total score was good (Cronbach's alpha, 0.75). Sensitivity and specificity using the YSR as the criterion were 0.75 and 0.91, respectively. When the CBCL was adopted as the criterion, these validity indices were lower. The SDQ parent-form does not provide additional information by comparison with self-reporting only when the YSR score is used as the criterion (odds ratio, 0.48; 95% confidence interval, 0.14-1.65); however, it does do so when the CBCL is the criterion (odds ratio, 10.9; 95% confidence interval, 4.23-27.9). CONCLUSIONS: The SDQ self-report is valid for the detection of EBPs in adolescents, and the SDQ parent-form provides additional information by comparison with the self-report. This indicates that it is useful to involve adolescents and their parents as informants for the identification of EBPs in adolescents.

Triage in preventive child healthcare: a prospective cohort study of care use and referral rates for children at risk.

OBJECTIVES: A novel triage approach to routine assessments was introduced to improve the efficiency of Preventive Child Healthcare (PCH): PCH assistants carried out pre-assessments of all children and sent the children with suspected health problems to follow-up assessments conducted by a physician or nurse. This two-step approach differed from the usual approach, in which physicians or nurses assessed all children. This study was aimed to examine the impact of triage and task shifting on care for children at risk identified by PCH or parents and schools. DESIGN AND PARTICIPANTS: An observational prospective cohort design was used, with an analysis of the basic registration data from the preventive health assessments for 1897 children aged 5 to 6, and 10 to 11, years from a sample of 41 schools stratified by socioeconomic status, region of PCH service and urbanisation. SETTING: A comparison was made between two PCH services in the Netherlands that used the triage approach and two PCH services that provided the usual approach. MAIN OUTCOME MEASURES: The primary outcome measures were the referral rates to either additional PCH assessments or external services. The secondary outcome measures were the rates of PCH assessments requested by, for example, parents and schools. RESULTS: Overall, a higher referral rate to additional PCH assessments was found for the triage approach than for the usual approach (OR 1.3, 95% CI 1.0 to 1.6), mainly in the age group of 5 to 6 years (OR 1.9, 95% CI 1.3 to 2.7). We found a lower rate of referral to external services in the triage approach (OR 0.4, 95% CI 0.3 to 0.7) and a higher referral rate to PCH assessments on request (OR=4.6, 95% CI 3.0 to 7.0). CONCLUSIONS: The triage approach provides extra opportunities to deliver PCH assessments and PCH assessments on request for children at risk. Further research is needed into the cost benefits of the triage approach.

Emotional and behavioural problems in young children with divorced parents.

Background: This study examines the link between divorce or separation and emotional and behavioural problems (EBP) in children aged 2-4 years. Methods: We obtained cross-sectional data for a nationally representative Dutch sample of children aged 2-4 years within the setting of the national system of routine visits to well-child clinics. A total of 2600 children participated (response rate: 70%). Before the visit, parents completed the Child Behaviour Checklist and a questionnaire with questions about divorce or separation. We assessed the associations of children's EBP with a divorce either in the previous year or at any time in the past after adjustment for other child and family factors. Results: Four percent of the children had parents who had divorced before the child reached the age of 2-4 years, and 3.4% of these parents had divorced in the previous year. EBP (and particularly behavioural problems) were more likely in children aged 2-4 years old in cases of lifetime divorce or separation. This association was weaker after adjustment for relevant child and family characteristics: it may be partly due to confounding factors such as paternal education level, ethnicity and family size. A divorce in the previous year was not linked to child EBP. Conclusions: These findings show the importance of identifying care needs and providing care for pre-school children whose parents have divorced since they suggest that there may be negative effects in the longer term.

Comparing three short questionnaires to detect psychosocial problems among 3 to 4-year olds.

BACKGROUND: Validated questionnaires help community pediatric services to identify psychosocial problems. Our aim was to assess which of three short questionnaires was most suitable for this identification among pre-school children. METHODS: We included 1,650 children (response 64 %) aged 3-4 years undergoing routine well-child health assessments in 18 services across the Netherlands. Child healthcare professionals (CHPs) interviewed and examined children and parents. Parents were randomized regarding filling out the Strengths and Difficulties Questionnaire (SDQ) or the KIPPPI, a Dutch-origin questionnaire. In addition, all filled out the Ages and Stages Questionnaires: Social-Emotional (ASQ:SE) and the Child Behavior Checklist (CBCL). We assessed the internal consistency and validity of each questionnaire, with CBCL and treatment status as criteria, and the degree to which each questionnaire could improve identification based solely on clinical assessment. RESULTS: The internal consistency of the total problems scale of each questionnaire was satisfactory, Cronbach's alphas varied between 0.75 and 0.98. Only the SDQ discriminated sufficiently between children with and without problems as measured by the CBCL (sensitivity = 0.76 at a cut-off point with specificity = 0.90), in contrast to the other two questionnaires (with sensitivity indices varying between 0.51-0.63). Similar results were found for the treatment status criterion, although sensitivity was lower for all questionnaires. The SDQ seemed to add most to the identification of psychosocial problems by CHPs, but the differences between the SDQ and the ASQ:SE were not statistically significant. CONCLUSIONS: The SDQ is the best tool for the identification of psychosocial problems in pre-school children by community paediatric services.

Punishment and reward in parental discipline for children aged 5 to 6 years: prevalence and groups at risk.

OBJECTIVE: In this study we examined the use and predictors of different discipline practices by parents of children aged 5 to 6 years. METHODS: We obtained cross-sectional data for a nationally representative Dutch sample of children aged 5 to 6 years within the setting of routine well-child visits provided to the entire population. A total of 1630 children participated (response rate, 84%). Before the visit, parents completed a questionnaire with questions about their approach to discipline (punishment and rewards). Chi-square tests and logistic regression analyses were used to examine associations between discipline practices and child, parent, and family factors. RESULTS: Parental punishment prevalence was 21.9% for spanking and 80.3% for other punishment practices, such as time-outs. The prevalence of rewards as a discipline strategy was 32.2% for granting privileges and 86.3% for cuddling/complimenting. Multivariate logistic regression analyses showed that spanking was more likely in families in which the mothers have low and medium levels of education and in families of non-Dutch ethnicity. Other punishment practices (eg, time-outs, verbal reprimands, and holding) were more likely in families of Dutch ethnicity. Granting privileges was more likely in families of non-Dutch ethnicity, who lived in large cities, whose income was below the poverty level, in unemployed families, and in small families. Cuddling and complimenting were more likely in families with a high maternal educational level, in families of Dutch ethnicity, and in small families. CONCLUSIONS: These findings show the importance of considering social and economic factors when identifying and supporting parents with parenting/rearing challenges.

Three questionnaires to detect psychosocial problems in toddlers: a comparison of the BITSEA, ASQ:SE, and KIPPPI.

OBJECTIVE: Validated questionnaires can improve the identification of psychosocial problems in community pediatric services. Our aim was to assess which of 3 short questionnaires-the Brief Infant-Toddler Social and Emotional Assessment (BITSEA), the Ages and Stages Questionnaires: Social-Emotional (ASQ:SE), and the KIPPPI (Brief Instrument Psychological and Pedagogical Problem Inventory)-was most suitable as a routine screening tool for identification among toddlers. METHODS: We included 2106 parents (response rate 81%) of children aged 6, 14, or 24 months at routine well-child visits in 18 services across the Netherlands. Child health care professionals interviewed and examined children and parents. Parents were randomized to complete either the BITSEA or the KIPPPI; all filled out the ASQ:SE and the Child Behavior Checklist. For each questionnaire, we assessed the internal consistency, validity with Child Behavior Checklist-Total Problems Score (CBCL-TPS) as a criterion, and added value to identification compared to clinical assessment alone. RESULTS: Cronbach's alphas of the total scales varied between 0.46 to 0.91. At the ages of 6 and 14 months, none of the instruments studied had adequate validity. At the age of 24 months, only the BITSEA discriminated sufficiently between children with and without problems (sensitivity = 0.84 at specificity = 0.90), but not the other 2 questionnaires (with sensitivity indices varying between 0.53 and 0.60 at similar specificity). The BITSEA at this age offered slightly higher added value to the identification of psychosocial problems by child health care professionals. CONCLUSIONS: For toddlers aged 6 and 14 months, no questionnaire is sufficiently valid to support the identification of psychosocial problems. The BITSEA is the best short tool for the early detection of psychosocial problems in 2-year-old children.

Ethnicity, educational level and attitudes contribute to parental intentions about genetic testing for child obesity.

The objective of this paper is to assess parental beliefs and intentions about genetic testing for their children in a multi-ethnic population with the aim of acquiring information to guide interventions for obesity prevention and management. A cross-sectional survey was conducted in parents of native Dutch children and children from a large minority population (Turks) selected from Youth Health Care registries. The age range of the children was 5-11 years. Parents with lower levels of education and parents of non-native children were more convinced that overweight has a genetic cause and their intentions to test the genetic predisposition of their child to overweight were firmer. A firmer intention to test the child was associated with the parents' perceptions of their child's susceptibility to being overweight, a positive attitude towards genetic testing, and anticipated regret at not having the child tested while at risk for overweight. Interaction effects were found in ethnic and socio-economic groups. Ethnicity and educational level play a role in parental beliefs about child overweight and genetic testing. Education programmes about obesity risk, genetic testing and the importance of behaviour change should be tailored to the cultural and behavioural factors relevant to ethnic and socio-economic target groups.

Characteristics of the strengths and difficulties questionnaire in preschool children.

OBJECTIVES: Validated questionnaires help the preventive child healthcare (PCH) system to identify psychosocial problems. This study assesses the psychometric properties and added value of the Strengths and Difficulties Questionnaire (SDQ) for the identification of psychosocial problems among preschool-aged children by PCH. METHODS: We included 839 children (response 66%) 3 to 4 years of age undergoing routine health assessments in 18 PCH services across the Netherlands. Child healthcare professionals interviewed and examined children and parents. Before the interview, parents completed the SDQ and the Child Behavior Checklist (CBCL). We assessed the internal consistency, the scale structure, and validity (correlation coefficients, sensitivity, and specificity), with CBCL and treatment status as criteria, and the degree to which the SDQ could improve identification solely on the basis of clinical assessment. RESULTS: The internal consistency of the SDQ total difficulties score was good (Cronbach's α, 0.78), but it was worse for some subscales of the SDQ (range, 0.50-0.74). The area under the receiver operating characteristic curve using the CBCL as a criterion was 0.94 (95% confidence interval 0.91-0.97), and sensitivity and specificity were 0.79 and 0.93, respectively. The SDQ added information to the clinical assessment; the odds ratio was 36.48 for added information by using the CBCL as a criterion. CONCLUSIONS: The SDQ is a valid tool for the identification of psychosocial problems in preschool-aged children by PCH. However, the low reliability of some SDQ subscales does not justify use of these subscales for decisions about further treatment.

Work experience and style explain variation among pediatricians in the detection of children with psychosocial problems.

OBJECTIVE: To assess whether variation in the proportion of children identified as having psychosocial problems by individual preventive pediatricians can be explained by pediatrician characteristics, over and above variations in the mix of children. Furthermore, to assess whether the characteristics of preventive pediatricians were related to the quality of problem identification. METHODS: We used data from approximately 3070 children ages 5 to 6 years who were assessed during a routine well-child visit by a preventive pediatrician in the Netherlands (response rate 85.2%). We obtained data about parent-reported child problems by using the Child Behavior Checklist (CBCL), sociodemographic background of the family, and characteristics of the preventive pediatrician. After each assessment, preventive pediatricians reported whether they had identified any psychosocial problem in the child. Multilevel logistic regression analyses were used to assess whether variation in the proportion of children identified by preventive pediatricians as having a psychosocial problem could be explained by the characteristics of preventive pediatricians and whether these characteristics were related to the quality of problem identification. RESULTS: Preventive pediatricians varied widely in the proportion of children identified as having psychosocial problems. Pediatrician characteristics such as work experience and work style (for example, on indication use of behavior questionnaires like the CBCL in routine care) explained about a quarter of this inter-pediatrician variation; child characteristics did not explain this variation even though characteristics like gender and parental education level were associated with likelihood of problem identification. More use of the CBCL and less use of the Teacher Report Form in routine care resulted in a better problem identification by preventive pediatricians. Work experience was not related to better problem identification. CONCLUSIONS: Preventive pediatricians identify psychosocial problems in children in a standardized way, but important inter-pediatrician variation remains. This variation may be reduced further and quality improved by changing their work style and targeted training.

Early detection of psychosocial problems in children aged 5 to 6 years by preventive child healthcare: has it improved?

OBJECTIVE: To assess whether the quality of identification of psychosocial problems by preventive child healthcare professionals (CHPs) in children aged 5-6 years has improved after a series of nationwide interventions. STUDY DESIGN: We analyzed data about 8440 children aged 5-6 years who were assessed during routine well-child visits by CHPs (response rates, 85%-90%). Of these children, 4339 were assessed before the interventions. Parents completed the Child Behavior Checklist (CBCL) and CHPs reported on psychosocial problems that they identified in children. The agreement between identification of psychosocial problems by CHPs and parent-reported problems on the CBCL were assessed before and after the nationwide interventions. RESULTS: CHPs identified psychosocial problems in 22%-28% of all children. Identification of psychosocial problems by CHPs was much more likely in children with an elevated CBCL total problems score than in others (OR: 4.65, 95% CI: 3.28-6.58). The quality of identification by CHPs did not improve after the interventions, the OR for improvement was 0.81 (95% CI: 0.57-1.15). CONCLUSIONS: The quality of problem identification by CHPs has not improved. CHPs still miss many cases with parent-reported problems on the CBCL. Additional efforts are needed to improve early identification of psychosocial problems.