P-Factor(s) for Youth Psychopathology Across Informants and Models in 24 Societies.

OBJECTIVE: Although the significance of the general factor of psychopathology (p) is being increasingly recognized, it remains unclear how to best operationalize and measure p. To test variations in the operationalizations of p and make practical recommendations for its assessment, we compared p-factor scores derived from four models. METHODS: We compared p scores derived from principal axis (Model 1), hierarchical factor (Model 2), and bifactor (Model 3) analyses, plus a Total Problem score (sum of unit-weighted ratings of all problem items; Model 4) for parent- and self-rated youth psychopathology from 24 societies. Separately for each sample, we fitted the models to parent-ratings on the Child Behavior Checklist for Ages 6-18 (CBCL/6-18) and self-ratings on the Youth Self-Report (YSR) for 25,643 11-18-year-olds. Separately for each sample, we computed correlations between p-scores obtained for each pair of models, cross-informant correlations between p-scores for each model, and Q-correlations between mean item x p-score correlations for each pair of models. RESULTS: Results were similar for all models, as indicated by correlations of .973-.994 between p-scores for Models 1-4, plus similar cross-informant correlations between CBCL/6-18 and YSR Model 1-4 p-scores. Item x p correlations had similar rank orders between Models 1-4, as indicated by Q correlations of .957-.993. CONCLUSIONS: The similar results obtained for Models 1-4 argue for using the simplest model - the unit-weighted Total Problem score - to measure p for clinical and research assessment of youth psychopathology. Practical methods for measuring p may advance the field toward transdiagnostic patterns of problems.

Cultural contributions to adults' self-rated mental health problems and strengths: 7 culture clusters, 28 societies, 16 906 adults.

BACKGROUND: It is unknown how much variation in adult mental health problems is associated with differences between societal/cultural groups, over and above differences between individuals. METHODS: To test these relative contributions, a consortium of indigenous researchers collected Adult Self-Report (ASR) ratings from 16 906 18- to 59-year-olds in 28 societies that represented seven culture clusters identified in the Global Leadership and Organizational Behavioral Effectiveness study (e.g. Confucian, Anglo). The ASR is scored on 17 problem scales, plus a personal strengths scale. Hierarchical linear modeling estimated variance accounted for by individual differences (including measurement error), society, and culture cluster. Multi-level analyses of covariance tested age and gender effects. RESULTS: Across the 17 problem scales, the variance accounted for by individual differences ranged from 80.3% for DSM-oriented anxiety problems to 95.2% for DSM-oriented avoidant personality (mean = 90.7%); by society: 3.2% for DSM-oriented somatic problems to 8.0% for DSM-oriented anxiety problems (mean = 6.3%); and by culture cluster: 0.0% for DSM-oriented avoidant personality to 11.6% for DSM-oriented anxiety problems (mean = 3.0%). For strengths, individual differences accounted for 80.8% of variance, societal differences 10.5%, and cultural differences 8.7%. Age and gender had very small effects. CONCLUSIONS: Overall, adults' self-ratings of mental health problems and strengths were associated much more with individual differences than societal/cultural differences, although this varied across scales. These findings support cross-cultural use of standardized measures to assess mental health problems, but urge caution in assessment of personal strengths.

Dimensions of Identity Development Scale: Confirmatory factor analysis, gender invariance, and external validity of the Persian version.

The present study was conducted to examine the psychometric properties and gender invariance of the Iranian version of the Dimensions of Identity Development Scale (DIDS). A total of 1453 adolescents (50.8% female; 14-18 years old, mean = 15.48) participated in a cross-sectional study and completed the DIDS and the Youth Self-Report of behavior problems. The Confirmatory Factor Analysis supported the six-factor model of the DIDS, echoing past studies showing the original 5th factor (Exploration in Depth) being divided into Exploration in Depth and Reconsidering the Commitment. The invariance testing showed comparable measurement properties of the DIDS across males and females (strict measurement invariance). Further, behavior problems were associated positively with Ruminative Exploration and negatively with Commitment Making, Identification with Commitments, Exploration in Depth, and Reconsideration of Commitments, whereas the opposite was true for academic performance. A six-factor DIDS was shown to be a valid and reliable measure for the assessment of identity development dimensions among Iranian adolescents. Future studies in the Iranian context evaluating the identity clusters derived from identity dimensions and their gender differences are warranted.

Effects of individual differences, society, and culture on youth-rated problems and strengths in 38 societies.

BACKGROUND: Clinicians increasingly serve youths from societal/cultural backgrounds different from their own. This raises questions about how to interpret what such youths report. Rescorla et al. (2019, European Child & Adolescent Psychiatry, 28, 1107) found that much more variance in 72,493 parents' ratings of their offspring's mental health problems was accounted for by individual differences than by societal or cultural differences. Although parents' reports are essential for clinical assessment of their offspring, they reflect parents' perceptions of the offspring. Consequently, clinical assessment also requires self-reports from the offspring themselves. To test effects of individual differences, society, and culture on youths' self-ratings of their problems and strengths, we analyzed Youth Self-Report (YSR) scores for 39,849 11-17 year olds in 38 societies. METHODS: Indigenous researchers obtained YSR self-ratings from population samples of youths in 38 societies representing 10 culture cluster identified in the Global Leadership and Organizational Behavioral Effectiveness study. Hierarchical linear modeling of scores on 17 problem scales and one strengths scale estimated the percent of variance accounted for by individual differences (including measurement error), society, and culture cluster. ANOVAs tested age and gender effects. RESULTS: Averaged across the 17 problem scales, individual differences accounted for 92.5% of variance, societal differences 6.0%, and cultural differences 1.5%. For strengths, individual differences accounted for 83.4% of variance, societal differences 10.1%, and cultural differences 6.5%. Age and gender had very small effects. CONCLUSIONS: Like parents' ratings, youths' self-ratings of problems were affected much more by individual differences than societal/cultural differences. Most variance in self-rated strengths also reflected individual differences, but societal/cultural effects were larger than for problems, suggesting greater influence of social desirability. The clinical significance of individual differences in youths' self-reports should thus not be minimized by societal/cultural differences, which-while important-can be taken into account with appropriate norms, as can gender and age differences.

Associations of Parental Depression with Children's Internalizing and Externalizing Problems: Meta-Analyses of Cross-Sectional and Longitudinal Effects.

OBJECTIVE: Meta-analyses were used to test associations of parental depression with child internalizing and externalizing problems, based on 107 cross-sectional and 127 longitudinal effects for 164,047 parent-child pairs in 112 studies published between 2009 and 2020. METHOD: For each child, internalizing and externalizing problems were assessed with the same measure and source of data. Meta-analyses were conducted with random effects, multi-level Structural Equation Modeling with Bayesian estimation. RESULTS: Mean Pearson rs between parental depression and children's internalizing and externalizing problems were statistically significant in both cross-sectional (rs = .267 and .264) and longitudinal (rs = .207 and .194) analyses. The difference between the correlations of parental depression with internalizing versus externalizing problems was not statistically significant for cross-sectional or longitudinal effects. For both internalizing and externalizing problems, the cross-sectional correlation was significantly larger than the longitudinal correlation. Using the Lag as Moderator Meta-Analyses (LAMMA), evidence of a linear negative effect of the measurement interval between parental depression and child internalizing problems was found. In addition, several significant methodological moderators were found, with most implicating informant factors. Significant non-methodological moderators included the proportion of girls in a sample and children's White ethnicity. CONCLUSIONS: Overall, the study provided evidence of small but consistent associations between parental depression and child internalizing and externalizing problems, including that these associations are present over substantial periods of development.

The generalizability of empirically derived syndromes of collateral-reported elder psychopathology across 11 societies.

The purpose of this study was to test whether a syndrome model of elder psychopathology derived from collateral ratings, such as from spouses and adult children, in the United States would be generalizable in 11 other societies. Societies represented South America, Asia, and Europe. The Older Adult Behavior Checklist (OABCL) was completed by collateral informants for 6141 60- to 102-year-olds. The tested model comprised syndromes designated as Anxious/Depressed, Worries, Somatic Complaints, Functional Impairment, Memory/Cognition Problems, Thought Problems, and Irritable/Disinhibited. The model was tested using confirmatory factor analyses in each society separately. The primary model fit index showed a good fit for all societies, while the secondary model fit indices showed acceptable to a good fit for all societies. The items loaded strongly on their respective factors, with a median item loading of 0.69 across the 11 societies. By syndrome, the overall median item loadings ranged from 0.47 for Worries to 0.77 for Functional Impairment. The OABCL syndrome structure was thus generalizable across the tested societies. The OABCL can be used for broad assessment of psychopathology for elders of diverse backgrounds in nursing services and research.

Les progrès dans la réalisation de la classification quantitative de la psychopathologie.

Shortcomings of approaches to classifying psychopathology based on expert consensus have given rise to contemporary efforts to classify psychopathology quantitatively. In this paper, we review progress in achieving a quantitative and empirical classification of psychopathology. A substantial empirical literature indicates that psychopathology is generally more dimensional than categorical. When the discreteness versus continuity of psychopathology is treated as a research question, as opposed to being decided as a matter of tradition, the evidence clearly supports the hypothesis of continuity. In addition, a related body of literature shows how psychopathology dimensions can be arranged in a hierarchy, ranging from very broad "spectrum level" dimensions, to specific and narrow clusters of symptoms. In this way, a quantitative approach solves the "problem of comorbidity" by explicitly modeling patterns of co-occurrence among signs and symptoms within a detailed and variegated hierarchy of dimensional concepts with direct clinical utility. Indeed, extensive evidence pertaining to the dimensional and hierarchical structure of psychopathology has led to the formation of the Hierarchical Taxonomy of Psychopathology (HiTOP) Consortium. This is a group of 70 investigators working together to study empirical classification of psychopathology. In this paper, we describe the aims and current foci of the HiTOP Consortium. These aims pertain to continued research on the empirical organization of psychopathology; the connection between personality and psychopathology; the utility of empirically based psychopathology constructs in both research and the clinic; and the development of novel and comprehensive models and corresponding assessment instruments for psychopathology constructs derived from an empirical approach.

The generalizability of Older Adult Self-Report (OASR) syndromes of psychopathology across 20 societies.

OBJECTIVES: As the world population ages, psychiatrists will increasingly need instruments for measuring constructs of psychopathology that are generalizable to diverse elders. The study tested whether syndromes of co-occurring problems derived from self-ratings of psychopathology by US elders would fit self-ratings by elders in 19 other societies. METHODS/DESIGN: The Older Adult Self-Report (OASR) was completed by 12 826 adults who were 60 to 102 years old in 19 societies from North and South America, Asia, and Eastern, Northern, Southern, and Western Europe, plus the United States. Individual and multigroup confirmatory factor analyses (CFAs) tested the fit of the seven-syndrome OASR model, consisting of the Anxious/Depressed, Worries, Somatic Complaints, Functional Impairment, Memory/Cognition Problems, Thought Problems, and Irritable/Disinhibited syndromes. RESULTS: In individual CFAs, the primary model fit index showed good fit for all societies, while the secondary model fit indices showed acceptable to good fit. The items loaded strongly on their respective factors, with a median item loading of .63 across 20 societies, and 98.7% of the loadings were statistically significant. In multigroup CFAs, 98% of items demonstrated approximate or full metric invariance. Fifteen percent of items demonstrated approximate or full scalar invariance, and another 59% demonstrated scalar invariance across more than half of societies. CONCLUSIONS: The findings supported the generalizability of OASR syndromes across societies. The seven syndromes offer empirically based clinical constructs that are relevant for elders of different backgrounds. They can be used to assess diverse elders and as a taxonomic framework to facilitate communication, services, research, and training in geriatric psychiatry.

Bottom-Up and Top-Down Paradigms for Psychopathology: A Half-Century Odyssey.

Bottom-up paradigms prioritize empirical data from which to derive conceptualizations of psychopathology. These paradigms use multivariate statistics to identify syndromes of problems that tend to co-occur plus higher-order groupings such as those designated as internalizing and externalizing. Bottom-up assessment instruments obtain self-ratings and collateral ratings of behavioral, emotional, social, and thought problems and strengths for ages 1½-90+. Ratings of population samples provide norms for syndrome and higher-order scales for each gender, at different ages, rated by different informants, in relation to multicultural norms. The normed assessment instruments operationalize the empirically derived syndromes and higher-order groupings for applications to clinical services, research, and training. Because cross-informant agreement is modest and no single informant provides comprehensive assessment data, software compares ratings by different informants. Top-down paradigms prioritize conceptual representations of the nature and structure of psychopathology, as exemplified by psychodynamic, DSM/ICD, and HiTOP paradigms. Although these paradigms originated with observations, they tend to prioritize conceptual representations over empirical data.

International Comparisons of the Dysregulation Profile Based on Reports by Parents, Adolescents, and Teachers.

Our objective was to examine international similarities and differences in the Dysregulation Profile (DP) of the Child Behavior Checklist (CBCL), Teacher's Report Form (TRF), and Youth Self-Report (YSR) via comparisons of data from many societies. Primary samples were those studied by Rescorla et al. (2012): CBCL: N = 69,866, 42 societies; YSR: N = 38,070, 34 societies; TRF: N = 37,244, 27 societies. Omnicultural Q correlations of items composing the DP (from the Anxious/Depressed, Attention Problems, and Aggressive Behavior syndromes) indicated considerable consistency across diverse societies with respect to which of the DP items tended to receive low, medium, or high ratings, whether ratings were provided by parents (M Q = .70), adolescents (M Q = .72), or teachers (M Q = .68). Omnicultural mean item ratings indicated that, for all 3 forms, the most common items on the DP reflect a mix of problems from all 3 constituent scales. Cross-informant analyses for the CBCL-YSR and CBCL-TRF supported these results. Aggregated DP scores, derived by summing ratings on all DP items, varied significantly by society. Age and gender differences were minor for all 3 forms, but boys scored higher than girls on the TRF. Many societies differing in ethnicity, religion, political/economic system, and geographical region manifested very similar DP scores. The most commonly reported DP problems reflected the mixed symptom picture of the DP, with dysregulation in mood, attention, and aggression. Overall, societies were more similar than different on DP scale scores and item ratings.

Testing Syndromes of Psychopathology in Parent and Youth Ratings Across Societies.

As societies become increasingly diverse, mental health professionals need instruments for assessing emotional, behavioral, and social problems in terms of constructs that are supported within and across societies. Building on decades of research findings, multisample alignment confirmatory factor analyses tested an empirically based 8-syndrome model on parent ratings across 30 societies and youth self-ratings across 19 societies. The Child Behavior Checklist for Ages 6-18 and Youth Self-Report for Ages 11-18 were used to measure syndromes descriptively designated as Anxious/Depressed, Withdrawn/Depressed, Somatic Complaints, Social Problems, Thought Problems, Attention Problems, Rule-Breaking Behavior, and Aggressive Behavior. For both parent ratings (N = 61,703) and self-ratings (N = 29,486), results supported aggregation of problem items into 8 first-order syndromes for all societies (configural invariance), plus the invariance of item loadings (metric invariance) across the majority of societies. Supported across many societies in both parent and self-ratings, the 8 syndromes offer a parsimonious phenotypic taxonomy with clearly operationalized assessment criteria. Mental health professionals in many societies can use the 8 syndromes to assess children and youths for clinical, training, and scientific purposes.

Correction to: Effects of society and culture on parents' ratings of children's mental health problems in 45 societies.

Unfortunately, due to a technical error the International ASEBA Consortium was not listed as author in the original publication. This error is corrected via this correction.

Effects of society and culture on parents' ratings of children's mental health problems in 45 societies.

To improve international needs assessment for child mental health services, it is necessary to employ standardized assessment methods that can be easily administered and scored, can be interpreted by practitioners and researchers with various kinds of training, and that perform similarly across many societies. To this end, we tested the effects of both society and culture on parents' ratings of children's problems. We used hierarchical linear modeling as well as analyses of variance to analyze parents' Child Behavior Checklist ratings of 72,493 6- to 16-year-olds from 45 societies. The 45 societies were nested within 10 culture clusters based on the Global Leadership and Organizational Behavior Effectiveness (GLOBE) taxonomy. Societal differences accounted for 3.8-10.7% of variance in various kinds of problems, while differences between culture clusters (e.g., Anglo vs. Confucian) accounted for 0.1-10.0%. By contrast, differences associated with parents' ratings of individual children accounted for 85.5-93.3% of variance. Averaged across 17 problem scales, society plus culture cluster accounted for about 10% of the variance in parents' ratings of children's problems, whereas individual differences and other possible variables accounted for about 90%. These findings indicate that parents' standardized ratings can be used to assess effects associated with individual differences in child and adolescent psychopathology, over and above differences associated with societies and culture clusters.

Empirically based assessment and taxonomy of psychopathology for ages 1½-90+ years: Developmental, multi-informant, and multicultural findings.

BACKGROUND: Originating in the 1960s, the Achenbach System of Empirically Based Assessment (ASEBA) comprises a family of instruments for assessing problems and strengths for ages 1½-90+ years. PURPOSE: To provide an overview of the ASEBA, related research, and future directions for empirically based assessment and taxonomy. CONTENT: Standardized, multi-informant ratings of transdiagnostic dimensions of behavioral, emotional, social, and thought problems are hierarchically scored on narrow-spectrum syndrome scales, broad-spectrum internalizing and externalizing scales, and a total problems (general psychopathology) scale. DSM-oriented and strengths scales are also scored. The instruments and scales have been iteratively developed from assessments of clinical and population samples of hundreds of thousands of individuals. Items, instruments, scales, and norms are tailored to different kinds of informants for ages 1½-5, 6-18, 18-59, and 60-90+ years. To take account of differences between informants' ratings, parallel instruments are completed by parents, teachers, youths, adult probands, and adult collaterals. Syndromes and Internalizing/Externalizing scales derived from factor analyses of each instrument capture variations in patterns of problems that reflect different informants' perspectives. Confirmatory factor analyses have supported the syndrome structures in dozens of societies. Software displays scale scores in relation to user-selected multicultural norms for the age and gender of the person being assessed, according to ratings by each type of informant. Multicultural norms are derived from population samples in 57 societies on every inhabited continent. Ongoing and future research includes multicultural assessment of elders; advancing transdiagnostic progress and outcomes assessment; and testing higher order structures of psychopathology.

Future Directions for Clinical Research, Services, and Training: Evidence-Based Assessment Across Informants, Cultures, and Dimensional Hierarchies.

As the Diagnostic and Statistical Manual of Mental Disorders (5th ed.; DSM-5) acknowledges, DSM diagnostic categories do not fit the real-world heterogeneity, comorbidity, and complexity of most mental health problems. Many efforts to develop and test evidence-based treatments also fail to take account of the heterogeneity, comorbidity, and complexity of problems seen in the community settings where most mental health services are rendered. Most community services cannot attain the treatment specificity and fidelity characterizing randomized controlled trials, which often yield larger therapeutic effects than when the tested treatments are tried in community services. Widely applicable evidence-based assessments (EBAs) can bridge gaps between evidence-based treatments and the diverse providers, cases, and conditions characterizing community services. To advance community services, intake EBAs can help providers take account of cross-informant discrepancies, parents' problems, multicultural variations, and hierarchical dimensional aspects of psychopathology. To capitalize on intake EBAs, progress and outcome EBAs should be used to identify changes and failures-to-change on which to base recalibrations of treatments. To strengthen therapeutic alliances, the results of intake, progress, and outcome EBAs can be shared with parents. To bridge gaps between research and services, it is recommended that training in clinical research and services should (a) focus on widely applicable EBAs as essential foundations for evidence-based practice; (b) systematically promote intake, progress, and outcome EBAs; and (c) equip psychologists to advance evidence-based practice in community services. To implement these recommendations, research is needed on how to increase use of EBAs, organize services around routine use of EBAs, and help providers base service decisions on EBAs.

Parent-teacher agreement on children's problems in 21 societies.

Parent-teacher cross-informant agreement, although usually modest, may provide important clinical information. Using data for 27,962 children from 21 societies, we asked the following: (a) Do parents report more problems than teachers, and does this vary by society, age, gender, or type of problem? (b) Does parent-teacher agreement vary across different problem scales or across societies? (c) How well do parents and teachers in different societies agree on problem item ratings? (d) How much do parent-teacher dyads in different societies vary in within-dyad agreement on problem items? (e) How well do parents and teachers in 21 societies agree on whether the child's problem level exceeds a deviance threshold? We used five methods to test agreement for Child Behavior Checklist (CBCL) and Teacher's Report Form (TRF) ratings. CBCL scores were higher than TRF scores on most scales, but the informant differences varied in magnitude across the societies studied. Cross-informant correlations for problem scale scores varied moderately across societies studied and were significantly higher for Externalizing than Internalizing problems. Parents and teachers tended to rate the same items as low, medium, or high, but within-dyad item agreement varied widely in every society studied. In all societies studied, both parental noncorroboration of teacher-reported deviance and teacher noncorroboration of parent-reported deviance were common. Our findings underscore the importance of obtaining information from parents and teachers when evaluating and treating children, highlight the need to use multiple methods of quantifying cross-informant agreement, and provide comprehensive baselines for patterns of parent-teacher agreement across 21 societies.

Emotional and Behavioral Problem Profiles of Preteens With Self-Injurious Thoughts and Behaviors: A Multicultural Study.

OBJECTIVE: Self-injurious thoughts and behaviors (SITB) among preteen children have risen to the attention of researchers, practitioners, and policymakers. To shed light on potential treatment/prevention targets, we sought to identify empirically derived emotional and behavioral problem profiles of preteens with SITB, and to determine whether these profiles differ by age, gender and society. METHOD: Caregivers of 46,719 children aged 6 to 12 years from 42 societies across the world completed the Child Behavior Checklist for ages 6-18 (CBCL/6-18). There were 1,656 children whose caregivers indicated that their child experienced SITB. We conducted a latent profile analysis (LPA) using scores from eight CBCL/6-18 problem scales to derive problem profiles of children with SITB. Multilevel modelling was used to estimate differences in the profiles by SITB, society, sex, and age. RESULTS: A 4-profile model provided the best fit to the data, with profiles reflecting low problems (39.7%), mild problems (42.6%), moderate problems (15.4%), and rule-breaking/thought problems (2.3%). The low problems profile had CBCL problem scale scores nearly indistinguishable from those of children without SITB. Children in the rule-breaking/thought problems group were mostly female, whereas children in the other profile groups were mostly male. Children with the rule-breaking/thought problems profile also were most likely to have both suicidal thoughts and self-harm behaviors. CONCLUSION: Problem profiles of preteens with SITB are heterogeneous, with most having relatively low levels of other psychopathology. Selectively screening only children with clinically significant mental health problems for suicidal thoughts and self-harm behaviors (eg, asking about suicidal thoughts only among children with depression) risks missing many children experiencing SITB.

Cross-informant agreement between parent-reported and adolescent self-reported problems in 25 societies.

We used population sample data from 25 societies to answer the following questions: (a) How consistently across societies do adolescents report more problems than their parents report about them? (b) Do levels of parent-adolescent agreement vary among societies for different kinds of problems? (c) How well do parents and adolescents in different societies agree on problem item ratings? (d) How much do parent-adolescent dyads within each society vary in agreement on item ratings? (e) How well do parent-adolescent dyads within each society agree on the adolescent's deviance status? We used five methods to test cross-informant agreement for ratings obtained from 27,861 adolescents ages 11 to 18 and their parents. Youth Self-Report (YSR) mean scores were significantly higher than Child Behavior Checklist (CBCL) mean scores for all problem scales in almost all societies, but the magnitude of the YSR-CBCL discrepancy varied across societies. Cross-informant correlations for problem scale scores varied more across societies than across types of problems. Across societies, parents and adolescents tended to rate the same items as low, medium, or high, but within-dyad parent-adolescent item agreement varied widely in every society. In all societies, both parental noncorroboration of self-reported deviance and adolescent noncorroboration of parent-reported deviance were common. Results indicated many multicultural consistencies but also some important differences in parent-adolescent cross-informant agreement. Our findings provide valuable normative baselines against which to compare multicultural findings for clinical samples.

Examining the criterion validity of CBCL and TRF problem scales and items in a large Singapore sample.

This study examined the criterion validity of the Child Behavior Checklist (CBCL) and Teacher's Report Form (TRF) problem scales and items in demographically-matched Singapore samples of referred and non-referred children (840 in each sample for the CBCL and 447 in each sample for the TRF). Internal consistency estimates for both the CBCL and TRF scales were good. Almost all CBCL and TRF problem scales and items significantly discriminated between referred and non-referred children, with referred children scoring higher, as expected. The largest referral status effects were on attention problems scales and their associated items, with the TRF having larger effects than the CBCL. Effect sizes for demographic variables such as age, gender, ethnicity and SES were much smaller than effect sizes for referral status, across both the CBCL and TRF forms and at both the scale and item levels. These findings suggest that teachers can be effective partners in identifying children who need mental health services and those who do not.