Distorted correlations among censored data: causes, effects, and correction.

Data censoring occurs when researchers do not know precise values of data points (e.g., age is 55+ or concentration ≤ .001). Censoring is frequent within psychology but typically unrecognized outside of longitudinal studies. We describe five circumstances when censoring may occur, demonstrate censoring distorts correlations, and discuss how censoring can create spurious factors. Next, we explain how to use R package lava to calculate maximum likelihood estimates (Holst and Budtz-Jørgensen Computational Statistics, 28(4), 1385-1452, 2013) of correlations between uncensored variables based upon censored variables. Previous research demonstrated these estimates were more accurate than Muthén's (1984) estimate for one particular model, but no research has systematically examined their accuracy. We therefore conducted a simulation study exploring the effects of the correlation, sample size, and censoring on point and interval estimates of correlations. Based upon 80 cells in which low values of normally distributed variables were censored, we recommend the constrained regression model with Wald confidence intervals. These methods were precise and unbiased unless both variables had 70% censoring and the correlation was large and negative (e.g., -.9), in which case estimates were closer to -1 than they should be. Opposite results would occur if low values of one variable and high values of the other were censored: Estimates would be precise and unbiased unless censoring was extreme and correlations were large and positive. To estimate large correlations accurately, we recommend researchers reduce censoring by using longer longitudinal studies, using scales with more response options, and matching measures to populations to reduce floor and ceiling effects.

Initial examination of the mental health disorders: screening instrument for athletes.

Introduction: There is a need to psychometrically develop assessment instruments capable of screening mental health disorders in athlete populations. The current study was conducted to determine reliability, validity and clinical utility of the Mental Health Disorders Screening Instrument for Athletes (MHDSIA). Methods and results: 259 collegiate athletes completed the MHDSIA. Factor analysis determined a single factor with good internal consistency, and this factor was positively correlated with an established measure of psychiatric symptomology (Symptom Checklist 90-R), demonstrating its concurrent validity. An optimum clinical cutoff score (i.e., 32) was determined using Receiver Operating Characteristic (ROC) analyses to assist appropriate mental health referrals. Discussion: Results suggest the MHSIA is a reliable, valid, and relatively quick and easy to interpret screen for the broad spectrum of mental health disorders in collegiate athletes. As expected, NCAA athletes reported lower MHDSIA scores than club and intramural athletes, while males reported similar severity scores as females.

Two and five-factor models of negative symptoms in schizophrenia are differentially associated with trait affect, defeatist performance beliefs, and psychosocial functioning.

Recent factor analytic evidence supports both two-factor (motivation and pleasure, MAP; diminished expression, EXP) and five-factor (anhedonia, asociality, avolition, blunted affect, alogia) conceptualizations of negative symptoms. However, it is unclear whether these two conceptualizations of the latent structure of negative symptoms have differential associations with external correlates. The current study evaluated external correlates of the two- and five-factor structures by examining associations with variables known to have critical relations with negative symptoms: trait affect, defeatist performance beliefs, neurocognition, and community-based psychosocial functioning. Participants included a total of 245 outpatients diagnosed with schizophrenia who were rated on the Brief Negative Symptom Scale and completed a battery of additional measures during periods of clinical stability. These additional measures included the Positive and Negative Affect Schedule, Defeatist Performance Beliefs scale, MATRICS Consensus Cognitive Battery, and Level of Function Scale. Pearson correlations indicated differential patterns of associations between the BNSS scores and the external correlates. Support for the two-factor model was indicated by a stronger association of MAP with positive affect and psychosocial functioning, compared to EXP with neurocognition. Significance tests examining a differential magnitude of associations showed that the two-dimension negative symptom structure masked unique correlational relationships among the five negative symptom domains with neurocognition and social/vocational community functioning and captured unique patterns of correlation with trait affect. Support for the five-factor model was shown by a stronger association between Blunted Affect with Attention/Vigilance, and stronger associations between Avolition, Anhedonia, and Asociality with psychosocial functioning. Results offer support for both the two-dimension and five-domain model of negative symptoms as well as a hierarchical two-dimensions-five-domains model of negative symptoms. Findings may have implications for diagnostic criteria and descriptions of the Diagnostic and Statistical Manual of Mental Disorders (5th ed.; DSM-5), as well as possible treatment targets of negative symptoms.

Latent structure of cognitive tests is invariant in men and women with schizophrenia.

Studies comparing the cognitive functioning of men and women with schizophrenia have produced conflicting results which could arise from sex-based differences in the latent structure of cognitive abilities. The current study used multigroup confirmatory factor analysis to examine invariance in latent structure of cognitive abilities to between men and women with schizophrenia. Confirmatory factor analysis of an initial neurocognitive assessment (men n = 612, women n = 201) and cross-validation using second assessment (men n = 549, women n = 198) demonstrated that a bifactor seven-factor model fit the data best for both men and women. Invariance analyses further indicated this model was invariant across men and women at both assessments. Group comparisons indicated women had significantly higher scores for Semantic Memory, Verbal Memory, and General Cognitive factors, whereas men exhibited better performance on the Vigilance factor. Results indicate that cognition in SZ is characterized by both a general cognitive factor and specific domains for both men and women. Invariance analysis provides evidence that cognitive differences between men and women do not result from sex-based differences in the latent structure of cognitive abilities. Current results also indicate small but statistically significant neurocognitive differences between men and women with schizophrenia.

Expanding the cross-cultural psychological assessment tool box with IQ test short forms.

OBJECTIVE: Short forms of standard intelligence tests are useful in clinical and research settings where administration of a full intelligence test is impractical or unnecessary. In cross cultural contexts where few tests are available, including brief intelligence tests, short forms may be particularly useful to meet clinical and research needs. However, there is little cross-cultural research on the validity of short forms. This study evaluated feasibility of short form development for the Spanish version of the Wechsler Intelligence Scale for Children-Fourth Edition (WISC-IV) and examined comparability of short-form IQ estimates in Spanish- and English-speaking children with Attention-Deficit/Hyperactivity Disorder (ADHD). METHOD: Participants included children with ADHD who were administered the WISC-IV Spanish (n = 165) or WISC-IV (n = 299). Full Scale IQs (FSIQs) were calculated for two-, three-, four-, and five-subtest short forms. Misclassification rates, mean absolute differences, and intraclass correlation coefficients (ICCs) were used to determine short form accuracy in estimating FSIQ. RESULTS: The WISC-IV short forms examined had generally strong psychometric properties (e.g., ICCs ranged from .78 to .94) and level of accuracy in estimating FSIQ did not differ across primary language of Spanish or English. CONCLUSIONS: Findings support feasibility of IQ short form development to help address mental health disparities in research and clinical screening for Spanish- and English-speaking pediatric populations with ADHD.

Confirmatory factor analysis of imPACT cognitive tests in high school athletes.

ImPACT is the most commonly utilized computerized neurocognitive assessment for the clinical management of sport concussion. The cognitive composite scores that ImPACT currently reports include Verbal Memory, Visual Memory, Visual Motor Speed, Reaction Time, and Impulse Control. However, exploratory factor analytic studies report that two or more factors may better represent ImPACT's latent structure, suggesting that the current cognitive composites may not adequately represent the cognitive constructs ImPACT assesses. The latent structure of ImPACT cognitive baseline scores was examined using exploratory (EFA) and confirmatory factor analysis (CFA) of valid baseline ImPACT scores for 36,091 high school athletes. These athletes were randomly divided into two samples. The first sample was a calibration sample used for EFA and the second sample was a cross-validation sample used for CFA to estimate the best model identified in the calibration phase, along with other models that were reported in the literature or based on theoretical considerations, including hierarchical and bifactor models. EFA identified a first-order four-factor solution consisting of Visual Memory, Visual Reaction Time, Verbal Memory, and Working Memory constructs. CFA indicated that this four-factor model provided superior fit for the data, while the current five-composite structure of ImPACT provided a poor fit for the data. The latent constructs identified in this study using CFA do not map well onto the composite scores that are currently used to interpret ImPACT performance. Future research should investigate whether interpretation of ImPACT based on the constructs identified here will be more useful for clinical decision making than current approaches. (PsycInfo Database Record (c) 2021 APA, all rights reserved).

Bifactor model of cognition in schizophrenia: Evidence for general and specific abilities.

BACKGROUND: Despite extensive study of cognition in schizophrenia, it remains unclear as to whether cognitive deficits and their latent structure are best characterized as reflecting a generalized deficit, specific deficits, or some combination of general and specific constructs. METHOD: To clarify latent structure of cognitive abilities, confirmatory factor analysis was used to examine the latent structure of cognitive data collected for the Clinical Antipsychotic Trials of Intervention Effectiveness (CATIE) for Schizophrenia study. Baseline assessment data (n = 813) were randomly divided into calibration (n = 413) and cross-validation samples (n = 400). To examine whether generalized or specific deficit models provided better explanation of the data, we estimated first-order, hierarchical, and bifactor models. RESULTS: A bifactor model with seven specific factors and one general factor provided the best fit to the data for both the calibration and cross-validation samples. CONCLUSIONS: These findings lend support for a replicable bifactor model of cognition in schizophrenia, characterized by both a general cognitive factor and specific domains. This suggests that cognitive deficits in schizophrenia might be best understood by separate general and specific contributions.

Influence of Special Education, ADHD, Autism, and Learning Disorders on ImPACT Validity Scores in High School Athletes.

OBJECTIVE: The Immediate Post-Concussion Assessment and Cognitive Testing (ImPACT) is commonly used to assist with post-concussion return-to-play decisions for athletes. Additional investigation is needed to determine whether embedded indicators used to determine the validity of scores are influenced by the presence of neurodevelopmental disorders (NDs). METHOD: This study examined standard and novel ImPACT validity indicators in a large sample of high school athletes (n = 33,772) with or without self-reported ND. RESULTS: Overall, 7.1% of athletes' baselines were judged invalid based on standard ImPACT validity criteria. When analyzed by group (healthy, ND), there were significantly more invalid ImPACT baselines for athletes with an ND diagnosis or special education history (between 9.7% and 54.3% for standard and novel embedded validity criteria) when compared to athletes without NDs. ND history was a significant predictor of invalid baseline performance above and beyond other demographic characteristics (i.e., age, sex, and sport), although it accounted for only a small percentage of variance. Multivariate base rates are presented stratified for age, sex, and ND. CONCLUSIONS: These data provide evidence of higher than normal rates of invalid baselines in athletes who report ND (based on both the standard and novel embedded validity indicators). Although ND accounted for a small percentage of variance in the prediction of invalid performance, negative consequences (e.g., extended time out of sports) of incorrect decision-making should be considered for those with neurodevelopmental conditions. Also, reasons for the overall increase noted here, such as decreased motivation, "sandbagging", or disability-related cognitive deficit, require additional investigation.

Comparing the accuracy and speed of four data-checking methods.

Double entry locates and corrects more data-entry errors than does visual checking or reading the data out loud with a partner. However, many researchers do not use double entry, because it is substantially slower. Therefore, in this study we examined the speed and accuracy of solo read aloud, which has never before been examined and might be faster than double entry. To compare these four methods, we deliberately introduced errors while entering 20 data sheets and then asked 412 randomly assigned undergraduates to locate and correct these errors. Double entry was significantly and substantially more accurate than the other data-checking methods. However, the double-entry participants still made some errors. Close examination revealed that whenever double-entry participants made errors, they made the two sets of entries match, sometimes by introducing new errors into the dataset. This suggests that double entry can be improved by focusing attention on making entries match the original data sheets (rather than each other), perhaps by using a new person for mismatch correction. Solo read aloud was faster than double entry, but not as accurate. Double entry remains the gold standard in data-checking methods. However, solo read aloud was often substantially more accurate than partner read aloud and was more accurate than visual checking for one type of data. Therefore, when double entry is not possible, we recommend that researchers use solo read aloud or visual checking.

Family contributions to sport performance and their utility in predicting appropriate referrals to mental health optimization programmes.

Limited research has examined the contributions of sport-specific family relationship problems to athlete mental health. In the current study we examined the extent to which collegiate athletes' family problems (as measured by the Student Athlete Relationship Instrument factors, SARI) predict athletes' general mental health distress and specific mental health symptoms that are relatively common in athletes (i.e. depression, anxiety, and drug and alcohol use). The study included 85 collegiate athletes (intramural, n = 26; club sport, n = 12; NCAA Division I, n = 47). We hypothesized that both general mental health distress and commonly evidenced mental health symptoms would be predicted by athletes' responses to the SARI factors (Poor Relationship and Lack of Support, General Pressure, Pressure to Quit or Continue Unsafely, Embarrassing Comments, and Negative Attitude). Results indicated that all of the aforementioned SARI factors predicted athletes' ratings of depression and general mental health distress levels. Only the General Pressure SARI factor predicted athletes' anxiety and drug use. Alcohol use was not predicted by any of the SARI factors. Receiver operating characteristic (ROC) analyses indicated that sport-specific problems in family relationships provided a good classification of athletes at risk for general mental health distress, depression, and anxiety. Practice implications are discussed in light of the results.

Factor Structure of the Wechsler Intelligence Scale for Children-Fourth Edition Spanish in a Clinical Sample.

OBJECTIVE: The Wechsler Intelligence Scale for Children-Fourth Edition Spanish (WISC-IV Spanish) is a translation and adaptation of the WISC-IV that is often used in neuropsychological evaluation of children and adolescents with acquired or developmental brain disorders. However, there is limited information on the factor structure of the WISC-IV Spanish when used with clinical populations. To address the potential effects of language and culture on the validity of the WISC-IV Spanish factor structure, this study examined the construct validity of the WISV-IV Spanish scores using confirmatory factor analysis in a clinical sample of Hispanic children with Attention-Deficit/Hyperactivity Disorder (ADHD). METHOD: Participants included 148 children whose primary language was Spanish, who had a primary diagnosis of ADHD, and who had been administered the WISC-IV Spanish as part of a clinical evaluation (mean age = 10.6 years; SD = 2.7). Confirmatory factor analyses were performed to evaluate if the WISC-IV Spanish was best explained by a 1-, 2-, 3-, 4-, or 5-factor model based on the Cattell-Horn-Carroll theory. RESULTS: A 4-factor model composed of verbal comprehension, perceptual reasoning, working memory, and processing speed factors provided the best fit for the data (comparative fit index = .95; root mean square error of approximation = .06). CONCLUSIONS: Findings for children with ADHD and LD support interpretation of WISC-IV Spanish Index scores based on the 4-factor model identified in Spanish- and English-speaking normative samples. Additional research with understudied clinical populations is warranted to address gaps in cross-cultural research.

The Latent Structure of Negative Symptoms in Schizophrenia.

Importance: Negative symptoms are associated with a range of poor clinical outcomes, and currently available treatments generally do not produce a clinically meaningful response. Limited treatment progress may be owing in part to poor clarity regarding latent structure. Prior studies have inferred latent structure using exploratory factor analysis, which has led to the conclusion that there are 2 dimensions reflecting motivation and pleasure (MAP) and diminished expressivity (EXP) factors. However, whether these conclusions are statistically justified remains unclear because exploratory factor analysis does not test latent structure. Confirmatory factor analysis (CFA) is needed to test competing models regarding the latent structure of a construct. Objective: To evaluate the fit of 4 models of the latent structure of negative symptoms in schizophrenia using CFA. Design, Setting, and Participants: Three cross-sectional studies were conducted on outpatients with schizophrenia who were rated on the 3 most conceptually contemporary measures: Scale for the Assessment of Negative Symptoms (SANS), Brief Negative Symptom Scale (BNSS), and Clinical Assessment Interview for Negative Symptoms (CAINS). Confirmatory factor analysis evaluated the following 4 models: (1) a 1-factor model; (2) a 2-factor model with EXP and MAP factors; (3) a 5-factor model with separate factors for the 5 domains of the National Institute of Mental Health consensus development conference (blunted affect, alogia, anhedonia, avolition, and asociality); and (4) a hierarchical model with 2 second-order factors reflecting EXP and MAP and 5 first-order factors reflecting the 5 consensus domains. Main Outcomes and Measures: Outcomes included CFA model fit statistics derived from symptom severity scores on the SANS, BNSS, and CAINS. Results: The study population included 860 outpatients with schizophrenia (68.0% male; mean [SD] age, 43.0 [11.4] years). Confirmatory factor analysis was conducted on each scale, including 268 patients for the SANS, 192 for the BNSS, and 400 for the CAINS. The 1- and 2-factor models provided poor fit for the SANS, BNSS, and CAINS as indicated by comparative fit indexes (CFIs) and Tucker Lewis indexes (TLIs) less than 0.950, RMSEAs that exceeded the 0.080 threshold, and WRMRs greater than 1.00. The 5-factor and hierarchical models provided excellent fit, with the 5-factor model being more parsimonious. The CFIs and TLIs met the 0.95 threshold and the 1.00 threshold for both factor models with all 3 measures. Interestingly, the RMSEAs for the 5-factor model and the hierarchical model fell under the 0.08 threshold for the BNSS and the CAINS but not the SANS. Conclusions and Relevance: These findings suggest that the recent trend toward conceptualizing the latent structure of negative symptoms as 2 distinct dimensions does not adequately capture the complexity of the construct. The latent structure of negative symptoms is best conceptualized in relation to the 5 consensus domains. Implications for identifying pathophysiological mechanisms and targeted treatments are discussed.

Eating Disorder Quality of Life Scale (EDQLS) in ethnically diverse college women: an exploratory factor analysis.

BACKGROUND: Extant research suggests that disordered eating is common in college women and is associated with decreased quality of life. The Eating Disorder Quality of Life Scale (EDQLS) examines impairment to disordered eating-related quality of life, but has not been validated in college women. Accordingly, the purpose of this study was to examine the reliability, validity, and factor structure of the EDQLS in a diverse sample of 971 college women. METHOD: Students from a large United States university completed questionnaires examining disordered eating and the EDQLS online. RESULTS: The EDQLS demonstrated excellent internal consistency and good convergent validity with the Eating Disorder Examination Questionnaire (EDEQ). Contrary to the original 12-domain design of the EDQLS, principal component analyses suggested five factors that mapped onto the following constructs: (1) Positive Emotionality; (2) Body/Weight Dissatisfaction; (3) Disordered Eating Behaviors; (4) Negative Emotionality; and (5) Social Engagement. However, 15 of the 40 items loaded onto multiple factors. CONCLUSIONS: Total scores on the EDQLS are reliable and valid when used with diverse samples of college women, but some revisions are needed to create subscales than can justifiably be used in clinical practice.

Computer Scoring of Emotional Awareness in a Nonclinical Population of Young Adults.

The Levels of Emotional Awareness Scale (LEAS; Lane, Quinlan, Schwartz, Walker, & Zeitlin, 1990 ) is an open-ended measure of the ability to describe emotional reactions. Scoring the LEAS by hand is complex and time consuming (Barchard, Bajgar, Leaf, & Lane, 2010 ). Therefore, Program for Open-Ended Scoring (POES; Leaf & Barchard, 2010 ) was designed to score the LEAS quickly and easily. Using 268 undergraduates, this article compares traditional LEAS hand scoring to 6 POES methods, 2 of which are holistic methods that have never before been examined. Based on split-half reliability, correlations with measures of emotional and social intelligence, and partial correlations once response length and vocabulary were partialed out, we recommend 3 of the POES methods when testing nonclinical samples of young adults. Because POES scoring is fast and efficient, it allows more researchers and clinicians to use the LEAS, thus moving away from self-report measures of emotional awareness.

Equivalence of mother and father ratings of ADHD in children.

Obtaining data from multiple informants provides a more comprehensive diagnostic picture in the assessment of attention deficit hyperactivity disorder (ADHD). Differences in symptom ratings have been observed between parent- and teacher-report scales, though less information is available regarding differences between mothers and fathers. To address this gap, this study examines the rater agreement between mothers and fathers on the Diagnostic and Statistical Manual of Mental Disorders - Fourth Edition (DSM-IV) ADHD Symptom Rating Scale (DSM-ADHD-SRS). The participants consisted of 337 children diagnosed with ADHD who underwent comprehensive neuropsychological assessment. Confirmatory factor analysis indicates that a three-factor model comprising inattention, hyperactivity, and impulsivity symptoms provides the best fit for both mothers' and fathers' ratings. Mothers provided higher mean ratings for the inattention scale. These results suggest that the factor structure for the DSM-ADHD-SRS is the same, regardless of parent gender. However, symptoms of inattention may vary depending upon which parent completes the ratings. This discrepancy could lead to differences in diagnostic impressions in clinical evaluations.

Examination of the Extent to which Employment Factors are Associated with Reduced Child Maltreatment Potential and Drug Use.

Job assistance programs are commonly recommended for parents of children who have been victimized by child maltreatment, particularly when illicit drugs are indicated. However, the relationship between employment factors, substance abuse and risk of child maltreatment has received limited empirical attention. Therefore, the current study examines employment factors in a sample of 72 mothers who were referred by Child Protective Services (CPS) for treatment of substance abuse and child neglect. Child maltreatment potential was found to be negatively associated with number of hours employed and self-reported happiness with employment. The association between child abuse potential and personal income of participants approached significance (p = .057), and the results were not influenced by social desirability. Employment satisfaction significantly contributed to the prediction of child maltreatment potential over and above other employment factors and control variables. These findings suggest that when mothers are involved in CPS their risk of perpetrating child maltreatment may be reduced when they are assisted in gainful employment that is personally satisfying. Happiness with employment was the only employment factor correlated (inversely) with substance use (biological testing, self-report of participants). Future directions are discussed in light of the results, including the importance of considering employment satisfaction when conducting vocational assistance programs in this population.

Is sadness blue? The problem of using figurative language for emotions on psychological tests.

Psychological tests sometimes include figurative language like I feel blue. However, figurative language may not mean the same thing cross-culturally. Previous research found cross-cultural evidence for 14 conceptual metaphors and metonymies for emotions (e.g., sadness is blue). Our two studies asked participants (total n = 795) in the USA and India whether happiness, sadness, anger, and fear are associated with certain descriptors (blue, down, bright, etc.). Most participants in both countries endorsed ten of the 14 hypothesized associations; however, the percentage of participants endorsing an association was often far from 100 %. For example, in the USA, only 71.7 % associated hot with anger and only 65.9 % associated blue with sadness. Moreover, descriptors were often associated with more than one emotion. Furthermore, only two associations (happiness is up and bright) were endorsed by more than 90 % of participants in both countries and had descriptors that were not associated with additional emotions. We conclude that figurative language is often ambiguous and should be used with caution on psychological tests unless there is evidence the language is understood cross-culturally. Advice to this effect is currently lacking from psychometrics textbooks and should be added.

Internal Consistency and Power When Comparing Total Scores from Two Groups.

Researchers now know that when theoretical reliability increases, power can increase, decrease, or stay the same. However, no analytic research has examined the relationship of power to the most commonly used type of reliability-internal consistency-and the most commonly used measures of internal consistency, coefficient alpha and ICC(A,k). We examine the relationship between the power of independent samples t tests and internal consistency. We explicate the mathematical model upon which researchers usually calculate internal consistency, one in which total scores are calculated as the sum of observed scores on K measures. Using this model, we derive a new formula for effect size to show that power and internal consistency are influenced by many of the same parameters but not always in the same direction. Changing an experiment in one way (e.g., lengthening the measure) is likely to influence multiple parameters simultaneously; thus, there are no simple relationships between such changes and internal consistency or power. If researchers revise measures to increase internal consistency, this might not increase power. To increase power, researchers should increase sample size, select measures that assess areas where group differences are largest, and use more powerful statistical procedures (e.g., ANCOVA).

Factor structure of symptom dimensions in attention-deficit/hyperactivity disorder (ADHD).

There is disagreement on whether attention-deficit/hyperactivity disorder (ADHD) symptoms are best characterized along two dimensions consisting of inattention and hyperactivity/impulsivity or three dimensions where hyperactivity and impulsivity are separate. To address this, the current study investigated the underlying symptom dimensions of ADHD by examining two- and three-factor models of ADHD symptom ratings in 400 children and adolescents diagnosed with ADHD. ADHD symptom ratings for each of the 18 DSM-IV Criteria A symptoms were obtained from mothers using a standardized symptom rating scale. Confirmatory factor analysis (CFA) was used to examine whether the 18 symptoms were best explained by two or three latent constructs. Results of the CFA demonstrated that a three-factor model was superior to a two-factor model. Findings support three distinct symptom dimensions that are consistent with previous research demonstrating unique clinical presentations of inattention, hyperactivity, and impulsivity. Differentiating between these three domains may aid in predicting behavioral outcomes in children with ADHD.