ABSTRACT
Introduction: A problem that applied researchers and practitioners often face is the fact that different institutions within research consortia use different scales to evaluate the same construct which makes comparison of the results and pooling challenging. In order to meaningfully pool and compare the scores, the scales should be harmonized. The aim of this paper is to use different test equating methods to harmonize the ADHD scores from Child Behavior Checklist (CBCL) and Strengths and Difficulties Questionnaire (SDQ) and to see which method leads to the result. Methods: Sample consists of 1551 parent reports of children aged 10-11.5 years from Raine study on both CBCL and SDQ (common persons design). We used linear equating, kernel equating, Item Response Theory (IRT), and the following machine learning methods: regression (linear and ordinal), random forest (regression and classification) and Support Vector Machine (regression and classification). Efficacy of the methods is operationalized in terms of the root-mean-square error (RMSE) of differences between predicted and observed scores in cross-validation. Results and discussion: Results showed that with single group design, it is the best to use the methods that use item level information and that treat the outcome as interval measurement level (regression approach).
ABSTRACT
Although earlier research has shown that individual differences on the spectrum of attention deficit hyperactivity disorder (ADHD) are highly heritable, emerging evidence suggests that symptoms are associated with complex interactions between genes and environmental influences. This study investigated whether a genetic predisposition [Note that the term 'genetic predisposition' was used in this manuscript to refer to an estimate based on twin modeling (an individual's score on the latent trait that resembles additive genetic influences) in the particular population being examined.] for the symptom dimensions hyperactivity and inattention determines the extent to which unique-environmental influences explain variability in these symptoms. To this purpose, we analysed a sample drawn from the Twins Early Development Study (TEDS) that consisted of item-level scores of 2168 16-year-old twin pairs who completed both the Strengths and Difficulties Questionnaire (SDQ; Goodman, in J Child Psychol Psychiatry 38:581-586, 1997) and the Strength and Weaknesses of ADHD Symptoms and Normal Behavior (SWAN; Swanson, in Paper presented at the meeting of the American Psychological Association, Los Angeles, 1981) questionnaire. To maximize the psychometric information to measure ADHD symptoms, psychometric analyses were performed to investigate whether the items from the two questionnaires could be combined to form two longer subscales. In the estimation of genotype-environment interaction, we corrected for error variance heterogeneity in the measurement of ADHD symptoms through the application of item response theory (IRT) measurement models. A positive interaction was found for both hyperactivity (e.g., [Formula: see text] = 2.20 with 95% highest posterior density interval equal to [1.79;2.65] and effect size equal to 3.00) and inattention (e.g., [Formula: see text] = 2.16 with 95% highest posterior density interval equal to [1.56;2.79] and effect size equal to 3.07). These results indicate that unique-environmental influences were more important in creating individual differences in both hyperactivity and inattention for twins with a genetic predisposition for these symptoms than for twins without such a predisposition.
Subject(s)
Attention Deficit Disorder with Hyperactivity , Gene-Environment Interaction , Humans , Attention Deficit Disorder with Hyperactivity/genetics , Attention Deficit Disorder with Hyperactivity/diagnosis , Diseases in Twins/genetics , Genetic Predisposition to Disease/genetics , Twins/genetics , AdolescentABSTRACT
The Roadmap for Mental Health and Wellbeing Research in Europe (ROAMER) identified child and adolescent mental illness as a priority area for research. CAPICE (Childhood and Adolescence Psychopathology: unravelling the complex etiology by a large Interdisciplinary Collaboration in Europe) is a European Union (EU) funded training network aimed at investigating the causes of individual differences in common childhood and adolescent psychopathology, especially depression, anxiety, and attention deficit hyperactivity disorder. CAPICE brings together eight birth and childhood cohorts as well as other cohorts from the EArly Genetics and Life course Epidemiology (EAGLE) consortium, including twin cohorts, with unique longitudinal data on environmental exposures and mental health problems, and genetic data on participants. Here we describe the objectives, summarize the methodological approaches and initial results, and present the dissemination strategy of the CAPICE network. Besides identifying genetic and epigenetic variants associated with these phenotypes, analyses have been performed to shed light on the role of genetic factors and the interplay with the environment in influencing the persistence of symptoms across the lifespan. Data harmonization and building an advanced data catalogue are also part of the work plan. Findings will be disseminated to non-academic parties, in close collaboration with the Global Alliance of Mental Illness Advocacy Networks-Europe (GAMIAN-Europe).
Subject(s)
Anxiety Disorders , Attention Deficit Disorder with Hyperactivity , Adolescent , Anxiety , Anxiety Disorders/epidemiology , Attention Deficit Disorder with Hyperactivity/psychology , Child , European Union , Humans , Longitudinal StudiesABSTRACT
This article introduces a new hybrid intake procedure developed for posttraumatic stress disorder (PTSD) screening, which combines an automated textual assessment of respondents' self-narratives and item-based measures that are administered consequently. Text mining technique and item response modeling were used to analyze long constructed response (i.e., self-narratives) and responses to standardized questionnaires (i.e., multiple choices), respectively. The whole procedure is combined in a Bayesian framework where the textual assessment functions as prior information for the estimation of the PTSD latent trait. The purpose of this study is twofold: first, to investigate whether the combination model of textual analysis and item-based scaling could enhance the classification accuracy of PTSD, and second, to examine whether the standard error of estimates could be reduced through the use of the narrative as a sort of routing test. With the sample at hand, the combination model resulted in a reduction in the misclassification rate, as well as a decrease of standard error of latent trait estimation. These findings highlight the benefits of combining textual assessment and item-based measures in a psychiatric screening process. We conclude that the hybrid test design is a promising approach to increase test efficiency and is expected to be applicable in a broader scope of educational and psychological measurement in the future.
ABSTRACT
For the participants in the Netherlands Twin Register (NTR) we constructed the extended pedigrees which specify all relations among nuclear and larger twin families in the register. A total of 253,015 subjects from 58,645 families were linked to each other, to the degree that we had information on the relations among participants. We describe the algorithm that was applied to construct the pedigrees. For > 30,000 adolescent and adult NTR participants data were available on harmonized neuroticism scores. We analyzed these data in the Mendel software package (Lange et al., Bioinformatics 29(12):1568-1570, 2013) to estimate the contributions of additive and non-additive genetic factors. In contrast to much of the earlier work based on twin data rather than on extended pedigrees, we could also estimate the contribution of shared household effects in the presence of non-additive genetic factors. The estimated broad-sense heritability of neuroticism was 47%, with almost equal contributions of additive and non-additive (dominance) genetic factors. A shared household effect explained 13% and unique environmental factors explained the remaining 40% of the variance in neuroticism.
Subject(s)
Diseases in Twins/genetics , Neuroticism/physiology , Twins/genetics , Family/psychology , Female , Humans , Male , Models, Genetic , Netherlands/epidemiology , Pedigree , Registries , Social Environment , Twins, Dizygotic/genetics , Twins, Monozygotic/geneticsABSTRACT
Genotype by environment interaction in behavioral traits may be assessed by estimating the proportion of variance that is explained by genetic and environmental influences conditional on a measured moderating variable, such as a known environmental exposure. Behavioral traits of interest are often measured by questionnaires and analyzed as sum scores on the items. However, statistical results on genotype by environment interaction based on sum scores can be biased due to the properties of a scale. This article presents a method that makes it possible to analyze the actually observed (phenotypic) item data rather than a sum score by simultaneously estimating the genetic model and an item response theory (IRT) model. In the proposed model, the estimation of genotype by environment interaction is based on an alternative parametrization that is uniquely identified and therefore to be preferred over standard parametrizations. A simulation study shows good performance of our method compared to analyzing sum scores in terms of bias. Next, we analyzed data of 2,110 12-year-old Dutch twin pairs on mathematical ability. Genetic models were evaluated and genetic and environmental variance components estimated as a function of a family's socio-economic status (SES). Results suggested that common environmental influences are less important in creating individual differences in mathematical ability in families with a high SES than in creating individual differences in mathematical ability in twin pairs with a low or average SES.
Subject(s)
Gene-Environment Interaction , Genotype , Mathematics , Twins/genetics , Child , Female , Humans , Male , Social Class , Surveys and Questionnaires , WorkforceABSTRACT
As for most phenotypes, the amount of variance in educational achievement explained by SNPs is lower than the amount of additive genetic variance estimated in twin studies. Twin-based estimates may however be biased because of self-selection and differences in cognitive ability between twins and the rest of the population. Here we compare twin registry based estimates with a census-based heritability estimate, sampling from the same Dutch birth cohort population and using the same standardized measure for educational achievement. Including important covariates (i.e., sex, migration status, school denomination, SES, and group size), we analyzed 893,127 scores from primary school children from the years 2008-2014. For genetic inference, we used pedigree information to construct an additive genetic relationship matrix. Corrected for the covariates, this resulted in an estimate of 85%, which is even higher than based on twin studies using the same cohort and same measure. We therefore conclude that the genetic variance not tagged by SNPs is not an artifact of the twin method itself.
ABSTRACT
Model comparisons in the behavioral sciences often aim at selecting the model that best describes the structure in the population. Model selection is usually based on fit indices such as AIC or BIC, and inference is done based on the selected best-fitting model. This practice does not account for the possibility that due to sampling variability, a different model might be selected as the preferred model in a new sample from the same population. A previous study illustrated a bootstrap approach to gauge this model selection uncertainty using two empirical examples. The current study consists of a series of simulations to assess the utility of the proposed bootstrap approach in multi-group and mixture model comparisons. These simulations show that bootstrap selection rates can provide additional information over and above simply relying on the size of AIC and BIC differences in a given sample.
ABSTRACT
Extraversion is a relatively stable and heritable personality trait associated with numerous psychosocial, lifestyle and health outcomes. Despite its substantial heritability, no genetic variants have been detected in previous genome-wide association (GWA) studies, which may be due to relatively small sample sizes of those studies. Here, we report on a large meta-analysis of GWA studies for extraversion in 63,030 subjects in 29 cohorts. Extraversion item data from multiple personality inventories were harmonized across inventories and cohorts. No genome-wide significant associations were found at the single nucleotide polymorphism (SNP) level but there was one significant hit at the gene level for a long non-coding RNA site (LOC101928162). Genome-wide complex trait analysis in two large cohorts showed that the additive variance explained by common SNPs was not significantly different from zero, but polygenic risk scores, weighted using linkage information, significantly predicted extraversion scores in an independent cohort. These results show that extraversion is a highly polygenic personality trait, with an architecture possibly different from other complex human traits, including other personality traits. Future studies are required to further determine which genetic variants, by what modes of gene action, constitute the heritable nature of extraversion.
Subject(s)
Extraversion, Psychological , Genome-Wide Association Study , Personality/genetics , Cohort Studies , Humans , Multifactorial Inheritance/genetics , Polymorphism, Single Nucleotide/genetics , Risk FactorsABSTRACT
The Wilson-Patterson conservatism scale was psychometrically evaluated using homogeneity analysis and item response theory models. Results showed that this scale actually measures two different aspects in people: on the one hand people vary in their agreement with either conservative or liberal catch-phrases and on the other hand people vary in their use of the "?" response category of the scale. A 9-item subscale was constructed, consisting of items that seemed to measure liberalism, and this subscale was subsequently used in a biometric analysis including genotype-environment interaction, correcting for non-homogeneous measurement error. Biometric results showed significant genetic and shared environmental influences, and significant genotype-environment interaction effects, suggesting that individuals with a genetic predisposition for conservatism show more non-shared variance but less shared variance than individuals with a genetic predisposition for liberalism.
Subject(s)
Culture , Models, Genetic , Politics , Psychometrics/methods , Adolescent , Adult , Aged , Aged, 80 and over , Humans , Middle Aged , Young AdultABSTRACT
OBJECTIVE: The present research addresses the question of how trust in systems is formed when unequivocal information about system accuracy and reliability is absent, and focuses on the interaction of indirect information (others' evaluations) and direct (experiential) information stemming from the interaction process. BACKGROUND: Trust in decision-supporting technology, such as route planners, is important for satisfactory user interactions. Little is known, however, about trust formation in the absence of outcome feedback, that is, when users have not yet had opportunity to verify actual outcomes. METHOD: Three experiments manipulated others' evaluations ("endorsement cues") and various forms of experience-based information ("process feedback") in interactions with a route planner and measured resulting trust using rating scales and credits staked on the outcome. Subsequently, an overall analysis was conducted. RESULTS: Study 1 showed that effectiveness of endorsement cues on trust is moderated by mere process feedback. In Study 2, consistent (i.e., nonrandom) process feedback overruled the effect of endorsement cues on trust, whereas inconsistent process feedback did not. Study 3 showed that although the effects of consistent and inconsistent process feedback largely remained regardless of face validity, high face validity in process feedback caused higher trust than those with low face validity. An overall analysis confirmed these findings. CONCLUSION: Experiential information impacts trust even if outcome feedback is not available, and, moreover, overrules indirect trust cues-depending on the nature of the former. APPLICATION: Designing systems so that they allow novice users to make inferences about their inner workings may foster initial trust.
Subject(s)
Attitude , Ergonomics , Feedback , Technology , Trust , Female , Humans , MaleABSTRACT
IMPORTANCE: Neuroticism is a pervasive risk factor for psychiatric conditions. It genetically overlaps with major depressive disorder (MDD) and is therefore an important phenotype for psychiatric genetics. The Genetics of Personality Consortium has created a resource for genome-wide association analyses of personality traits in more than 63,000 participants (including MDD cases). OBJECTIVES: To identify genetic variants associated with neuroticism by performing a meta-analysis of genome-wide association results based on 1000 Genomes imputation; to evaluate whether common genetic variants as assessed by single-nucleotide polymorphisms (SNPs) explain variation in neuroticism by estimating SNP-based heritability; and to examine whether SNPs that predict neuroticism also predict MDD. DESIGN, SETTING, AND PARTICIPANTS: Genome-wide association meta-analysis of 30 cohorts with genome-wide genotype, personality, and MDD data from the Genetics of Personality Consortium. The study included 63,661 participants from 29 discovery cohorts and 9786 participants from a replication cohort. Participants came from Europe, the United States, or Australia. Analyses were conducted between 2012 and 2014. MAIN OUTCOMES AND MEASURES: Neuroticism scores harmonized across all 29 discovery cohorts by item response theory analysis, and clinical MDD case-control status in 2 of the cohorts. RESULTS: A genome-wide significant SNP was found on 3p14 in MAGI1 (rs35855737; P = 9.26 × 10-9 in the discovery meta-analysis). This association was not replicated (P = .32), but the SNP was still genome-wide significant in the meta-analysis of all 30 cohorts (P = 2.38 × 10-8). Common genetic variants explain 15% of the variance in neuroticism. Polygenic scores based on the meta-analysis of neuroticism in 27 cohorts significantly predicted neuroticism (1.09 × 10-12 < P < .05) and MDD (4.02 × 10-9 < P < .05) in the 2 other cohorts. CONCLUSIONS AND RELEVANCE: This study identifies a novel locus for neuroticism. The variant is located in a known gene that has been associated with bipolar disorder and schizophrenia in previous studies. In addition, the study shows that neuroticism is influenced by many genetic variants of small effect that are either common or tagged by common variants. These genetic variants also influence MDD. Future studies should confirm the role of the MAGI1 locus for neuroticism and further investigate the association of MAGI1 and the polygenic association to a range of other psychiatric disorders that are phenotypically correlated with neuroticism.
Subject(s)
Anxiety Disorders/genetics , Cell Adhesion Molecules, Neuronal/genetics , Depressive Disorder, Major/genetics , Personality/genetics , Adaptor Proteins, Signal Transducing , Anxiety Disorders/psychology , Cell Adhesion Molecules , Depressive Disorder, Major/psychology , Genetic Predisposition to Disease , Genome-Wide Association Study , Guanylate Kinases , Humans , Multifactorial Inheritance , Neuroticism , Polymorphism, Single Nucleotide , Risk FactorsABSTRACT
Mega- or meta-analytic studies (e.g. genome-wide association studies) are increasingly used in behavior genetics. An issue in such studies is that phenotypes are often measured by different instruments across study cohorts, requiring harmonization of measures so that more powerful fixed effect meta-analyses can be employed. Within the Genetics of Personality Consortium, we demonstrate for two clinically relevant personality traits, Neuroticism and Extraversion, how Item-Response Theory (IRT) can be applied to map item data from different inventories to the same underlying constructs. Personality item data were analyzed in >160,000 individuals from 23 cohorts across Europe, USA and Australia in which Neuroticism and Extraversion were assessed by nine different personality inventories. Results showed that harmonization was very successful for most personality inventories and moderately successful for some. Neuroticism and Extraversion inventories were largely measurement invariant across cohorts, in particular when comparing cohorts from countries where the same language is spoken. The IRT-based scores for Neuroticism and Extraversion were heritable (48 and 49 %, respectively, based on a meta-analysis of six twin cohorts, total N = 29,496 and 29,501 twin pairs, respectively) with a significant part of the heritability due to non-additive genetic factors. For Extraversion, these genetic factors qualitatively differ across sexes. We showed that our IRT method can lead to a large increase in sample size and therefore statistical power. The IRT approach may be applied to any mega- or meta-analytic study in which item-based behavioral measures need to be harmonized.
Subject(s)
Models, Statistical , Personality Assessment , Personality/genetics , Anxiety Disorders/genetics , Extraversion, Psychological , Genome-Wide Association Study , Humans , Neuroticism , PhenotypeABSTRACT
The heritability of variety seeking in the food domain was estimated from a large sample (N = 5,543) of middle age to elderly monozygotic and dizygotic twins from the "Virginia 30,000" twin study. Different dietary variety scores were calculated based on a semi-quantitative food choice questionnaire that assessed consumption frequencies and quantities for a list of 99 common foods. Results indicate that up to 30% of the observed variance in dietary variety was explained through heritable influences. Most of the differences between twins were due to environmental influences that are not shared between twins. Additional non-genetic analyses further revealed a weak relationship between dietary variety and particular demographic variables, including socioeconomic status, age, sex, religious faith, and the number of people living in the same household.
Subject(s)
Diet , Environment , Feeding Behavior , Twins, Dizygotic , Twins, Monozygotic , Adult , Aged , Female , Humans , Male , Middle Aged , VirginiaABSTRACT
Considerable effort has been devoted to establish genotype by environment interaction (G x E) in case of unmeasured genetic and environmental influences. Although it has been outlined by various authors that the appearance of G x E can be dependent on properties of the given measurement scale, a non-biased method to assess G x E is still lacking. We show that the incorporation of an explicit measurement model can remedy potential bias due to ceiling and floor effects. By means of a simulation study it is shown that the use of sum scores can lead to biased estimates whereas the proposed method is unbiased. The power of the suggested method is illustrated by means of a second simulation study with different sample sizes and G x E effect sizes.
Subject(s)
Gene-Environment Interaction , Models, Genetic , Computer Simulation , HumansABSTRACT
This study investigated psychometric properties of two widely used instruments to measure subclinical levels of psychosis, the Community Assessment of Psychic Experiences (CAPE) and the Structured Interview for Schizotypy-Revised (SIS-R), and aimed to enhance measurements through the use of multidimensional measurement models. Data were collected in 747 siblings of schizophrenia patients and 341 healthy controls. Multidimensional Item-Response Theory, Mokken Scale and ordinal factor analyses were performed. Both instruments showed good psychometric properties and were measurement invariant across siblings and controls. The latent traits measured by the instruments show a correlation of 0.62 in siblings and 0.47 in controls. Multidimensional modeling resulted in smaller standard errors for SIS-R scores. By exploiting correlations among related traits through multidimensional models, scores from one diagnostic instrument can be estimated more reliably by making use of information from instruments that measure related traits.
Subject(s)
Judgment/physiology , Models, Statistical , Psychometrics , Schizotypal Personality Disorder , Self Report , Adolescent , Adult , Factor Analysis, Statistical , Female , Humans , Male , Middle Aged , Psychiatric Status Rating Scales , Schizotypal Personality Disorder/diagnosis , Schizotypal Personality Disorder/physiopathology , Schizotypal Personality Disorder/psychology , Surveys and Questionnaires , Young AdultABSTRACT
As data from sequencing studies in humans accumulate, rare genetic variants influencing liability to disease and disorders are expected to be identified. Three simulation studies show that characteristics and properties of diagnostic instruments interact with risk allele frequency to affect the power to detect a quantitative trait locus (QTL) based on a test score derived from symptom counts or questionnaire items. Clinical tests, that is, tests that show a positively skewed phenotypic sum score distribution in the general population, are optimal to find rare risk alleles of large effect. Tests that show a negatively skewed sum score distribution are optimal to find rare protective alleles of large effect. For alleles of small effect, tests with normally distributed item parameters give best power for a wide range of allele frequencies. The item-response theory framework can help understand why an existing measurement instrument has more power to detect risk alleles with either low or high frequency, or both kinds.
Subject(s)
Alleles , Gene Frequency/genetics , Genetic Predisposition to Disease/genetics , Genome-Wide Association Study , Phenotype , Quantitative Trait Loci/genetics , Case-Control Studies , Genetic Variation , Genome-Wide Association Study/methods , Humans , Models, Genetic , Research DesignABSTRACT
Twin concordance rates provide insight into the possibility of a genetic background for a disease. These concordance rates are usually estimated within a frequentistic framework. Here we take a Bayesian approach. For rare diseases, estimation methods based on asymptotic theory cannot be applied due to very low cell probabilities. Moreover, a Bayesian approach allows a straightforward incorporation of prior information on disease prevalence coming from non-twin studies that is often available. An MCMC estimation procedure is tested using simulation and contrasted with frequentistic analyses. The Bayesian method is able to include prior information on both concordance rates and prevalence rates at the same time and is illustrated using twin data on cleft lip and rheumatoid arthritis.
Subject(s)
Rare Diseases/genetics , Twins/genetics , Algorithms , Arthritis, Rheumatoid/epidemiology , Arthritis, Rheumatoid/genetics , Bayes Theorem , Cleft Lip/epidemiology , Cleft Lip/genetics , Cluster Analysis , Family , Humans , Models, Statistical , Prevalence , Rare Diseases/epidemiologyABSTRACT
Relatively little is known about how genetic influences on alcohol abuse and dependence (AAD) change with age. We examined the change in influence of genetic and environmental factors which explain symptoms of AAD from adolescence into early adulthood. Symptoms of AAD were assessed using the four AAD screening questions of the CAGE inventory. Data were obtained up to six times by self-report questionnaires for 8,398 twins from the Netherlands Twin Register aged between 15 and 32 years. Longitudinal genetic simplex modeling was performed with Mx. Results showed that shared environmental influences were present for age 15-17 (57%) and age 18-20 (18%). Unique environmental influences gained importance over time, contributing 15% of the variance at age 15-17 and 48% at age 30-32. At younger ages, unique environmental influences were largely age-specific, while at later ages, age-specific influences became less important. Genetic influences on AAD symptoms over age could be accounted for by one factor, with the relative influence of this factor differing across ages. Genetic influences increased from 28% at age 15-17 to 58% at age 21-23 and remained high in magnitude thereafter. These results are in line with a developmentally stable hypothesis that predicts that a single set of genetic risk factors acts on symptoms of AAD from adolescence into young adulthood.
Subject(s)
Alcoholism/genetics , Adolescent , Adult , Alcoholism/diagnosis , Algorithms , Cross-Sectional Studies , Diseases in Twins , Environment , Female , Genetics, Behavioral/methods , Humans , Longitudinal Studies , Male , Models, Genetic , Netherlands , Registries , Sex Factors , Surveys and QuestionnairesABSTRACT
The extent to which verbal (VM) and visuospatial memory (VSM) tests measure the same or multiple constructs is unclear. Likewise the relationship between VM and VSM across development is not known. These questions are addressed using genetically informative data, studying two age cohorts (young adults and children) of twins and siblings. VM and VSM were measured in the working memory and short-term memory domain. Multivariate genetic analyses revealed that two highly correlated common genetic factors, one for VM and one for VSM, gave the best description of the covariance structure among the measures. Only in children, specific genetic factors were also present. This led to the following conclusions: In children, one genetic factor is responsible for linking VM and VSM. Specific genetic factors create differences between these two domains. During the course of development, the influence of genetic factors unique to each of these domains disappears and the genetic factor develops into two highly correlated factors, which are specific to VM and VSM respectively. At the environmental level, in both age cohorts, environmental factors create differences between these domains.