ABSTRACT
Failures to replicate evidence of new discoveries have forced scientists to ask whether this unreliability is due to suboptimal implementation of methods or whether presumptively optimal methods are not, in fact, optimal. This paper reports an investigation by four coordinated laboratories of the prospective replicability of 16 novel experimental findings using rigour-enhancing practices: confirmatory tests, large sample sizes, preregistration and methodological transparency. In contrast to past systematic replication efforts that reported replication rates averaging 50%, replication attempts here produced the expected effects with significance testing (P < 0.05) in 86% of attempts, slightly exceeding the maximum expected replicability based on observed effect sizes and sample sizes. When one lab attempted to replicate an effect discovered by another lab, the effect size in the replications was 97% that in the original study. This high replication rate justifies confidence in rigour-enhancing methods to increase the replicability of new discoveries.
Subject(s)
Research Design , Social Behavior , Humans , Prospective Studies , Reproducibility of Results , Sample SizeABSTRACT
Postelection surveys regularly overestimate voter turnout by 10 points or more. This article provides the first comprehensive documentation of the turnout gap in three major ongoing surveys (the General Social Survey, Current Population Survey, and American National Election Studies), evaluates explanations for it, interprets its significance, and suggests means to continue evaluating and improving survey measurements of turnout. Accuracy was greater in face-to-face than telephone interviews, consistent with the notion that the former mode engages more respondent effort with less social desirability bias. Accuracy was greater when respondents were asked about the most recent election, consistent with the hypothesis that forgetting creates errors. Question wordings designed to minimize source confusion and social desirability bias improved accuracy. Rates of reported turnout were lower with proxy reports than with self-reports, which may suggest greater accuracy of proxy reports. People who do not vote are less likely to participate in surveys than voters are.
Subject(s)
Disasters/prevention & control , Environmental Restoration and Remediation/economics , Petroleum Pollution/prevention & control , Water Pollution, Chemical/prevention & control , Disasters/economics , Gulf of Mexico , Humans , Petroleum Pollution/economics , Surveys and Questionnaires , Taxes , Water Pollution, Chemical/economicsABSTRACT
This study examined the relationship between scores on field dependence and field independence and sensory learning preference, cognitive learning style, personality, interpersonal trust, attributions of responsibility for solving social problems, and attitudes regarding citizenship among youth. Participants were 72 private school students in Grades 6 through 12 (26 girls, 46 boys; M age: 15.2 yr., SD=1.9). When controlling for grade and sex, field independence (measured by Group Embedded Figures Test scores) was associated with Intuitive Thinking personality, Concrete lobal learning style, and rejection of individual responsibility for social problems, relative to governmental and community responsibility. Associations with other aspects of learning style fell short of significance. No association was found with generalized trust or citizenship attitudes. Reassessment of these variables with a larger sample should be undertaken.