Protecting the integrity of survey research.

Although polling is not irredeemably broken, changes in technology and society create challenges that, if not addressed well, can threaten the quality of election polls and other important surveys on topics such as the economy. This essay describes some of these challenges and recommends remediations to protect the integrity of all kinds of survey research, including election polls. These 12 recommendations specify ways that survey researchers, and those who use polls and other public-oriented surveys, can increase the accuracy and trustworthiness of their data and analyses. Many of these recommendations align practice with the scientific norms of transparency, clarity, and self-correction. The transparency recommendations focus on improving disclosure of factors that affect the nature and quality of survey data. The clarity recommendations call for more precise use of terms such as "representative sample" and clear description of survey attributes that can affect accuracy. The recommendation about correcting the record urges the creation of a publicly available, professionally curated archive of identified technical problems and their remedies. The paper also calls for development of better benchmarks and for additional research on the effects of panel conditioning. Finally, the authors suggest ways to help people who want to use or learn from survey research understand the strengths and limitations of surveys and distinguish legitimate and problematic uses of these methods.

The National Sleep Foundation's Sleep Satisfaction Tool.

OBJECTIVES: The National Sleep Foundation (NSF) sought to test, refine, and add statistical rigor to its previously described provisional Sleep Satisfaction Tool (SST). The tool assesses the general population's sleep satisfaction. DESIGN: In 2017, NSF created a provisional tool through systematic literature review and an expert consensus panel process. This tool was expanded, refined, and tested through an open-ended survey, 2 rounds of cognitive testing, and a national survey of a random sample of Internet users (aged 18-90). Factor analysis and final consensus panel voting produced the robust SST. RESULTS: The exploratory, open-ended surveying for identifying additional factors important to the public led to question formulation around mind relaxation. Cognitive testing yielded significant refinement to question and response option formatting. Factor analysis of questions from field testing indicated loading on one construct identified as "sleep satisfaction." The final 9-item SST demonstrated strong reliability and internal validity with overall SST scores of 56/100 (higher scores indicating greater sleep satisfaction). Individual SST item mean scores ranged from 39 to 66, and overall SST scores varied substantially across demographic groups. CONCLUSIONS: NSF used a series of development and validation tests on its provisional SST, producing a novel and reliable research tool that measures the general population's sleep satisfaction. The SST is a short, reliable, nonclinical assessment that expands the set of tools available to researchers that implements the individual, social, and environmental factors related to sleep satisfaction. Further research will explore refined scoring methods along with factor weighting and use within different populations.

The National Sleep Foundation's Sleep Health Index.

OBJECTIVES: A validated survey instrument to assess general sleep health would be a useful research tool, particularly when objective measures of sleep are not feasible. Thus, the National Sleep Foundation spearheaded the development of the Sleep Health Index (SHI). DESIGN: The development of the SHI began with a task force of experts who identified key sleep domains and questions. An initial draft of the survey was created and questions were refined using cognitive testing and pretesting. The resulting 28-question survey was administered via random-sample telephone interviews to nationally representative samples of adults in 2014 (n=1253) and 2015 (n=1250). These data were combined to create the index. A factor analysis linked 14 questions to 3 discrete domains: sleep quality, sleep duration, and disordered sleep. These were assembled as sub-indices, then combined to form the overall SHI, with scores ranging from 0 to 100 (higher score reflects better sleep health). RESULTS: Americans earned an overall SHI score of 76/100, with sub-index scores of 81/100 in disordered sleep, 79/100 in sleep duration, and 68/100 in sleep quality. In regression analyses, the strongest independent predictors of sleep health were self-reported stress (ß=-0.26) and overall health (ß=0.26), which were also the strongest predictors of sleep quality (ß=-0.32 and ß=0.27 respectively). CONCLUSIONS: The current 12-item SHI is a valid, reliable research tool that robustly measures 3 separate but related elements of sleep health-duration, quality, and disorders-and assesses the sleep health status of adults in the United States.

The association of knowledge with concern about global warming: trusted information sources shape public thinking.

During the last decade, a great deal of news media attention has focused on informing the American public about scientific findings on global warming (GW). Has learning this sort of information led the American public to become more concerned about GW? Using data from two surveys of nationally representative samples of American adults, this article shows that the relation between self-reported knowledge and concern about GW is more complex than what previous research has suggested. Among people who trust scientists to provide reliable information about the environment and among Democrats and Independents, increased knowledge has been associated with increased concern. But among people who are skeptical about scientists and among Republicans more knowledge was generally not associated with greater concern. The association of knowledge with concern among Democrats and Independents who trust scientists was mediated by perceptions of consensus among scientists about GW's existence and by perceptions that humans are a principal cause of GW. Moreover, additional analyses of panel survey data produced findings consistent with the notion that more knowledge yields more concern among Democrats and Independents, but not among Republicans. Thus, when studying the relation of knowledge and concern, it is important to take into account the content of the information that different types of people acquire and choose to rely upon.

People in pain: how do they seek relief?

UNLABELLED: Little is known about how people with pain seek relief. To estimate the proportion of the population reporting recent pain, to identify ways people seek pain relief, and to report the perceived effectiveness of pain relief methods, we conducted a secondary analysis of results from a nationwide survey of the general U.S. population. Of the 1204 respondents, 31% had experienced moderate to very severe pain within the past 2 weeks and 75% of these had sought medical attention. Only 56% of those who sought medical attention got significant pain relief. Although seeking medical attention was the primary pain relief strategy, almost all of those with pain had tried multiple alternative methods for pain control, with 92% of pain sufferers having tried 3 or more alternative strategies. People who did not seek medical attention were more likely to report pain relief from prayer and going to a chiropractor than were those who sought medical attention. Factors leading to inadequate pain relief included difficulty communicating with a health professional and lack of health insurance. People who perceive that their pain is not understood by medical providers and those without health care insurance coverage are at greater risk for poor pain control. PERSPECTIVE: This article presents an analysis of data from a national survey on pain and the effectiveness of ways people seek pain relief. Difficulty communicating with health professionals and lack of health insurance contributed to inadequate pain relief. Almost all people with pain used multiple methods to control their pain.