ABSTRACT
Survey participants' mouse movements provide a rich, unobtrusive source of paradata, offering insight into the response process beyond the observed answers. However, the use of mouse tracking may require participants' explicit consent for their movements to be recorded and analyzed. Thus, the question arises of how its presence affects the willingness of participants to take part in a survey at all-if prospective respondents are reluctant to complete a survey if additional measures are recorded, collecting paradata may do more harm than good. Previous research has found that other paradata collection modes reduce the willingness to participate, and that this decrease may be influenced by the specific motivation provided to participants for collecting the data. However, the effects of mouse movement collection on survey consent and participation have not been addressed so far. In a vignette experiment, we show that reported willingness to participate in a survey decreased when mouse tracking was part of the overall consent. However, a larger proportion of the sample indicated willingness to both take part and provide mouse-tracking data when these decisions were combined, compared to an independent opt-in to paradata collection, separated from the decision to complete the study. This suggests that survey practitioners may face a trade-off between maximizing their overall participation rate and maximizing the number of participants who also provide mouse-tracking data. Explaining motivations for paradata collection did not have a positive effect and, in some cases, even reduced participants' reported willingness to take part in the survey.
ABSTRACT
The COVID-19 pandemic has spotlighted the importance of high-quality data for empirical health research and evidence-based political decision-making. To leverage the full potential of these data, a better understanding of the determinants and conditions under which people are willing to share their health data is critical. Building on the privacy theory of contextual integrity, the privacy calculus, and previous findings regarding different data types and recipients, we argue that established social norms shape the acceptance of novel practices of data collection and use. To investigate the willingness to share health data, we conducted a preregistered vignette experiment. The scenarios experimentally varied the vignette dimensions by data type, recipient, and research purpose. While some findings contradict our hypotheses, the results indicate that all three dimensions affected respondents' data sharing decisions. Additional analyses suggest that institutional and social trust, privacy concerns, technical affinity, altruism, age, and device ownership influence the willingness to share health data.
Subject(s)
COVID-19 , Pandemics , Humans , Medical Records , Biomarkers , Information DisseminationABSTRACT
Employment relationships are embedded in a network of social norms that provide an implicit framework for desired behaviour, especially if contractual solutions are weak. The COVID-19 pandemic has brought about major changes that have led to situations, such as the scope of short-time work or home-based work in a firm. Against this backdrop, our study addresses three questions: first, are there social norms dealing with these changes; second, are there differences in attitudes between employees and supervisors (misalignment); and third, are there differences between respondents' average attitudes and the attitudes expected to exist in the population (pluralistic ignorance). We find that for the assignment of short-time work and of work at home, there are shared normative attitudes with only small differences between supervisors and nonsupervisors. Moreover, there is evidence for pluralistic ignorance; asked for the perceived opinion of others, respondents over- or underestimated the consensus in the (survey) population. Such pluralistic ignorance can contribute to the upholding of a norm even if individuals do not support the norm, with potentially far-reaching consequences for the quality of the employment relationship and the functioning of the organization. Our results show that, especially in times of change, social norms should be considered for the analysis of labour markets.
ABSTRACT
Objectives: Real-time data analysis during a pandemic is crucial. This paper aims to introduce a novel interactive tool called Covid-Predictor-Tracker using several sources of COVID-19 data, which allows examining developments over time and across countries. Exemplified here by investigating relative effects of vaccination to non-pharmaceutical interventions on COVID-19 spread. Methods: We combine >100 indicators from the Global COVID-19 Trends and Impact Survey, Johns Hopkins University, Our World in Data, European Centre for Disease Prevention and Control, National Centers for Environmental Information, and Eurostat using random forests, hierarchical clustering, and rank correlation to predict COVID-19 cases. Results: Between 2/2020 and 1/2022, we found among the non-pharmaceutical interventions "mask usage" to have strong effects after the percentage of people vaccinated at least once, followed by country-specific measures such as lock-downs. Countries with similar characteristics share ranks of infection predictors. Gender and age distribution, healthcare expenditures and cultural participation interact with restriction measures. Conclusion: Including time-aware machine learning models in COVID-19 infection dashboards allows to disentangle and rank predictors of COVID-19 cases per country to support policy evaluation. Our open-source tool can be updated daily with continuous data streams, and expanded as the pandemic evolves.
Subject(s)
COVID-19 , Humans , COVID-19/epidemiology , COVID-19/prevention & control , SARS-CoV-2 , European Union , Communicable Disease Control , Pandemics/prevention & controlABSTRACT
Prediction algorithms are regularly used to support and automate high-stakes policy decisions about the allocation of scarce public resources. However, data-driven decision-making raises problems of algorithmic fairness and justice. So far, fairness and justice are frequently conflated, with the consequence that distributive justice concerns are not addressed explicitly. In this paper, we approach this issue by distinguishing (a) fairness as a property of the algorithm used for the prediction task from (b) justice as a property of the allocation principle used for the decision task in data-driven decision-making. The distinction highlights the different logic underlying concerns about fairness and justice and permits a more systematic investigation of the interrelations between the two concepts. We propose a new notion of algorithmic fairness called error fairness which requires prediction errors to not differ systematically across individuals. Drawing on sociological and philosophical discourse on local justice, we present a principled way to include distributive justice concerns into data-driven decision-making. We propose that allocation principles are just if they adhere to well-justified distributive justice principles. Moving beyond the one-sided focus on algorithmic fairness, we thereby make a first step toward the explicit implementation of distributive justice into data-driven decision-making.
ABSTRACT
Human perceptions of fairness in (semi-)automated decision-making (ADM) constitute a crucial building block toward developing human-centered ADM solutions. However, measuring fairness perceptions is challenging because various context and design characteristics of ADM systems need to be disentangled. Particularly, ADM applications need to use the right degree of automation and granularity of data input to achieve efficiency and public acceptance. We present results from a large-scale vignette experiment that assessed fairness perceptions and the acceptability of ADM systems. The experiment varied context and design dimensions, with an emphasis on who makes the final decision. We show that automated recommendations in combination with a final human decider are perceived as fair as decisions made by a dominant human decider and as fairer than decisions made only by an algorithm. Our results shed light on the context dependence of fairness assessments and show that semi-automation of decision-making processes is often desirable.
ABSTRACT
Objectives: To examine the association of non-pharmaceutical interventions (NPIs) with anxiety and depressive symptoms among adults and determine if these associations varied by gender and age. Methods: We combined survey data from 16,177,184 adults from 43 countries who participated in the daily COVID-19 Trends and Impact Survey via Facebook with time-varying NPI data from the Oxford COVID-19 Government Response Tracker between 24 April 2020 and 20 December 2020. Using logistic regression models, we examined the association of [1] overall NPI stringency and [2] seven individual NPIs (school closures, workplace closures, cancellation of public events, restrictions on the size of gatherings, stay-at-home requirements, restrictions on internal movement, and international travel controls) with anxiety and depressive symptoms. Results: More stringent implementation of NPIs was associated with a higher odds of anxiety and depressive symptoms, albeit with very small effect sizes. Individual NPIs had heterogeneous associations with anxiety and depressive symptoms by gender and age. Conclusion: Governments worldwide should be prepared to address the possible mental health consequences of stringent NPI implementation with both universal and targeted interventions for vulnerable groups.
Subject(s)
COVID-19 , SARS-CoV-2 , Adult , Anxiety/epidemiology , Anxiety/prevention & control , Anxiety Disorders , COVID-19/epidemiology , COVID-19/prevention & control , Depression/epidemiology , Depression/prevention & control , HumansABSTRACT
The gold-standard approaches for gleaning statistically valid conclusions from data involve random sampling from the population. Collecting properly randomized data, however, can be challenging, so modern statistical methods, including propensity score reweighting, aim to enable valid inferences when random sampling is not feasible. We put forth an approach for making inferences based on available data from a source population that may differ in composition in unknown ways from an eventual target population. Whereas propensity scoring requires a separate estimation procedure for each different target population, we show how to build a single estimator, based on source data alone, that allows for efficient and accurate estimates on any downstream target data. We demonstrate, theoretically and empirically, that our target-independent approach to inference, which we dub "universal adaptability," is competitive with target-specific approaches that rely on propensity scoring. Our approach builds on a surprising connection between the problem of inferences in unspecified target populations and the multicalibration problem, studied in the burgeoning field of algorithmic fairness. We show how the multicalibration framework can be employed to yield valid inferences from a single source population across a diverse set of target populations.
ABSTRACT
AIMS: To examine changes in drinking behavior among United States (US) adults between March 10 and July 21, 2020, a critical period during the COVID-19 pandemic. DESIGN: Longitudinal, internet-based panel survey. SETTING: The Understanding America Study (UAS), a nationally representative panel of US adults age 18 or older. PARTICIPANTS: A total of 4298 US adults who reported alcohol use. MEASUREMENTS: Changes in number of reported drinking days from March 11, 2020 through July 21, 2020 in the overall sample and stratified by sex, age, race/ethnicity, household structure, poverty status, and census region. FINDINGS: Compared with March 11, the number of drinking days per week was significantly higher on April 1 by an average of 0.36 days (95% CI = 0.30, 0.43), on May 1 by an average of 0.55 days (95% CI = 0.47, 0.63), on June 1 by an average of 0.41 days (95% CI = 0.33, 0.49), and on July 1 by an average of 0.39 days (95% CI = 0.31, 0.48). Males, White participants, and older adults reported sustained increases in drinking days, whereas female participants and individuals living under the federal poverty line had attenuated drinking days in the latter part of the study period. CONCLUSIONS: Between March and mid-July 2020, adults in the United States reported increases in the number of drinking days, with sustained increases observed among males, White participants, and older adults.
Subject(s)
COVID-19 , Adolescent , Aged , Alcohol Drinking/epidemiology , Ethnicity , Female , Humans , Male , Pandemics , SARS-CoV-2 , United States/epidemiologyABSTRACT
The US COVID-19 Trends and Impact Survey (CTIS) is a large, cross-sectional, internet-based survey that has operated continuously since April 6, 2020. By inviting a random sample of Facebook active users each day, CTIS collects information about COVID-19 symptoms, risks, mitigating behaviors, mental health, testing, vaccination, and other key priorities. The large scale of the survey-over 20 million responses in its first year of operation-allows tracking of trends over short timescales and allows comparisons at fine demographic and geographic detail. The survey has been repeatedly revised to respond to emerging public health priorities. In this paper, we describe the survey methods and content and give examples of CTIS results that illuminate key patterns and trends and help answer high-priority policy questions relevant to the COVID-19 epidemic and response. These results demonstrate how large online surveys can provide continuous, real-time indicators of important outcomes that are not subject to public health reporting delays and backlogs. The CTIS offers high value as a supplement to official reporting data by supplying essential information about behaviors, attitudes toward policy and preventive measures, economic impacts, and other topics not reported in public health surveillance systems.
Subject(s)
COVID-19 Testing/statistics & numerical data , COVID-19/epidemiology , Health Status Indicators , Adult , Aged , COVID-19/diagnosis , COVID-19/prevention & control , COVID-19/transmission , COVID-19 Vaccines , Cross-Sectional Studies , Epidemiologic Methods , Female , Humans , Male , Middle Aged , Patient Acceptance of Health Care/statistics & numerical data , Social Media/statistics & numerical data , United States/epidemiology , Young AdultABSTRACT
Simultaneously tracking the global impact of COVID-19 is challenging because of regional variation in resources and reporting. Leveraging self-reported survey outcomes via an existing international social media network has the potential to provide standardized data streams to support monitoring and decision-making worldwide, in real time, and with limited local resources. The University of Maryland Global COVID-19 Trends and Impact Survey (UMD-CTIS), in partnership with Facebook, has invited daily cross-sectional samples from the social media platform's active users to participate in the survey since its launch on April 23, 2020. We analyzed UMD-CTIS survey data through December 20, 2020, from 31,142,582 responses representing 114 countries/territories weighted for nonresponse and adjusted to basic demographics. We show consistent respondent demographics over time for many countries/territories. Machine Learning models trained on national and pooled global data verified known symptom indicators. COVID-like illness (CLI) signals were correlated with government benchmark data. Importantly, the best benchmarked UMD-CTIS signal uses a single survey item whereby respondents report on CLI in their local community. In regions with strained health infrastructure but active social media users, we show it is possible to define COVID-19 impact trajectories using a remote platform independent of local government resources. This syndromic surveillance public health tool is the largest global health survey to date and, with brief participant engagement, can provide meaningful, timely insights into the global COVID-19 pandemic at a local scale.
Subject(s)
COVID-19/epidemiology , Public Health Surveillance/methods , Social Media , COVID-19/diagnosis , COVID-19 Testing , Cross-Sectional Studies , Epidemiologic Methods , Humans , Internationality , Machine Learning , Pandemics/statistics & numerical dataABSTRACT
BACKGROUND: Guidelines and recommendations from public health authorities related to face masks have been essential in containing the COVID-19 pandemic. We assessed the prevalence and correlates of mask usage during the pandemic. METHODS: We examined a total of 13,723,810 responses to a daily cross-sectional online survey in 38 countries of people who completed from April 23, 2020 to October 31, 2020 and reported having been in public at least once during the last 7 days. The outcome was individual face mask usage in public settings, and the predictors were country fixed effects, country-level mask policy stringency, calendar time, individual sociodemographic factors, and health prevention behaviors. Associations were modeled using survey-weighted multivariable logistic regression. RESULTS: Mask-wearing varied over time and across the 38 countries. While some countries consistently showed high prevalence throughout, in other countries mask usage increased gradually, and a few other countries remained at low prevalence. Controlling for time and country fixed effects, sociodemographic factors (older age, female gender, education, urbanicity) and stricter mask-related policies were significantly associated with higher mask usage in public settings. Crucially, social behaviors considered risky in the context of the pandemic (going out to large events, restaurants, shopping centers, and socializing outside of the household) were associated with lower mask use. CONCLUSION: The decision to wear a face mask in public settings is significantly associated with sociodemographic factors, risky social behaviors, and mask policies. This has important implications for health prevention policies and messaging, including the potential need for more targeted policy and messaging design.
Subject(s)
COVID-19 , Pandemics , Aged , Cross-Sectional Studies , Female , Humans , Masks , SARS-CoV-2ABSTRACT
The severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) pandemic is posing a global public health burden. These consequences have been shown to increase the risk of mental distress, but the underlying protective and risk factors for mental distress and trends over different waves of the pandemic are largely unknown. Furthermore, it is largely unknown how mental distress is associated with individual protective behavior. Three quota samples, weighted to represent the population forming the German COVID-19 Snapshot Monitoring study (24 March and 26 May 2020, and 9 March 2021 with >900 subjects each), were used to describe the course of mental distress and resilience, to identify risk and protective factors during the pandemic, and to investigate their associations with individual protective behaviors. Mental distress increased slightly during the pandemic. Usage of cognitive reappraisal strategies, maintenance of a daily structure, and usage of alternative social interactions decreased. Self-reported resilience, cognitive reappraisal strategies, and maintaining a daily structure were the most important protective factors in all three samples. Adherence to individual protective behaviors (e.g., physical distancing) was negatively associated with mental distress and positively associated with frequency of information intake, maintenance of a daily structure, and cognitive reappraisal. Maintaining a daily structure, training of cognitive reappraisal strategies, and information provision may be targets to prevent mental distress while assuring a high degree of individual protective behaviors during the COVID-19 pandemic. Effects of the respective interventions have to be confirmed in further studies.
Subject(s)
COVID-19 , Pandemics , Germany/epidemiology , Humans , Pandemics/prevention & control , Risk Factors , SARS-CoV-2ABSTRACT
The ability to 'sense' the social environment and thereby to understand the thoughts and actions of others allows humans to fit into their social worlds, communicate and cooperate, and learn from others' experiences. Here we argue that, through the lens of computational social science, this ability can be used to advance research into human sociality. When strategically selected to represent a specific population of interest, human social sensors can help to describe and predict societal trends. In addition, their reports of how they experience their social worlds can help to build models of social dynamics that are constrained by the empirical reality of human social systems.
Subject(s)
Computer Simulation , Models, Theoretical , Social Environment , Social Sciences/methods , Social Skills , Theory of Mind , Humans , Interpersonal RelationsABSTRACT
BACKGROUND: Cross-sectional studies have found that the coronavirus disease 2019 (COVID-19) pandemic has negatively affected population-level mental health. Longitudinal studies are necessary to examine trajectories of change in mental health over time and identify sociodemographic groups at risk for persistent distress. PURPOSE: To examine the trajectories of mental distress between March 10 and August 4, 2020, a key period during the COVID-19 pandemic. METHODS: Participants included 6,901 adults from the nationally representative Understanding America Study, surveyed at baseline between March 10 and 31, 2020, with nine follow-up assessments between April 1 and August 4, 2020. Mixed-effects logistic regression was used to examine the association between date and self-reported mental distress (measured with the four-item Patient Health Questionnaire) among U.S. adults overall and among sociodemographic subgroups defined by sex, age, race/ethnicity, household structure, federal poverty line, and census region. RESULTS: Compared to March 11, the odds of mental distress among U.S. adults overall were 1.84 (95% confidence interval [CI] = 1.65-2.07) times higher on April 1 and 1.92 (95% CI = 1.62-2.28) times higher on May 1; by August 1, the odds of mental distress had returned to levels comparable to March 11 (odds ratio [OR] = 0.80, 95% CI = 0.66-0.96). Females experienced a sharper increase in mental distress between March and May compared to males (females: OR = 2.29, 95% CI = 1.85-2.82; males: OR = 1.53, 95% CI = 1.15-2.02). CONCLUSIONS: These findings highlight the trajectory of mental health symptoms during an unprecedented pandemic, including the identification of populations at risk for sustained mental distress.
Subject(s)
COVID-19/psychology , Mental Health/trends , Psychological Distress , Adult , Aged , Cross-Sectional Studies , Female , Humans , Male , Middle Aged , Patient Health Questionnaire , Self Report , Socioeconomic Factors , United States , Young AdultABSTRACT
BACKGROUND: The SARS-CoV-2 pandemic has caused mental stress in a number of ways: overstrain of the health care system, lockdown of the economy, restricted opportunities for interpersonal contact and excursions outside the home and workplace, and quarantine measures where necessary. In this article, we provide an overview of psychological distress in the current pandemic, identifying protective factors and risk factors. METHODS: The PubMed, PsycINFO, and Web of Science databases were systematically searched for relevant publications (1 January 2019 - 16 April 2020). This study was registered in OSF Registries (osf.io/34j8g). Data on mental stress and resilience in Germany were obtained from three surveys carried out on more than 1000 participants each in the framework of the COSMO study (24 March, 31 March, and 21 April 2020). RESULTS: 18 studies from China and India, with a total of 79 664 participants, revealed increased stress in the general population, with manifestations of depression and anxiety, post-traumatic stress, and sleep disturbances. Stress was more marked among persons working in the health care sector. Risk factors for stress included patient contact, female sex, impaired health status, worry about family members and significant others, and poor sleep quality. Protective factors included being informed about the increasing number of persons who have recovered from COVID, social support, and a lower perceived infectious risk. The COSMO study, though based on an insufficiently representative population sample because of a low questionnaire return rate (<20%), revealed increased rates of despondency, loneliness, and hopelessness in the German population as compared to norm data, with no change in estimated resilience. CONCLUSION: Stress factors associated with the current pandemic probably increase stress by causing anxiety and depression. Once the protective factors and risk factors have been identified, these can be used to develop psychosocial interventions. The informativeness of the results reported here is limited by the wide variety of instruments used to acquire data and by the insufficiently representative nature of the population samples.
Subject(s)
Coronavirus Infections/psychology , Mental Disorders/epidemiology , Pandemics , Pneumonia, Viral/psychology , Resilience, Psychological , COVID-19 , Coronavirus Infections/epidemiology , Germany/epidemiology , Humans , Pneumonia, Viral/epidemiology , Protective Factors , Risk FactorsABSTRACT
INTRODUCTION: Exposure to disaster-related media may be a risk factor for mental distress, but this has not been examined in the context of the COVID-19 pandemic. This study assesses whether exposure to social and traditional media during the rise of the COVID-19 pandemic was associated with mental distress among U.S. adults. METHODS: Data came from the Understanding America Study, conducted with a cross-sectional, nationally representative sample of adults who completed surveys online. Participants included 6,329 adults surveyed between March 10 and March 31, 2020. Regression analyses examined the associations of (1) self-reported average time spent on social media in a day (hours) and (2) number of traditional media sources (radio, TV, and newspaper) consulted to learn about COVID-19 with self-reported mental distress (4-item Patient Health Questionnaire). Data were analyzed in April 2020. RESULTS: Participants responding at later survey dates reported more time spent on social media (ß=0.02, 95% CI=0.01, 0.03), a greater number of traditional media sources consulted to learn about COVID-19 (ß=0.01, 95% CI=0.01, 0.02), and greater mental distress (ß=0.07, 95% CI=0.04, 0.09). Increased time spent on social media and consulting a greater number of traditional media sources to learn about COVID-19 were independently associated with increased mental distress, even after adjusting for potential confounders (social media: ß=0.14, 95% CI=0.05, 0.23; traditional media: ß=0.14, 95% CI=0.08, 0.20). CONCLUSIONS: Exposure to a greater number of traditional media sources and more hours on social media was modestly associated with mental distress during the rise of the COVID-19 pandemic in the U.S.
Subject(s)
Coronavirus Infections , Pandemics , Pneumonia, Viral , Psychological Distress , Social Environment , Social Media/statistics & numerical data , Adult , Betacoronavirus , COVID-19 , Coronavirus Infections/epidemiology , Coronavirus Infections/prevention & control , Coronavirus Infections/psychology , Correlation of Data , Cross-Sectional Studies , Female , Humans , Information Dissemination/methods , Male , Pandemics/prevention & control , Pneumonia, Viral/epidemiology , Pneumonia, Viral/prevention & control , Pneumonia, Viral/psychology , Psychology , Risk Factors , SARS-CoV-2 , Self Report/statistics & numerical data , United States/epidemiologyABSTRACT
Objectives. To assess the impact of the COVID-19 pandemic on mental distress in US adults.Methods. Participants were 5065 adults from the Understanding America Study, a probability-based Internet panel representative of the US adult population. The main exposure was survey completion date (March 10-16, 2020). The outcome was mental distress measured via the 4-item version of the Patient Health Questionnaire.Results. Among states with 50 or more COVID-19 cases as of March 10, each additional day was significantly associated with an 11% increase in the odds of moving up a category of distress (odds ratio = 1.11; 95% confidence interval = 1.01, 1.21; P = .02). Perceptions about the likelihood of getting infected, death from the virus, and steps taken to avoid infecting others were associated with increased mental distress in the model that included all states. Individuals with higher consumption of alcohol or cannabis or with history of depressive symptoms were at significantly higher risk for mental distress.Conclusions. These data suggest that as the COVID-19 pandemic continues, mental distress may continue to increase and should be regularly monitored. Specific populations are at high risk for mental distress, particularly those with preexisting depressive symptoms.
Subject(s)
Coronavirus Infections/epidemiology , Coronavirus Infections/psychology , Pandemics , Pneumonia, Viral/epidemiology , Pneumonia, Viral/psychology , Stress, Psychological/epidemiology , Adolescent , Adult , Alcohol Drinking/epidemiology , Betacoronavirus , COVID-19 , Coronavirus Infections/ethnology , Depression/epidemiology , Female , Humans , Insurance, Health , Male , Marijuana Smoking/epidemiology , Medically Uninsured , Middle Aged , Pneumonia, Viral/ethnology , SARS-CoV-2 , Socioeconomic Factors , United States/epidemiology , Young AdultABSTRACT
Most individuals in the United States have no history of a mental health condition yet are at risk for psychological distress due to the COVID-19 pandemic. The objective of this study was to assess the frequency and risk and protective factors of psychological distress, during the beginning of the COVID-19 pandemic, in this group. Data comes from the Pew Research Center's American Trends Panel (ATP), a probability-based online survey panel representative of the US adult population. The analytic sample consisted of 9687 individuals with no prior history of a mental health condition who completed the survey between March 19-24, 2020. Explanatory variables included sociodemographic factors and items related to behavior, perceptions, and experiences surrounding the pandemic. The outcome was psychological distress, measured by five items on symptoms of anxiety, depression, loneliness, sleep difficulties, and hyperarousal. A multivariable linear regression model was used to identify risk and protective factors for psychological distress. Fifteen percent of the sample experienced 2 psychological distress symptoms for at least 3 days over the past week; 13% had three or more symptoms. Risk factors for higher distress included searching online or using social media to post about coronavirus, reporting that the outbreak caused major changes to personal life, and perception that the virus was a threat to the US economy, the individual's personal health or finances. This has important implications for mental health service delivery.