Outcomes of Population Surveillance Data Collection Pilots and the Behavioral Risk Factor Surveillance System: What Happens in Texas.

Declining response rates and rising costs have prompted the search for alternatives to traditional random-digit dialing (RDD) interviews. In 2021, three Behavioral Risk Factor Surveillance System (BRFSS) pilots were conducted in Texas: data collection using an RDD short message service (RDD SMS) text-messaging push-to-web pilot, an address-based push-to-web pilot, and an internet panel pilot. We used data from the three pilots and from the concurrent Texas BRFSS Computer Assisted Telephone Interview (CATI). We compared unweighted data from these four sources to demographic information from the American Community Survey (ACS) for Texas, comparing respondents' health information across the protocols as well as cost and response rates. Non-Hispanic White adults and college graduates disproportionately responded in all survey protocols. Comparing costs across protocols was difficult due to the differences in methods and overhead, but some cost comparisons could be made. The cost per complete for BRFSS/CATI ranged from $75 to $100, compared with costs per complete for address-based sampling ($31 to $39), RDD SMS ($12 to $20), and internet panel (approximately $25). There were notable differences among survey protocols and the ACS in age, race/ethnicity, education, and marital status. We found minimal differences in respondents' answers to heart disease-related questions; however, responses to flu vaccination questions differed by protocol. Comparable responses were encouraging. Properly weighted web-based data collection may help use data collected by new protocols as a supplement to future BRFSS efforts.

The Value and Validity of Self-Reported Survey Data on the Rape Experiences of College Students.

Self-reported survey data on the extent and nature of rape and sexual assault experienced by a population represent an important source of information because these crimes often go unreported, and are thus undercounted in law enforcement or other official statistics. This article compares Campus Climate Survey Validation Study (CCSVS) data to Clery Act data in an effort to (1) assess the validity of the CCSVS data and the Clery Act data based on the extent to which they corroborate one another, and (2) estimate the extent to which Clery Act data potentially underestimate the true incidence of rape. The results help to establish the extent to which self-report surveys on sexual victimization are needed to understand the magnitude of the problem among a given population.

A Field Test of Opportunities for Teen Dating Violence Disclosure in School-Based Relationship Education Programs.

School-based relationship education programs offer an opportunity to identify youth who are experiencing teen dating violence (TDV), support their safety, and connect them with individualized services or referrals. However, no research has tested the feasibility or accuracy of approaches to create opportunities for TDV disclosure in the context of school-based programs. The current study presents the results of a field test comparing three tools used to provide opportunities for TDV disclosure (two questionnaire-style tools and one universal education discussion guide). High school students from two federally funded healthy marriage and relationship education (HMRE) program sites (N = 648) were offered the three tools in random order over the course of the HMRE program, which lasted between 3 weeks and 3 months and took place during the school day. Onsite qualitative interviews with HMRE program staff and their local domestic violence program partners assessed how service providers saw the tools and the process of implementing them. Latent class models examined the accuracy of the tools in identifying TDV. Sensitivities of the tools were low and specificities were high; the questionnaire-style tools tended to have higher sensitivities and fewer classification errors than the universal education tool. Several three-item combinations from across the tools performed better than any intact tool, suggesting that shorter assessments may be effective, provided they include items on sexual coercion and physical violence. Qualitative findings suggested that implementation of TDV assessment and universal education in school settings is a viable strategy, provided programs are able to gain support from school staff, adapt to tight time constraints, and plan procedures for protecting student privacy and confidentiality.

The Prevalence and Negative Impacts of Substance Use Disorders among People with HIV in the United States: A Real-Time Delphi Survey of Key Stakeholders.

Although HIV and substance use disorders (SUDs) constitute a health syndemic, no research to date has examined the perceived negative impacts of different SUDs for people with HIV (PWH). In May 2019, 643 stakeholders in the U.S., representing clients of AIDS service organizations (ASOs), ASO staff, and HIV/AIDS Planning Council members, participated in an innovative Stakeholder-Engaged Real-Time Delphi (SE-RTD) survey focused on the prevalence and individual-level negative impact of five SUDs for PWH. The SE-RTD method has advantages over conventional survey methods by efficiently sharing information, thereby reducing the likelihood that between-group differences are simply due to lack of information, knowledge, and/or understanding. The population-level negative impacts were calculated by weighting each SUD's individual-level negative impact on indicators of the HIV Care Continuum and other important areas of life by the perceived prevalence of each SUD. Overall, we found these SUDs to have the greatest population-level negative impact scores (possible range 0-24): alcohol use disorder (population-level negative impact = 6.9; perceived prevalence = 41.9%), methamphetamine use disorder (population-level negative impact = 6.5; perceived prevalence = 3.2%), and opioid use disorder (population-level negative impact = 6.4; perceived prevalence = 34.6%). Beyond further demonstration of the need to better integrate SUD services within HIV settings, our findings may help inform how finite funding is allocated for addressing the HIV-SUD syndemic within the U.S. Based on our findings, such future efforts should prioritize the integration of evidence-based treatments that help address use disorders for alcohol, methamphetamine, and opioids.

Sensitivity of Sexual Victimization Estimates to Definitional and Measurement Decisions.

Self-report surveys are subject to measurement error associated with variation in the methodology employed. The current analysis uses data from the Campus Climate Survey Validation Study (CCSVS) to examine the impact that measurement decisions have on estimates. The findings demonstrate that asking victims to provide detailed information in an effort to properly place incidents in time and classify incidents by type resulted in relatively minor decreases in estimate magnitude. Ultimately, asking respondents to provide or confirm additional incident-level information for proper classification resulted in more complete information with very little impact on estimates.

Assessing the perceived prevalence of research fraud among faculty at research-intensive universities in the USA.

Survey-based studies on research fraud often feature narrow operationalizations of misbehavior and use limited samples. Such factors potentially hinder the development of strategies aimed at reducing the frequency of wrongdoing among researchers. This study asked full-time faculty members in the natural, social, and applied sciences how frequently six types of research fraud (i.e., data fabrication, plagiarism, data falsification, authorship fraud, publication fraud, and grant fraud) occur in their field of study. These data come from mail and online surveys that were administered to a stratified random sample of tenured and tenure-track faculty members (N = 613) at the top 100 research universities in the United States. Factor-analytic modeling demonstrated that the survey items load on the hypothesized latent constructs and also confirmed the presence of a second-order factor. A specific type of authorship fraud - gift authorship - was perceived to be the most prevalent overall. The least common fraud was a form of data fabrication (i.e., creating data from a study that was never actually conducted). The results were largely consistent with previous studies indicating that serious forms of fraud like data fabrication are relatively rare. Future survey-based studies should pay careful attention to the multidimensional nature of research fraud.

Methods for Improving Representativeness in a Web Survey on Sexual Assault Among College Students.

Many colleges and universities conduct web-based campus climate surveys to understand the prevalence and nature of sexual assault among their students. When designing and fielding a web survey to measure a sensitive topic like sexual assault, methodological decisions, including the length of the field period and the use or amount of an incentive, can affect the representativeness of the respondent sample leading to biased or imprecise estimates. This study uses data from the Campus Climate Survey Validation Study (CCSVS) to assess how the interaction between field period length and survey incentive amount affects nonresponse, sample representativeness, and the precision of survey estimates. Research suggests that using robust incentives gives potential survey respondents a reason to complete the survey beyond their intrinsic motivation to do so. Likewise, extending the field period gives more time to people who may be less intrinsically motivated to complete the survey. Both serve to increase sample size and representativeness, minimize bias, and improve estimate precision. Schools, however, sometimes lack the time and/or resources for both a robust incentive and a lengthy field period, and this study examines the extent to which the potential negative impacts of not using one can be mitigated by the presence of the other. Findings indicate that target response rates can be achieved using a smaller incentive if the field period is lengthy but, even with a lengthy field period, the use of a smaller incentive can result in biased estimates due to a lack of representativeness. Conversely, when a robust incentive is used and weights are developed to adjust for nonresponse, a shorter field period will not have a significant impact on point estimates, but the estimates will be less precise due to fewer respondents participating in the survey.

Local Dependence in Latent Class Analysis of Rare and Sensitive Events.

For survey methodologists, latent class analysis (LCA) is a powerful tool for assessing the measurement error in survey questions, evaluating survey methods, and estimating the bias in estimates of population prevalence. LCA can be used when gold standard measurements are not available and applied to essentially any set of indicators that meet certain criteria for identifiability. LCA offers quality inference, provided the key threat to model validity-namely, local dependence-can be appropriately addressed either in the study design or in the model-building process. Three potential causes threaten local independence: bivocality, behaviorally correlated error, and latent heterogeneity. In this article, these threats are examined separately to obtain insights regarding (a) questionnaire designs that reduce local dependence, (b) the effects of local dependence on parameter estimation, and (c) modeling strategies to mitigate these effects in statistical inference. The article focuses primarily on the analysis of rare and sensitivity outcomes and proposes a practical approach for diagnosing and mitigating model failures. The proposed approach is empirically tested using real data from a national survey of inmate sexual abuse where measurement errors are a serious concern. Our findings suggest that the proposed modeling strategy was successful in reducing local dependence bias in the estimates, but its success varied by the quality of the indicators available for analysis. With only three indicators, the biasing effects of local dependence can usually be reduced but not always to acceptable levels.