The effect of interviewer-respondent age difference on the reporting of sexual activity in the Demographic and Health Surveys: Analysis of data from 21 countries.

Background: Interviewer effects can have consequential impacts on survey data, particularly for reporting sensitive attitudes and behaviours such as sexual activity and drug use, yet these effects remain understudied in low- and middle-income countries. The Demographic and Health Surveys (DHS) present a unique opportunity to study interviewer effects on the self-report of sensitive topics in low- and middle-income countries by including interviewer characteristics data. This paper aims to narrow the gap in research on interviewer effects by studying the effects that age difference between interviewer and respondent and interviewer survey experience have on the reporting of ever having sexual intercourse. Methods: We used DHS data from 91 066 women and 56 336 men in 21 countries where the standard DHS was implemented among all women of reproductive age, and interviewer characteristics were included in the data set. Using a Bayesian cross-classified model with random intercepts for interviewer and cluster, we assessed whether the effect of an age difference of 10 years or greater was associated with a difference in self-report of ever having sexual intercourse, adjusting for respondent demographics. Results: There was a meaningful association between an age difference of greater than ten years and reporting of ever having had sexual intercourse in most countries for both genders after adjusting for interviewer age and experience, rural or urban cluster, and individual-level characteristics. Among women, the marginal posterior probability of reporting ever having sexual intercourse if the interviewer was ten years or more years older was lower for 17 of 19 countries (countries ranged from -12.50 to 3.90 percentage points). Among men, the marginal posterior probability was lower for 16 of 20 countries, ranging from -18.30 to 17.10 percentage points. Conclusions: In most countries, women and men were less likely to report ever having sexual activity if the interviewer was ten or more years older than them, adjusting for potential confounders. These findings have important implications for interpreting numerous sexual health indicators, such as unmet family planning needs and human immunodeficiency virus (HIV)/acquired immunodeficiency syndrome (AIDS) risk. Survey administrators may consider more careful interviewer-respondent characteristic matching or novel approaches like Audio Computer Assisted Self Interview to minimize interviewer-induced variance.

Measuring Knowledge of Community Health Workers at the Last Mile in Liberia: Feasibility and Results of Clinical Vignette Assessments.

INTRODUCTION: Community health workers (CHWs) can provide lifesaving treatment for children in remote areas, but high-quality care is essential for effective delivery. Measuring the quality of community-based care in remote areas is logistically challenging. Clinical vignettes have been validated in facility settings as a proxy for competency. We assessed feasibility and effectiveness of clinical vignettes to measure CHW knowledge of integrated community case management (iCCM) in Liberia's national CHW program. METHODS: We developed 3 vignettes to measure knowledge of iCCM illnesses (malaria, diarrhea, and pneumonia) in 4 main areas: assessment, diagnosis, treatment, and caregiver instructions. Trained nurse supervisors administered the vignettes to CHWs in 3 counties in rural Liberia as part of routine program supervision between January and May 2019, collected data on CHW knowledge using a standardized checklist tool, and provided feedback and coaching to CHWs in real time after vignette administration. Proportions of vignettes correctly managed, including illness classification, treatment, and referral where necessary, were calculated. We assessed feasibility, defined as the ability of clinical supervisors to administer the vignettes integrated into their routine activities once per year for each CHW, and effectiveness, defined as the ability of the vignettes to measure the primary outcomes of CHW knowledge of diagnosis and treatment including referrals. RESULTS: We were able to integrate this assessment into routine supervision, facilitate real-time coaching, and collect data on iCCM knowledge among 155 CHWs through delivery of 465 vignettes. Diagnosis including severity was correct in 65%-82% of vignettes. CHWs correctly identified danger signs in 44%-50% of vignettes, correctly proposed referral to the facility in 63% of vignettes including danger signs, and chose correct lifesaving treatment in 23%-65% of vignettes. Both diagnosis and lifesaving treatment rates were highest for malaria and lowest for severe pneumonia. CONCLUSION: Administration of vignettes to assess knowledge of correct iCCM case management was feasible and effective in producing results in this setting. Proportions of correct diagnosis and lifesaving treatment varied, with high proportions for uncomplicated disease, but lower for more severe cases, with accurate recognition of danger signs posing a challenge. Future work includes validation of vignettes for use with CHWs through direct observation, strengthening supportive supervision, and program interventions to address identified knowledge gaps.