Demographic and Geographic Characterization of Excess Mortality During the COVID-19 Pandemic in Baltimore City, Maryland, March 2020 to March 2021.

Estimates of excess mortality can provide insight into direct and indirect impacts of the coronavirus disease 2019 (COVID-19) pandemic beyond deaths specifically attributed to COVID-19. We analyzed death certificate data from Baltimore City, Maryland, from March 1, 2020, to March 31, 2021, and found that 1,725 individuals (95% confidence interval: 1,495, 1,954) died in excess of what was expected from all-cause mortality trends in 2016-2019; 1,050 (61%) excess deaths were attributed to COVID-19. Observed mortality was 23%-32% higher than expected among individuals aged 50 years and older. Non-White residents of Baltimore City also experienced 2 to 3 times higher rates of excess mortality than White residents (e.g., 37.4 vs. 10.7 excess deaths per 10,000 population among Black residents vs. White residents). There was little to no observed excess mortality among residents of hospice, long-term care, and nursing home facilities, despite accounting for nearly 30% (312/1,050) of recorded COVID-19 deaths. There was significant geographic variation in excess mortality within the city, largely following racial population distributions. These results demonstrate the substantial and unequal impact of the COVID-19 pandemic on Baltimore City residents and the importance of building robust, timely surveillance systems to track disparities and inform targeted strategies to remediate the impact of future epidemics.

From raw data to a score: comparing quantitative methods that construct multi-level composite implementation strength scores of family planning programs in Malawi.

BACKGROUND: Data that capture implementation strength can be combined in multiple ways across content and health system levels to create a summary measure that can help us to explore and compare program implementation across facility catchment areas. Summary indices can make it easier for national policymakers to understand and address variation in strength of program implementation across jurisdictions. In this paper, we describe the development of an index that we used to describe the district-level strength of implementation of Malawi's national family planning program. METHODS: To develop the index, we used data collected during a 2017 national, health facility and community health worker Implementation Strength Assessment survey in Malawi to test different methods to combine indicators within and then across domains (4 methods-simple additive, weighted additive, principal components analysis, exploratory factor analysis) and combine scores across health facility and community health worker levels (2 methods-simple average and mixed effects model) to create a catchment area-level summary score for each health facility in Malawi. We explored how well each model captures variation and predicts couple-years protection and how feasible it is to conduct each type of analysis and the resulting interpretability. RESULTS: We found little difference in how the four methods combined indicator data at the individual and combined levels of the health system. However, there were major differences when combining scores across health system levels to obtain a score at the health facility catchment area level. The scores resulting from the mixed effects model were able to better discriminate differences between catchment area scores compared to the simple average method. The scores using the mixed effects combination method also demonstrated more of a dose-response relationship with couple-years protection. CONCLUSIONS: The summary measure that was calculated from the mixed effects combination method captured the variation of strength of implementation of Malawi's national family planning program at the health facility catchment area level. However, the best method for creating an index should be based on the pros and cons listed, not least, analyst capacity and ease of interpretability of findings. Ultimately, the resulting summary measure can aid decision-makers in understanding the combined effect of multiple aspects of programs being implemented in their health system and comparing the strengths of programs across geographies.

A data quality assessment of the first four years of malaria reporting in the Senegal DHIS2, 2014-2017.

BACKGROUND: As the global burden of malaria decreases, routine health information systems (RHIS) have become invaluable for monitoring progress towards elimination. The District Health Information System, version 2 (DHIS2) has been widely adopted across countries and is expected to increase the quality of reporting of RHIS. In this study, we evaluated the quality of reporting of key indicators of childhood malaria from January 2014 through December 2017, the first 4 years of DHIS2 implementation in Senegal. METHODS: Monthly data on the number of confirmed and suspected malaria cases as well as tests done were extracted from the Senegal DHIS2. Reporting completeness was measured as the number of monthly reports received divided by the expected number of reports in a given year. Completeness of indicator data was measured as the percentage of non-missing indicator values. We used a quasi-Poisson model with natural cubic spline terms of month of reporting to impute values missing at the facility level. We used the imputed values to take into account the percentage of malaria cases that were missed due to lack of reporting. Consistency was measured as the absence of moderate and extreme outliers, internal consistency between related indicators, and consistency of indicators over time. RESULTS: In contrast to public facilities of which 92.7% reported data in the DHIS2 system during the study period, only 15.3% of the private facilities used the reporting system. At the national level, completeness of facility reporting increased from 84.5% in 2014 to 97.5% in 2017. The percentage of expected malaria cases reported increased from 76.5% in 2014 to 94.7% in 2017. Over the study period, the percentage of malaria cases reported across all districts was on average 7.5% higher (P < 0.01) during the rainy season relative to the dry season. Reporting completeness rates were lower among hospitals compared to health centers and health posts. The incidence of moderate and extreme outlier values was 5.2 and 2.3%, respectively. The number of confirmed malaria cases increased by 15% whereas the numbers of suspected cases and tests conducted more than doubled from 2014 to 2017 likely due to a policy shift towards universal testing of pediatric febrile cases. CONCLUSIONS: The quality of reporting for malaria indicators in the Senegal DHIS2 has improved over time and the data are suitable for use to monitor progress in malaria programs, with an understanding of their limitations. Senegalese health authorities should maintain the focus on broader adoption of DHIS2 reporting by private facilities, the sustainability of district-level data quality reviews, facility-level supervision and feedback mechanisms at all levels of the health system.

Validity of using mobile phone surveys to evaluate community health worker program in Mali.

BACKGROUND: The monitoring and evaluation of public health programs based on traditional face-to-face interviews in hard-to-reach and unstable regions present many challenges. Mobile phone-based methods are considered to be an effective alternative, but the validity of mobile phone-based data for assessing implementation strength has not been sufficiently studied yet. Nested within an evaluation project for an integrated community case management (iCCM) and family planning program in Mali, this study aimed to assess the validity of a mobile phone-based health provider survey to measure the implementation strength of this program. METHODS: From July to August 2018, a cross-sectional survey was conducted among the community health workers (ASCs) from six rural districts working with the iCCM and family planning program. ASCs were first reached to complete the mobile phone-based survey; within a week, ASCs were visited in their communities to complete the in-person survey. Both surveys used identical implementation strength tools to collect data on program activities related to iCCM and family planning. Sensitivity and specificity were calculated for each implementation strength indicator collected from the phone-based survey, with the in-person survey as the gold standard. A threshold of ≥ 80% for sensitivity and specificity was considered adequate for evaluation purposes. RESULTS: Of the 157 ASCs interviewed by mobile phone, 115 (73.2%) were reached in person. Most of the training (2/2 indicators), supervision (2/3), treatment/modern contraceptive supply (9/9), and reporting (3/3) indicators reached the 80% threshold for sensitivity, while only one supervision indicator and one supply indicator reached 80% for specificity. In contrast, most of the stock-out indicators (8/9) reached 80% for specificity, while only two indicators reached the threshold for sensitivity. CONCLUSIONS: The validity of mobile phone-based data was adequate for general training, supervision, and supply indicators for iCCM and family planning. With sufficient mobile phone coverage and reliable mobile network connection, mobile phone-based surveys are useful as an alternative for data collection to assess the implementation strength of general activities in hard-to-reach areas.

Disrespectful care in family planning services among youth and adult simulated clients in public sector facilities in Malawi.

BACKGROUND: Provision of high-quality family planning (FP) services improves access to contraceptives. Negative experiences in maternal health have been documented worldwide and likely occur in other services including FP. This study aims to quantify disrespectful care for adult and adolescent women accessing FP in Malawi. METHODS: We used simulated clients (SCs) to measure disrespectful care in a census of public facilities in six districts of Malawi in 2018. SCs visited one provider in each of the 112 facilities: two SCs visits (one adult and one adolescent case scenario) or 224 SC visits total. We measured disrespectful care using a quantitative tool and field notes and report the prevalence and 95% confidence intervals for the indicators and by SC case scenarios contextualized with quotes from the field notes. RESULTS: Some SCs (12%) were refused care mostly because they did not agree to receive a HIV test or vaccination, or less commonly because the clinic was closed during operating hours. Over half (59%) of the visits did not have privacy. The SCs were not asked their contraceptive preference in 57% of the visits, 28% reported they were not greeted respectfully, and 20% reported interruptions. In 18% of the visits the SCs reported humiliation such as verbal abuse. Adults SCs received poorer counseling compared to the adolescent SCs with no other differences found. CONCLUSIONS: We documented instances of refusal of care, lack of privacy, poor client centered care and humiliating treatment by providers. We recommend continued effort to improve quality of care with an emphasis on client treatment, regular quality assessments that include measurement of disrespectful care, and more research on practices to reduce it.

Key informant perspectives on the challenges and opportunities for using routine health data for decision-making in Senegal.

BACKGROUND: Increasing the performance of routine health information systems (RHIS) is an important policy priority both globally and in Senegal. As RHIS data become increasingly important in driving decision-making in Senegal, it is imperative to understand the factors that determine their use. METHODS: Semi-structured interviews were conducted with 18 high- and mid-level key informants active in the malaria, tuberculosis and HIV programmatic areas in Senegal. Key informants were employed in the relevant divisions of the Senegal Ministry of Health or nongovernmental / civil society organizations. We asked respondents questions related to the flow, quality and use of RHIS data in their organizations. A framework approach was used to analyze the qualitative data. RESULTS: Although the respondents worked at the strategic levels of their respective organizations, they consistently indicated that data quality and data use issues began at the operational level of the health system before the data made its way to the central level. We classify the main identified barriers and facilitators to the use of routine data into six categories and attempt to describe their interrelated nature. We find that data quality is a central and direct determinant of RHIS data use. We report that a number of upstream factors in the Senegal context interact to influence the quality of routine data produced. We identify the sociopolitical, financial and system design determinants of RHIS data collection, dissemination and use. We also discuss the organizational and infrastructural factors that influence the use of RHIS data. CONCLUSIONS: We recommend specific prescriptive actions with potential to improve RHIS performance in Senegal, the quality of the data produced and their use. These actions include addressing sociopolitical factors that often interrupt RHIS functioning in Senegal, supporting and motivating staff that maintain RHIS data systems as well as ensuring RHIS data completeness and representativeness. We argue for improved coordination between the various stakeholders in order to streamline RHIS data processes and improve transparency. Finally, we recommend the promotion of a sustained culture of data quality assessment and use.

Linking household surveys and facility assessments: a comparison of geospatial methods using nationally representative data from Malawi.

BACKGROUND: Linking facility and household surveys through geographic methods is a popular technique to draw conclusions about the relationship between health services and population health outcomes at local levels. These methods are useful tools for measuring effective coverage and tracking progress towards Universal Health Coverage, but are understudied. This paper compares the appropriateness of several geospatial methods used for linking individuals (within displaced survey cluster locations) to their source of family planning (at undisplaced health facilities) at a national level. METHODS: In Malawi, geographic methods linked a population health survey, rural clusters from the Woman's Questionnaire of the 2015 Malawi Demographic and Health Survey (MDHS 2015), to Malawi's national health facility census to understand the service environment where women receive family planning services. Individuals from MDHS 2015 clusters were linked to health facilities through four geographic methods: (i) closest facility, (ii) buffer (5 km), (iii) administrative boundary, and (iv) a newly described theoretical catchment area method. Results were compared across metrics to assess the number of unlinked clusters (data lost), the number of linkages per cluster (precision of linkage), and the number of women linked to their last source of modern contraceptive (appropriateness of linkage). RESULTS: The closest facility and administrative boundary methods linked every cluster to at least one facility, while the 5-km buffer method left 288 clusters (35.3%) unlinked. The theoretical catchment area method linked all but one cluster to at least one facility (99.9% linked). Closest facility, 5-km buffer, administrative boundary, and catchment methods linked clusters to 1.0, 1.4, 21.1, and 3.3 facilities on average, respectively. Overall, the closest facility, 5-km buffer, administrative boundary, and catchment methods appropriately linked 64.8%, 51.9%, 97.5%, and 88.9% of women to their last source of modern contraceptive, respectively. CONCLUSIONS: Of the methods studied, the theoretical catchment area linking method loses a marginal amount of population data, links clusters to a relatively low number of facilities, and maintains a high level of appropriate linkages. This linking method is demonstrated at scale and can be used to link individuals to qualities of their service environments and better understand the pathways through which interventions impact health.

Testing the validity and feasibility of using a mobile phone-based method to assess the strength of implementation of family planning programs in Malawi.

BACKGROUND: To effectively deliver on proposed objectives, it is vital that practitioners, policymakers, and other stakeholders are able to clearly understand how strongly their large-scale program is being implemented. This study sought to test the feasibility, cost-effectiveness, and validity of a phone-based method as an innovative and cost-efficient approach to assessing program implementation strength (through an Implementation Strength Assessment - ISA), alternative to the traditional in-person field methods. METHODS: We conducted 701 mobile phone and 356 in-person interviews with facility in-Charges and two types of community health workers who provide family planning services in the Dowa and Ntcheu districts in Malawi. Responses received via the phone interview were validated through in-person review of records and inspections. Sensitivity and specificity were calculated to determine validity. RESULTS: Most indicators at the health facility and community health worker levels were above a 70% threshold for sensitivity. However, there were fewer indicators that met this threshold for specificity. The primary reason for lower specificity was due to poor recordkeeping. Collecting data via mobile phone was found to be feasible and twice as cost-efficient as collecting the same data via in-person inspections. CONCLUSIONS: The rapid increase in mobile phone ownership and network availability in lower income countries could offer an alternative, cost-effective avenue to collect data for a better understanding of program implementation. Through rigorous assessment, this study found that using mobile phones could be a low-cost alternative to collect data on health system delivery of services, especially in places where routine data quality is poor and traditional, in-person methods are costly.

Youth accessing reproductive health services in Malawi: drivers, barriers, and suggestions from the perspectives of youth and parents.

BACKGROUND: Malawi has made progress in increasing its overall modern contraceptive prevalence rate since 2000, resulting in a dramatic reduction in its total fertility rate. However, youth, 15-24 years, have not had the same successes. Teenage pregnancies are on the rise and little progress has been made in reducing unmet need for family planning among youth. With two-thirds of the population under the age of 25 and with Malawi's rapid population growth, reducing unmet need for family planning among youth remains a priority for the government's reproductive health agenda. To further explore this situation, we conducted a qualitative study to explore the perspectives of youth and adults about the drivers and barriers to youth accessing family planning in Malawi and their ideas to improve services. METHODS: We conducted 34 focus group discussions with youth aged 15-24 and parents or legal guardians of female youth in 3 districts in Malawi. Focus groups were translated and transcribed. Data was input into Dedoose and analyzed using a thematic framework to identify broader patterns and themes. RESULTS: Youth participants felt motivated to use family planning to protect themselves from sexually transmitted diseases and to prevent unwanted pregnancies. Females focused on the consequences of unplanned pregnancies and believed family planning services were targeted primarily at them, while males thought family planning services targeted males and females equally. Barriers to youth accessing family planning included contraception misconceptions, the costs of family planning services, and negative attitudes. Parents had mixed views on family planning. While many parents acknowledged they could play a role in supporting youth, most said they are reluctant to support youth using family planning. Participants said improving counseling services, integrating family planning services and education within school curricula, and utilizing youth clubs could improve family planning services for youth. CONCLUSIONS: Policy makers and program implementers should consider the diverse preferences among youth and parents and continue seeking their input when designing policies and programs. Youth clubs and school-based services were among the most common suggestions. However, the effectiveness of youth clubs and school-based initiatives to increase contraceptive use among youth in Malawi is not clear.

Role of Food Insecurity in Outbreak of Anthrax Infections among Humans and Hippopotamuses Living in a Game Reserve Area, Rural Zambia.

In September 2011, a total of 511 human cases of anthrax (Bacillus anthracis) infection and 5 deaths were reported in a game management area in the district of Chama, Zambia, near where 85 hippopotamuses (Hippopotamus amphibious) had recently died of suspected anthrax. The human infections generally responded to antibiotics. To clarify transmission, we conducted a cross-sectional, interviewer-administered household survey in villages where human anthrax cases and hippopotamuses deaths were reported. Among 284 respondents, 84% ate hippopotamus meat before the outbreak. Eating, carrying, and preparing meat were associated with anthrax infection. Despite the risk, 23% of respondents reported they would eat meat from hippopotamuses found dead again because of food shortage (73%), lack of meat (12%), hunger (7%), and protein shortage (5%). Chronic food insecurity can lead to consumption of unsafe foods, leaving communities susceptible to zoonotic infection. Interagency cooperation is necessary to prevent outbreaks by addressing the root cause of exposure, such as food insecurity.

Effect of an electronic alert on treatment of skin and soft tissue infections.

This is a prospective intervention study conducted between 2007 and 2011 to evaluate whether an electronic alert can influence provider practice in treatment of skin and soft tissue infections (SSTIs). A best-practice alert (BPA) was programmed to appear for intervention ICD-9 SSTI diagnoses. Controls were patients who had other SSTI ICD-9 codes where the BPA was not programmed to fire. Rate of culture taken in patients was compared between patients in the intervention and control groups. We found that cultures were taken among 13.5% of the intervention group and 5.4% of the control group (p <.0001). A logistic regression analysis controlling for covariates showed the odds of the intervention group having a culture taken was 2.6 times that of the control group. The results of this study support the use of BPAs for improving the management of SSTIs.

Association of neighborhood-level factors with hospitalization for community-associated methicillin-resistant Staphylococcus aureus, New York City, 2006: a multilevel observational study.

BACKGROUND: Hospitalizations with community-associated methicillin-resistant Staphylococcus aureus (CA-MRSA) infection have increased in New York City, with substantial geographic variation across neighborhoods. While individual-level risk factors, such as age, sex, HIV infection, and diabetes have been described, the role of neighborhood-level factors (e.g., neighborhood HIV prevalence or income) has not been examined. METHODS: To explore plausible neighborhood-level factors associated with CA-MRSA-related hospitalizations, a retrospective analysis was conducted using New York City hospital discharges from 2006 and New York City-specific survey and health department surveillance data. CA-MRSA-related hospitalizations were identified using diagnosis codes and admission information. Associations were determined by using sex-specific multilevel logistic regression. RESULTS: The CA-MRSA hospitalization rate varied by more than six-fold across New York City neighborhoods. Females hospitalized with CA-MRSA had more than twice the odds of residing in neighborhoods in the highest quintile of HIV prevalence (adjusted odds ratio [AOR](Q5 vs. Q1) 2.3, 95% CI: 1.2, 2.7). Both males and females hospitalized with CA-MRSA had nearly twice the odds of residing in neighborhoods with moderately high proportion of men who have sex with men (MSM) residing in the neighborhood (males: AOR(Q4 vs. Q1) 1.7, 95% CI: 1.1, 2.7; females: AOR(Q4 vs. Q1) 2.0, 95% CI: 1.1, 3.6); but this association did not hold for neighborhoods in the highest quintile (males: AOR(Q5 vs. Q1) 1.2, 95% CI: 0.76, 1.8; females: AOR(Q5 vs. Q1) 1.5, 95% CI: 0.82, 2.7). CONCLUSIONS: Neighborhood-level characteristics were associated with CA-MRSA hospitalization odds, independent of individual-level risk factors, and may contribute to the population-level burden of CA-MRSA infection.

Community associated methicillin resistant Staphylococcus aureus among New York City men who have sex with men: qualitative research findings and implications for public health practice.

Academic literature has recorded increased microbial resistance in the United States and recent news media has adversely portrayed men who have sex with men (MSM) at increased risk for community associated methicillin resistant Staphylococcus aureus (CA-MRSA) transmission. CA-MRSA is a specific type of bacteria resistant to certain antibiotics, which limits treatment options for those needing clinical care. Infection can manifest as painful abscesses and can cause severe illness. With increased CA-MRSA infections overall, and attention given to MSM populations regarding CA-MRSA, as well as the fact that limited data on sociocultural factors that may facilitate transmission, we undertook a qualitative study to explore contextual influences that may fuel infection among MSM in New York City so that public health professionals can better recognize, and respond appropriately to, potential future outbreaks. In-depth interviews were used to qualitatively investigate perceptions and beliefs regarding transmission, as well as community understandings of treatment options. Participants included thirteen MSM who reported a previous CA-MRSA infection and nine community practitioners. A thematic content analysis of these interviews was conducted and data suggests that behaviors and exposures associated with transmission of CA-MRSA are common in certain MSM networks. Specifically, sociocultural influences and methamphetamine use activities were found to contribute to CA-MRSA transmission. We underscore the role of public health and health services practitioners in providing appropriate CA-MRSA awareness and education to MSM populations.

Measuring Quality of Maternal, Neonatal, Child, Reproductive Health and Nutrition Care with tools developed by the RADAR project and tested in Sub Saharan Africa.

Increasing coverage of evidence-based maternal, neonatal, child, reproductive health and nutrition (MNCRHN) programs in low- and middle-income countries has coincided with dramatic improvements in health despite variable quality of implementation. Comprehensive evaluation to inform program improvement requires standardized but adaptable tools, which the Real Accountability, Data Analysis for Results (RADAR) project has developed. To inform selection of tools and methods packages ('packages') to measure program quality of care (QoC), we documented experiences testing the packages, which were developed and adapted based on global and local expertise, and pre- and pilot-testing. We conducted cross-sectional studies in 2018-2019 on the quality of 1) integrated community case management, 2) counseling on maternal, infant, and young child feeding, 3) intrapartum care, and 4) family planning counseling in Mali, Mozambique, Tanzania, and Malawi. Herein we describe package performance and highlight experiences that inform their selection and use. Direct observation packages provided high-quality, immediately applicable results but they required specialized expertise, in-person collection, adequate patient volume, reasonable wait times, and unambiguously 'correct' provision of care. General satisfaction questions from exit interview packages produced unvaryingly positive responses despite variable observed quality of care. Variation increased when questions were more targeted, but findings on caregiver and client's recall of recommendations were more actionable. When interactive, clinical vignettes can capture knowledge of clinical care. But for conditions that can be simulated, like provision of family planning counseling, we could capture provider practice from simulated clients. Clinicians could more easily demonstrate tactile aspects of intrapartum care using observed structured clinical examinations, but this method required storage and transport of the required mannequins. Based on our findings we recommend ten questions upon which evaluators can base package selection. Findings from these packages inform programs and, in the context of comprehensive program evaluation enable us to link programs with impact.

Assessing provider performance of intrapartum care using simulated encounters and clinical vignettes: A comparison study from Tanzania.

OBJECTIVE: To compare clinical vignettes and objective structured clinical examinations (OSCE) as methods for assessing the quality of intrapartum care among skilled providers in rural primary-level health facilities in Tanzania. METHODS: Cross-sectional study conducted at six health facilities in the Simiyu region of Tanzania. Providers were assessed using OSCE and clinical vignettes in spontaneous delivery, neonatal resuscitation, and management of postpartum hemorrhage. Trained researchers used a structured clinical checklist. The frequencies of items are presented as percentages and the agreement of the methods of assessment are reported using kappa statistics (high: kappa > 0.80, moderate: kappa = 0.60-0.80, low: kappa < 0.60). RESULTS: Most healthcare providers were female (60.7%), registered nurses by training (29.0%), and worked in a dispensary (56.1%), with an average age of 33 years and an average of 7.4 years of experience in their respective professions. Five items had high agreement between OSCE and clinical vignettes: postpartum vital signs every 15 min, oxytocin within 1 min of birth, diagnosis of postpartum hemorrhage, elevating legs of the mother, and deciding on manual compression of the uterus. CONCLUSION: OSCE and clinical vignettes should be viewed as complimentary to one another in the assessment of provider knowledge and skill, with priority given to OSCE, particularly in intrapartum care.

Behavioral Determinants of Routine Health Information System Data Use in Senegal: A Qualitative Inquiry Based on the Integrated Behavioral Model.

Routine health information system (RHIS) data are essential in driving decision making and planning in health systems as well as health programs. However, despite their importance, these data are underutilized, and the underlying individual-level facilitators and barriers to use remain understudied. In this research, we applied the Integrated Behavior Model (IBM) to examine how attitudes toward RHIS data, perceived norms concerning RHIS data use, and the ability to use RHIS data influence the demand and use of RHIS data among stakeholders in Senegal. Using data from interviews with respondents working at national levels of malaria, HIV, and TB control programs in Senegal, we used a framework analysis approach to apply the IBM behavioral constructs and identify their linkages to RHIS data use. We found that attitudes about the quality, availability, and relevance of RHIS data for decision making were important in driving data use among respondents. Institutional expectations, organizational protocols, policies, and practices around RHIS data ultimately shape social norms around the use of the data. Although we found that perceived ability and self-efficacy to use RHIS data were not barriers to RHIS data use among stakeholders at the strategic levels of their respective organizations, these were reported to be barriers at lower levels of the health system. Low perceived control of the RHIS data production process ultimately reduced RHIS data use for decision making among the strategic-level respondents. We recommend context-specific reexamination of existing RHIS interventions with a renewed emphasis on behavioral aspects of data use. The IBM can help guide practitioners, policy makers, and academics to address multiple socioecological factors that influence data use behavior when recommending RHIS and data use solutions.

Comparing program supervision with an external RADAR evaluation of quality of care in integrated community case management for childhood illnesses in Mali.

BACKGROUND: Many countries have adopted integrated community case management (iCCM) to reduce mortality among children under five years from common childhood illnesses. The 2016-2020 Malian Red Cross iCCM program trained 441 Community Health Workers (CHWs) to treat malaria, pneumonia, diarrhea, and malnutrition for children under five years of age in six districts. Implementation strength and quality of care (QoC) were assessed through the program's supervision function, using the Malian Ministry of Health's system. OBJECTIVE: This paper compares methods and results of program supervision data and an independent evaluation to assess the effectiveness of program implementation and supervision and inform program improvement. It also presents the benefits and limitations of each method. METHOD: An independent QoC evaluation was conducted using tools developed by the Real Accountability: Data Analysis for Results (RADAR) project, hereafter referred to as the RADAR evaluation. RADAR evaluation data collected in July and August 2018 were compared with program supervision data collected mostly between May and December 2018. RESULTS: The RADAR evaluation provided detailed findings on correct assessment, classification, and treatment per illness, medication type, and dosage. Program supervision combined the findings for all illnesses, medication type, and dosage due to limitations in the data collection process. Six indicators were comparable between both methods. Findings were similar for temperature and mid-upper arm circumference measurements but diverged between program supervision and the RADAR evaluation, respectively, on correct classification for all illnesses (87.1% vs. 65.3%), correct treatment for all illnesses (69.5% vs. 39.8%), correct respiratory rate counting (88.5% vs. 54.7%), and administering the first dose by CHW (75.4% vs. 65.0%). Findings from the RADAR evaluation guided improvements in program supervision. CONCLUSIONS: A robust program supervision system can serve as a credible method to assess QoC. However, a rigorous independent QoC evaluation provides a valuable benchmark to gauge the effectiveness of the supervisory process.

Feasibility of using a World Health Organization-standard methodology for Sample Vital Registration with Verbal Autopsy (SAVVY) to report leading causes of death in Zambia: results of a pilot in four provinces, 2010.

BACKGROUND: Verbal autopsy (VA) can be used to describe leading causes of death in countries like Zambia where vital events registration does not produce usable data. The objectives of this study were to assess the feasibility of using verbal autopsy to determine age-, sex-, and cause-specific mortality in a community-based setting in Zambia and to estimate overall age-, sex-, and cause-specific mortality in the four provinces sampled. METHODS: A dedicated census was conducted in regions of four provinces chosen by cluster-sampling methods in January 2010. Deaths in the 12-month period prior to the census were identified during the census. Subsequently, trained field staff conducted verbal autopsy interviews with caregivers or close relatives of the deceased using structured and unstructured questionnaires. Additional deaths were identified and respondents were interviewed during 12 months of fieldwork. After the interviews, two physicians independently reviewed each VA questionnaire to determine a probable cause of death. RESULTS: Among the four provinces (1,056 total deaths) assessed, all-cause mortality rate was 17.2 per 1,000 person-years (95% confidence interval [CI]: 12.4, 22). The seven leading causes of death were HIV/AIDS (287, 27%), malaria (111, 10%), injuries and accidents (81, 8%), diseases of the circulatory system (75, 7%), malnutrition (58, 6%), pneumonia (56, 5%), and tuberculosis (50, 5%). Those who died were more likely to be male, have less than or equal to a primary education, and be unmarried, widowed, or divorced compared to the baseline population. Nearly half (49%) of all reported deaths occurred at home. CONCLUSIONS: The 17.2 per 1,000 all-cause mortality rate is somewhat similar to modeled country estimates. The leading causes of death -- HIV/AIDS, malaria, injuries, circulatory diseases, and malnutrition -- reflected causes similar to those reported for the African region and by other countries in the region. Results can enable the targeting of interventions by region, disease, and population to reduce preventable death. Collecting vital statistics using standardized Sample Vital Registration with Verbal Autopsy (SAVVY) methods appears feasible in Zambia. If conducted regularly, these data can be used to evaluate trends in estimated causes of death over time.

The aggregate effect of implementation strength of family planning programs on modern contraceptive use at the health systems level in rural Malawi.

To explore the association between the strength of implementation of family planning (FP) programs on the use of modern contraceptives. Specifically, how strongly these programs are being implemented across a health facility's catchment area in Malawi and the odds of a woman in that catchment area is using modern contraceptives. This information can be used to assess whether the combined impact of multiple large-scale FP programs is leading to change in the health outcomes they aim to improve. We used data from the 2017 Implementation Strength Assessment (ISA) that quantified how much of family planning programs at the health facility and community health worker levels were being implemented across every district of Malawi. We used a summary measure developed in a previous study that employs quantitative methods to combine data across FP domains and health system levels. We tested the association of this summary measure for implementation strength with household data from the 2015 Malawi Demographic Health Survey (DHS). We found that areas with stronger implementation of FP programs had higher odds of women using modern contraceptives compared with areas with weaker implementation. The association of ISA with use of modern contraception was different by education, marital status, and geography. After controlling for these factors, we found that the adjusted odds of using a modern contraceptive was three times higher in catchment areas with high implementation strength compared to those with lower strength. Metrics that summarize how strongly FP programs are being implemented were used to show a statistically significantly positive relationship between increasing implementation strength and higher rates of modern contraceptive use. Decisionmakers at the various levels of health authority can use this type of summary measure to better understand the combined impact of their diverse FP programming and inform future programmatic and policy decisions. The findings also reinforce the idea that having a well-supported and supplied cadre of community health workers supplementing FP provision at the health facility can be an important health systems mechanism, especially in rural settings and to target youth populations.

Epidemiologic investigation and targeted vaccination initiative in response to an outbreak of meningococcal disease among illicit drug users in Brooklyn, New York.

BACKGROUND: An outbreak of serogroup C meningococcal disease that involved illicit drug users and their contacts occurred in Brooklyn, New York, during 2005 and 2006. METHODS: The objectives of this study were to identify the population at risk for meningococcal disease, describe efforts to interrupt disease transmission, and assess the impact of a vaccine initiative. Descriptive and molecular epidemiological analysis was used to define the extent of the outbreak and the common risk factors among outbreak-related cases. A vaccine initiative that used community-based service providers was targeted to illicit drug users and their close contacts. The vaccine initiative was assessed through cessation of outbreak-related cases and the reduction in carriage rate. RESULTS: The investigation identified 23 outbreak-related cases of serogroup C meningococcal disease; 17 isolates were indistinguishable and 4 isolates were closely related according to pulsed-field gel electrophoresis. Two additional culture-negative cases had epidemiological links to laboratory-confirmed cases. The median age of patients with outbreak-related cases was 41 years, and 19 (83%) of 23 patients reported an association with illicit drug use. There were 7 outbreak-related deaths. Vaccination was administered to 2763 persons at 29 community locations, including methadone treatment centers, syringe-exchange programs, and soup kitchens. Three additional cases of meningococcal disease due to strains with the same pulsed-field gel electrophoresis pattern were identified after the vaccination initiative. CONCLUSIONS: Community-based outbreaks of meningococcal disease are difficult to control, and the decision to vaccinate is not straightforward. Current national guidelines for implementing a vaccination campaign are not strict criteria and cannot be expected to accommodate the myriad of factors that occur in community-based invasive meningococcal disease outbreaks, such as the inability to enumerate the population at risk.