More Tethered to the EHR: EHR Workload Trends Among Academic Primary Care Physicians, 2019-2023.

PURPOSE: The purpose of this study is to evaluate recent trends in primary care physician (PCP) electronic health record (EHR) workload. METHODS: This longitudinal study observed the EHR use of 141 academic PCPs over 4 years (May 2019 to March 2023). Ambulatory full-time equivalency (aFTE), visit volume, and panel size were evaluated. Electronic health record time and inbox message volume were measured per 8 hours of scheduled clinic appointments. RESULTS: From the pre-COVID-19 pandemic year (May 2019 to February 2020) to the most recent study year (April 2022 to March 2023), the average time PCPs spent in the EHR per 8 hours of scheduled clinic appointments increased (+28.4 minutes, 7.8%), as did time in orders (+23.1 minutes, 58.9%), inbox (+14.0 minutes, 24.4%), chart review (+7.2 minutes, 13.0%), notes (+2.9 minutes, 2.3%), outside scheduled hours on days with scheduled appointments (+6.4 minutes, 8.2%), and on unscheduled days (+13.6 minutes, 19.9%). Primary care physicians received more patient medical advice requests (+5.4 messages, 55.5%) and prescription messages (+2.3, 19.5%) per 8 hours of scheduled clinic appointments, but fewer patient calls (-2.8, -10.5%) and results messages (-0.3, -2.7%). While total time in the EHR continued to increase in the final study year (+7.7 minutes, 2.0%), inbox time decreased slightly from the year prior (-2.2 minutes, -3.0%). Primary care physicians' average aFTE decreased 5.2% from 0.66 to 0.63 over 4 years. CONCLUSIONS: Primary care physicians' time in the EHR continues to grow. While PCPs' inbox time may be stabilizing, it is still substantially higher than pre-pandemic levels. It is imperative health systems develop strategies to change the EHR workload trajectory to minimize PCPs' occupational stress and mitigate unnecessary reductions in effective physician workforce resulting from the increased EHR burden.

Refining Vendor-Defined Measures to Accurately Quantify EHR Workload Outside Time Scheduled With Patients.

Accurately quantifying clinician time spent on electronic health record (EHR) activities outside the time scheduled with patients is critical for understanding occupational stress associated with ambulatory clinic environments. We make 3 recommendations regarding EHR workload measures that are intended to capture time working in the EHR outside time scheduled with patients, formally defined as work outside of work (WOW): (1) separate all time working in the EHR outside of time scheduled with patients from time working in the EHR during time scheduled with patients, (2) do not exclude any time before or after scheduled time with patients, and (3) encourage the EHR vendor and research communities to develop and standardize validated, vendor-agnostic methods for measuring active EHR use. Attributing all EHR work outside time scheduled with patients to WOW, regardless of when it occurs, will produce an objective and standardized measure better suited for use in efforts to reduce burnout, set policy, and facilitate research.

Primary Care Patients' and Staff's Perceptions of Self-Rooming as Alternative to Waiting Rooms.

PURPOSE: Most patients are escorted to exam rooms (escorted rooming) although patients directing themselves to their exam room (self-rooming) saves patient and staff time while increasing patient satisfaction. This study assesses patient and staff perceptions after pragmatic implementation of self-rooming. METHODS: In October-December 2020, we surveyed patients and staff in 25 primary care clinics after our institution expanded self-rooming from 4 specially built clinics during the COVID-19 pandemic. Semi-structured surveys asked about rooming process used, rooming process preferred, and perceptions of self-rooming compared with escorted rooming. RESULTS: Most patients (n = 1,561) preferred self-rooming (86%), especially among patients aged <65 years and in family medicine clinics. Few patients felt less welcomed (10.6%), less cared about (6.8%), more isolated (15.6%), more lost/confused (7.6%), or more frustrated (3.2%) with self-rooming compared with escorted rooming. Early-adopter clinics that implemented self-rooming ≤2016 had even lower rates of patients feeling more isolated, lost/confused, or frustrated with self-rooming compared with escorted rooming.Over one-half of staff (n = 241; 180 clinical, 61 nonclinical) preferred self-rooming (59%) and thought most patients liked self-rooming (65.8%), especially among clinical staff and in early adopter clinics (≤2016). Few staff reported worse waiting times for patients (12.4%), medical assistants (MAs) (15.9%), and clinicians (16.4%) or worse crowding in waiting areas (1.7%) and hallways (10.1%). Unlike patient-reported confusion (7.6%), most staff thought self-rooming led to more patient confusion (63.8%), except in early-adopter clinics (44.4%). CONCLUSIONS: Self-rooming is a patient-centered innovation that is also acceptable to staff. We demonstrated that pragmatic implementation is feasible across primary care without expensive technology or specially designed buildings.

Cancer Survivorship Care Plan Utilization and Impact on Clinical Decision-Making at Point-of-Care Visits with Primary Care: Results from an Engineering, Primary Care, and Oncology Collaborative for Survivorship Health.

Every cancer survivor and his/her primary care provider should receive an individualized survivorship care plan (SCP) following curative treatment. Little is known regarding point-of-care utilization at primary care visits. We assessed SCP utilization in the clinical context of primary care visits. Primary care physicians and advanced practice providers (APPs) who had seen survivors following provision of an SCP were identified. Eligible primary care physicians and APPs were sent an online survey, evaluating SCP utilization and influence on decision-making at the point-of-care, accompanied by copies of the survivor's SCP and the clinic note. Eighty-eight primary care physicians and APPs were surveyed November 2016, with 40 (45%) responding. Most respondents (60%) reported discussing cancer or related issues during the visit. Information needed included treatment (66%) and follow-up visits, and the cancer team was responsible for (58%) vs primary care (58%). Respondents acquired this information by asking the patient (79%), checking oncology notes (75%), the SCP (17%), or online resources (8%). Barriers to SCP use included being unaware of the SCP (73%), difficulty locating it (30%), and finding needed information faster via another mechanism (15%). Despite largely not using the SCP for the visit (90%), most respondents (61%) believed one would be quite or very helpful for future visits. Most primary care visits included discussion of cancer or cancer-related issues. SCPs may provide the information necessary to deliver optimal survivor care but efforts are needed to reduce barriers and design SCPs for primary care use.

Implementing rapid testing for tuberculosis in Mozambique.

PROBLEM: In Mozambique, pulmonary tuberculosis is primarily diagnosed with sputum smear microscopy. However this method has low sensitivity, especially in people infected with human immunodeficiency virus (HIV). Patients are seldom tested for drug-resistant tuberculosis. APPROACH: The national tuberculosis programme and Health Alliance International introduced rapid testing of smear-negative sputum samples. Samples were tested using a polymerase-chain-reaction-based assay that detects Mycobacterium tuberculosis deoxyribonucleic acid and a mutation indicating rifampicin resistance; Xpert® MTB/RIF (Xpert®). Four machines were deployed in four public hospitals along with a sputum transportation system to transfer samples from selected health centres. Laboratory technicians were trained to operate the machines and clinicians taught to interpret the results. LOCAL SETTING: In 2012, Mozambique had an estimated 140,000 new tuberculosis cases, only 34% of which were diagnosed and treated. Of tuberculosis patients, 58% are HIV-infected. RELEVANT CHANGES: From 2012-2013, 1558 people were newly diagnosed with tuberculosis using sputum smears at intervention sites. Xpert® detected M. tuberculosis in an additional 1081 sputum smear-negative individuals, an increase of 69%. Rifampicin resistance was detected in 58/1081 (5%) of the samples. However, treatment was started in only 82% of patients diagnosed by microscopy and 67% of patients diagnosed with the rapid test. Twelve of 16 Xpert® modules failed calibration within 15 months of implementation. LESSONS LEARNT: Using rapid tests to diagnose tuberculosis is promising but logistically challenging. More affordable and durable platforms are needed. All patients diagnosed with tuberculosis need to start and complete treatment, including those who have drug resistant strains.

Perspectives of key stakeholders regarding task shifting of care for HIV patients in Mozambique: a qualitative interview-based study with Ministry of Health leaders, clinicians, and donors.

BACKGROUND: Task shifting is a common strategy to deliver antiretroviral therapy (ART) in resource-limited settings and is safe and effective if implemented appropriately. Consensus among stakeholders is necessary to formulate clear national policies that maintain high-quality care. We sought to understand key stakeholders' opinions regarding task shifting of HIV care in Mozambique and to characterize which specific tasks stakeholders considered appropriate for specific cadres of health workers. METHODS: National and provincial Ministry of Health leaders, representatives from donor and non-governmental organizations (NGOs), and clinicians providing HIV care were intentionally selected to represent diverse viewpoints. Using open- and closed-ended questions, interviewees were asked about their general support of task shifting, its potential advantages and disadvantages, and whether each of seven cadres of non-physician health workers should perform each of eight tasks related to ART provision. Responses were tallied overall and stratified by current job category. Interviews were conducted between November 2007 and June 2008. RESULTS: Of 62 stakeholders interviewed, 44% held leadership positions in the Ministry of Health, 44% were clinicians providing HIV care, and 13% were donors or employed by NGOs; 89% held a medical degree. Stakeholders were highly supportive of physician assistants performing simple ART-related tasks and unanimous in opposing community health workers providing any ART-related services. The most commonly cited motives to implement task shifting were to increase ART access, decrease physician workload, and decrease patient wait time, whereas chief concerns included reduced quality of care and poor training and supervision. Support for task shifting was higher among clinicians than policy and programme leaders for three specific task/cadre combinations: general mid-level nurses to initiate ART in adults (supported by 75% of clinicians vs. 41% of non-clinicians) and in pregnant women (75% vs. 34%, respectively) and physician assistants to change ART regimens in adults (43% vs. 24%, respectively). CONCLUSIONS: Stakeholders agreed on some ART-related task delegation to lower health worker cadres. Clinicians were more likely to support task shifting than policy and programme leaders, perhaps motivated by their front-line experiences. Harmonizing policy and programme managers' views with those of clinicians will be important to formulate and implement clear policy.

Transmission of nevirapine-resistant HIV type 1 via breast milk to infants after single-dose nevirapine in Beira, Mozambique.

Acquisition of nevirapine (NVP)-resistant human immunodeficiency virus type 1 (HIV-1) by breast-feeding infants after receipt of single-dose NVP to prevent mother-to-child transmission is not well defined. A prospective observational study of 307 infants evaluated the rate of breast milk transmission of NVP-resistant HIV and the concentrations of mutants over time. NVP resistance was detected in 9 of 24 infants (37.5%; 95% confidence interval, 18.8%-59.4%) infected via breast milk. Eight had a pure mutant HIV population at the time infection was first detected, and majority mutant populations persisted in all 6 infants with follow-up specimens. Infection of breast-feeding infants with NVP-resistant HIV resulted in mutants persisting as the dominant virus, which may indefinitely compromise treatment with NVP-based antiretroviral regimens.

Low concentrations of HIV-1 DNA at birth delays diagnosis, complicating identification of infants for antiretroviral therapy to potentially prevent the establishment of viral reservoirs.

Among infants exposed to human immunodeficiency virus type 1 (HIV-1), detection of viral infection at birth was increased by 39% (95% confidence interval, 19%-47%) by increasing DNA input from dried blood spots into polymerase chain reaction. Infants with low concentrations of HIV-1 at birth may be the best target population to evaluate whether immediate antiretroviral therapy can prevent long-term infection.

Results from early programmatic implementation of Xpert MTB/RIF testing in nine countries.

BACKGROUND: The Xpert MTB/RIF assay has garnered significant interest as a sensitive and rapid diagnostic tool to improve detection of sensitive and drug resistant tuberculosis. However, most existing literature has described the performance of MTB/RIF testing only in study conditions; little information is available on its use in routine case finding. TB REACH is a multi-country initiative focusing on innovative ways to improve case notification. METHODS: We selected a convenience sample of nine TB REACH projects for inclusion to cover a range of implementers, regions and approaches. Standard quarterly reports and machine data from the first 12 months of MTB/RIF implementation in each project were utilized to analyze patient yields, rifampicin resistance, and failed tests. Data was collected from September 2011 to March 2013. A questionnaire was implemented and semi-structured interviews with project staff were conducted to gather information on user experiences and challenges. RESULTS: All projects used MTB/RIF testing for people with suspected TB, as opposed to testing for drug resistance among already diagnosed patients. The projects placed 65 machines (196 modules) in a variety of facilities and employed numerous case-finding strategies and testing algorithms. The projects consumed 47,973 MTB/RIF tests. Of valid tests, 7,195 (16.8%) were positive for MTB. A total of 982 rifampicin resistant results were found (13.6% of positive tests). Of all tests conducted, 10.6% failed. The need for continuous power supply was noted by all projects and most used locally procured solutions. There was considerable heterogeneity in how results were reported and recorded, reflecting the lack of standardized guidance in some countries. CONCLUSIONS: The findings of this study begin to fill the gaps among guidelines, research findings, and real-world implementation of MTB/RIF testing. Testing with Xpert MTB/RIF detected a large number of people with TB that routine services failed to detect. The study demonstrates the versatility and impact of the technology, but also outlines various surmountable barriers to implementation. The study is not representative of all early implementer experiences with MTB/RIF testing but rather provides an overview of the shared issues as well as the many different approaches to programmatic MTB/RIF implementation.

Strengthening integrated primary health care in Sofala, Mozambique.

BACKGROUND: Large increases in health sector investment and policies favoring upgrading and expanding the public sector health network have prioritized maternal and child health in Mozambique and, over the past decade, Mozambique has achieved substantial improvements in maternal and child health indicators. Over this same period, the government of Mozambique has continued to decentralize the management of public sector resources to the district level, including in the health sector, with the aim of bringing decision-making and resources closer to service beneficiaries. Weak district level management capacity has hindered the decentralization process, and building this capacity is an important link to ensure that resources translate to improved service delivery and further improvements in population health. A consortium of the Ministry of Health, Health Alliance International, Eduardo Mondlane University, and the University of Washington are implementing a health systems strengthening model in Sofala Province, central Mozambique. DESCRIPTION OF IMPLEMENTATION: The Mozambique Population Health Implementation and Training (PHIT) Partnership focuses on improving the quality of routine data and its use through appropriate tools to facilitate decision making by health system managers; strengthening management and planning capacity and funding district health plans; and building capacity for operations research to guide system-strengthening efforts. This seven-year effort covers all 13 districts and 146 health facilities in Sofala Province. EVALUATION DESIGN: A quasi-experimental controlled time-series design will be used to assess the overall impact of the partnership strategy on under-5 mortality by examining changes in mortality pre- and post-implementation in Sofala Province compared with neighboring Manica Province. The evaluation will compare a broad range of input, process, output, and outcome variables to strengthen the plausibility that the partnership strategy led to health system improvements and subsequent population health impact. DISCUSSION: The Mozambique PHIT Partnership expects to provide evidence on the effect of efforts to improve data quality coupled with the introduction of tools, training, and supervision to improve evidence-based decision making. This contribution to the knowledge base on what works to enhance health systems is highly replicable for rapid scale-up to other provinces in Mozambique, as well as other sub-Saharan African countries with limited resources and a commitment to comprehensive primary health care.

Effects of short-course zidovudine on the selection of nevirapine-resistant HIV-1 in women taking single-dose nevirapine.

Single-dose nevirapine (sdNVP) given to prevent mother-to-child-transmission of HIV-1 selects NVP-resistance. Short-course zidovudine (ZDV) was hypothesized to lower rates of NVP-resistance. HIV-1 infected pregnant women administered sdNVP with or without short-course ZDV were assessed for HIV-1 mutations (K103N, Y181C, G190A, and V106M) prior to delivery and postpartum. Postpartum NVP-resistance was lower among 31 taking ZDV+sdNVP compared to 33 taking only sdNVP (35.5% vs. 72.7%; χ2 P = .003). NVP mutants decayed to <2% in 24/35 (68.6%) at a median 6 months postpartum, with no differences based on ZDV use (logrank P = .99). Short-course ZDV was associated with reduced NVP-resistance mutations among women taking sdNVP.

An assessment of the accuracy and availability of data in electronic patient tracking systems for patients receiving HIV treatment in central Mozambique.

BACKGROUND: Since the rapid scale-up of antiretroviral therapy (ART) programs in sub-Saharan Africa, electronic patient tracking systems (EPTS) have been deployed to respond to the growing demand for program monitoring, evaluation and reporting to governments and donors. These routinely collected data are often used in epidemiologic and operations research studies intended to improve programs. To ensure accurate reporting and good quality for research, the reliability and completeness of data systems need to be assessed and reported. We assessed the completeness and reliability of EPTS used in 16 HIV care and treatment clinics in Manica and Sofala provinces of Mozambique. METHODS: We conducted a cross-sectional study to assess the completeness and reliability of key variables in the electronic data system for patients enrolling in 16 public sector HIV treatment clinics between 1 July 2004 and 30 June 2008. Data from the electronic database was compared with data abstracted from a stratified random sample of 520 patient charts. Percent agreement, kappa scores and concordance correlation coefficients were calculated for specified variables. Percentile bootstrap confidence intervals were calculated to account for the stratified nature of our sampling. RESULTS: A total of 16,149 patients with a median age of 33 years and a median CD4 count of 151 enrolled in these 16 clinics between 1 July 2004 and 30 June 2008. The level of completeness was high for most variables with height (18.6%) and weight (11.5%) having the highest amount of missing data. The level of agreement for available data was also high with reliability statistics of 0.95 (95% CI: 0.92-0.98) for gender, 0.91 (95% CI: 0.80-1.00) for pre-ART CD4 value and 0.97 (95% CI: 0.95-0.99) for patient retention. CONCLUSIONS: Electronic patient tracking systems have been deployed to respond to the growing monitoring, evaluation and reporting requirements. In our cross-sectional study of clinics in Manica and Sofala provinces of Mozambique, we found high levels of completeness and reliability for key variables indicating that these electronic databases provided adequate data not only for monitoring and evaluation but also for research. Routine evaluations of the completeness and reliability of these databases need to occur to ensure high quality data are being used for reporting and research.

Reduction in Medication Refill Encounters Through Primary Care Redesign Workflow Changes.

With a goal of improving efficiency and reducing workload outside of visits, we sought to examine a primary care redesign process aimed at reducing refill requests made outside of office visits. Data on the number of refill encounters per panel member were collected at 17 clinics before, during, and after the implementation of a redesign process. There was an initial reduction in the number of medication refill encounters, and the rate of refill encounters continued to decline following implementation. Variation across clinic contexts suggests that redesign processes may need to be tailored for different settings to optimize effectiveness.

Patients' View of Their Primary Care Telemedicine During the COVID-19 Pandemic and Implications for Future Integration: A Multimethod Study.

INTRODUCTION: Telemedicine has become an integral part of primary care since the COVID-19 pandemic. This paper reports patients' assessments of their early telemedicine visits. METHODS: Adult primary care patients who had a telemedicine visit were identified from electronic medical records of a large Midwestern health system and randomly invited to participate in semistructured interviews. Participants compared telemedicine visits (audio and video) to face-to-face visits on measures of satisfaction and answered open-ended questions about the technology, primary care relationships, and ongoing use of telemedicine. Interviews were recorded and responses transcribed for qualitative analysis. RESULTS: The quantitative results revealed participants valued convenience and judged telemedicine visits "about the same" as office visits on satisfaction measures. Participants were largely willing to have another telemedicine visit but were concerned with the technological challenges and lack of physical examination. The qualitative analysis found most participants reported that telemedicine care was best with a known clinician. Further, they judged telemedicine to be best for follow-ups and simple or single problems and believed it should be balanced with face-to-face visits. CONCLUSIONS: Participants expect telemedicine will continue and have clearly articulated their telemedicine preferences. These preferences include telemedicine with a known clinician, the visits that they judged most appropriate for telemedicine, the need to balance telemedicine with face-to-face visits, and assured technologic access. The need for quality measures beyond patient satisfaction and the role of team-based telemedicine care emerged as areas for further research.

The effect of remote scribes on primary care physicians' wellness, EHR satisfaction, and EHR use.

BACKGROUND: Physician burnout is a major problem in the United States. Small studies suggest scribes can improve clinician satisfaction, but scribe programs have not been evaluated using separate control groups or structured measures of electronic health record (EHR) use. METHODS: We conducted a pre-post, non-randomized controlled evaluation of a remote scribe pilot program introduced in September 2019 in an academic primary care practice. Scribes were paired with physicians via an audio-only cellphone connection to hear and document in real-time. Physician wellness was measured with the 10-item Mini-Z and 16-item Professional Fulfillment Index. EHR use was measured using vendor-derived platforms that provide routine EHR-related data. RESULTS: 37 of 38 scribe users (97.4%) and 68 of 160 potential control physicians (42.5%) completed both pre and post intervention questionnaires. Compared with controls, scribe users had improvements in Mini-Z wellness metrics including Joyful Workplace (mean improvement 2.83, 95%CI 0.60, 5.06) and a single-item dichotomized burnout measure (OR 0.15, 95%CI 0.03, 0.71). There were significant reductions among scribe users compared to controls in total EHR time per 8 scheduled hours (-1.14 h, 95%CI -1.55, -0.72), and an increase in the percentage of orders with team contribution (10.4%, 95%CI 5.2, 15.6). These findings remained significant in adjusted analyses. CONCLUSIONS/IMPLICATIONS: A remote scribe program was associated with improvements in physician wellness and reduced EHR use. Healthcare organizations can consider scribe programs to help improve wellness among their physician workforce.

Collaborative care implementation: lessons learned.

The authors drafted a "Shared Values of Collaborative Care" document with fundamental principles to make better group decisions in implementing collaborative care.

Does a Change in Physician Compensation Lead to Changes in Care Delivery in Family Medicine Clinics?

BACKGROUND AND OBJECTIVES: Many highly capitated systems still pay physicians based on relative value units (RVU), which may lead to excessive office visits. We reviewed electronic health records from the family medicine clinic panel members of 97 physicians and 42 residents to determine if a change from RVUs to panel-based compensation influenced care delivery as defined by the number of office visits and telephone contacts per panel member per month. METHODS: A retrospective analysis of the electronic health records of patients seen in 4 residency training clinics, 10 community clinics, and 4 regional clinics was conducted. We assessed face-to-face care delivery and telephone call volume for the clinics individually and for the clinics pooled by clinic type from 1 year before to at least 1 year after the change. RESULTS: Change in physician compensation was not found to have an effect on office visits or telephone calls per panel member per month when pooled by clinic categories. Some significant effects were seen in individual clinics without any clear patterns by clinic size or type. CONCLUSIONS: Change in physician compensation was not a key driver of care delivery in family medicine clinics. Understanding changes in care delivery may require looking at a broad array of system, physician, and patient factors.

Change in sexual activity 12 months after ART initiation among HIV-positive Mozambicans.

We assessed sexual behaviors before and 12-months after ART initiation among 277 Mozambicans attending an HIV clinic. Measured behaviors included the number of sexual partners, condom use, concurrent relationships, disclosure of HIV status, alcohol use, and partners' serostatus. Compared to before ART initiation, increases were seen 12 months after ART in the proportion of participants who were sexually active (48% vs. 64% respondents, P < 0.001) and the proportion of participants with HIV-negative or unknown serostatus partners (45% vs. 80%, P < 0.001). Almost all (96%) concurrent partnerships reported at 12 months formed after ART initiation. Although reported correct and consist condom use increased, the number of unprotected sexual relationships remained the same (n = 45). Non-disclosure of HIV-serostatus to sexual partners was the only significant predictor of practicing unprotected sex with partners of HIV-negative or unknown serostatus. Sexual activity among HIV-positive persons on ART increased 12 months after ART initiation. Ongoing secondary transmission prevention programs addressing sexual activity with multiple partners, disclosure to partners and consistent condom use with serodisconcordant partners must be incorporated throughout HIV care programs.

An assessment of routine primary care health information system data quality in Sofala Province, Mozambique.

BACKGROUND: Primary health care is recognized as a main driver of equitable health service delivery. For it to function optimally, routine health information systems (HIS) are necessary to ensure adequate provision of health care and the development of appropriate health policies. Concerns about the quality of routine administrative data have undermined their use in resource-limited settings. This evaluation was designed to describe the availability, reliability, and validity of a sample of primary health care HIS data from nine health facilities across three districts in Sofala Province, Mozambique. HIS data were also compared with results from large community-based surveys. METHODOLOGY: We used a methodology similar to the Global Fund to Fight AIDS, Tuberculosis and Malaria data verification bottom-up audit to assess primary health care HIS data availability and reliability. The quality of HIS data was validated by comparing three key indicators (antenatal care, institutional birth, and third diptheria, pertussis, and tetanus [DPT] immunization) with population-level surveys over time. RESULTS AND DISCUSSION: The data concordance from facility clinical registries to monthly facility reports on five key indicators--the number of first antenatal care visits, institutional births, third DPT immunization, HIV testing, and outpatient consults--was good (80%). When two sites were excluded from the analysis, the concordance was markedly better (92%). Of monthly facility reports for immunization and maternity services, 98% were available in paper form at district health departments and 98% of immunization and maternity services monthly facility reports matched the Ministry of Health electronic database. Population-level health survey and HIS data were strongly correlated (R = 0.73), for institutional birth, first antenatal care visit, and third DPT immunization. CONCLUSIONS: Our results suggest that in this setting, HIS data are both reliable and consistent, supporting their use in primary health care program monitoring and evaluation. Simple, rapid tools can be used to evaluate routine data and facilitate the rapid identification of problem areas.