The Impact of Alternate Methodological and Structural Assumptions on Results of Cost-effectiveness Analysis: Empirical Evidence using Three Indian Economic Evaluations.

BACKGROUND: Despite advancement in methods and application of economic evaluations (EEs), there are several uncertainties. OBJECTIVES: To assess the impact of alternate methodological and structural assumptions for four key principles of EE, on the results of cost-effectiveness analysis. MATERIALS AND METHODS: Three previously published model-based EEs were used: (1) Integrated Management of Neonatal and Childhood Illnesses (IMNCIs) intervention; (2) intervention for multiple myeloma, and (3) safety-engineered syringes (SES) intervention. A series of empirical analyses was undertaken to assess the impact of alternate assumptions for discount-rate, time-horizon, study perspective, and health outcome measure, on incremental cost-effectiveness ratio (ICER), and interpretation of cost-effectiveness. RESULTS: Increasing discount rate resulted in an increase in ICERs, for all three case-studies; however, there was no change in the conclusions. Using shorter time-horizons resulted in a significant increase in ICERs, the multiple myeloma intervention remained cost-ineffective, SES intervention became cost-ineffective, whereas IMNCI intervention remained cost-effective, despite a three-fold increase in ICER. On using disability adjusted life years instead of quality adjusted life years, ICERs increased to 0.04, 2 and 4 times for SES, IMNCI and multiple myeloma interventions, respectively. On analyzing results from a societal perspective, a decline in ICERs was observed. The decline was significant for IMNCI where the intervention turned dominant/cost-saving. In the other two case-studies decline in ICERs was modest, 32% for multiple myeloma, and 4% for SES. CONCLUSION: We observed a significant impact of using alternate assumptions on ICERs which can potentially impact resource-allocation decisions. Our findings provide strong argument in favor of standardization of processes and development of country-specific guidelines for conduct of EE.

Association of Child Growth Failure Indicators With Household Sanitation Practices in India (1998-2021): Spatiotemporal Observational Study.

BACKGROUND: Undernutrition among children younger than 5 years is a subtle indicator of a country's health and economic status. Despite substantial macroeconomic progress in India, undernutrition remains a significant burden with geographical variations, compounded by poor access to water, sanitation, and hygiene services. OBJECTIVE: This study aimed to explore the spatial trends of child growth failure (CGF) indicators and their association with household sanitation practices in India. METHODS: We used data from the Indian Demographic and Health Surveys spanning 1998-2021. District-level CGF indicators (stunting, wasting, and underweight) were cross-referenced with sanitation and sociodemographic characteristics. Global Moran I and Local Indicator of Spatial Association were used to detect spatial clustering of the indicators. Spatial regression models were used to evaluate the significant determinants of CGF indicators. RESULTS: Our study showed a decreasing trend in stunting (44.9%-38.4%) and underweight (46.7%-35.7%) but an increasing prevalence of wasting (15.7%-21.0%) over 15 years. The positive values of Moran I between 1998 and 2021 indicate the presence of spatial autocorrelation. Geographic clustering was consistently observed in the states of Madhya Pradesh, Jharkhand, Odisha, Uttar Pradesh, Chhattisgarh, West Bengal, Rajasthan, Bihar, and Gujarat. Improved sanitation facilities, a higher wealth index, and advanced maternal education status showed a significant association in reducing stunting. Relative risk maps identified hotspots of CGF health outcomes, which could be targeted for future interventions. CONCLUSIONS: Despite numerous policies and programs, malnutrition remains a concern. Its multifaceted causes demand coordinated and sustained interventions that go above and beyond the usual. Identifying hotspot locations will aid in developing control methods for achieving objectives in target areas.

Indian Model of Integrated Healthcare (IMIH): a conceptual framework for a coordinated referral system in resource-constrained settings.

INTRODUCTION: With the escalating burden of chronic disease and multimorbidity in India, owing to its ageing population and overwhelming health needs, the Indian Health care delivery System (HDS) is under constant pressure due to rising public expectations and ambitious new health goals. The three tired HDS should work in coherence to ensure continuity of care, which needs a coordinated referral system. This calls for optimising health care through Integrated care (IC). The existing IC models have been primarily developed and adopted in High-Income Countries. The present study attempts to review the applicability of existing IC models and frame a customised model for resource-constrained settings. METHODS: A two-stage methodology was used. Firstly, a narrative literature review was done to identify gaps in existing IC models, as per the World Health Organization framework approach. The literature search was done from electronic journal article databases, and relevant literature that reported conceptual and theoretical concepts of IC. Secondly, we conceptualised an IC concept according to India's existing HDS, validated by multiple rounds of brainstorming among co-authors. Further senior co-authors independently reviewed the conceptualised IC model as per national relevance. RESULTS: Existing IC models were categorised as individual, group and disease-specific, and population-based models. The limitations of having prolonged delivery time, focusing only on chronic diseases and being economically expensive to implement, along with requirement of completely restructuring and reorganising the existing HDS makes the adoption of existing IC models not feasible for India. The Indian Model of Integrated Healthcare (IMIH) model proposes three levels of integration: Macro, Meso, and Micro levels, using the existing HDS. The core components include a Central Gateway Control Room, using existing digital platforms at macro levels, a bucket overflow model at the meso level, a Triple-layered Concentric Circle outpatient department (OPD) design, and a three-door OPD concept at the micro level. CONCLUSION: IMIH offers features that consider resource constraints and local context of LMICs while being economically viable. It envisages a step toward UHC by optimising existing resources and ensuring a continuum of care. However, health being a state subject, various socio-political and legal/administrative issues warrant further discussion before implementation.

Human Resources for Health in Haryana, India: What can be Done Better?

Introduction: Health systems in developing countries suffers from both input and productivity issues. We examined the status of three domains of human resources for health, i.e., availability and distribution, capacity and productivity, and motivation and job-satisfaction, of the health-care workforce employed in the public health system of Haryana, a North Indian state. Methodology: The primary data were collected from 377 public health facilities and 1749 healthcare providers across 21 districts. The secondary data were obtained from government reports in the public domain. Bivariate and multivariate statistical techniques were used for evaluating district performances, making inter-district comparisons and identifying determinants of motivation and job-satisfaction of the clinical cadres. Results: We found 3.6 core health-care workers (doctors, staff nurses, and auxiliary nurses-midwives) employed in the public health-care system per 10,000 population, ranging from 1.35 in Faridabad district to 6.57 in Panchkula district. Around 78% of the sanctioned positions were occupied. A number of inpatient hospitalizations per doctor/nurses per month were 17 at the community health center level and 29 at the district hospital level; however, significant differences were observed among districts. Motivation levels of community health workers (85%) were higher than clinical workforce (78%), while health system administrators had lowest motivation and job satisfaction levels. Posting at primary healthcare facility, contractual employment, and co-habitation with family at the place of posting were found to be the significant motivating factors. Conclusions: A revamp of governance strategies is required to improve health-care worker availability and equitable distribution in the public health system to address the observed geographic variations. Efforts are also needed to improve the motivation levels of health system administrators, especially in poorly performing districts and reduce the wide gap with better-off districts.

Development of the Indian Reference Case for undertaking economic evaluation for health technology assessment.

Background: Health technology assessment (HTA) is globally recognised as an important tool to guide evidence-based decision-making. However, heterogeneity in methods limits the use of any such evidence. The current research was undertaken to develop a set of standards for conduct of economic evaluations for HTA in India, referred to as the Indian Reference Case. Methods: Development of the reference case comprised of a four-step process: (i) review of existing international HTA guidelines; (ii) systematic review of economic evaluations for three countries to assess adherence with pre-existing country-specific HTA guidelines; (iii) empirical analysis to assess the impact of alternate assumptions for key principles of economic evaluation on the results of cost-effectiveness analysis; (iv) stakeholder consultations to assess appropriateness of the recommendations. Based on the inferences drawn from the first three processes, a preliminary draft of the reference case was developed, which was finalised based on stakeholder consultations. Findings: The Indian Reference Case provides twelve recommendations on eleven key principles of economic evaluation: decision problem, comparator, perspective, source of effectiveness evidence, measure of costs, health outcomes, time-horizon, discounting, heterogeneity, uncertainty analysis and equity analysis, and for presentation of results. The recommendations are user-friendly and have scope to allow for context-specific flexibility. Interpretation: The Indian Reference Case is expected to provide guidance in planning, conducting, and reporting of economic evaluations. It is anticipated that adherence to the Reference Case would increase the quality and policy utilisation of future evaluations. However, with advancement in the field of health economics efforts aimed at refining the Indian Reference Case would be needed. Funding: This research received no specific grant from any funding agency, commercial, or not-for-profit sectors. The research was undertaken as part of doctoral thesis of Sharma D, who received scholarship from the Indian Council of Medical Research (ICMR), New Delhi, India.

What is the out-of-pocket expenditure on medicines in India? An empirical assessment using a novel methodology.

The share of expenditure on medicines as part of the total out-of-pocket (OOP) expenditure on healthcare services has been reported to be much higher in India than in other countries. This study was conducted to ascertain the extent of this share of medicine expenditure using a novel methodology. OOP expenditure data were collected through exit interviews with 5252 out-patient department patients in three states of India. Follow-up interviews were conducted after Days 1 and 15 of the baseline to identify any additional expenditure incurred. In addition, medicine prescription data were collected from the patients through prescription audits. Self-reported expenditure on medicines was compared with the amount imputed using local market prices based on prescription data. The results were also compared with the mean expenditure on medicines per spell of ailment among non-hospitalized cases from the National Sample Survey (NSS) 75th round for the corresponding states and districts, which is based on household survey methodology. The share of medicines in OOP expenditure did not change significantly for organized private hospitals using the patient-reported vs imputation-based methods (30.74-29.61%). Large reductions were observed for single-doctor clinics, especially in the case of 'Ayurvedic' (64.51-36.51%) and homeopathic (57.53-42.74%) practitioners. After adjustment for socio-demographic factors and types of ailments, we found that household data collection as per NSS methodology leads to an increase of 25% and 26% in the reported share of medicines for public- and private-sector out-patient consultations respectively, as compared with facility-based exit interviews with the imputation of expenditure for medicines as per actual quantity and price data. The nature of healthcare transactions at single-doctor clinics in rural India leads to an over-reporting of expenditure on medicines by patients. While household surveys are valid to provide total expenditure, these are less likely to correctly estimate the share of medicine expenditure.

Adherence to country-specific guidelines among economic evaluations undertaken in three high-income and middle-income countries: a systematic review.

OBJECTIVE: To assess the adherence of economic evaluations to the recommendations on principles of economic evaluation as stated in the country-specific guidelines for three countries across different income groups, namely, Canada, South Africa, and Egypt. METHODS: Searches were undertaken in three databases to identify economic evaluations meeting predefined inclusion criteria. Methodological and reporting standards listed in the country-specific guidelines were converted into discrete binary variables to calculate mean adherence scores. Quality appraisal was done using Drummond's checklist. Stratified analysis was undertaken to identify independent variables affecting adherence. RESULTS: We identified forty-four, seventy-nine, and sixteen economic evaluations for Canada, South Africa, and Egypt, respectively. The mean adherence score was the highest for Canada (71%), followed by South Africa (65%) and Egypt (60%). Adherence to guidelines was positively correlated with quality of studies, r = .72. Furthermore, the mean adherence score was significantly (p < .05) higher for studies using a cost-utility analysis design (72%), having local/national funding aid (72%), undertaken by a health economist (71%) and for pharmacoeconomic evaluations (70%). CONCLUSION: The quality of economic evaluations improves with adherence to country-specific guidelines. Locally funded and health-economist led health technology assessments (HTAs) should be encouraged for greater adherence to the guidelines. The HTA researchers and the HTA bodies should lay emphasis on adherence to the country-specific guidelines for improving the quality of HTA evidence.

National Healthcare Economic Evaluation Guidelines: A Cross-Country Comparison.

BACKGROUND AND OBJECTIVES: Globally, a number of countries have developed guidelines that describe the design and conduct of economic evaluations as part of health technology assessment (HTA) or pharmacoeconomic analysis for decision making. The current scoping review was undertaken with an objective to summarize the recommendations made on methods of economic evaluation by the national healthcare economic evaluation (HEE) guidelines. METHODOLOGY: A comprehensive search was undertaken in the website repositories of the International Society for Pharmacoeconomic and Outcomes Research (ISPOR) and Guide to Economic Analysis and Research (GEAR), and websites of national HTA agencies and ministries of health of individual countries. All guidelines in the English language were included in this review. Data were extracted with respect to general and methodological characteristics, and a descriptive analysis of recommendations made across the countries was undertaken. RESULTS: Overall, our review included 31 national HEE guidelines, published between 1997 and August 2020. Nearly half (45%) of the guidelines targeted the evaluation of pharmaceuticals. The nature of the guidelines was either mandatory (31%), recommendatory (42%), or voluntary (16%). There was a substantial consensus among the guidelines on several key principles, including type of economic evaluation (cost-utility analysis), time horizon of the analysis (long enough), health outcome measure (quality-adjusted life-years) and use of sensitivity analyses. The recommendations on study perspective, comparator, discount rate and type of costs to be included (particularly the inclusion of indirect costs) varied widely. CONCLUSION: Despite similarity in the overall processes, variation in several recommendations given by various national HEE guidelines was observed. This is perhaps unsurprising given the differences in the health systems and financing mechanisms, capacity of local researchers, and data availability. This review offers important lessons and a starting point for countries that are planning to develop their own HEE guidelines.

Overcoming the health system barriers to early diagnosis and management of multidrug-resistant tuberculosis in a rural setting in North India.

India contributes a quarter of the global burden of multidrug-resistant tuberculosis (MDR-TB) and has inadequate diagnostic infrastructure and institutional capacities for drug susceptibility testing. Subsequently, this leads to a large number of undetected and untreated cases of MDR-TB. In this report, we describe a case of a 55-year-old man from rural North India presenting with complaints of continued symptoms of chronic cough, fever and dyspnoea despite being recently diagnosed with recurrent tuberculosis and receiving treatment from the local community health centre. MDR-TB was suspected, but confirmatory diagnostic capabilities were not available in the local setting. The patient was finally diagnosed with MDR-TB. Treatment was coordinated by the district tuberculosis programme officer. Through this case, we describe the various barriers to detecting MDR-TB in the rural regions of India. Prompt identification of patients with presumptive MDR-TB, diagnosis of the disease and initiation of treatment are crucial to preventing disease transmission and reducing morbidity and mortality.

Cost-Effectiveness of Therapeutic Use of Safety-Engineered Syringes in Healthcare Facilities in India.

BACKGROUND: Globally, 16 billion injections are administered each year of which 95% are for curative care. India contributes 25-30% of the global injection load. Over 63% of these injections are reportedly unsafe or deemed unnecessary. OBJECTIVES: To assess the incremental cost per quality-adjusted life-year (QALY) gained with the introduction of safety-engineered syringes (SES) as compared to disposable syringes for therapeutic care in India. METHODS: A decision tree was used to compute the volume of needle-stick injuries (NSIs) and reuse episodes among healthcare professionals and the patient population. Subsequently, three separate Markov models were used to compute lifetime costs and QALYs for individuals infected with hepatitis B virus (HBV), hepatitis C virus (HCV) and human immunodeficiency virus (HIV). Three SES were evaluated-reuse prevention syringe (RUP), sharp injury prevention (SIP) syringe, and syringes with features of both RUP and SIP. A lifetime study horizon starting from a base year of 2017 was considered appropriate to cover all costs and consequences comprehensively. A systematic review was undertaken to assess the SES effects in terms of reduction in NSIs and reuse episodes. These were then modelled in terms of reduction in transmission of blood-borne infections, life-years and QALYs gained. Future costs and consequences were discounted at the rate of 3%. Incremental cost per QALY gained was computed to assess the cost-effectiveness. A probabilistic sensitivity analysis was undertaken to account for parameter uncertainties. RESULTS: The introduction of RUP, SIP and RUP + SIP syringes in India is estimated to incur an incremental cost of Indian National Rupee (INR) 61,028 (US$939), INR 7,768,215 (US$119,511) and INR 196,135 (US$3017) per QALY gained, respectively. A total of 96,296 HBV, 44,082 HCV and 5632 HIV deaths are estimated to be averted due to RUP in 20 years. RUP has an 84% probability to be cost-effective at a threshold of per capita gross domestic product (GDP). The RUP syringe can become cost saving at a unit price of INR 1.9. Similarly, SIP and RUP + SIP syringes can be cost-effective at a unit price of less than INR 1.2 and INR 5.9, respectively. CONCLUSION: RUP syringes are estimated to be cost-effective in the Indian context. SIP and RUP + SIP syringes are not cost-effective at the current unit prices. Efforts should be made to bring down the price of SES to improve its cost-effectiveness.

Out-of-pocket expenditure for health care: District level estimates for Haryana state in India.

INTRODUCTION: In this paper, we present district level out-of-pocket (OOP) expenditures with respect to outpatient consultation within last 15 days and hospitalization in last 1 year for Haryana state. METHODS: The data from a large cross-sectional household survey covering all 21 districts of Haryana comprising of randomly selected 79 742 households were analyzed. Of the total sample, 56 056 households consisting of 314 639 individuals in 21 districts of Haryana state were surveyed to gather information on OOP expenditure incurred on outpatient consultation within last 15 days. Similarly, 59 901 households and 324 977 respondents were interviewed to elicit OOP expenditures for any hospitalization during the 1 year preceding the survey. Mean OOP expenditure per OP consultation, per hospitalization as well as per capita were computed. Mean OOP expenditure was also estimated by the type of provider, gender, and district. RESULTS: The mean OOP expenditure for OP consultation and hospitalization in Haryana was Indian National Rupees (INR) 1005 (US Dollar [USD] 16.1; 95% CI: INR 934-1076) and INR 22 489 (USD 360.0; 95% CI: INR 21 375-23 608), respectively. Mean per capita OOP expenditure for OP consultation, which was INR 85 (USD 1.3) in Haryana, varied from INR 595 (USD 9.5) in district Panipat to INR 29 (USD 0.5) in district Kaithal. CONCLUSION: This is the first study to comprehensively present district level estimates for OOP expenditure for health care. These estimates are useful for policy planning, and preparation for district and state health accounts.

Cost analysis of a simulation-based training for health workforce in India.

BACKGROUND: Training of health-care workforce including doctors, staff nurses, and Auxiliary Nurse Midwives using simulation techniques for skill enhancement have been used in a variety of clinical settings to improve the quality of training. India adopted the skills laboratories model for capacity building of health workers in maternal and child health in Bihar state. OBJECTIVE: Current economic evaluation was performed with the objective of assessing the financial and economic cost of implementing skills laboratories. METHODS: Data on all resources spent for the development of skill laboratory and implementing training during financial year 2011 were collected from Patna district in Bihar state. We used standard methods to estimate the full financial and economic costs of implementing the skills laboratories from a health system perspective. RESULTS: Overall cost of implementing 20 permanent and 10 mobile skills laboratory training in Bihar was Indian Rupee (INR) 8849895 from a financial perspective. The cost was nearly two times higher when using an economic perspective to account for opportunity cost of all resources used. The unit cost of training a participant using permanent and mobile laboratory was INR 6856 and INR 7474, respectively assuming an annual volume of 90 training. The optimum number of training which should be operated annually in a skills laboratory to make it most efficient is about 70-80 training per annum. CONCLUSIONS: Economic implications of skills laboratory organization should be borne while planning scale up in Bihar and other states. Further research on the effectiveness of two models of skill laboratory, that is, permanent and mobile and their cost is recommended.

Out-of-pocket expenditure for hospitalization in Haryana State of India: Extent, determinants & financial risk protection.

BACKGROUND & OBJECTIVES: India aspires to achieve universal health coverage, which requires ensuring financial risk protection (FRP). This study was done to assess the extent of out-of-pocket (OOP) expenditure and FRP for hospitalization in Haryana State, India. Further, the determinants for FRP were also evaluated. METHODS: Data collected as a part of a household level survey conducted in Haryana 'Concurrent Evaluation of National Rural Health Mission: Haryana Health Survey' were analyzed. Descriptive analysis was undertaken to assess socio-demographic characteristics, hospitalization rate, extent and determinants of OOP expenditure and FRP. Prevalence of catastrophic health expenditure (CHE) (more than 40% of non-food expenditure) and impoverishment (Int$ 1.25) were estimated. Multivariate logistic regression was used to assess determinants of FRP. RESULTS: Hospitalization rate was found to be 3106 persons or 3307 episodes per 100,000 population. Median OOP expenditure on hospitalization was ₹ 8000 (USD 133), which was predominantly attributed to medicines (37%). Prevalence of CHE was 25.2 per cent with higher prevalence amongst males [odds ratio (OR)=1.30], those belonging to scheduled caste and scheduled tribes (OR=1.35), poorest 20 per cent households (OR=3.05), having injuries (OR=4.03) and non-communicable diseases (OR=3.13) admitted in a private hospital (OR=2.69) and those who were insured (OR=1.74). There was a 12 per cent relative increase in poverty head count due to OOP payments on healthcare. INTERPRETATION & CONCLUSIONS: Our findings showed that hospitalization resulted in significant OOP expenditure, leading to CHEs and impoverishment of households. Impact of OOP expenditures was inequitably more on the vulnerable groups. OOP expenditure may be curtailed through provision of free medicines and diagnostics and removal of any form of user charges.

A composite indicator to measure universal health care coverage in India: way forward for post-2015 health system performance monitoring framework.

BACKGROUND: There is limited work done on developing methods for measurement of universal health coverage. We undertook a study to develop a methodology and demonstrate the practical application of empirically measuring the extent of universal health coverage at district level. Additionally, we also develop a composite indicator to measure UHC. METHODS: A cross-sectional survey was undertaken among 51 656 households across 21 districts of Haryana state in India. Using the WHO framework for UHC, we identified indicators of service coverage, financial risk protection, equity and quality based on the Government of India and the Haryana Government's proposed UHC benefit package. Geometric mean approach was used to compute a composite UHC index (CUHCI). Various statistical approaches to aggregate input indicators with or without weighting, along with various incremental combinations of input indicators were tested in a comprehensive sensitivity analysis. FINDINGS: The population coverage for preventive and curative services is presented. Adjusting for inequality, the coverage for all the indicators were less than the unadjusted coverage by 0.1-6.7% in absolute term and 0.1-27% in relative term. There was low unmet need for curative care. However, about 11% outpatient consultations were from unqualified providers. About 30% households incurred catastrophic health expenditures, which rose to 38% among the poorest 20% population. Summary index (CUHCI) for UHC varied from 12% in Mewat district to 71% in Kurukshetra district. The inequality unadjusted coverage for UHC correlates highly with adjusted coverage. CONCLUSION: Our paper is an attempt to develop a methodology to measure UHC. However, careful inclusion of others indicators of service coverage is recommended for a comprehensive measurement which captures the spirit of universality. Further, more work needs to be done to incorporate quality in the measurement framework.

Effect of User Charges on Secondary Level Surgical Care Utilization and Out-of-Pocket Expenditures in Haryana State, India.

BACKGROUND: Generation of resources for providing health care services is an important issue in developing countries. User charges in the form of Surgical Package Program (SPP) were introduced in all district hospitals of Haryana to address this problem. We evaluate the effect of this SPP program on surgical care utilization and out-of-pocket (OOP) expenditures. METHODS: Data on 25437 surgeries, from July 2006 to June 2013 in 3 districts of Haryana state, was analyzed using interrupted time series analysis to assess the impact of SPP on utilization of services. Adjustment was made for presence of any autocorrelation and seasonality effects. A cross sectional survey was undertaken among 180 patients in District hospital, Panchkula during June 2013 to assess the extent of out of pocket (OOP) expenditure incurred, financial risk protection and methods to cope with OOP expenditure. Catastrophic health expenditure, estimated as any expenditure in excess of 10% of the household consumption expenditure, was used to assess the extent of financial risk protection. RESULTS: User charges had a negative effect on the number of surgeries in public sector district hospitals in all the 3 districts. The mean out-of-pocket expenditure incurred by the patients was Rs.4564 (USD 74.6). The prevalence of catastrophic expenditure was 5.6%. A higher proportion among the poorest 20% population coped through borrowing money (47.2%), while majority (86.1%) of those belonging to richest quintile paid from their monthly income or savings, or had insurance. CONCLUSION: There is a need to increase the public financing for curative services and it should be based on the needs of population. Any form of user charge in public sector hospitals should be removed.

Process evaluation of community monitoring under national health mission at Chandigarh, union territory: Methodology and challenges.

BACKGROUND: Community monitoring was introduced on a pilot mode in 36 selected districts of India in a phased manner. In Chandigarh, it was introduced in the year 2009-2010. A preliminary evaluation of the program was undertaken with special emphasis on the inputs and the processes. METHODOLOGY: Quantitative methods included verification against checklists and record reviews. Nonparticipant observation was used to evaluate the conduct of trainings, interviews, and group discussions. Health system had trained health system functionaries (nursing students and Village Health Sanitation Committee [VHSC] members) to generate village-based scorecards for assessing community needs. Community needs were assessed independently for two villages under the study area to validate the scores generated by the health system. RESULTS: VHSCs were formed in all 22 villages but without a chairperson or convener. The involvement of VHSC members in the community monitoring process was minimal. The conduct of group discussions was below par due to poor moderation and unequal responses from the group. The community monitoring committees at the state level had limited representation from the non-health sector, lower committees, and the nongovernmental organizations/civil societies. Agreement between the report cards generated by the investigator and the health system in the selected villages was found to be to be fair (0.369) whereas weighted kappa (0.504) was moderate. CONCLUSION: In spite of all these limitations and challenges, the government has taken a valiant step by trying to involve the community in the monitoring of health services. The dynamic nature of the community warrants incorporation of an evaluation framework into the planning of such programs.

Evaluation of publicly financed and privately delivered model of emergency referral services for maternal and child health care in India.

BACKGROUND: Emergency referral services (ERS) are being strengthened in India to improve access for institutional delivery. We evaluated a publicly financed and privately delivered model of ERS in Punjab state, India, to assess its extent and pattern of utilization, impact on institutional delivery, quality and unit cost. METHODS: Data for almost 0.4 million calls received from April 2012 to March 2013 was analysed to assess the extent and pattern of utilization. Segmented linear regression was used to analyse month-wise data on number of institutional deliveries in public sector health facilities from 2008 to 2013. We inspected ambulances in 2 districts against the Basic Life Support (BLS) standards. Timeliness of ERS was assessed for determining quality. Finally, we computed economic cost of implementing ERS from a health system perspective. RESULTS: On an average, an ambulance transported 3-4 patients per day. Poor and those farther away from the health facility had a higher likelihood of using the ambulance. Although the ERS had an abrupt positive effect on increasing the institutional deliveries in the unadjusted model, there was no effect on institutional delivery after adjustment for autocorrelation. Cost of operating the ambulance service was INR 1361 (USD 22.7) per patient transported or INR 21 (USD 0.35) per km travelled. CONCLUSION: Emergency referral services in Punjab did not result in a significant change in public sector institutional deliveries. This could be due to high baseline coverage of institutional delivery and low barriers to physical access. Choice of interventions for reduction in Maternal Mortality Ratio (MMR) should be context-specific to have high value for resources spent. The ERS in Punjab needs improvement in terms of quality and reduction of cost to health system.

Impact of referral transport system on institutional deliveries in Haryana, India.

BACKGROUND & OBJECTIVES: Creation of a strong referral transport network across the country is necessary for improving physical access to public sector health facilities. In this study we evaluated the referral transport services in Haryana, i.e. Haryana Swasthya Vaahan Sewa (HSVS), now known as National Ambulance Service (NAS), to assess the extent and pattern of utilization, and to ascertain its effect on public sector institutional deliveries. METHODS: Secondary data on 116,562 patients transported during April to July 2011 in Haryana state were analysed to assess extent and pattern of NAS utilization. Exit interviews were conducted with 270 consecutively selected users and non- users of referral services respectively in Ambala (High NAS utilization), Hisar (medium utilization) and Narnaul (low utilization) districts. Month-wise data on institutional deliveries in public facilities during 2005-2012 were collected in these three districts, and analysed using interrupted time series analysis to assess the impact of NAS on institutional deliveries. RESULTS: Female gender (OR=77.7), rural place of residence (OR=5.96) and poor socio-economic status (poorest wealth quintile OR=2.64) were significantly associated with NAS ambulance service usage. Institutional deliveries in Haryana rose significantly after the introduction of NAS service in Ambala (OR=137.4, 95% CI=22.4-252.4) and Hisar (OR=215, 95% CI=88.5-341.3) districts. No significant increase was observed in Narnaul (OR=4.5, 95% CI=-137.4 to 146.4) district. INTERPRETATION & CONCLUSIONS: The findings of the present study showed a positive effect of referral transport service on increasing institutional deliveries. However, this needs to be backed up with adequate supply of basic and emergency obstetric care at hospitals and health centres.

Integrated Management of Neonatal and Childhood Illness (IMNCI): skill assessment of health and Integrated Child Development Scheme (ICDS) workers to classify sick under-five children.

OBJECTIVE: To assess the skills (diagnostic/counseling) of Integrated Management of Neonatal and Childhood Illness (IMNCI) trained workers; and to assess the degree of agreement between the physician and the IMNCI trained workers of Raipurrani block, district Panchkula, India, to classify sick under-five children in field. METHODS: The cross-sectional study was conducted in Raipurrani in the outpatient departments of the community health centre and one primary health centre in 2010. Workers from health department and Integrated Child Development Scheme (ICDS) were assessed in this study. They received IMNCI training in 2006, with 1 day refresher training in 2009. Investigator noted his observations using a skill assessment checklist. Under-five child observations were the unit of study. RESULTS: Sixteen IMNCI trained workers made 128 child observations. Considering color-coded categorization under IMNCI, agreement with investigator (Kappa) was intermediate; red and yellow categorizations had poor agreement. Morbidity-wise agreement (Kappa) was poor for possible serious bacterial infection, feeding problem, respiratory problem and anemia. Considering final diagnosis, investigator and IMNCI trained worker completely agreed in 45 % child observations. All symptoms were asked only in 15 %. Skills were poor overall for young infants. For children between 2 mo to 5 y, danger signs, neck stiffness, edema, wasting and pallor were checked in <40 % observations. Immunization card was asked for in 20 % observations. IMNCI trained workers performed well in all aspects of counseling, except follow up. CONCLUSIONS: Training without effective implementation plans will not result in long term skill retention.