Pioneering family physicians and the mechanisms for strengthening primary health care in India-A qualitative descriptive study.

India has one of the most unequal healthcare systems globally, lagging behind its economic development. Improved primary care and primary health care play an integral role in overcoming health disparities. Family medicine is a subset of primary care-delivered by family physicians, characterized by comprehensive, continuous, coordinated, collaborative, personal, family and community-oriented services-and may be able to fill these gaps. This research aims to understand the potential mechanisms by which family physicians can strengthen primary health care. In this qualitative descriptive study, we interviewed twenty family physicians, identified by purposeful and snowball sampling, who are among the first family physicians in India who received accredited certification in FM and were identified as pioneers of family medicine. We used the Contribution of Family Medicine to Strengthening Primary Health Care Framework to understand the potential mechanisms by which family medicine strengthens primary health care. Iterative inductive techniques were used for analysis. This research identifies multiple ways family physicians can strengthen primary health care in India. They are skilled primary care providers and support mid and low-level health care providers' ongoing training and capacity building. They develop relationships with specialists, ensure appropriate referral systems are in place, and, when necessary, work with governments and organizations to access the essential resources needed to deliver care. They motivate the workforce and change how care is delivered by ensuring providers' skills match the needs of communities and engage communities as partners in healthcare delivery. These findings highlight multiple mechanisms by which family physicians strengthen primary health care. Investments in postgraduate training in family medicine and integrating family physicians into the primary care sector, particularly the public sector, could address health disparities.

The emergence of family medicine in India-A qualitative descriptive study.

Countries globally are introducing family medicine to strengthen primary health care; however, for many, that process has been slow. Understanding the implementation of family medicine in a national context is complex but critical to uncovering what worked, the challenges faced, and how the process can be improved. This study explores how family medicine was implemented in India and how early cohort family physicians supported the field's emergence. In this qualitative descriptive study, we interviewed twenty family physicians who were among the first in India and recognized as pioneers. We used Rogers's Diffusion of Innovation Theory to describe and understand the roles of family physicians, as innovators and early adopters, in the process of implementation. Greenhalgh's Model of Diffusion in Service Organizations is applied to identify barriers and enablers to family medicine implementation. This research identifies multiple mechanisms by which pioneering family physicians supported the implementation of family medicine in India. They were innovators who developed the first family medicine training programs. They were early adopters willing to enter a new field and support spread as educators and mentors for future cohorts of family physicians. They were champions who developed professional organizations to bring together family physicians to learn from one another. They were advocates who pushed the medical community, governments, and policymakers to recognize family medicine's role in healthcare. Facilitators for implementation included the supportive environment of academic institutions and the development of family medicine professional organizations. Barriers to implementation included the lack of government support and awareness of the field by society, and tension with subspecialties. In India, the implementation of family medicine has primarily occurred through pioneering family physicians and supportive educational institutions. For family medicine to continue to grow and have the intended impacts on primary care, government and policymaker support are needed.

Towards an evolutionary approach to learning from assumptions: Lessons from the evaluation of Dancing with Parkinson's.

This paper highlights how learnings from exploring assumptions can be strengthened by taking an evolutionary approach to theory building and analysis. We discuss theory-driven evaluation applied to a community-based intervention implemented by Dancing With Parkinson's in Toronto, Canada, targeting Parkinson's disease (PD), a neurodegenerative condition affecting movement. A major gap in the literature is understanding the mechanisms by which dance might make a difference in the daily lives of people living with PD. This study was an early exploratory evaluation to better understand mechanisms and short-term outcomes. Conventional thinking generally favors "permanent" over "transitory" changes, and "long-term" over "short-term" effects. Yet, for people living with degenerative conditions (and also people experiencing chronic pain and other chronic symptoms), transitory and short-term changes may be highly valued and welcomed relief. In order to study and link multiple longitudinal events to explore key linkages in the theory of change, we piloted the use of diaries, with brief entries filled out daily by participants. The aim was to better understand the short-term experiences of participants using their daily routines as a means of learning about potential mechanisms, what matters to participants, and to see if small effects could be observed on days when participants danced versus days when they did not dance and also longitudinally over several months. Our initial theoretical stance began with a view of dance as exercise and the well-established benefits of exercise; yet, we explored through the diary data collected, as well as client interviews and literature review, potential other mechanisms of dancing (such as group interaction, touch, stimulation by the music, and esthetics including "feeling lovely"). This paper does not develop a full, comprehensive theory of dance but moves towards a more comprehensive view that locates dance within the routine activities of participants' daily lives. We argue that given the challenges of evaluating complex interventions comprising multiple, interacting components, there is a need for an evolutionary learning process to understand heterogeneities in mechanisms -- what works for whom -- when faced with knowledge incompleteness in the theory of change.

Learning from experiences of evaluators implementing theory-driven evaluations in diverse settings: Building on the contributions of John Mayne.

The papers in this volume grapple with various issues related to the use of theories of change in program evaluation. This introductory paper reviews some of the critical challenges that arise in developing and learning from theory-driven evaluations. These challenges include the relationship between theories of change and ecologies of evidence, the need for epistemic fluency in learning, and coming to terms with the initial incompleteness of knowledge in program mechanisms. The nine papers that follow, which represent a geographically diverse set of evaluations and evaluators (including Scotland, India, Canada, USA), help develop these and other themes. This volume of papers also serves as a celebration of the work of John Mayne, one of the foremost theory-driven evaluators of the last few decades. John passed away in December of 2020. This volume is intended to honor his legacy while also identifying challenging issues that call for further development.

Nothing about me without me: The central role of program beneficiaries in developing theories of change.

This paper discusses the central importance of involving program recipients in the initial development of the theory of change. Through an example of a drop-in located in the inner-city of Toronto, we describe how, first, theories of change based on funder and even staff perspectives may have program goals that do not connect with the lives and values of clients. Second, engagement with clients should surface heterogeneities in their expectations; many theories of change, even when they are developed with clients, assume there is a 'homogenous' clientele. Third, programs that address the needs of marginalized individuals need to pay attention to the dynamics of marginalization. These points have consequences for the development of the initial theories of change.

Testing theory of change assumptions of health behavior change interventions: A blended approach exploring local contexts.

This paper used a blended approach that involves multiple techniques to, first, test a set of assumptions around a health behavior change communication intervention theory of change (ToC) and, second, surface some unidentified assumptions involving the local context. The intervention was integrated with women's self-help groups (SHGs) in Uttar Pradesh, India. The key assumption tested in this paper was the linkage between SHG membership, program exposure, and maternal, newborn, and child health practices. Learnings were substantiated through empirical investigations, including structural equation modeling and mediation analysis, as well as 'co-learning' workshops within the community. The workshops aimed to capture and interpret the heterogeneity of local contexts through deep dialogs with the community and program implementers at various levels. Statistical analyses indicated a significant association between the amount of women's program exposure and their health practices. SHG membership was shown to affect maternal health practices; however, it did not have a direct effect on neonatal or child health practices. The 'co-learning' workshops revealed crucial aspects, such as prevailing socio-cultural norms, which prevented pregnant or recently delivered women from participating in SHG meetings. This paper encourages evaluators to work with the community to interpret and co-construct meaning in unpacking the contextual forces that seldom appear in the program ToC.

The role of evaluation in iterative learning and implementation of quality of care interventions.

Background: The Lancet Global Health Commission (LGHC) has argued that quality of care (QoC) is an emergent property that requires an iterative process to learn and implement. Such iterations are required given that health systems are complex adaptive systems.Objective: This paper explores the multiple roles that evaluations need to play in order to help with iterative learning and implementation. We argue evaluation needs to shift from a summative focus toward an approach that promotes learning in complex systems. A framework is presented to help guide the iterative learning, and includes the dimensions of clinical care, person-centered care, continuum of care, and 'more than medicine. Multiple roles of evaluation corresponding to each of the dimensions are discussed.Methods: This paper is informed by reviews of the literature on QoC and the roles of evaluation in complex systems. The proposed framework synthesizes the multiple views of QoC. The recommendations of the roles of evaluation are informed both by review and experience in evaluating multiple QoC initiatives.Results: The specific roles of different evaluation approaches, including summative, realist, developmental, and participatory, are identified in relationship to the dimensions in our proposed framework. In order to achieve the potential of LGHC, there is a need to discuss how different evaluation approaches can be combined in a coherent way to promote iterative learning and implementation of QoC initiatives.Conclusion: One of the implications of the QoC framework discussed in the paper is that time needs to be spent upfront in recognizing areas in which knowledge of a specific intervention is not complete at the outset. This, of course, implies taking stock of areas of incompleteness in knowledge of context, theory of change, support structures needed in order for the program to succeed in specific settings. The role of evaluation should not be limited to only providing an external assessment, but an important goal in building evaluation capacity should be to promote adaptive management among planners and practitioners. Such iterative learning and adaptive management are needed to achieve the goals of sustainable development goals.

Valuing and embracing complexity: How an understanding of complex interventions needs to shape our evaluation capacities building initiatives.

This paper describes some of the main challenges of evaluating complex interventions, as well as the implications of such challenges for evaluation capacity building. It discusses lessons learned from a case study of an evaluation of Dancing with Parkinson's, an organization that provides dance classes to people with Parkinson's disease in Toronto, Canada. These implications are developed from a realist evaluation lens. Key lessons include the need to develop skills to understand program mechanisms and contexts, recognize multiple models of causality, apply mixed method designs, and ensure the successful scaling up and spread of an intervention.

Experiments in evaluation capacity building: Enhancing brain disorders research impact in Ontario.

This paper is the introductory paper on a forum on evaluation capacity building for enhancing impacts of research on brain disorders. It describes challenges and opportunities of building evaluation capacity among community-based organizations in Ontario involved in enhancing brain health and supporting people living with a brain disorder. Using an example of a capacity building program called the "Evaluation Support Program", which is run by the Ontario Brain Institute, this forum discusses multiple themes including evaluation capacity building, evaluation culture and evaluation methodologies appropriate for evaluating complex community interventions. The goal of the Evaluation Support Program is to help community-based organizations build the capacity to demonstrate the value that they offer in order to improve, sustain, and spread their programs and activities. One of the features of this forum is that perspectives on the Evaluation Support Program are provided by multiple stakeholders, including the community-based organizations, evaluation team members involved in capacity building, thought leaders in the fields of evaluation capacity building and evaluation culture, and the funders.

Reflections on experiential learning in evaluation capacity building with a community organization, Dancing With Parkinson's.

This paper discusses what was learned about evaluation capacity building with community organizations who deliver services to individuals with neurological disorders. Evaluation specialists engaged by the Ontario Brain Institute Evaluation Support Program were paired with community organizations, such as Dancing With Parkinson's. Some of the learning included: relationship building is key for this model of capacity building; community organizations often have had negative experiences with evaluation and the idea that evaluations can be friendly tools in implementing meaningful programs is one key mechanism by which such an initiative can work; community organizations often need evaluation most to be able to demonstrate their value; a strength of this initiative was that the focus was not just on creating products but mostly on developing a learning process in which capacities would remain; evaluation tools and skills that organizations found useful were developing a theory of change and the concept of heterogeneous mechanisms (informed by a realist evaluation lens).

Heterogeneities in utilization of antenatal care in Uttar Pradesh, India: the need to contextualize interventions to individual contexts.

BACKGROUND: This paper explores the heterogeneities in antenatal care (ANC) utilization in India's most populated state, Uttar Pradesh. Taking an intersectionality lens, multiple individual- and district-level factors are used to identify segments of any antenatal care usage in Uttar Pradesh Objective: This paper seeks to understand the multilevel contexts of ANC utilization. The planning and programming challenge is that such knowledge of contextual specificity is rarely known upfront at the initial stages of planning or implementing an intervention. Exploratory data analysis might be needed to identify such contextual specificity. METHODS: Tree-structured regression methods are used to identify segments and interactions between factors. The results from the tree-structured regression were complemented with multilevel models that controlled for the clustering of individuals within districts. RESULTS: Heterogeneities in utilization of any ANC were observed. The multiple segments of ANC utilization that were developed went from a low utilization of 23.7% for respondents who were not literate and did not have home ownership to a high of 82.4% for respondents who were literate and at the highest level of wealth. Key variables that helped define the segments of ANC utilization include: woman's literacy, ownership of home, wealth index, and district-level sex ratio. Based on the multilevel model of any ANC utilization, cross-level interactions also were obtained between sex ratio and ownership of home as well as between sex ratio and literacy. Increases in sex ratio increased the influence of ownership of home on any ANC, while increases in sex ratio reduced the impact of woman's literacy on receiving any ANC. CONCLUSION: We argue that a focus on heterogeneous segments of utilization can help build knowledge of the mechanisms that underlie inequities in maternal health utilization. Such knowledge of heterogeneity needs to be incorporated in contextualizing interventions to meet a variety of recipients' needs.

The potential of an online educational platform to contribute to achieving sustainable development goals: a mixed-methods evaluation of the Peoples-uni online platform.

BACKGROUND: This paper reports on an online platform, People's Open Access Education Initiative (Peoples-uni), as a means of enhancing access to master's level public health education for health professionals. Peoples-uni seeks to improve population health in low- and middle-income countries by building public health capacity through e-learning at very low cost. We report here an evaluation of the Peoples-uni programme, conducted within the context of Sustainable Development Goal 4, which seeks to "ensure inclusive and quality education for all and promote lifelong learning" by 2030. The evaluation seeks to address the following three questions: (1) Did Peoples-uni meet its intended goals? (2) What were the different types of impacts that students experienced? (3) What suggestions for future changes in Peoples-uni did students recommend? METHODS: A mixed methods evaluation consisted of two parts, namely an online survey and a telephone interview. A total of 119 master's level graduates were invited to participate; responses were obtained from 71 of those invited, giving a response rate of 60%. Respondents were spread across 31 countries. Interviews were conducted with 18 respondents. RESULTS: There was strong evidence that Peoples-uni had achieved its stated goals. Potential impacts on students included knowledge to enhance practice and appreciation of context, enhanced research capacity through knowledge of public health, critical thinking and evidence-based programming, and empowerment of students about the potential of education as a means of improving their lives. Accreditation through future partnerships with local universities was recommended by students. CONCLUSIONS: Peoples-uni has been able to deliver a credible public health master's level educational programme, with positive impacts on the students who graduated. Challenges are to find a way to accredit the programme to ensure its sustainability and to see how to take full advantage of the current, and future, graduates to turn this from an education programme into a capacity-building programme with real impact.

Towards an understanding of the multilevel factors associated with maternal health care utilization in Uttar Pradesh, India.

BACKGROUND: This paper explores the multilevel factors associated with maternal health utilization in India's most populous state, Uttar Pradesh. 3 key utilization practices: registration of pregnancy, receipt of antenatal care, and delivery at home are examined for district and individual level predictors. The data is based on 5666 household surveys conducted as part of a baseline evaluation of the Uttar Pradesh Technical Support Unit (UPTSU.) program. OBJECTIVES: This intervention aims to assist the Government of Uttar Pradesh in increasing the efficiency, effectiveness, and equity of service delivery across a continuum of reproductive, maternal, new-born, child, and adolescent health (RMNCH+A) outcomes. METHODS: The paper employs multilevel models that control for individuals being nested within districts in order to understand the predictors of maternal health care utilization. RESULTS: The study identifies several individual-level predictors of health care utilization, including: literacy of the woman, the husband's schooling, age at marriage, and socio-economic factors. Key predictors of pregnancy registration include husband's schooling (OR 1.49, 95% CI 1.26-1.76), having a bank account (OR 1.36, 95% CI 1.11-1.68), and owning a house (OR 2.28, 95% CI 1.85-2.80). Factors affecting antenatal care include the woman's literacy (OR 1.49, 95% CI 1.28-1.73), the respondent having had a job in the last year (OR 1.39, 95% CI 1.10-1.77), and owning a house (OR 2.83, 95% CI 2.27-3.53). Home delivery tends to be associated with woman's literacy (OR 0.62, 95% CI 0.54-0.72) and marriage age of 15 and younger (OR 1.48, 95% CI 1.26-1.73). CONCLUSIONS: Interventions having equity considerations need to disrupt existing patterns of the health gradient. Successful implementation of such interventions, necessitate understanding the mechanisms that can disrupt the unequal utilization patterns and target domains of disadvantage. Knowledge of key predictors of utilization can aid in the implementation of such complex interventions.

Incorporating gender, equity, and human rights into the action planning process: moving from rhetoric to action.

BACKGROUND: Mainstreaming of gender, equity, and human rights (GER) is an important focus of the World Health Organization (WHO) and other UN organizations. This paper explores the role of action plans in mainstreaming GER. This paper is informed by a theory-driven evaluation lens. DESIGN: A theory of change framework explored the following seven dimensions of how action plans can implement mainstreaming of GER: awareness of the foundations of GER; understanding of context; planning to impact GER; implementation for GER; monitoring, evaluation, and learning; planning for sustainability; agenda setting and buy-in. The seven dimensions were used to analyze the action plans. Reviewers also explored innovations within each of the action plans for the seven dimensions. RESULTS: GER mainstreaming is more prominent in the foundation, background, and planning components of the plan but becomes less so along the theory of change including implementation; monitoring and evaluation; sustainability; and agenda setting and buy-in. CONCLUSIONS: Our analysis demonstrates that much more can be done to incorporate GER considerations into the action planning process. Nine specific recommendations are identified for WHO and other organizations. A theory-driven approach as described in the paper is potentially helpful for developing clarity by which action plans can help with mainstreaming GER considerations.

Steps towards incorporating heterogeneities into program theory: A case study of a data-driven approach.

This paper describes a framework that can help refine program theory through data explorations and stakeholder dialogue. The framework incorporates the following steps: a recognition that program implementation might need to be multi-phased for a number of interventions, the need to take stock of program theory, the application of pattern recognition methods to help identify heterogeneous program mechanisms, and stakeholder dialogue to refine the program. As part of the data exploration, a method known as developmental trajectories is implemented to learn about heterogeneous trajectories of outcomes in longitudinal evaluations. This method identifies trajectory clusters and also can estimate different treatment impacts for the various groups. The framework is highlighted with data collected in an evaluation of an alcohol risk-reduction program delivered in a college fraternity setting. The framework discussed in the paper is informed by a realist focus on "what works for whom under what contexts." The utility of the framework in contributing to a dialogue on heterogeneous mechanism and subsequent implementation is described. The connection of the ideas in paper to a 'learning through principled discovery' approach is also described.

Where theory and practice of global health intersect: the developmental history of a Canadian global health initiative.

OBJECTIVE: This paper examines the scope of practice of global health, drawing on the practical experience of a global health initiative of the Government of Canada--the Teasdale-Corti Global Health Research Partnership Program. A number of challenges in the practical application of theoretical definitions and understandings of global health are addressed. These challenges are grouped under five areas that form essential characteristics of global health: equity and egalitarian North-South partnerships, interdisciplinary scope, focus on upstream determinants of health, global conceptualization, and global health as an area of both research and practice. DESIGN: Information in this paper is based on the results of an external evaluation of the program, which involved analysis of project proposals and technical reports, surveys with grantees and interviews with grantees and program designers, as well as case studies of three projects and a review of relevant literature. RESULTS: The philosophy and recent definitions of global health represent a significant and important departure from the international health paradigm. However, the practical applicability of this maturing area of research and practice still faces significant systemic and structural impediments that, if not acknowledged and addressed, will continue to undermine the development of global health as an effective means to addressing health inequities globally and to better understanding, and acting upon, upstream determinants of health toward health for all. CONCLUSIONS: While it strives to redress global inequities, global health continues to be a construct that is promoted, studied, and dictated mostly by Northern institutions and scholars. Until practical mechanisms are put in place for truly egalitarian partnerships between North and South for both the study and practice of global health, the emerging philosophy of global health cannot be effectively put into practice.

Rethinking Evaluations of Health Equity Initiatives: an introduction to the special issue.

This paper is an introduction to a special issue on "Re-thinking Evaluations of Health Equity Initiatives." The papers in this volume aim to build understanding of how evaluations can contribute to addressing inequities and how evaluation design can develop a better understanding and also better respond to: (i) policy maker and practitioner needs; (ii) the systemic and complex nature of the interventions necessary to impact inequities; (iii) an understanding of the processes that generate inequities.

Getting real about policy and practice needs: evaluation as a bridge between the problem and solution space.

This paper introduces the concept of problem and solution spaces, its relevance to planning and evaluating health equity interventions and how evaluations can serve as a bridge between problem and solution spaces. A number of questions are described as part of evaluative thinking about solutions that can help with planning more rigorous and context sensitive solutions to health inequities. The questions are informed by conceptual, operational and strategic issues that need to be addressed in evaluating health inequities.