Multiple case study of processes used by hospitals to select performance indicators: do they align with best practices?

Several health policy institutes recommend reducing the number of indicators monitored by hospitals to better focus on indicators most relevant to local contexts. To determine which indicators are the most appropriate to eliminate, one must understand how indicator selection processes are undertaken. This study classifies hospital indicator selection processes and analyzes how they align with practices outlined in the 5-P Indicator Selection Process Framework. This qualitative, multiple case study examined indicator selection processes used by four large acute care hospitals in Ontario, Canada. Data were collected through 13 semistructured interviews and document analysis. A thematic analysis compared processes to the 5-P Indicator Selection Process Framework. Two types of hospital indicator selection processes were identified. Hospitals deployed most elements found within the 5-P Indicator Selection Process Framework including setting clear aims, having governance structures, considering indicators required by health agencies, and categorizing indicators into strategic themes. Framework elements largely absent included: adopting evidence-based selection criteria; incorporating finance and human resources indicators; considering if indicators measure structures, processes, or outcomes; and engaging a broader set of end users in the selection process. Hospitals have difficulty in balancing how to monitor government-mandated indicators with indicators more relevant to local operations. Hospitals often do not involve frontline managers in indicator selection processes. Not engaging frontline managers in selecting indicators may risk hospitals only choosing government-mandated indicators that are not reflective of frontline operations or valued by those managers accountable for improving unit-level performance.

Selecting Performance Indicators and Targets in Health Care: An International Scoping Review and Standardized Process Framework.

Objective: Health care organizations monitor hundreds of performance indicators. It is unclear what processes and criteria organizations use to identify the indicators they use, who is involved in these processes, how performance targets are set, and what the impacts of these processes are. The purpose of this study is to synthesize international approaches to indicator selection and develop a standardized process framework. Methods: Using the PubMed and Web of Science search engines, a scoping review of peer reviewed and grey literature following PRISMA-ScR guidelines was conducted to identify documents describing indicator selection processes used by health systems. English-language papers from 11 countries published from 2010 to 2020 were included. Papers were thematically analyzed to develop a standardized process framework. Results: The review included 33 peer-reviewed papers and 11 grey-literature documents. While there are common practices used in health care to select indicators, no single standardized process framework for indicator selection exists. Arbitrary or incomplete indicator selection processes risk over-measurement, lack of alignment with strategic and operational goals, lack of support by end-users, and paralyzed decision-making ability. By consolidating international practices, we developed the 5-P indicator selection process framework to mitigate process risks and support high-quality indicator selection processes. Conclusion: The 5-P indicator selection process framework consists of five domains and 17 elements, and offers health care agencies a practical structure they can use to design indicator selection processes. The framework also provides researchers with a basis by which the implementation of these processes may be evaluated.

Understanding Government Decisions to De-fund Medical Services Analyzing the Impact of Problem Frames on Resource Allocation Policies.

Many medical services lack robust evidence of effectiveness and may therefore be considered "unnecessary" care. Proactively withdrawing resources from, or de-funding, such services and redirecting the savings to services that have proven effectiveness would enhance overall health system performance. Despite this, governments have been reluctant to discontinue funding of services once funding is in place. The focus of this study is to understand how the framing of an issue or problem influences government decision-making related to de-funding of medical services. To achieve this, a framework describing how problem frames, or explanatory naratives, influence government policy decisions was developed and applied to actual cases. The two cases selected were the Ontario government's decisions to de-fund the drug Oxycontin and blood glucose test strips used by patients with diabetes. A qualitative content analysis of public discourse (political debate and media coverage) surrounding these two resource withdrawal examples was conducted and described using the framework. In the framework, government decision-making is a partial reflection of the visibility of the policy issue and complexity of the causal story told within a problem frame. By applying this framework and considering these two key characteristics of problem frames, we can better understand, and possibly predict, the shape and timing of government policy decisions to withdraw resources from medical services.

Protection of digital health information: Examining guidance from the physician regulatory colleges in Canada.

BACKGROUND: The use of information and communication technology (ICT) has tremendous potential to enhance communication among physicians, leading to improvements in service delivery. However, the protection of health information in digital/electronic format is an ongoing concern. OBJECTIVE: The purpose of this study was to examine guidance for the protection of health information when using ICT from all 10 of Canada's provincial regulatory colleges for physicians and to discuss the potential policy and service delivery implications. METHOD: A search of the regulatory college websites was conducted, followed by a document analysis (content and thematic). RESULTS: The college website search identified 522 documents; 12 of these documents (from 8 of the 10 colleges) met the study criteria. These documents were notable for the considerable variation in the scope and detail of guidance provided across the colleges. CONCLUSION: While the federal-provincial division of powers in Canada enables different jurisdictional approaches to health service delivery and, thus, opportunities for policy learning, this governing structure may also contribute to a lack of incentive for collaboration, leading to an absence of standardised guidance for health information protection when using ICT. This, in turn, may result in unequal and inequitable protection of health information across the provinces. Therefore, a macro-level approach to policy development in this area may hold the greatest promise for enhancing the protection of health information and doing so in a more standardised manner in countries with federal systems of governance.

Conceptualising characteristics of resources withdrawal from medical services: a systematic qualitative synthesis.

BACKGROUND: Terms used to describe government-led resource withdrawal from ineffective and unsafe medical services, including 'rationing' and 'disinvestment', have tended to be used interchangeably, despite having distinct characteristics. This lack of descriptive precision for arguably distinct terms contributes to the obscurity that hinders effective communication and the achievement of evidence-based decision-making. The objectives of this study are to (1) identify the various terms used to describe resource withdrawal and (2) propose definitions for the key or foundational terms, which includes a clear description of the unique characteristics of each. METHODS: This is a systematic qualitative synthesis of characteristics and terms found through a search of the academic and grey literature. This approach involved identifying commonly used resource withdrawal terms, extracting data about resource withdrawal characteristics associated with each term and conducting a comparative analysis by categorising elements as antecedents, attributes or outcomes. RESULTS: Findings from an analysis of 106 documents demonstrated that terms used to describe resource withdrawal are inconsistently defined and applied. The characteristics associated with these terms, mainly antecedents and attributes, are used interchangeably by many authors but are differentiated by others. Our analysis resulted in the development of a framework that organises these characteristics to demonstrate the unique attributes associated with each term. To enhance precision, these terms were classified as either policy options or patient health outcomes and refined definitions for rationing and disinvestment were developed. Rationing was defined as resource withdrawal that denies, on average, patient health benefits. Disinvestment was defined as resource withdrawal that results in, on average, improved or no change in health benefits. CONCLUSION: Agreement on the definition of various resource withdrawal terms and their key characteristics is required for transparent government decision-making regarding medical service withdrawal. This systematic qualitative synthesis presents the proposed definitions of resource withdrawal terms that will promote consistency, benefit public policy dialogue and enhance the policy-making process for health systems.

Barriers to Implementing Patient-Centred Care: An Exploration of Guidance Provided by Ontario's Health Regulatory Colleges.

The philosophy of patient-centred care has become widely embraced but its implementation is dependent on interrelated factors. A factor that has received limited attention is the role of policy tools. In Ontario, one method government can use to promote healthcare priorities is through health regulatory colleges, which set the standard of practice for health professionals. The degree to which government policy in support of patient-centered care has influenced the direction provided by health regulatory colleges to their members, and ultimately impacted actual patient care, remains unclear. This study investigates the extent to which Ontario's health regulatory colleges have provided explicit written guidance to members related to the importance of patient-centred care. It also explores applied and theoretical explanations that may further our understanding of why patient-centred care has not been more fully embraced. Findings reveal that guidance provided by Ontario's health regulatory colleges varies widely. Institutional barriers and the choice of policy tools for disseminating government preferences may hinder full implementation of the principles of patient-centred care. More fully understanding the role health regulatory colleges' play in facilitating the implementation of health policy will contribute positively to dialogue and to efforts to achieve positive health system reforms.

Physician communication via Internet-enabled technology: A systematic review.

The use of Internet-enabled technology (information and communication technology such as smartphone applications) may enrich information exchange among providers and, consequently, improve health care delivery. The purpose of this systematic review was to gain a greater understanding of the role that Internet-enabled technology plays in enhancing communication among physicians. Studies were identified through a search in three electronic platforms: the Association for Computing Machinery Digital Library, ProQuest, and Web of Science. The search identified 5140 articles; of these, 21 met all inclusion criteria. In general, physicians were satisfied with Internet-enabled technology, but consensus was lacking regarding whether Internet-enabled technology improved efficiency or made a difference to clinical decision-making. Internet-enabled technology can play an important role in enhancing communication among physicians, but the extent of that benefit is influenced by (1) the impact of Internet-enabled technology on existing work practices, (2) the availability of adequate resources, and (3) the nature of institutional elements, such as privacy legislation.

Lost in transition or translation? Care philosophies and transitions between child and youth and adult mental health services: a systematic review.

Background: Differences in care philosophies may influence transitions from child and adolescent mental health services (CAMHS) to adult mental health services (AMHS). Aims: To review literature about CAMHS and AMHS care philosophies and their influence on transitions. Method: MEDLINE, PsycINFO, Embase and CINAHL databases were searched electronically using keywords related to transitions, youth and mental disorders. Content relating to philosophies of care was searched manually. Descriptive themes were extracted and the analysis suggested four hypotheses of how care philosophies influence transitions. Results: Of the 1897 identified articles, 12 met eligibility criteria. Findings reveal consistent differences in care philosophies between CAMHS (developmental approach, involving families and nurturing) and AMHS (clinical/diagnosis-focus, emphasis on client autonomy and individual responsibility). Conclusions: Better understanding of philosophical differences and collaborative planning and service delivery may foster shared approaches in CAMHS and AMHS to better meet the needs of transitioning youth.

Physician perspectives on Choosing Wisely Canada as an approach to reduce unnecessary medical care: a qualitative study.

BACKGROUND: Reducing monies spent on unnecessary medical care is one possible target to improve value in healthcare systems. Regional variation in the provision of medical care suggests physician behaviour and patient demands influence the provision of unnecessary medical care. Recently, Choosing Wisely campaigns began using 'top 5 do-not-do' lists to target unnecessary medical care by encouraging greater physician and patient dialogue at the point of care. The present study aims to examine the rationale for Choosing Wisely Canada's (CWC) design and to analyse physician perceptions regarding the features of CWC aimed to reduce unnecessary medical care. METHODS: The study involved semi-structured interviews with 19 key informant physicians with CWC experience and the application of procedures of grounded theory to analyse interview transcripts and develop explanations addressing the objectives. RESULTS: Participants reported that the CWC was the medical community's response to three pressures, namely (1) demand for unnecessary medical care from patients during the clinical encounter; (2) public perception that physicians do not always prioritise patients' needs; and (3) 'blunt' government tools aimed to reduce costs rather than improving patient care. Respondents stated that involving the patient in decision-making would help alleviate these pressures by promoting the clinical encounter as the paramount decision-point in achieving necessary care. However, CWC does not address several of the key reasons, from a physician perspective, for providing unnecessary medical care, including time pressures in the clinical encounter, uncertainty about the optimal care pathway and fear of litigation. CONCLUSION: This study contributes to our understanding of the perceptions of physicians regarding the CWC campaign. Specifically, physicians believe that CWC does little to address the clinical reasons for unnecessary medical care. Ultimately, because CWC has limited impact on physician behaviour or patient expectations, it is unlikely to have a major influence on unnecessary medical care.

The transition from youth to adult mental health services and the economic impact on youth and their families.

The transition from Child and Adolescent Mental Health Services (CAMHS) to Adult Mental Health Services (AMHS) can be challenging for youth, their families, and healthcare providers. The purpose of this study was to identify, summarize, and assess evidence found in scholarly literature regarding the economic impact on youth and their families during the transition from CAMHS to AMHS. Relevant studies were identified through a search of 7 electronic platforms. The search identified 829 articles; 5 of which met all inclusion criteria. Evidence from the included studies suggests that, when continuity of care is lacking, transitions from CAMHS to AMHS have substantial impacts on the financial demands of youth and their families. These demands are due to increases in the cost of care, loss of employment income and productivity, and changes in insurance coverage. However, there remains limited information in this area, which highlights the need for further research.

Genetic non-discrimination policy in Canada: Assessing windows of opportunity for policy change.

As the ease of obtaining genetic information for both the diagnosis and treatment of diseases has become increasingly common, so have concerns about the misuse of such information. The obstacles Canada faces in adopting genetic non-discrimination legislation have left health leaders with a lack of clear direction. Using the Kingdon agenda-setting framework, this article will identify lost opportunities for policy change and will analyze the potential for the adoption of a genetic non-discrimination policy in Canada. Windows of opportunity for policy change have existed in the past, but these windows have closed prior to a policy being adopted. More recently, the alignment of problem, policy, and politics streams in the agenda-setting process has resulted in a new window of opportunity. The adoption of a clear and coherent policy will provide the public with protection and health leaders with greater direction around genetic information.

The rise and fall of dental therapy in Canada: a policy analysis and assessment of equity of access to oral health care for Inuit and First Nations communities.

BACKGROUND: Inequality between most Canadians and those from Inuit and First Nations communities, in terms of both access to oral health care services and related health outcomes, has been a long-standing problem. Efforts to close this equity gap led to the creation of dental therapy training programs. These programs were designed to produce graduates who would provide services in rural and northern communities. The closure of the last dental therapy program in late 2011 has ended the supply of dental therapists and governments do not appear to have any alternative solutions to the growing gap in access to oral health care services between most Canadians and those from Inuit and First Nations communities. METHODS: A policy analysis of the rise and fall of the dental therapy profession in Canada was conducted using historical and policy documents. The analysis is framed within Kingdon's agenda-setting framework and considers why dental therapy was originally pursued as an option to ensure equitable access to oral health care for Inuit and First Nations communities and why this policy has now been abandoned with the closure of Canada's last dental therapy training school. RESULTS: The closure of the last dental therapy program in Canada has the potential to further reduce access to dental care in some Inuit and First Nations communities. Overlaps between federal and provincial jurisdiction have contributed to the absence of a coordinated policy approach to address the equity gap in access to dental care which will exacerbate the inequalities in comparison to the general population. The analysis suggests that while a technically feasible policy solution is available there continues to be no politically acceptable solution and thus it remains unlikely that a window of opportunity for policy change will open any time soon. CONCLUSION: In the absence of federal government leadership, the most viable option forward may be incremental policy change. Provincial governments could expand the scope of practice for dental hygienists in the hope that it may support enhanced access, consumer choice, and efficiency in the delivery of oral health care to Inuit and First Nations communities in Canada.

Preventing Youth from Falling Through the Cracks Between Child/Adolescent and Adult Mental Health Services: A Systematic Review of Models of Care.

Optimizing the transition between child and adolescent mental health services (CAMHS) and adult mental health services (AMHS) is a priority for healthcare systems. The purpose of this systematic review is to: (1) identify and compare models of care that may be used to facilitate the transition from CAMHS to AMHS; and (2) discuss trends and implications to inform future research and practice. Results identified three models of care which move beyond healthcare services and incorporate a broader range of services that better meet the dynamic needs of transition-aged youth. Joint working among providers, coupled with individualized approaches, is essential to facilitating continuity of care.

Mandating influenza vaccinations for health care workers: analysing opportunities for policy change using Kingdon's agenda setting framework.

BACKGROUND: The consequences of annual influenza outbreaks are often underestimated by the general public. Influenza poses a serious public health threat around the world, particularly for the most vulnerable populations. Fortunately, vaccination can mitigate the negative effects of this common infectious disease. Although inoculating frontline health care workers (HCWs) helps minimize disease transmission, some HCWs continue to resist participating in voluntary immunization programs. A potential solution to this problem is government-mandated vaccination for HCWs; however, in practice, there are substantial barriers to the adoption of such policies. The purpose of this paper is to identify the likelihood of adopting a policy for mandatory immunization of HCWs in Ontario based on a historical review of barriers to the agenda setting process. METHODS: Documents from secondary data sources were analysed using Kingdon's agenda setting framework of three converging streams leading to windows of opportunity for possible policy adoption. RESULTS: The problems, politics, and policies streams of Kingdon's framework have converged and diverged repeatedly over an extended period (policy windows have opened and closed several times). In each instance, a technically feasible solution was available. However, despite the evidence supporting the value of HCW immunization, alignment of the three agenda setting streams occurred for very short periods of time, during which, opposition lobby groups reacted, making the proposed solution less politically acceptable. CONCLUSIONS: Prior to the adoption of any new policies, issues must reach a government's decision agenda. Based on Kingdon's agenda setting framework, this only occurs when there is alignment of the problems, politics, and policies streams. Understanding this process makes it easier to predict the likelihood of a policy being adopted, and ultimately implemented. Such learning may be applied to policy issues in other jurisdictions. In the case of mandatory influenza vaccinations for HCWs in Ontario, it seems highly unlikely that a new policy will be adopted until perception of the problem's importance is sufficient to overcome the political opposition to implementing a solution and thus, create a window of opportunity that is open long enough to support change.

Can evidence-based health policy from high-income countries be applied to lower-income countries: considering barriers and facilitators to an organ donor registry in Mumbai, India.

BACKGROUND: Organ transplantation has become an effective means to extend lives; however, a major obstacle is the lack of availability of cadaveric organs. India has one of the lowest cadaver organ donation rates in the world. If India could increase the donor rate, the demand for many organs could be met. Evidence from high-income countries suggests that an organ donor registry can be a valuable tool for increasing donor rates. The purpose of this study is to determine whether the implementation of an organ donor registry is a feasible and appropriate policy option to enhance cadaver organ donation rates in a lower-income country. METHODS: This qualitative policy analysis employs semi-structured interviews with physicians, transplant coordinators, and representatives of organ donation advocacy groups in Mumbai. Interviews were designed to better understand current organ donation procedures and explore key informants' perceptions about Indian government health priorities and the likelihood of an organ donor registry in Mumbai. The 3-i framework (ideas, interests, and institutions) is used to examine how government decisions surrounding organ donation policies are shaped. RESULTS: Findings indicate that organ donation in India is a complex issue due to low public awareness, misperceptions of religious doctrines, the need for family consent, and a nation-wide focus on disease control. Key informants cite social, political, and infrastructural barriers to the implementation of an organ donor registry, including widely held myths about organ donation, competing health priorities, and limited hospital infrastructure. CONCLUSIONS: At present, both the central government and Maharashtra state government struggle to balance international pressures to improve overall population health with the desire to also enhance individual health. Implementing an organ donor registry in Mumbai is not a feasible or appropriate policy option in India's current political and social environment, as the barriers, identified through the 3-i framework lens, may be too difficult to overcome. Despite the evidence supporting the use of donor registries as a means to enhance organ donation rates, it is clear that context is critical and that it is not always practical to apply evidence-based policy solutions from high-income countries to lower-income settings.

Effectiveness of Health System Services and Programs for Youth to Adult Transitions in Mental Health Care: A Systematic Review of Academic Literature.

Youth shifting to adult mental health services often report experiencing frustrations with accessing care that adequately replaces the youth services they had received. This systematic review assesses the peer reviewed evidence on services/programs aimed at addressing youth to adult transitions in mental health services. Findings suggest little data exists on the effectiveness of transition services/programs. While the available evidence supports meetings between youth and youth caseworkers prior to transitions occurring, it also verifies that this is not common practice. Other identified barriers to effective transitions were categorized as logistical (ineffective system communication), organizational (negative incentives), and related to clinical governance.

Barriers to implementing WHO's exclusive breastfeeding policy for women living with HIV in sub-Saharan Africa: an exploration of ideas, interests and institutions.

The vertical transmission of HIV occurs when an HIV-positive woman passes the virus to her baby during pregnancy, delivery or breastfeeding. The World Health Organization's (WHO) Guidelines on HIV and infant feeding 2010 recommends exclusive breastfeeding for HIV-positive mothers in resource-limited settings. Although evidence shows that following this strategy will dramatically reduce vertical transmission of HIV, full implementation of the WHO Guidelines has been severely limited in sub-Saharan Africa. This paper provides an analysis of the role of ideas, interests and institutions in establishing barriers to the effective implementation of these guidelines by reviewing efforts to implement prevention of vertical transmission programs in various sub-Saharan countries. Findings suggest that WHO Guidelines on preventing vertical transmission of HIV through exclusive breastfeeding in resource-limited settings are not being translated into action by governments and front-line workers because of a variety of structural and ideological barriers. Identifying and understanding the role played by ideas, interests and institutions is essential to overcoming barriers to guideline implementation.

Fidelity to assertive community treatment program standards: a regional survey of adherence to standards.

In 2004, the Ontario government approved revised program standards for the operation of Assertive Community Treatment (ACT) programs in the province. This paper reports on results from The 2005 Survey of ACT Programs in Ontario. We provide a profile of ACT programs in the province and identify respondents' perceptions of the extent to which the revised program standards have been complied with and are thought to be essential for the effective operation of an ACT program. Program Coordinators completed surveys for 56 (85%) of the 66 ACT programs in existence at the time. None of the Program Coordinators reported that their ACT program was fully compliant with all program standards and only 4% of ACT programs were identified as being fully compliant with more than 75% of the program standards. Conclusions are provided and the broader implications of lower fidelity to program standards are discussed.

Competing for Referrals for Cardiac Diagnostic Tests: What Do Family Physicians Really Want?

In recent years, there has been a substantial shift in where many cardiac diagnostic tests are performed. Not-for-profit hospitals now have to compete with for-profit private clinics for referrals from family physicians. This study aims to evaluate the key factors that family physicians consider when deciding where to refer their patients for several cardiac diagnostic services. Ninety-one family physicians were recruited from one of Ontario's 14 regional local health integration networks (LHINs). These physicians reported on 1,262 referrals made in the previous month for echocardiography, cardiac stress testing, cardiac nuclear imaging, and arrhythmia management. Family physician referrals were almost evenly split between not-for-profit hospitals and for-profit private clinics. The primary criteria influencing the location of referrals were: (1) speed of notification of test date; (2) short wait time for patients; and (3) speed of obtaining test results. Study findings also revealed that 23% of participating family physicians referred 25% or more of all patients needing cardiac diagnostic tests outside of their local LHIN, even though 80% of participants indicated that it is "important" or "somewhat important" to have their patients access cardiac diagnostic services within their local LHIN. Knowledge of the criteria that influence family physician decisions on where to refer patients for cardiac diagnostic testing may be used to assist both hospitals and private laboratories in better meeting the needs of physicians and patients. In particular, failure to meet physicians' expectations regarding fast access and communication of results can be expected to have a negative impact on referrals for cardiac diagnostic testing to a particular facility.

Identifying barriers to mental health system improvements: an examination of community participation in assertive community treatment programs.

BACKGROUND: Integrating the best available evidence into program standards is essential if system-wide improvements in the delivery of community-based mental health services are to be achieved. Since the beginning of the Assertive Community Treatment (ACT) program movement, program standards have included a role for the community. In particular, ACT program standards have sought to ensure that members of the local community are involved in governance and that former clients participate in service delivery as "Peer Support Specialists". This paper reports on the extent to which ACT program standards related to community participation have been implemented and identifies barriers to full compliance. METHODS: Qualitative and quantitative data were collected through a telephone survey of ACT Program Coordinators in Ontario, Canada, using a census sample of the existing 66 ACT programs. A thematic approach to content analysis was used to analyze respondents' qualitative comments. Quantitative data were analyzed using SPSS 16.0 and included means, frequencies, independent t-tests and Pearson Correlations. RESULTS: An 85% response rate was achieved. Of the 33 program standards, the two that received the lowest perceived compliance ratings were the two standards directly concerning community participation. Specifically, the standard to have a functioning Community Advisory Body and the standard requiring the inclusion of a Peer Support Specialist. The three major themes that emerged from the survey data with respect to the barriers to fully implementing the Community Advisory Body were: external issues; standard related issues; and, organizational/structural related issues. The three major themes concerning barriers to implementing the Peer Support Specialist role were: human resource related issues; organizational/structural related issues; and, standard related issues. CONCLUSIONS: The reasons for low compliance of ACT programs with community participation standards are complex and are tied to structural and human resources barriers (both internal and external to the ACT programs) as well as to the requirements of the standards themselves. In order for improvements to the mental health system to be achieved there is a need to identify and address these barriers. Failure to do so will result in less than optimal client, family and economic efficiency outcomes.