A Qualitative Evaluation of Program Budgeting and Marginal Analysis in a Canadian Pediatric Tertiary Care Institution.

BACKGROUND: Hospitals in Canada are being asked by governments to improve efficiency and do more with fewer resources. Healthcare decision makers are thus driven to find better ways to manage budgets and deliver on their mission. Formal processes of priority setting and resource allocation (PSRA) are one means to this end. OBJECTIVE: This paper reports an evaluation of one such approach, Program Budgeting and Marginal Analysis (PBMA), as applied at a children and women's tertiary care facility in Nova Scotia, Canada. A brief evaluation conducted immediately after the conclusion of the PBMA process was supplemented with a larger retrospective evaluation. METHODS: The retrospective evaluation included 26 face-to-face individual interviews with senior and middle managers who took part in PBMA. Interview transcripts were analyzed against a template consisting of 19 elements of structure, process, attitudes, and outcomes associated with high performance in PSRA. RESULTS: Respondents had a good experience with the implementation of PBMA, and considered it an improvement over past practice. Success was attributed to effective leadership, and substantial efforts to engage staff members. Understanding of economic and ethical principles of decision making was reportedly increased. Areas for improvement included ensuring that everyone participated in good faith, better communication of final results, and stronger follow-through to determine if anticipated changes and benefits in fact occurred. CONCLUSION: The evaluation framework employed here proved useful in assessing the quality of this resource allocation exercise. The results are directly useful to local decision makers, and the identified strengths and weaknesses are broadly consistent with those reported in studies of other organizations.

Introducing New Priority Setting and Resource Allocation Processes in a Canadian Healthcare Organization: A Case Study Analysis Informed by Multiple Streams Theory.

BACKGROUND: In this article, we analyze one case instance of how proposals for change to the priority setting and resource allocation (PSRA) processes at a Canadian healthcare institution reached the decision agenda of the organization's senior leadership. We adopt key concepts from an established policy studies framework - Kingdon's multiple streams theory - to inform our analysis. METHODS: Twenty-six individual interviews were conducted at the IWK Health Centre in Halifax, NS, Canada. Participants were asked to reflect upon the reasons leading up to the implementation of a formal priority setting process - Program Budgeting and Marginal Analysis (PBMA) - in the 2012/2013 fiscal year. Responses were analyzed qualitatively using Kingdon's model as a template. RESULTS: The introduction of PBMA can be understood as the opening of a policy window. A problem stream - defined as lack of broad engagement and information sharing across service lines in past practice - converged with a known policy solution, PBMA, which addressed the identified problems and was perceived as easy to use and with an evidence-base from past applications across Canada and elsewhere. Conditions in the political realm allowed for this intervention to proceed, but also constrained its potential outcomes. CONCLUSION: Understanding in a theoretically-informed way how change occurs in healthcare management practices can provide useful lessons to researchers and decision-makers whose aim is to help health systems achieve the most effective use of available financial resources.

Olly Olly Oxen Free (or Ally Ally in Free): Playing Hide and Seek in Allocating Resources for Child and Youth Health.

There are powerful arguments for increased investment in child and youth health. But the extent to which these benefits can be realized is shaped by health institutions' priority setting processes. We asked, "What are the unique features of a pediatric care setting that should influence choice and implementation of a formal priority setting and resource allocation process?" Based on multiple sources of data, we created a "made-for-child-health" lens containing three foci reflective of the distinct features of pediatric care settings: the diversity of child and youth populations, the challenges in measuring outcomes and the complexity of patient and public engagement.

Description of the development and validation of the Canadian Paediatric Trigger Tool.

OBJECTIVE: To describe the process of developing and validating the Canadian Association of Paediatric Health Centres Trigger Tool (CPTT). METHODS: Five existing trigger tools were consolidated with duplicate triggers eliminated. After a risk analysis and modified Delphi process, the tool was reduced from 94 to 47 triggers. Feasibility of use was tested, reviewing 40 charts in three hospitals. For validation, charts were randomly selected across four age groups, half medical/half surgical diagnoses, from six paediatric academic health sciences centres. 591 charts were reviewed by six nurses (for triggers and adverse events (AEs)) and three physicians (for AEs only). The incidence of trigger- and AE-positive charts was documented, and the sensitivity and specificity of the tool to identify charts with AEs were determined. Identification of AEs by nurses and physicians was compared. The positive predictive value (PPV) of each trigger was calculated and the ratio of false- to true-positive AE predictors analysed for each trigger. RESULTS: Nurses rated the CPTT easy to use and identified triggers in 61.1% (361/591; 95% CI 57.2 to 65.0) of patient charts; physicians identified AEs in 15.1% (89/ 591, 95% CI 0.23 to 0.43). Over a third of patients with AEs were neonates. The sensitivity and specificity were 0.88 and 0.44, respectively. Nurse and physician AE assessments correlated poorly. The PPV for each trigger ranged from 0 to 88.3%. Triggers with a false/true-positive ratio of >0.7 were eliminated, resulting in the final 35-trigger CPTT. CONCLUSIONS: The CPTT is the first validated, comprehensive trigger tool available to detect AEs in children hospitalised in acute care facilities.