Core outcomes for speech-language services in Ontario schools: a group concept mapping study and guiding framework.

BACKGROUND: Establishing the most important outcomes for school-based speech-language therapy is essential to guide future research and program evaluation for these services. Many health disciplines have developed core outcomes sets (COS) for this purpose. A COS encompasses the most important outcomes for particular health services as identified by appropriate interested parties. These interested parties usually represent health care providers and those with the health condition. In this paper, we report the development of a guiding framework for a COS for speech-language therapy services in schools in a Canadian context. METHODS: Using a group concept mapping method, we identified the outcomes for inclusion in the COS guiding framework through the elicited opinions of key interested parties: speech-language therapists, teachers, and family members of children with speech, language, and communication needs. We extracted 103 statements (potential outcomes) from a previous data set of interview transcripts. We then asked participants to sort the statements into conceptually similar groups, which were aggregated and transformed into a cluster map using multidimensional scaling followed by hierarchical cluster analysis. Participants also rated each statement on 5-point scales for importance and feasibility. We calculated mean ratings for individual statements and for all statements in a cluster, for all participants and for participant groups separately. RESULTS: We identified seven core outcomes for school-based speech-language services in Ontario, Canada. These included: classroom-based services, a holistic approach, support for teachers, care coordination, accessible services, family supports, and student success. All outcomes were rated highly for importance. Feasibility ratings were consistently below importance ratings. All participant groups concurred that a holistic approach was the most important outcome and accessible services was the least feasible outcome to achieve. CONCLUSIONS: The seven outcomes identified in this study are recommended to guide the development of a full COS to direct future research and program evaluation for school-based speech-language services. These outcomes have not been widely included in previous research and should be incorporated into future research alongside specific intervention outcomes. Data for some outcomes may be available from non-traditional sources such as administrative data sets. Consequently, their use for program evaluations should be accompanied by appropriate institutional support to allow speech-language therapists to make meaningful use of appropriate outcomes data.

Exploring the valued outcomes of school-based speech-language therapy services: a sequential iterative design.

Background: Achieving outcomes that community members value is essential to high-quality, family-centred care. These valued outcomes should inform the production and interpretation of research evidence. To date, outcomes included in studies of service delivery models for speech-language services in schools have been narrowly defined, and do not match the outcomes suggested as important by families, teachers, and children. The most important outcomes of school-based, speech-languages services have not been directly and systematically investigated. We aimed to address this gap by asking school community members what outcomes were most relevant to evaluating and improving the delivery of speech-language services in schools. Methods: A sequential, iterative mixed-method study was conducted using interviews with 14 family members, educators, and speech-language therapists that asked what outcomes or impacts of school-based services they considered most important or valuable. Summative content analysis was used to analyse the data. Structural topic modelling between rounds of qualitative analysis was used to describe both the quality and the quantity of the interview content. School community members' perspectives were compared through estimation of topic proportions within interviews from each member group and through qualitative comparison. Results: Structural topic modelling diagnostics and qualitative interpretation of topic output suggested a six-topic solution. This solution was estimated successfully and yielded the following topics: (1) meeting all needs appropriately, (2) teamwork and collaboration, (3) building capacities, (4) supporting individual student needs in context, (5) coordinating care, and finally (6) supporting core educational goals. Families focused on school-based services meeting all needs appropriately and coordinating care, while educators highlighted supporting individual student needs in context. By contrast, speech-language therapists emphasized building capacities and supporting core educational goals. All school community members agreed that current assessment tools and outcome measures were inadequate to capture the most important impacts of school-based services. Conclusions: Outcomes identified by school community members as important or valuable were broad, and included individual student outcomes, interpersonal outcomes, and systems-level outcomes. Although these outcomes were discussed by all member groups, each group focused on different outcomes in the interviews, suggesting differences in the prioritization of outcomes. We recommend building consensus regarding the most important outcomes for school-based speech-language services, as well as the prioritization of outcomes for measure development.

Supporting rehabilitation stakeholders in making service delivery decisions: a rapid review of multi-criteria decision analysis methods.

PURPOSE: This review aimed to synthesize knowledge about multi-criteria decision analysis methods for supporting rehabilitation service design and delivery decisions, including: (1) describing the use of these methods within rehabilitation, (2) identifying decision types that can be supported by these methods, (3) describing client and family involvement, and (4) identifying implementation considerations. METHODS: We conducted a rapid review in collaboration with a knowledge partner, searching four databases for peer-reviewed articles reporting primary research. We extracted relevant data from included studies and synthesized it descriptively and with conventional content analysis. RESULTS: We identified 717 records, of which 54 met inclusion criteria. Multi-criteria decision analysis methods were primarily used to understand the strength of clients' and clinicians' preferences (n = 44), and five focused on supporting decision making. Shared decision making with stakeholders was evident in only two studies. Clients and families were mostly engaged in data collection and sometimes in selecting the relevant criteria. Good practices for supporting external validity were inconsistently reported. Implementation considerations included managing cognitive complexity and offering authentic choices. CONCLUSIONS: Multi-criteria decision analysis methods are promising for better understanding client and family preferences and priorities across rehabilitation professions, contexts, and caseloads. Further work is required to use these methods in shared decision making, for which increased use of qualitative methods and stakeholder engagement is recommended. IMPLICATIONS FOR REHABILITATIONMulti-criteria decision analysis methods are promising for evidence-based, shared decision making for rehabilitation.However, most studies to date have focused on estimating stakeholder preferences, not supporting shared decision making.Cognitive complexity and modelling authentic and realistic decision choices are major barriers to implementation.Stakeholder-engagement and qualitative methods are recommended to address these barriers.

Outcomes management practices in tiered school-based speech-language therapy: A Canadian example.

BACKGROUND: Measuring, assessing and managing outcomes in school practice environments is difficult due to the complex nature of school communities as well as the recent shift in service-delivery models towards tiered approaches. In tiered approaches, multiple levels of service are offered to better match students' needs. Each level of service may require different outcomes and management techniques. Research to date on outcomes has focused on measuring outcomes in medical settings, leaving a substantive gap in the literature regarding practice in schools. AIMS: The first aim was to explore how school-based speech-language therapists approached outcomes management as their clinical programmes transitioned to tiered service-delivery models The second aim was to describe the successes and challenges in outcomes management reported by clinicians in this context. METHODS & PROCEDURES: A secondary deductive-inductive content analysis was performed using qualitative interviews with 24 clinical managers and senior therapists from schools across Ontario, Canada. Using a framework of outcomes measurement, assessment and management in schools based on previous research studies, data were grouped into broad categories deductively, and then the content of each category was further explored using inductive coding. Iterative peer debriefing and reflexive journaling were key strategies to increase the trustworthiness of the results. FINDINGS & RESULTS: Participants reported measuring and qualitatively assessing seven key outcomes for school-based practice. These included: (1) student progress and achievement, (2) student participation and inclusion in the school community, (3) stakeholder perspectives, (4) 'buy-in', (5) expanded capacities, (6) responsiveness to needs and (7) accountability to systems. Participants reported more challenges than successes in outcomes management during this transition to tiered services. Challenges were attributed to idiosyncratic organizational barriers, the transition to tiered models and the philosophy of working within the educational system. CONCLUSIONS & IMPLICATIONS: School-based speech-language therapists measure, assess and manage multiple outcomes relevant to school-based practice in tiered service-delivery models. Many challenges remain. Solutions to support meaningful, systematic and proactive outcomes management in schools should address the broader set of outcomes relevant to tiered service-delivery models and the unique practice context of the educational system, while remaining responsive to idiosyncratic organizational factors. Sustained clinical-research collaboration and knowledge exchange is recommended. WHAT THIS PAPER ADDS: What is already known on the subject Systematic, proactive collection and interpretation of outcomes has long been encouraged within speech-language therapy. However, implementing outcomes management in clinical practice remains a substantial challenge. Additionally, research on outcomes to date has focused on medical practice environments, to the exclusion of school-based practice. What are the potential or actual clinical implications of this work? Outcomes management is valued in school practice environments; however, the current repertoire of techniques for outcomes management are a poor match for school-based practice. Clinicians in schools would benefit from the development of contextually relevant, meaningful and feasible outcomes management tools.

Self-esteem mediates mental health outcomes in young people with epilepsy.

OBJECTIVE: To evaluate the extent to which self-esteem mediates the impacts of epilepsy-specific and environmental factors on mental health outcomes in young people with epilepsy. METHODS: A prospective cohort of 480 young people with epilepsy and their families participated in five visits over 28 months. We collected data on clinical seizure burden, cognitive comorbidity, peer and parental support, self-esteem, and self-reported mental health symptoms. We used structural equation modeling to specify and test relationships among these constructs simultaneously. Direct, indirect, and total effects were estimated with confidence intervals constructed through bias-corrected bootstrapping. RESULTS: Self-esteem mediated the effects of clinical seizure burden ( ß  = 0.23, 95% confidence interval [0.05, 0.42]) and peer support ( ß  = -0.15, 95% CI [-0.28, -0.03]) on mental health. There were no mediating effects of parental support ( ß  = -0.07, 95% CI [-0.14, 0.00]) or cognitive comorbidity ( ß  = -0.01, 95% CI [-0.02, 0.01]) on mental health. SIGNIFICANCE: We found evidence that self-esteem mediates the impact that both clinical seizure burden and peer support have on mental health outcomes, indicating that assessment of and interventions targeting self-esteem may be appropriate for young people with epilepsy. Supporting self-esteem could mitigate negative influences on mental health, whether from resistant epilepsy or low peer support.