Core outcomes for speech-language services in Ontario schools: a group concept mapping study and guiding framework.

BACKGROUND: Establishing the most important outcomes for school-based speech-language therapy is essential to guide future research and program evaluation for these services. Many health disciplines have developed core outcomes sets (COS) for this purpose. A COS encompasses the most important outcomes for particular health services as identified by appropriate interested parties. These interested parties usually represent health care providers and those with the health condition. In this paper, we report the development of a guiding framework for a COS for speech-language therapy services in schools in a Canadian context. METHODS: Using a group concept mapping method, we identified the outcomes for inclusion in the COS guiding framework through the elicited opinions of key interested parties: speech-language therapists, teachers, and family members of children with speech, language, and communication needs. We extracted 103 statements (potential outcomes) from a previous data set of interview transcripts. We then asked participants to sort the statements into conceptually similar groups, which were aggregated and transformed into a cluster map using multidimensional scaling followed by hierarchical cluster analysis. Participants also rated each statement on 5-point scales for importance and feasibility. We calculated mean ratings for individual statements and for all statements in a cluster, for all participants and for participant groups separately. RESULTS: We identified seven core outcomes for school-based speech-language services in Ontario, Canada. These included: classroom-based services, a holistic approach, support for teachers, care coordination, accessible services, family supports, and student success. All outcomes were rated highly for importance. Feasibility ratings were consistently below importance ratings. All participant groups concurred that a holistic approach was the most important outcome and accessible services was the least feasible outcome to achieve. CONCLUSIONS: The seven outcomes identified in this study are recommended to guide the development of a full COS to direct future research and program evaluation for school-based speech-language services. These outcomes have not been widely included in previous research and should be incorporated into future research alongside specific intervention outcomes. Data for some outcomes may be available from non-traditional sources such as administrative data sets. Consequently, their use for program evaluations should be accompanied by appropriate institutional support to allow speech-language therapists to make meaningful use of appropriate outcomes data.

Exploring the valued outcomes of school-based speech-language therapy services: a sequential iterative design.

Background: Achieving outcomes that community members value is essential to high-quality, family-centred care. These valued outcomes should inform the production and interpretation of research evidence. To date, outcomes included in studies of service delivery models for speech-language services in schools have been narrowly defined, and do not match the outcomes suggested as important by families, teachers, and children. The most important outcomes of school-based, speech-languages services have not been directly and systematically investigated. We aimed to address this gap by asking school community members what outcomes were most relevant to evaluating and improving the delivery of speech-language services in schools. Methods: A sequential, iterative mixed-method study was conducted using interviews with 14 family members, educators, and speech-language therapists that asked what outcomes or impacts of school-based services they considered most important or valuable. Summative content analysis was used to analyse the data. Structural topic modelling between rounds of qualitative analysis was used to describe both the quality and the quantity of the interview content. School community members' perspectives were compared through estimation of topic proportions within interviews from each member group and through qualitative comparison. Results: Structural topic modelling diagnostics and qualitative interpretation of topic output suggested a six-topic solution. This solution was estimated successfully and yielded the following topics: (1) meeting all needs appropriately, (2) teamwork and collaboration, (3) building capacities, (4) supporting individual student needs in context, (5) coordinating care, and finally (6) supporting core educational goals. Families focused on school-based services meeting all needs appropriately and coordinating care, while educators highlighted supporting individual student needs in context. By contrast, speech-language therapists emphasized building capacities and supporting core educational goals. All school community members agreed that current assessment tools and outcome measures were inadequate to capture the most important impacts of school-based services. Conclusions: Outcomes identified by school community members as important or valuable were broad, and included individual student outcomes, interpersonal outcomes, and systems-level outcomes. Although these outcomes were discussed by all member groups, each group focused on different outcomes in the interviews, suggesting differences in the prioritization of outcomes. We recommend building consensus regarding the most important outcomes for school-based speech-language services, as well as the prioritization of outcomes for measure development.

Supporting rehabilitation stakeholders in making service delivery decisions: a rapid review of multi-criteria decision analysis methods.

PURPOSE: This review aimed to synthesize knowledge about multi-criteria decision analysis methods for supporting rehabilitation service design and delivery decisions, including: (1) describing the use of these methods within rehabilitation, (2) identifying decision types that can be supported by these methods, (3) describing client and family involvement, and (4) identifying implementation considerations. METHODS: We conducted a rapid review in collaboration with a knowledge partner, searching four databases for peer-reviewed articles reporting primary research. We extracted relevant data from included studies and synthesized it descriptively and with conventional content analysis. RESULTS: We identified 717 records, of which 54 met inclusion criteria. Multi-criteria decision analysis methods were primarily used to understand the strength of clients' and clinicians' preferences (n = 44), and five focused on supporting decision making. Shared decision making with stakeholders was evident in only two studies. Clients and families were mostly engaged in data collection and sometimes in selecting the relevant criteria. Good practices for supporting external validity were inconsistently reported. Implementation considerations included managing cognitive complexity and offering authentic choices. CONCLUSIONS: Multi-criteria decision analysis methods are promising for better understanding client and family preferences and priorities across rehabilitation professions, contexts, and caseloads. Further work is required to use these methods in shared decision making, for which increased use of qualitative methods and stakeholder engagement is recommended. IMPLICATIONS FOR REHABILITATIONMulti-criteria decision analysis methods are promising for evidence-based, shared decision making for rehabilitation.However, most studies to date have focused on estimating stakeholder preferences, not supporting shared decision making.Cognitive complexity and modelling authentic and realistic decision choices are major barriers to implementation.Stakeholder-engagement and qualitative methods are recommended to address these barriers.

Outcomes management practices in tiered school-based speech-language therapy: A Canadian example.

BACKGROUND: Measuring, assessing and managing outcomes in school practice environments is difficult due to the complex nature of school communities as well as the recent shift in service-delivery models towards tiered approaches. In tiered approaches, multiple levels of service are offered to better match students' needs. Each level of service may require different outcomes and management techniques. Research to date on outcomes has focused on measuring outcomes in medical settings, leaving a substantive gap in the literature regarding practice in schools. AIMS: The first aim was to explore how school-based speech-language therapists approached outcomes management as their clinical programmes transitioned to tiered service-delivery models The second aim was to describe the successes and challenges in outcomes management reported by clinicians in this context. METHODS & PROCEDURES: A secondary deductive-inductive content analysis was performed using qualitative interviews with 24 clinical managers and senior therapists from schools across Ontario, Canada. Using a framework of outcomes measurement, assessment and management in schools based on previous research studies, data were grouped into broad categories deductively, and then the content of each category was further explored using inductive coding. Iterative peer debriefing and reflexive journaling were key strategies to increase the trustworthiness of the results. FINDINGS & RESULTS: Participants reported measuring and qualitatively assessing seven key outcomes for school-based practice. These included: (1) student progress and achievement, (2) student participation and inclusion in the school community, (3) stakeholder perspectives, (4) 'buy-in', (5) expanded capacities, (6) responsiveness to needs and (7) accountability to systems. Participants reported more challenges than successes in outcomes management during this transition to tiered services. Challenges were attributed to idiosyncratic organizational barriers, the transition to tiered models and the philosophy of working within the educational system. CONCLUSIONS & IMPLICATIONS: School-based speech-language therapists measure, assess and manage multiple outcomes relevant to school-based practice in tiered service-delivery models. Many challenges remain. Solutions to support meaningful, systematic and proactive outcomes management in schools should address the broader set of outcomes relevant to tiered service-delivery models and the unique practice context of the educational system, while remaining responsive to idiosyncratic organizational factors. Sustained clinical-research collaboration and knowledge exchange is recommended. WHAT THIS PAPER ADDS: What is already known on the subject Systematic, proactive collection and interpretation of outcomes has long been encouraged within speech-language therapy. However, implementing outcomes management in clinical practice remains a substantial challenge. Additionally, research on outcomes to date has focused on medical practice environments, to the exclusion of school-based practice. What are the potential or actual clinical implications of this work? Outcomes management is valued in school practice environments; however, the current repertoire of techniques for outcomes management are a poor match for school-based practice. Clinicians in schools would benefit from the development of contextually relevant, meaningful and feasible outcomes management tools.

Self-esteem mediates mental health outcomes in young people with epilepsy.

OBJECTIVE: To evaluate the extent to which self-esteem mediates the impacts of epilepsy-specific and environmental factors on mental health outcomes in young people with epilepsy. METHODS: A prospective cohort of 480 young people with epilepsy and their families participated in five visits over 28 months. We collected data on clinical seizure burden, cognitive comorbidity, peer and parental support, self-esteem, and self-reported mental health symptoms. We used structural equation modeling to specify and test relationships among these constructs simultaneously. Direct, indirect, and total effects were estimated with confidence intervals constructed through bias-corrected bootstrapping. RESULTS: Self-esteem mediated the effects of clinical seizure burden ( ß  = 0.23, 95% confidence interval [0.05, 0.42]) and peer support ( ß  = -0.15, 95% CI [-0.28, -0.03]) on mental health. There were no mediating effects of parental support ( ß  = -0.07, 95% CI [-0.14, 0.00]) or cognitive comorbidity ( ß  = -0.01, 95% CI [-0.02, 0.01]) on mental health. SIGNIFICANCE: We found evidence that self-esteem mediates the impact that both clinical seizure burden and peer support have on mental health outcomes, indicating that assessment of and interventions targeting self-esteem may be appropriate for young people with epilepsy. Supporting self-esteem could mitigate negative influences on mental health, whether from resistant epilepsy or low peer support.

Recommended practices to organize and deliver school-based services for children with disabilities: A scoping review.

BACKGROUND: Inclusive educational environments can have a positive effect on the general health and well-being of children with disabilities. However, their level of academic success and participation remains limited. Considering scarce resources and high needs, identifying efficient methods for providing interdisciplinary services is critical. This scoping review, therefore, aims to (a) synthesize current evidence about principles for organizing and delivering interdisciplinary school-based support services for students with disabilities and (b) ascertain useful strategies for implementation of principles in the school setting. METHODS: Scholarly and grey literature in rehabilitation and education were reviewed collaboratively with school-based stakeholders. A search of five databases identified 13,141 references and resulted in 56 relevant articles published from 1998 to 2017. Information (e.g., principles to organize services and strategies for implementation) was extracted, and thematic analysis was used to summarize findings. RESULTS: Within the documents retained, 65% were scientific and 35% were grey. Services primarily targeted students with behavioral issues, followed by those with cognitive and learning disabilities with a focus on improving social-emotional functioning and academic performance. Thematic analysis revealed 10 common principles to guide service organization (e.g., collaborative interventions and support for teachers) and seven implementation strategies (e.g., training and coordination) for employing these principles. CONCLUSIONS: Findings can guide rehabilitation professionals, educators, and policy makers in restructuring well-coordinated collaborative services involving training and capacity-building of school-based service providers. Such knowledge can contribute to the improved provision of care and, consequently, promote children's school participation and inclusion.

Supporting occupational therapists implementing a capacity-building model in schools: Appuyer les ergothérapeutes mettant en œuvre un modèle de renforcement des capacités dans les écoles.

BACKGROUND: Adopting a new model of clinical practice is complex. Professional development programs based on best-practice principles may facilitate this process. PURPOSE: This paper describes the development and evaluation of a multifaceted professional development program designed to support school-based occupational therapists to deliver a capacity-building model of service. METHOD: Twenty-two therapists participated in the program; completed pre-post evaluations of knowledge, skills, and beliefs; evaluated specific components of the training program; and participated in focus groups. Quantitative data were analyzed using descriptive and inferential statistics. Qualitative data were analyzed using a directed content analysis. FINDINGS: Therapists' perceptions of their knowledge and skills showed statistically significant change. Both training and mentorship were highly valued; however, having opportunities to build peer networks was considered essential. IMPLICATIONS: Multifaceted professional development programs designed using best-practice principles are an important mechanism for facilitating practice change. Including a process for peer support is advised.

Implementation Science: Buzzword or Game Changer?

PURPOSE: The purpose of this supplement article is to provide a resource of pertinent information concerning implementation science for immediate research application in communication sciences and disorders. METHOD: Key terminology related to implementation science is reviewed. Practical suggestions for the application of implementation science theories and methodologies are provided, including an overview of hybrid research designs that simultaneously investigate clinical effectiveness and implementation as well as an introduction to approaches for engaging stakeholders in the research process. A detailed example from education is shared to show how implementation science was utilized to move an intervention program for autism into routine practice in the public school system. In particular, the example highlights the value of strong partnership among researchers, policy makers, and frontline practitioners in implementing and sustaining new evidence-based practices. CONCLUSIONS: Implementation science is not just a buzzword. This is a new field of study that can make a substantive contribution in communication sciences and disorders by informing research agendas, reducing health and education disparities, improving accountability and quality control, increasing clinician satisfaction and competence, and improving client outcomes.

Use of the Medical Research Council Framework to develop a complex intervention in pediatric occupational therapy: Assessing feasibility.

The United Kingdom Medical Research Council recommends use of a conceptual framework for designing and testing complex therapeutic interventions. Partnering for Change (P4C) is an innovative school-based intervention for children with Developmental Coordination Disorder (DCD) that was developed by an interdisciplinary team who were guided by this framework. The goals of P4C are to facilitate earlier identification, build capacity of educators and parents to manage DCD, and improve children's participation in school and at home. Eight occupational therapists worked in school settings during the 2009-2010 school year. Their mandate was to build capacity through collaboration and coaching with the school becoming the "client", rather than any individual student. Over 2600 students and 160 teachers in 11 elementary schools received service during the project. Results from questionnaires and individual interviews indicated that this model was highly successful in increasing knowledge and capacity. P4C intervention holds promise for transforming service delivery in schools.

"Support for everyone": Experiences of occupational therapists delivering a new model of school-based service.

BACKGROUND: Occupational therapists working in school health have recognized the need to move away from a one-to-one direct service delivery model towards a more collaborative, classroom-based approach. Partnering for Change (P4C) is an innovative service delivery model that may enhance school-based collaborative care. PURPOSE: To capture the experiences of occupational therapists implementing P4C and to elicit their perspectives about how this model differs from the direct service approach. METHODS: Semi-structured, face-to-face interviews were conducted with seven therapists who had delivered P4C in 10 Ontario schools. Thematic analysis was utilized with themes verified through member checking. FINDINGS: Five themes (a year of growth, becoming a community, the key ingredients of P4C, a balancing act, and providing services that make an impact) reflected therapists'personal and professional growth, aspects of the model they believed were key, challenges they encountered, and the impact they felt they had made. IMPLICATIONS: Partnering for Change has the potential to transform school-based occupational therapy and overcome existing barriers to collaboration. This model also may better address the needs of children with motor coordination difficulties.

Partnering for change: an innovative school-based occupational therapy service delivery model for children with developmental coordination disorder.

BACKGROUND: Developmental coordination disorder (DCD) is a common, chronic health condition that is poorly recognized and understood in school settings. Without appropriate support, children with DCD are at increased risk of depression, decreased fitness, and obesity. Evidence shows that occupational therapy intervention needs to shift from remediation of impairment to chronic disease management. PURPOSE: This paper describes Partnering for Change (P4C), an innovative, empirically derived school health service delivery model for children with DCD. KEY ISSUES: The model emphasizes the partnership of the occupational therapist with educators and parents to change the life and daily environment of a child. The P4C partnership focuses on capacity building through collaboration and coaching in context. The model uses a tiered approach which includes whole class instruction, dynamic performance analysis, and monitoring response to intervention. IMPLICATIONS: P4C is a model that responds to the needs of this population, addresses issues identified in research, and provides a continuum of services designed to build capacity.

The relationship between peer conflict resolution knowledge and peer victimization in school-age children across the language continuum.

UNLABELLED: Peer victimization, or bullying, has been identified as a significant child health priority and children with language impairment (LI) are among those who are vulnerable. Given the mandate of educators to provide support for all students who are bullied regardless of language status, research is needed that integrates the study of risk factors for peer victimization among children who are developing typically and children who have LI. Accordingly, this preliminary study explored the degree to which one potential risk factor, peer conflict resolution knowledge, was related to peer victimization in children across the language continuum, and considered whether or not individual differences in language ability influenced that relationship. Participants included 17 girls and 15 boys aged 9-12 years with a wide range of language abilities, six meeting criteria for LI. Participants completed a hypothetical peer conflict resolution task and a measure of peer victimization. Correlational analyses revealed very different patterns of relationships for boys and girls. Whereas boys' reports of peer victimization were meaningfully related to how they responded to hypothetical peer conflicts, girls' reports were most strongly associated with language ability. These preliminary findings suggest that it is important to consider gender when conceptualizing how factors such as peer conflict resolution knowledge might influence children's risk of being bullied. LEARNING OUTCOMES: Readers will be able to: (1) provide a definition of peer victimization and give examples of different forms of peer victimization; (2) recognize that inadequate peer conflict resolution knowledge may be a risk factor for peer victimization; (3) describe the relationships between peer conflict resolution knowledge, language ability, and peer victimization in this study, and explain how these relationships differed for boys and girls; and (4) identify at least three opportunities for future research that would help to clarify risk factors for peer victimization in boys and girls.

Innovations in measuring peer conflict resolution knowledge in children with LI: exploring the accessibility of a visual analogue rating scale.

UNLABELLED: This preliminary study explored peer conflict resolution knowledge in children with and without language impairment (LI). Specifically, it evaluated the utility of a visual analogue scale (VAS) for measuring nuances in such knowledge. Children aged 9-12 years, 26 with typically developing language (TLD) and 6 with LI, completed a training protocol and hypothetical task in which they rated goals and strategies that could be pursued following peer conflict. Whereas participants with TLD provided graded judgments using the entire VAS, most children with LI relied solely on the scale anchors. These results suggest at least two possibilities. The less differentiated manner in which participants with LI utilized the VAS may have been influenced by how they viewed the peer conflict situations. Alternatively, additional training may be required to enable them to consistently use the whole scale. Further research is needed to establish whether ratings made by children with LI reflect differences in social perceptions or a need for further experience with the VAS. In either case, distinguishing between these alternatives will likely provide a better understanding of factors that impact the peer relationships of children with LI. LEARNING OUTCOMES: Readers will be able to: (1) identify challenges associated with assessing peer conflict resolution knowledge in children with language impairments; (2) describe current methods for measuring children's peer conflict resolution knowledge; (3) describe a visual analogue rating (VAS) scale and explain the potential advantages of this scale format; and (4) describe similarities and differences in how children with and without LI used a VAS in a hypothetical peer conflict resolution task.

School-aged children with SLI: the ICF as a framework for collaborative service delivery.

UNLABELLED: Reports of associated disabilities among children with specific language impairment (SLI) and children with other developmental disabilities are widespread. Clinicians require a broader definition of SLI that recognizes associated disabilities because it is their goal to impact children's everyday functioning. In this paper, we explore SLI from a broader perspective in which consideration is given to features known to be common across different developmental disabilities. The World Health Organization's (2001) International Classification of Functioning, Disability and Health (ICF) is utilized as an organizational and conceptual framework for considering how knowledge of commonalities across developmental disabilities may be used to promote collaborative service delivery in an educational setting. This framework can potentially provide a coherent and comprehensive approach to treating SLI and its associated disabilities without overburdening clinical services. LEARNING OUTCOMES: As a result of this activity, the reader will be able to: (1) describe the potential role of the ICF in facilitating collaborative service delivery in the school setting; (2) identify and describe the commonalities among SLI and its associated disabilities; and (3) describe how knowledge of commonalities may inform approaches to service delivery.

A conceptual model for interprofessional education: the international classification of functioning, disability and health (ICF).

A shared language and conceptual framework is essential to successful interprofessional collaboration. The World Health Organization's International Classification of Functioning, Disability and Health (ICF) provides a shared language and conceptual framework that transcends traditional disciplinary boundaries. This paper will familiarize readers with the ICF and describe the biopsychosocial perspective that is adopted in its conceptual framework and language. The presentation of a case study will illustrate how the ICF can enhance interprofessional learning by promoting a multidimensional perspective of an individual's health concerns. The case study will also highlight the value of the shared language and conceptual framework of the ICF for interprofessional collaboration. It is argued that a strong foundation in the principles exemplified by the ICF may serve to enhance interprofessional communication, and in so doing, encourage involvement in interprofessional collaboration and healthcare.