Developing and testing a reflection method for implementation of the informal care guideline in community nursing: Design-based research.

AIM: To develop a reflection method for community nurses and certified nursing assistants to support the implementation of the Dutch Informal Care guideline in daily care. DESIGN: Design-based research. METHODS: A design group and four test groups of community nurses and nursing assistants were formed to develop a reflection method that aligns with the needs and preferences of its end-users. The design and test group meetings were video recorded. The video data were iteratively discussed and analysed thematically to adapt and refine the method and to identify its key features. RESULTS: A final reflection method was developed. Five main themes were identified from the analysis: the group, reflective triggers, knowledge about the guidelines, the coach and preconditions. The themes are linked to nine key features representing the building blocks of the reflection method. The key features are group size, participants with different (educational) backgrounds, pairs of participants, expressing thoughts, video feedback, reflection game, making the connection with the guideline, coaching as a process facilitator and meeting organizational and contextual conditions for implementation. CONCLUSION: An evidence- and practice-based reflection method for community nurses and certified nursing assistants is developed to support the implementation. By involving community nurses and certified nursing assistants, the method closely matches their needs and preferences. Critical elements of the reflection method are a game element, video feedback and working in pairs in a group of participants from different (educational) backgrounds. Guidance is needed to make the transfer from theory to practice. IMPACT: A reflection method for community nurses and certified nursing assistants was developed to enhance care work according to guideline recommendations, aiming to improve the care provided by informal caregivers. REPORT METHOD: The COREQ guideline was used. PATIENT OR PUBLIC CONTRIBUTION: This reflection method was developed in close collaboration with all stakeholders during the entire study.

Development of the Musi-CI Training, A Musical Listening Training for Cochlear Implant Users: A Participatory Action Research Approach.

A cochlear implant (CI) is a prosthesis that allows people with severe to profound hearing loss to understand speech in quiet settings. However, listening to music presents a challenge to most CI users; they often do not enjoy music or avoid it altogether. The Musi-CI training course was developed for CI users with the goal of reducing music aversion and improving music enjoyment. A consortium was established consisting of a professional musician with CI, CI rehabilitation professionals and researchers. Participatory action research (PAR) was applied to develop and evaluate the training experiences, collaborating with 37 CI users during three cycles of eight training sessions, each held over a period of 3 months. Input and feedback were collected after each training session using questionnaires, observations and focus group interviews. Almost all participants (86%) completed the training. After completing the training a large majority of participants reported increased music appreciation, increased social participation in musical settings and a positive impact on general auditory perception. The resulting Musi-CI training programme focuses on music listening skills, self-efficacy, and self-motivation. It consists of exercises intended to strengthen attention and working memory, to improve beat and rhythm perception (with online rhythm exercises) and exercises to distinguish timbre of instruments and emotion in music. A Melody Game was developed to improve pitch and melodic contour discrimination.

A framework to improve quality of hospital-based physiotherapy: a design-based research study.

BACKGROUND: A quality framework for hospital-based physiotherapy is lacking. This study aims to design a framework, building on the currently available literature, to improve the quality of hospital-based physiotherapy. METHODS: A multidisciplinary panel of six representatives of hospital-based physiotherapy and their key stakeholders (patients, medical specialists, hospital management and professional association) was set up. We used brainwriting to sample ideas and the 'decision-matrix' to select the best ideas. RESULTS: The first round of brainwriting with an online panel of six experienced participants yielded consensus on seven possible methods for quality improvement of hospital-based physiotherapy [1]: continuing education [2] ,feedback on patient reported experience measures and patient reported outcome measures [3] ,a quality portfolio [4] ,peer observation and feedback [5] ,360 degree feedback [6] ,a management information system, and [7] intervision with intercollegiate evaluation. Placing these methods in a decision matrix against four criteria (measurability, acceptability, impact, accessibility) resulted in a slight preference for a management information system, with almost equal preference for five other methods immediately thereafter. The least preference was given to a 360-degree feedback. CONCLUSIONS: In the design of a framework for improving the quality of hospital-based physiotherapy, all seven suggested methods were perceived as relevant but differed in terms of advantages and disadvantages. This suggests that, within the framework, a mixture of these methods may be desirable to even out respective advantages and disadvantages.

Quality aspects of hospital-based physiotherapy from the perspective of key stakeholders: a qualitative study.

BACKGROUND: For the design of a robust quality system for hospital-based physiotherapy, it is important to know what key stakeholders consider quality to be. OBJECTIVE: To explore key stakeholders' views on quality of hospital-based physiotherapy. METHODS: We conducted 53 semi-structured interviews with 62 representatives of five key stakeholder groups of hospital-based physiotherapy: medical specialists, hospital managers, boards of directors, multidisciplinary colleagues and patients. Audio recordings of these interviews were transcribed verbatim and analysed with thematic analysis. RESULTS: According to the interviewees, quality of hospital-based physiotherapy is characterised by: (1) a human approach, (2) context-specific and up-to-date applicable knowledge and expertise, (3) providing the right care in the right place at the right time, (4) a proactive departmental policy in which added value for the hospital is transparent, (5) professional development and innovation based on a vision on science and developments in healthcare, (6) easy access and awareness of one's own and others' position within the interdisciplinary cooperation and (7) ensuring a continuum of care with the inclusion of preclinical and postclinical care of patients. CONCLUSIONS: Important quality aspects in the perspective of all stakeholders were an expertise that matches the specific pathology of the patient, the hospital-based physiotherapist being a part of the care team, and the support and supervision of all patients concerning physical functioning during the hospitalisation period. Whereas patients mainly mentioned the personal qualities of the physiotherapist, the other stakeholders mainly focused on professional and organisational factors. The results of this study offer opportunities for hospital-based physiotherapy to improve the quality of provided care seen from the perspective of key stakeholders.

Educational programs for learning to observe movement quality in physical therapy: a design-based research approach.

Introduction: Movement observation is a core aspect in physical therapists' diagnosis to determine which interventions are adequate to improve functional abilities. The aim of this study was to derive design principles for an educational program for the development of observational skills.Methods: We used a qualitative approach within a design-based research methodology. In four rounds, 8 physical therapy students, 16 teachers, and 9 practitioners participated in five Nominal Group Technique meetings and six interviews. Meetings and interviews were transcribed verbatim and analyzed using thematic analysis.Results: We identified three themes, each with several design principles: (1) didactics; (2) professional content; and (3) conditions for optimal learning. We developed a proto-theory underpinned with underlying educational theories.Conclusions: To learn observational skills, students, facilitated by an experienced teacher, need to take the lead in their own learning process. This might imply a need for additional training for teachers. A realistic context is a precondition for learning; it might be necessary to increase possibilities for observations in clinical contexts or to invest in training for (simulated) patients as participants in education. Further research is needed to test the applicability of the design principles and a proto-theory for other professionals with a focus on observation and analysis of movements.

The application of the tracer method with peer observation and formative feedback for professional development in clinical practice: a scoping review.

INTRODUCTION: The tracer method, commonly used for quality assessment, can also be used as a tool for peer observation and formative feedback on professional development. This scoping review describes how, by whom, and with what effect the tracer method is applied as a formative professional development instrument between healthcare professionals of equal status and aims to identify the types of scientific evidence for this use of the tracer method. METHODS: The authors searched four electronic databases for eligible articles, which were screened and assessed for eligibility by two independent researchers. From eligible studies, data were extracted to summarize, collate, and make a narrative account of the findings. RESULTS: The electronic search yielded 1757 unique studies, eight of which were included as valid and relevant to our aim: five qualitative, two mixed methods, and one quantitative study. Seven studies took place in hospitals and one in general practice. The tracer method was used mainly as a form of peer observation and formative feedback. Most studies evaluated the tracer method's feasibility and its impact on professional development. All but one study reported positive effects: participants described the tracer method generally as being valuable and worth continuing. DISCUSSION: Although the body of evidence is small and largely limited to the hospital setting, using the tracer method for peer observation and formative feedback between healthcare professionals of equal status appears sufficiently useful to merit further rigorous evaluation and implementation in continuous professional development in healthcare.

Impact and feasibility of a tailor-made patient communication quality improvement programme for hospital-based physiotherapists: a mixed-methods study.

BACKGROUND: In tailoring a quality improvement programme for hospital-based physiotherapy, the original use of video recordings was replaced by using the tracer methodology. OBJECTIVE: To examine the impact of a tailor-made quality improvement programme addressing patient communication on the professional development of hospital-based physiotherapists, and to evaluate barriers and facilitators as determinants of feasibility of the programme. METHODS: A mixed-methods study was conducted. Participants were clustered in groups per hospital and linked with an equally sized group in a nearby hospital. Within the groups, fixed couples carried out a 2-hour tracer by directly observing each other's daily work routine. This procedure was repeated 6 months later. Data from feedback forms were analysed quantitatively, and a thematic analysis of transcripts from group interviews was conducted. RESULTS: Fifty hospital-based physiotherapists from 16 hospitals participated. They rated the impact of the programme on professional development, on a scale from 1 (much improvement needed) to 5 (no improvement needed), as 3.99 (SD 0.64) after the first tracer and 4.32 (SD 0.63) 6 months later; a mean improvement of 0.33 (95% CI 0.16 to 0.50). Participants scored, on a scale ranging from 1 to 5 on barriers and facilitators (feasibility), a mean of 3.45 (SD 0.95) on determinants of innovation, 3.47 (SD 0.86) on probability to use and 2.63 (SD 1.07) on the user feedback list. All participants emphasised the added value of the tracer methodology and mentioned effects on self-reflection and awareness most. CONCLUSIONS: The tailor-made quality improvement programme, based on principles of the tracer methodology, was associated with a significant impact on professional development. Barriers and facilitators as determinants of feasibility of the programme showed the programme being feasible.

Exploring the perspective of patients with musculoskeletal health problems in primary care on the use of patient-reported outcome measures to stimulate quality improvement in physiotherapist practice; a qualitative study.

Background: Patient-reported outcome measures (PROMs) in clinical practice might enhance patient- centeredness and effectiveness of physiotherapy practice. Although patients have a crucial role in using PROMs, little is known about their perspective on its usefulness.Purpose: Explore the perspective of patients with musculoskeletal health problems on using PROMs for quality improvement in primary care physiotherapy practice, and determine what barriers and facilitators patients perceive.Methods: Semi-structured interviews were performed in 21 patients recruited from primary care physiotherapy practice and analyzed using theoretical thematic analysis. Barriers and facilitators on PROMs implementation were categorized into four predefined domains conform.Results: Across all domains, three major themes were identified: 1) Practicality; 2) Interaction with the physiotherapist for decision-making; and 3) Sharing information outside the clinical context. Generally, PROMs were perceived practically applicable instruments with added value to the interaction with the physiotherapist for shared decision-making and for stimulating quality improvement. The perceived barriers were: difficulties in administering PROMs for patients with poor computer skills, suboptimal efficiency when PROMs were administered at the expense of the consultation, the insufficient added value of PROMs for patients with recurrent health problems, and reluctance about sharing aggregated data for accountability purposes.Limitations: The dependence on the participating physiotherapists in patient recruitment might have resulted in selection bias.Conclusion: Patients perceive that using PROMs has an added value in primary care physiotherapy practice. Optimizing implementation using tailored implementation strategies related to the identified barriers in all four domains might further improve the use of PROMs in clinical practice.

Development of quality indicators for departments of hospital-based physiotherapy: a modified Delphi study.

BACKGROUND: International hospital accreditation instruments, such as Joint Commission International (JCI) and Qmentum, focus mainly on hospital policy and procedures and do not specifically cover a profession such as hospital-based physiotherapy. This justifies the need for a quality system to which hospital-based physiotherapy can better identify, based on a common framework of quality indicators for effective quality management. OBJECTIVE: This study aimed to identify the most important quality indicators of a hospital-based physiotherapy department in the eyes of hospital-based physiotherapists and their managers. METHODS: Based on input from three focus groups and a structured literature review, a first set of quality indicators for hospital physiotherapy was assembled. After checking this set for duplicates and for overlap with JCI and Qmentum, it formed the starting point of a modified Delphi procedure. In two rounds, 17 hospital-based physiotherapy experts rated the quality indicators on relevance through online surveys. In a final consensus meeting, quality indicators were established, classified in quality themes and operationalised by describing for each theme the rationale, specifications, domain and type of indicator. RESULTS: Three focus groups provided 120 potential indicators, which were complemented with 18 potential indicators based on literature. After duplicate and overlap check and the Delphi procedure, these 138 potential indicators were reduced to a set of 56 quality indicators for hospital-based physiotherapy. Finally, these 56 indicators were condensed into 7 composite indicators, each representing a quality theme based on definitions of the European Foundation for Quality Management. CONCLUSION: A set of 56 quality indicators, condensed into 7 composite indicators each representing a quality theme, was developed to assess the quality of a hospital-based physiotherapy department.

Development and validity of an innovative test to assess guideline-consistent clinical reasoning by physical therapists in stroke rehabilitation.

OBJECTIVE: To evaluate the validity of a script concordance test to assess guideline-consistent clinical reasoning by physical therapists in stroke rehabilitation, and to identify critical features of physical therapists specializing in stroke rehabilitation. METHODS: A script concordance test was developed according to current standards. Four subgroups of physical therapists (those specializing in neurology, those focusing on neurology or geriatrics, other, and non-specialized undergraduate students) were asked to complete the test. The construct validity of the script concordance test was evaluated with 1-way analysis of variance (ANOVA) to estimate differences between subgroups. Associations between physical therapist characteristics, and script concordance test scores were analysed with bivariate regression analysis followed by multivariate analyses. RESULTS: The script concordance test, with 59 items, was completed by 211 physical therapists. ANOVA analysis showed statistically significant differences between the script concordance test scores of the 4 groups (p<0.001), with higher scores by the physical therapists specializing in neurology compared with the other, non-specialized, subgroups. The multivariate analysis showed that better guideline knowledge (B = 1.07; CI = 0.48-1.65; p =<0.001), successful completion of the Dutch Neurorehabilitation course (B = 4.1; CI = 1.37-6.87; p = 0.003), and participation in professional development activities (B = 2.4; CI = 0.05-4.68; p = 0.046) were associated with higher script concordance test scores. CONCLUSION: The script concordance test has good construct validity. Greater self-reported guideline knowledge, successful completion of the post-bachelor Dutch Neurorehabilitation course, as well as systematic participation in professional development activities facilitate important factors that enhance specialization. The script concordance test is a valid feedback tool for physical therapists to support professional development in the domain of stroke rehabilitation.

Self-regulated learning in physical therapy education: a non-randomized experimental study comparing self-directed and instruction-based learning.

BACKGROUND: There is a concern that traditional instruction based methods of learning do not adequately prepare students for the challenges of physical therapy practice. Self-directed learning is considered to be the most appropriate educational approach to enhance life-long learning as it enhances self-efficacy. This study compares outcomes in two educational approaches: self-directed learning (SDL), and traditional instruction based learning (IBL). METHODS: In this non-randomized experimental study two groups of second year physiotherapy students were compared using pre-post-test assessments. Study results (both knowledge and physiotherapy performance), and self-reported self-efficacy were used as outcome variables. Study results from the end of year 1 and the end of year two were retrieved form the student information system. Self-reported variables including general and physical therapy self-efficacy were assessed using an online questionnaire which was completed at the start and the end of year two. Changes in self-efficacy were analysed using a repeated measures multivariate ANOVA. RESULTS: A total of 174 students were enrolled in the second year, of which 108 (62%) agreed to participate in the online questionnaire. The online questionnaire at baseline (September 2015) was completed by 27 students in the SDL condition compared to 81 students in the IBL condition. There were no statistical differences at baseline between both educational approaches on any of the variables in the study. At the end of year two, there was no difference between both conditions in indicators of study results: knowledge and performance. Perceived self-efficacy in functioning as a physical therapist increased between both assessments. However, this increase was observed in both condition, and the difference between both conditions was not statistically significant. CONCLUSIONS: Self-directed learning and traditional instruction based learning result in equal study outcome and self-efficacy at the end of year two. More research is needed to determine the long term outcome that is most relevant for lifelong learning, and which students will benefit most from this approach. Nonetheless, self-directed learning might be an important alternative for instruction-based l education.

Impact of Self- and Peer Assessment on the Clinical Performance of Physiotherapists in Primary Care: A Cohort Study.

Purpose: This study evaluated the impact of a quality improvement programme based on self- and peer assessment to justify nationwide implementation. Method: Four professional networks of physiotherapists in The Netherlands (n = 379) participated in the programme, which consisted of two cycles of online self-assessment and peer assessment using video recordings of client communication and clinical records. Assessment was based on performance indicators that could be scored on a 5-point Likert scale, and online assessment was followed by face-to-face feedback discussions. After cycle 1, participants developed personal learning goals. These goals were analyzed thematically, and goal attainment was measured using a questionnaire. Improvement in performance was tested with multilevel regression analyses, comparing the self-assessment and peer-assessment scores in cycles 1 and 2. Results: In total, 364 (96%) of the participants were active in online self-assessment and peer assessment. However, online activities varied between cycle 1 and cycle 2 and between client communication and recordkeeping. Personal goals addressed client-centred communication (54%), recordkeeping (24%), performance and outcome measurement (15%), and other (7%). Goals were completely attained (29%), partly attained (64%), or not attained at all (7%). Self-assessment and peer-assessment scores improved significantly for both client communication (self-assessment = 11%; peer assessment = 8%) and recordkeeping (self-assessment = 7%; peer assessment = 4%). Conclusions: Self-assessment and peer assessment are effective in enhancing commitment to change and improving clinical performance. Nationwide implementation of the programme is justified. Future studies should address the impact on client outcomes.

Objectif : évaluer les répercussions d'un programme d'amélioration de la qualité reposant sur l'autoévaluation et l'évaluation par les pairs pour en justifier la mise en œuvre nationale. Méthodologie : quatre réseaux professionnels de physiothérapeutes des Pays-Bas (n=379) ont participé au programme, composé de deux cycles d'autoévaluation en ligne et d'évaluation par les pairs à l'aide d'enregistrements vidéo des communications des clients et des dossiers cliniques. L'évaluation était fondée sur des indicateurs de la performance qui pouvaient être cotés sur une échelle de Likert de cinq points, et l'évaluation en ligne était suivie de rencontres de rétroaction. Après le cycle 1, les participants se sont donné des objectifs d'apprentissage personnel. Les chercheurs ont évalué ces objectifs par thème et en ont mesuré l'atteinte au moyen d'un questionnaire. Ils ont vérifié l'amélioration de la performance à l'aide d'analyses de régression multiniveaux et ont comparé les cotes d'autoévaluation et d'évaluation par les pairs des cycles 1 et 2. Résultats : au total, 364 des participants (96 %) étaient actifs dans l'autoévaluation en ligne et l'évaluation par les pairs. Cependant, les activités en ligne variaient entre le cycle 1 et le cycle 2 et entre les communications avec le client et la tenue de dossier. Les objectifs personnels portaient sur les communications axées sur le client (54 %), la tenue de dossiers (24 %), les mesures de la performance et des résultats cliniques (15 %) et d'autres points (7 %). Les objectifs étaient complètement atteints (29 %), partiellement atteints (64 %) ou pas du tout atteints (7 %). Les cotes d'autoévaluation et d'évaluation par les pairs s'amélioraient sensiblement dans les secteurs des communications avec le client (autoévaluation = 11 %; évaluation par les pairs = 8 %) et de la tenue de dossiers (autoévaluation = 7 %; évaluation par les pairs = 4 %). Conclusions : l'autoévaluation et l'évaluation par les pairs sont efficaces pour accroître la volonté de changer et améliorer la performance clinique. La mise en œuvre nationale du programme est justifiée. De futures études devraient aborder les répercussions de ce programme sur les résultats cliniques des clients.

Development and Evaluation of an Implementation Strategy for Collecting Data in a National Registry and the Use of Patient-Reported Outcome Measures in Physical Therapist Practices: Quality Improvement Study.

BACKGROUND: In 2013, the Royal Dutch Society for Physical Therapy launched the program "Quality in Motion." This program aims to collect data from electronic health record systems in a registry that is fed back to physical therapists, facilitating quality improvement. PURPOSE: The purpose of this study was to describe the development of an implementation strategy for the program and to evaluate the feasibility of building a registry and implementing patient-reported outcome measures (PROMs) in physical therapist practices. METHODS: A stepwise approach using mixed methods was established in 3 consecutive pilots with 355 physical therapists from 66 practices. Interim results were evaluated using quantitative data from a self-assessment questionnaire and the registry and qualitative data from 21 semistructured interviews with physical therapists. Descriptive statistics and McNemar's symmetry chi-squared test were used to summarize the feasibility of implementing PROMs. RESULTS: PROMs were selected for the 5 most prevalent musculoskeletal conditions in Dutch physical therapist practices. A core component of the implementation strategy was the introduction of knowledge brokers to support physical therapists in establishing the routine use of PROMs in clinical practice and to assist in executing peer assessment workshops. In February 2013, 30.3% of the physical therapist practices delivered 4.4 completed treatment episodes per physical therapist to the registry; this increased to 92.4% in November 2014, delivering 54.1 completed patient episodes per physical therapist. Pre- and posttreatment PROM use increased from 12.2% to 39.5%. LIMITATIONS: It is unclear if the participating physical therapists reflect a representative sample of Dutch therapists. CONCLUSION: Building a registry and implementing PROMs in physical therapist practices are feasible. The routine use of PROMs needs to increase to ensure valid feedback of outcomes. Using knowledge brokers is promising for implementing the program via peer assessment workshops.

Feasibility of peer assessment and clinical audit to self-regulate the quality of physiotherapy services: a mixed methods study.

OBJECTIVES: To evaluate the feasibility of a quality improvement programme aimed to enhance the client-centeredness, effectiveness and transparency of physiotherapy services by addressing three feasibility domains: (1) acceptability of the programme design, (2) appropriateness of the implementation strategy and (3) impact on quality improvement. DESIGN: Mixed methods study. PARTICIPANTS AND SETTING: 64 physiotherapists working in primary care, organised in a network of communities of practice in the Netherlands. METHODS: The programme contained: (1) two cycles of online self-assessment and peer assessment (PA) of clinical performance using client records and video-recordings of client communication followed by face-to-face group discussions, and (2) clinical audit assessing organisational performance. Assessment was based on predefined performance indicators which could be scored on a 5-point Likert scale. Discussions addressed performance standards and scoring differences. All feasibility domains were evaluated qualitatively with two focus groups and 10 in-depth interviews. In addition, we evaluated the impact on quality improvement quantitatively by comparing self-assessment and PA scores in cycles 1 and 2. RESULTS: We identified critical success features relevant to programme development and implementation, such as clarifying expectations at baseline, training in PA skills, prolonged engagement with video-assessment and competent group coaches. Self-reported impact on quality improvement included awareness of clinical and organisational performance, improved evidence-based practice and client-centeredness and increased motivation to self-direct quality improvement. Differences between self-scores and peer scores on performance indicators were not significant. Between cycles 1 and 2, scores for record keeping showed significant improvement, however not for client communication. CONCLUSIONS: This study demonstrated that bottom-up initiatives to improve healthcare quality can be effective. The results justify ongoing evaluation to inform nationwide implementation when the critical success features are addressed. Further research is necessary to explore the sustainability of the results and the impact on client outcomes in a full-scale study.

Critical features of peer assessment of clinical performance to enhance adherence to a low back pain guideline for physical therapists: a mixed methods design.

BACKGROUND: Clinical practice guidelines are intended to improve the process and outcomes of patient care. However, their implementation remains a challenge. We designed an implementation strategy, based on peer assessment (PA) focusing on barriers to change in physical therapy care. A previously published randomized controlled trial showed that PA was more effective than the usual strategy "case discussion" in improving adherence to a low back pain guideline. Peer assessment aims to enhance knowledge, communication, and hands-on clinical skills consistent with guideline recommendations. Participants observed and evaluated clinical performance on the spot in a role-play simulating clinical practice. Participants performed three roles: physical therapist, assessor, and patient. This study explored the critical features of the PA program that contributed to improved guideline adherence in the perception of participants. METHODS: Dutch physical therapists working in primary care (n = 49) organized in communities of practice (n = 6) participated in the PA program. By unpacking the program we identified three main tasks and eleven subtasks. After the program was finished, a questionnaire was administered in which participants were asked to rank the program tasks from high to low learning value and to describe their impact on performance improvement. Overall ranking results were calculated. Additional semi-structured interviews were conducted to elaborate on the questionnaires results and were transcribed verbatim. Questionnaires comments and interview transcripts were analyzed using template analysis. RESULTS: Program tasks related to performance in the therapist role were perceived to have the highest impact on learning, although task perceptions varied from challenging to threatening. Perceptions were affected by the role-play format and the time schedule. Learning outcomes were awareness of performance, improved attitudes towards the guideline, and increased self-efficacy beliefs in managing patients with low back pain. Learning was facilitated by psychological safety and the quality of feedback. CONCLUSION: The effectiveness of PA can be attributed to the structured and performance-based design of the program. Participants showed a strong cognitive and emotional commitment to performing the physical therapist role. That might have contributed to an increased awareness of strength and weakness in clinical performance and a motivation to change routine practice.

An innovative peer assessment approach to enhance guideline adherence in physical therapy: single-masked, cluster-randomized controlled trial.

BACKGROUND: Clinical practice guidelines (CPGs) are not readily implemented in clinical practice. One of the impeding factors is that physical therapists do not hold realistic perceptions of their adherence to CPGs. Peer assessment (PA) is an implementation strategy that aims at improving guideline adherence by enhancing reflective practice, awareness of professional performance, and attainment of personal goals. OBJECTIVE: The purpose of this study was to compare the effectiveness of PA with the usual case discussion (CD) strategy on adherence to CPGs for physical therapist management of upper extremity complaints. DESIGN: A single-masked, cluster-randomized controlled trial with pretest-posttest design was conducted. INTERVENTION: Twenty communities of practice (n=149 physical therapists) were randomly assigned to groups receiving PA or CD, with both interventions consisting of 4 sessions over 6 months. Both PA and CD groups worked on identical clinical cases relevant to the guidelines. Peer assessment focused on individual performance observed and evaluated by peers; CD focused on discussion. OUTCOMES: Guideline adherence was measured with clinical vignettes, reflective practice was measured with the Self-Reflection and Insight Scale (SRIS), awareness of performance was measured via the correlation between perceived and assessed improvement, and attainment of personal goals was measured with written commitments to change. RESULTS: The PA groups improved more on guideline adherence compared with the CD groups (effect=22.52; 95% confidence interval [95% CI]=2.38, 42.66; P=.03). The SRIS scores did not differ between PA and CD groups. Awareness of performance was greater for the PA groups (r=.36) than for the CD groups (r=.08) (effect=14.73; 95% CI=2.78, 26.68; P=.01). The PA strategy was more effective than the CD strategy in attaining personal goals (effect=0.50; 95% CI=0.04, 0.96; P=.03). LIMITATIONS: Limited validity of clinical vignettes as a proxy measure of clinical practice was a limitation of the study. CONCLUSIONS: Peer assessment was more effective than CD in improving adherence to CPGs. Personal feedback may have contributed to its effectiveness. Future research should address the role of the group coach.

Why peer assessment helps to improve clinical performance in undergraduate physical therapy education: a mixed methods design.

BACKGROUND: Peer Assessment (PA) in health professions education encourages students to develop a critical attitude towards their own and their peers' performance. We designed a PA task to assess students' clinical skills (including reasoning, communication, physical examination and treatment skills) in a role-play that simulated physical therapy (PT) practice. Students alternately performed in the role of PT, assessor, and patient. Oral face-to-face feedback was provided as well as written feedback and scores.This study aims to explore the impact of PA on the improvement of clinical performance of undergraduate PT students. METHODS: The PA task was analyzed and decomposed into task elements. A qualitative approach was used to explore students' perceptions of the task and the task elements. Semi-structured interviews with second year students were conducted to explore the perceived impact of these task elements on performance improvement. Students were asked to select the elements perceived valuable, to rank them from highest to lowest learning value, and to motivate their choices. Interviews were transcribed verbatim and analyzed, using a phenomenographical approach and following template analysis guidelines. A quantitative approach was used to describe the ranking results. RESULTS: Quantitative analyses showed that the perceived impact on learning varied widely. Performing the clinical task in the PT role, was assigned to the first place (1), followed by receiving expert feedback (2), and observing peer performance (3). Receiving peer feedback was not perceived the most powerful task element.Qualitative analyses resulted in three emerging themes: pre-performance, true-performance, and post-performance triggers for improvement. Each theme contained three categories: learning activities, outcomes, and conditions for learning.Intended learning activities were reported, such as transferring prior learning to a new application context and unintended learning activities, such as modelling a peer's performance. Outcomes related to increased self-confidence, insight in performance standards and awareness of improvement areas. Conditions for learning referred to the quality of peer feedback. CONCLUSIONS: PA may be a powerful tool to improve clinical performance, although peer feedback is not perceived the most powerful element. Peer assessors in undergraduate PT education use idiosyncratic strategies to assess their peers' performance.

Effectiveness of peer assessment for implementing a Dutch physical therapy low back pain guideline: cluster randomized controlled trial.

BACKGROUND: Clinical practice guidelines are considered important instruments to improve quality of care. However, success is dependent on adherence, which may be improved using peer assessment, a strategy in which professionals assess performance of their peers in a simulated setting. OBJECTIVE: The aim of this study was to determine whether peer assessment is more effective than case-based discussions to improve knowledge and guideline-consistent clinical reasoning in the Dutch physical therapy guideline for low back pain (LBP). DESIGN: A cluster randomized controlled trial was conducted. SETTING AND PARTICIPANTS: Ten communities of practice (CoPs) of physical therapists were cluster randomized (N=90): 6 CoPs in the peer-assessment group (n=49) and 4 CoPs in the case-based discussion group (control group) (n=41). INTERVENTION: Both groups participated in 4 educational sessions and used clinical patient cases. The peer-assessment group reflected on performed LBP management in different roles. The control group used structured discussions. MEASUREMENTS: Outcomes were assessed at baseline and at 6 months. The primary outcome measure was knowledge and guideline-consistent reasoning, measured with 12 performance indicators using 4 vignettes with specific guideline-related patient profiles. For each participant, the total score was calculated by adding up the percentage scores (0-100) per vignette, divided by 4. The secondary outcome measure was reflective practice, as measured by the Self-Reflection and Insight Scale (20-100). RESULTS: Vignettes were completed by 78 participants (87%). Multilevel analysis showed an increase in guideline-consistent clinical reasoning of 8.4% in the peer-assessment group, whereas the control group showed a decline of 0.1% (estimated group difference=8.7%, 95% confidence interval=3.9 to 13.4). No group differences were found on self-reflection. LIMITATIONS: The small sample size, a short-term follow-up, and the use of vignettes as a proxy for behavior were limitations of the study. CONCLUSIONS: Peer assessment leads to an increase in knowledge and guideline-consistent clinical reasoning.