Measuring communication as a core outcome in aphasia trials: Results of the ROMA-2 international core outcome set development meeting.

BACKGROUND: Evidence-based recommendations for a core outcome set (COS; minimum set of outcomes) for aphasia treatment research have been developed (the Research Outcome Measurement in Aphasia-ROMA, COS). Five recommended core outcome constructs: communication, language, quality of life, emotional well-being and patient-reported satisfaction/impact of treatment, were identified through three international consensus studies. Constructs were paired with outcome measurement instruments (OMIs) during an international consensus meeting (ROMA-1). Before the current study (ROMA-2), agreement had not been reached on OMIs for the constructs of communication or patient-reported satisfaction/impact of treatment. AIM: To establish consensus on a communication OMI for inclusion in the ROMA COS. METHODS & PROCEDURES: Research methods were based on recommendations from the Core Outcome Measures in Effectiveness Trials (COMET) Initiative. Participants with expertise in design and conduct of aphasia trials, measurement instrument development/testing and/or communication outcome measurement were recruited through an open call. Before the consensus meeting, participants agreed on a definition of communication, identified appropriate OMIs, extracted their measurement properties and established criteria for their quality assessment. During the consensus meeting they short-listed OMIs and participants without conflicts of interest voted on the two most highly ranked instruments. Consensus was defined a priori as agreement by ≥ 70% of participants. OUTCOMES & RESULTS: In total, 40 researchers from nine countries participated in ROMA-2 (including four facilitators and three-panel members who participated in pre-meeting activities only). A total of 20 OMIs were identified and evaluated. Eight short-listed communication measures were further evaluated for their measurement properties and ranked. Participants in the consensus meeting (n = 33) who did not have conflicts of interest (n = 29) voted on the top two ranked OMIs: The Scenario Test (TST) and the Communication Activities of Daily Living-3 (CADL-3). TST received 72% (n = 21) of 'yes' votes and the CADL-3 received 28% (n = 8) of 'yes' votes. CONCLUSIONS & IMPLICATIONS: Consensus was achieved that TST was the preferred communication OMI for inclusion in the ROMA COS. It is currently available in the original Dutch version and has been adapted into English, German and Greek. Further consideration must be given to the best way to measure communication in people with mild aphasia. Development of a patient-reported measure for satisfaction with/impact of treatment and multilingual versions of all OMIs of the COS is still required. Implementation of the ROMA COS would improve research outcome measurement and the quality, relevance, transparency, replicability and efficiency of aphasia treatment research. WHAT THIS PAPER ADDS: What is already known on this subject International consensus has been reached on five core constructs to be routinely measured in aphasia treatment studies. International consensus has also been established for OMIs for the three constructs of language, quality of life and emotional well-being. Before this study, OMIs for the constructs of communication and patient-reported satisfaction/impact of treatment were not established. What this paper adds to existing knowledge We gained international consensus on an OMI for the construct of communication. TST is recommended for inclusion in the ROMA COS for routine use in aphasia treatment research. What are the potential or actual clinical implications of this work? The ROMA COS recommends OMIs for a minimum set of outcomes for adults with post-stroke aphasia within phases I-IV aphasia treatment research. Although not intended for clinical use, clinicians may employ the instruments of the ROMA COS, considering the quality of their measurement properties. The systematic inclusion of a measure of communication, such as TST, in clinical practice could ultimately support the implementation of research evidence and best practices.

New ways to analyze word generation performance in brain injury: A systematic review and meta-analysis of additional performance measures.

INTRODUCTION: The investigation of word generation performance is an accepted, widely used, and well-established method for examining cognitive, language, or communication impairment due to brain damage. The performance measure traditionally applied in the investigation of word generation is the number of correct responses. Previous studies, however, have suggested that this measure does not capture all potentially relevant aspects of word generation performance and hence its underlying processes, so that its analytical and explanatory power of word generation performance might be rather limited. Therefore, additional qualitative or quantitative performance measures have been introduced to gain information that goes beyond the deficit and allows for therapeutic implications. METHOD: We undertook a systematic review and meta-analysis of original research that focused on the application of additional measures of word generation performance in adult clinical populations with acquired brain injury. RESULTS: Word generation tasks are an integral part of many different tests, but only few use additional performance measures in addition to the number of correct responses in the analysis of word generation performance. Additional measures, which showed increased or similar diagnostic utility relative to the traditional performance measure, regarded clustering and switching, error types, and temporal characteristics. CONCLUSIONS: The potential of additional performance measures is not yet fully exhausted in patients with brain injury. The temporal measure of response latencies in particular is not adequately represented, though it may be a reliable measure especially for identifying subtle impairments. Unfortunately, there is no general consensus as of yet on which additional measures are best suited to characterizing word generation performance. Further research is needed to specify the additional parameters that are best qualified for identifying and characterizing impaired word generation performance.