Performance of Medication Tasks: Relationship Among Patient-Reported Outcomes, Performance-Based Assessments, and Objective Assessments.

IMPORTANCE: Occupational therapy practitioners use standardized assessments to guide their clinical decision-making, but it is unclear how well performance on standardized assessments translates to performance at home. OBJECTIVE: To understand the concurrent and predictive validity of patient-reported outcomes and performance-based assessments for monitoring performance at home within the context of medication management and adherence. DESIGN: Exploratory study. SETTING: Participants completed standardized assessments in a lab or at home, which were followed by home-based electronic monitoring of medication adherence. PARTICIPANTS: Sixty community-dwelling adults with hypertension or stroke who independently took antihypertensive medications. OUTCOMES AND MEASURES: Participants completed the Hill-Bone Medication Adherence Scale, the Hill-Bone Medication Adherence Reasons Scale, the Performance Assessment of Self-Care Skills Medication Management subtask, and the Executive Function Performance Test-Enhanced Medication Management subtest. Then, they used an electronic pill cap to monitor medication adherence at home for 1 month. RESULTS: Patient-reported outcomes and performance-based assessments in the context of medication management and adherence demonstrated poor concurrent and predictive validity to medication adherence at home. CONCLUSIONS AND RELEVANCE: There is a gap between what people think they will do, what they can do on a standardized assessment, and what they actually do at home. Future research is needed to strengthen concurrent and predictive validity to clinically meaningful outcomes. Plain-Language Summary: Occupational therapy practitioners should use caution when using standardized assessments to try to predict client performance at home. They should also continue to use a battery of assessments, clinical reasoning, and client preferences to guide their decision-making for monitoring performance at home within the context of medication management and adherence.

Development and Initial Testing of the Electronic Activity Card Sort (ACS3) Among Community-Dwelling Adults.

IMPORTANCE: The Activity Card Sort is a valid, widely used measure of participation. There is a need for remotely delivered measures of participation to support the growing use of telehealth. OBJECTIVE: To develop and test the concurrent validity and acceptability of the electronic Activity Card Sort (ACS3). DESIGN: Cross-sectional. SETTING: Research laboratory. PARTICIPANTS: Community-dwelling adults. OUTCOMES AND MEASURES: The Activity Card Sort (ACS) and the ACS3 were administered in randomized order. Relationships between performance on the overlapping items of the ACS and ACS3 were evaluated using Spearman's ρ correlations. Additionally, acceptability of the ACS3 was evaluated using a survey with a 5-point Likert scale. RESULTS: High correlations were found between each of the four domains (rs ≥ .836) and total current activities score (rs = .863) between the ACS and ACS3. Ratings on the survey indicate high levels of acceptability and usability for the ACS3. CONCLUSIONS AND RELEVANCE: Findings suggest that performance on the ACS3 is consistent with performance on the ACS. This finding coupled with a high level of acceptability indicates that the ACS3 may be a clinically useful tool for evaluating daily life participation. What This Article Adds: The ACS3 provides an electronic, paperless option for measuring multiple domains of participation in adults.

Interventions to Improve Work and Leisure for Adults Poststroke (January 1, 2009-December 31, 2019).

Systematic Review Briefs provide a summary of the findings from systematic reviews developed in conjunction with the American Occupational Therapy Association's Evidence-Based Practice Program. Each Systematic Review Brief summarizes the evidence on a theme related to a systematic review topic. This Systematic Review Brief presents findings from the systematic review on interventions to improve work and leisure for adults poststroke.

Occupation-Based Interventions for Social Participation Outcomes for Adults Poststroke (January 1, 2009-December 31, 2019).

Systematic Review Briefs provide a summary of the findings from systematic reviews developed in conjunction with the American Occupational Therapy Association's Evidence-Based Practice Program. Each Systematic Review Brief summarizes the evidence on a theme related to a systematic review topic. This Systematic Review Brief presents findings from the systematic review on occupation-based interventions for social participation outcomes for adults poststroke.

Impairment-Based Interventions to Improve Social Participation Outcomes for Adults Poststroke (January 1, 2009-December 31, 2019).

Systematic Review Briefs provide a summary of the findings from systematic reviews developed in conjunction with the American Occupational Therapy Association's Evidence-Based Practice Program. Each Systematic Review Brief summarizes the evidence on a theme related to a systematic review topic. This Systematic Review Brief presents findings from the systematic review on stroke and impairment-based interventions to improve social participation for adults poststroke.

Interventions to Improve Social Participation, Work, and Leisure Among Adults Poststroke: A Systematic Review.

IMPORTANCE: Sustaining a stroke frequently leads to difficulties in returning to work, leisure, and social participation. These outcomes are important for occupational therapy practitioners to address. OBJECTIVE: To determine the current evidence for the effectiveness of interventions within the scope of occupational therapy practice to improve social participation, work, and leisure among adults poststroke. DATA SOURCES: MEDLINE, PsycINFO, CINAHL, OTseeker, and Cochrane databases. STUDY SELECTION AND DATA COLLECTION: Primary inclusion criteria were peer-reviewed journal articles published between January 1, 2009, and December 31, 2019, within the scope of occupational therapy that evaluated an intervention to address work, leisure, or social participation poststroke (levels of evidence ranged from Level 1b to Level 2b). Reviewers assessed records for inclusion, quality, and validity following Cochrane Collaboration and Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines. FINDINGS: Forty-seven articles met the inclusion criteria. Forty-four articles related to social participation were categorized as follows: occupation-based approaches, metacognitive strategy training, education and training approaches, impairment-based approaches, and enriched environment approaches. Three articles related to work and 3 articles related to leisure were not further categorized (2 articles were each included in two categories). Seventeen Level 1b and 30 Level 2b articles were included. The strength of evidence to support occupational therapy interventions for social participation, work, and leisure outcomes is predominantly low. CONCLUSIONS AND RELEVANCE: Occupational therapy interventions may improve work, leisure, and social participation outcomes poststroke, with the strongest evidence existing for client education, upper extremity training, and cognitive training for improving social participation. What This Article Adds: Occupational therapy practitioners may use the available literature along with clinical reasoning to improve work, leisure, and social participation outcomes among clients poststroke. Additional research is required to build stronger evidence to support clinical decision making in stroke rehabilitation in these areas.

Initial Development and Evaluation of the Executive Function Performance Test-Enhanced (EFPT-E) in Women With Cancer-Related Cognitive Impairment.

IMPORTANCE: Psychometrically sound instruments are needed to evaluate executive functioning in the population of people with cancer. OBJECTIVE: To develop and evaluate the reliability and validity of the Executive Function Performance Test-Enhanced (EFPT-E) in women after being treated for breast cancer. DESIGN: Cross-sectional. SETTING: University research laboratory. PARTICIPANTS: Women treated for breast cancer who had cognitive impairment (n = 12) and community control participants (n = 13). OUTCOMES AND MEASURES: Evaluators (n = 8) independently scored a recorded administration of the EFPT-E to evaluate interrater reliability. An assessment battery, including the EFPT-E, was administered to evaluate the EFPT-E's known-groups validity and concurrent validity. RESULTS: Excellent interrater reliability was observed for the EFPT-E total score and each subtask score (intraclass correlation coefficient = .90-.98). Moderate effect sizes were noted for the EFPT-E total score (Cohen's d = 0.5) and the total number of cues (d = 0.4) between the breast cancer group and the control group, with the breast cancer group demonstrating poorer performance. A limited correlation was found between the EFPT-E and the other cognitive measures. CONCLUSIONS AND RELEVANCE: The results support the EFPT-E's interrater reliability and warrant continued investigation to further establish its reliability and validity. WHAT THIS ARTICLE ADDS: Assessments are needed to quantify the impact of cognitive processes within functional tasks. The EFPT-E has been developed to assess the functional impact of mild cognitive impairment; initial testing with women with cancer showed excellent agreement between raters and promising results for validity.

The construct validity of a new screening measure of functional cognitive ability: The menu task.

This study evaluated the construct validity of the Menu Task (MT): a new performance-based screening measure of functional cognition. We enrolled 114 community dwelling adults (55 years or older) in the study: all participants completed the MT and four other neuropsychological screening measures. Construct validity was evaluated using a three-step hierarchical regression model with the MT as the dependent variable. Demographic control variables were entered at step 1, followed by the Brief Interview of Mental Status (BIMS), and the Trail Making Test A (TMT A) at step 2, and finally TMT B and the Montreal Cognitive Assessment (MoCA) at step 3. It was hypothesised that measures sensitive to executive functioning (TMT B and MoCA) would significantly explain MT performance after controlling for demographic variables and adding measures of cognitive function to the model, providing additional evidence for construct validity of the MT. All three steps of the model were statistically significant (p < 0.01). Inclusion of measures sensitive to executive function in step 3 explained 30% of variability in MT score (adjusted R2 = 0.30). Our findings provide further empirical support for the construct validity of the MT, and offer implications for the use of the MT in acute and post-acute care settings.

Complex Task Performance Assessment (CTPA) and Functional Cognition in People With Parkinson's Disease.

OBJECTIVE: The objective of this study was to determine how Parkinson's disease (PD) affects functional cognition as assessed by the Complex Task Performance Assessment (CTPA) and to examine the associations of CTPA performance with other indicators of executive function in people with PD. METHOD: Volunteers with PD without dementia (n = 20) and community control participants (n = 19) completed neuropsychological testing, patient-reported outcome measures, and the CTPA. RESULTS: There were no group differences for CTPA performance accuracy; however, the PD group took longer to complete the CTPA than did the control group. In the PD group, inefficient CTPA performance correlated with poorer cognitive flexibility and worse reported everyday shifting and task monitoring. CONCLUSION: Decreased executive function, namely cognitive flexibility and attentional control, may impair functional cognition in people with PD. Future studies with larger, more diverse samples are warranted to determine the discriminant validity and sensitivity of the CTPA. Use of performance-based assessments such as the CTPA may increase the understanding of functional cognition in people with PD.

Combining Virtual Reality Motor Rehabilitation With Cognitive Strategy Use in Chronic Stroke.

IMPORTANCE: Rehabilitation interventions for chronic stroke are largely impairment based, with results confined to the level of impairment instead of function. In contrast, cognitive strategy training interventions have demonstrated clinically meaningful improvements in functional outcomes. Integration of these approaches has yet to be explored. OBJECTIVE: To evaluate acceptability, recruitment, and retention rate and determine which outcome measures best capture the effect of the intervention. DESIGN: Single-group, pre-post design. SETTING: Research laboratory. PARTICIPANTS: Adults with chronic stroke and hemiparesis (N = 10). INTERVENTION: A 12-wk intervention integrating cognitive strategy training with upper extremity motor training. Two weekly sessions used Kinect-based virtual reality to encourage high numbers of upper extremity movement repetitions. The third weekly session focused on the use of cognitive strategies with practice of client-centered goals. OUTCOMES AND MEASURES: Upper extremity motor performance was measured with the Fugl-Meyer Assessment. Occupational performance on trained and untrained goals was measured via the Performance Quality Rating Scale and the Canadian Occupational Performance Measure. Outcome data were gathered preintervention, postintervention, and at 3-mo follow-up. RESULTS: The intervention was perceived as acceptable. Recruitment rate was 15%, and retention rate was 100%. Large effects were found on outcomes of upper extremity motor performance, occupational performance, and participation at follow-up. CONCLUSION AND RELEVANCE: MetacogVR is feasible for adults with chronic stroke. The effect of MetacogVR is best captured through measures of upper extremity motor performance, occupational performance, and participation. WHAT THIS ARTICLES ADDS: Traditional, impairment-based approaches to chronic stroke rehabilitation may require integration with cognitive-strategy training to affect performance on meaningful goals.

Reliability and Validity of a Functional Cognition Screening Tool to Identify the Need for Occupational Therapy.

IMPORTANCE: The Centers for Medicare & Medicaid Services (CMS) has identified the need to assess functional cognition as part of the postacute care planning process. OBJECTIVE: We examined the reliability, validity, and clinical utility of the Menu Task (MT) as a screening measure of functional cognition to assess the need for occupational therapy services. DESIGN: Cross-sectional study testing a convenience sample of community-dwelling older adults (n = 130) and adults hospitalized for elective orthopedic surgery (n = 60). The MT and four neuropsychological screening tests-the Brief Interview of Mental Status, the Montreal Cognitive Assessment, Trail Making Tests A and B, and an instrumental activities of daily living (IADL) scale-were administered. SETTING: Community-dwelling participants were tested at the University of Wisconsin occupational therapy program and in community settings. Hospitalized participants were tested at the University of Missouri Orthopedic Institute. PARTICIPANTS: We recruited healthy community-dwelling adults in Madison, WI (community sample; n = 130) and patients hospitalized for elective orthopedic surgery in Columbia, MO (hospital sample; n = 60). Inclusion criteria were age 55 yr or older, living in the community, and willingness to be tested in English; for the hospital sample, participants had to be referred for elective orthopedic surgery requiring a hospital stay and be independent in activities of daily living before being admitted for surgery. RESULTS: We found significant differences between groups classified as impaired or not impaired on the basis of MT scores. Participants classified as impaired on the MT performed significantly less well than those classified as not impaired on the neurocognitive and IADL measures. CONCLUSION: The reliability and validity of the MT were supported. WHAT THIS ARTICLE ADDS: The American Occupational Therapy Association and the occupational therapy experts advising CMS have stressed the importance of a brief performance-based screening tool to identify people who need more comprehensive occupational therapy evaluation. The implementation of a functional cognition screening tool as part of the required CMS assessment protocol should greatly increase the number of patients referred for occupational therapy evaluation and treatment. The MT has the capacity to address the gap in the proposed CMS assessment of Medicare recipients across postacute care settings.

The reliability and validity of the Complex Task Performance Assessment: A performance-based assessment of executive function.

The objective of this study was to evaluate the inter-rater reliability, test-retest reliability, concurrent validity, and discriminant validity of the Complex Task Performance Assessment (CTPA): an ecologically valid performance-based assessment of executive function. Community control participants (n = 20) and individuals with mild stroke (n = 14) participated in this study. All participants completed the CTPA and a battery of cognitive assessments at initial testing. The control participants completed the CTPA at two different times one week apart. The intra-class correlation coefficient (ICC) for inter-rater reliability for the total score on the CTPA was .991. The ICCs for all of the sub-scores of the CTPA were also high (.889-.977). The CTPA total score was significantly correlated to Condition 4 of the DKEFS Color-Word Interference Test (p = -.425), and the Wechsler Test of Adult Reading (p = -.493). Finally, there were significant differences between control subjects and individuals with mild stroke on the total score of the CTPA (p = .007) and all sub-scores except interpretation failures and total items incorrect. These results are also consistent with other current executive function performance-based assessments and indicate that the CTPA is a reliable and valid performance-based measure of executive function.

Screening for Functional Cognition in Postacute Care and the Improving Medicare Post-Acute Care Transformation (IMPACT) Act of 2014.

Occupational therapists have a long history of assessing functional cognition, defined as the ability to use and integrate thinking and performance skills to accomplish complex everyday activities. In response to passage of the Improving Medicare Post-Acute Care Transformation (IMPACT) Act of 2014 (Pub. L. 113-185), the American Occupational Therapy Association has been advocating that the Centers for Medicare and Medicaid Services consider functional cognition for inclusion in routine patient assessment in postacute care settings, with important implications for occupational therapy. These efforts have the potential to increase referrals to occupational therapy, emphasize the importance of addressing functional cognition in occupational therapy practice, and support the value of occupational therapy in achieving optimal postacute care outcomes.

Development and Alternate Form Reliability of the Complex Task Performance Assessment (CTPA) for People With Mild Stroke.

Cognitive impairment is a common consequence of mild stroke. Current performance-based assessments for mild stroke can detect mild impairments in executive function but lack alternate forms to be used as outcome measures. This study aimed to develop an alternate form of the Complex Task Performance Assessment (CTPA-Alt), a performance-based assessment of executive function, and to establish the alternate form reliability of the CTPA-Alt. A repeated-measures study was conducted with 26 community participants. Participants were screened for eligibility and administered both forms of the CTPA; administration order was alternated. Overall performance was significantly correlated (rs = .44, p = .03), but pattern of scoring differed by CTPA form and order of administration. Our results indicate that the CTPA forms were similar but that the specific tasks in each form were different. The CTPA may be used as an ecologically valid outcome assessment with further considerations.

The Feasibility of Using Metacognitive Strategy Training to Improve Cognitive Performance and Neural Connectivity in Women with Chemotherapy-Induced Cognitive Impairment.

OBJECTIVE: To evaluate the feasibility and preliminary effect of metacognitive strategy training (MCST) on cognitive performance and on neural connectivity in the frontoparietal network in women with chemotherapy-induced cognitive impairment (CICI) following treatment for breast cancer. METHODS: A single-group pre/post study was conducted. After completing the baseline assessment battery and neuroimaging, the participants completed a 12-session MCST intervention. Following the completion of the intervention, the subjects completed the same assessment battery and neuroimaging as was completed at baseline within 4 weeks after the intervention. The key inclusion/exclusion criteria for this study were: completed chemotherapy for treatment of breast cancer, no other neurological or psychiatric diagnoses, self-reported CICI, and no contraindications to the use of MRI. RESULTS: MCST had a small-to-large positive effect on all primary (cognitive) and secondary (quality of life and psychosocial) behavioral outcome measures (r = -0.12 to -0.88). There was also a positive change in functional connectivity in a frontoparietal cognitive control network connection in 6 of the 10 subjects, which was correlated to changes in the behavioral measures. CONCLUSIONS: This study found that MCST was associated with a positive effect on cognitive performance and neural connectivity in women with CICI following treatment for breast cancer.

Combined Cognitive-Strategy and Task-Specific Training Affects Cognition and Upper-Extremity Function in Subacute Stroke: An Exploratory Randomized Controlled Trial.

The purpose of this study was to estimate the effect of Cognitive Orientation to Daily Occupational Performance (CO-OP) compared with usual occupational therapy on upper-extremity movement, cognitive flexibility, and stroke impact in people less than 3 mo after stroke. An exploratory, single-blind randomized controlled trial was conducted with people referred to outpatient occupational therapy services at two rehabilitation centers. Arm movement was measured with the Action Research Arm Test, cognitive flexibility with the Delis-Kaplan Executive Function System Trail Making subtest, and stroke impact with subscales of the Stroke Impact Scale. A total of 35 participants were randomized, and 26 completed the intervention. CO-OP demonstrated measurable effects over usual care on all measures. These data provide early support for the use of CO-OP to improve performance and remediate cognitive and arm movement impairments after stroke over usual care; however, future study is warranted to confirm the effects observed in this trial.

Effectiveness of occupation-based interventions to improve areas of occupation and social participation after stroke: an evidence-based review.

This evidence-based review examined the evidence supporting the use of occupation-based interventions to improve areas of occupation and social participation poststroke. A total of 39 studies met the inclusion criteria and were critically evaluated. Most of the literature targeted activity of daily living (ADL)-based interventions and collectively provided strong evidence for the use of occupation-based interventions to improve ADL performance. The evidence related to instrumental ADLs was much more disparate, with limited evidence to support the use of virtual reality interventions and emerging evidence to support driver education programs to improve occupational performance poststroke. Only 6 studies addressed leisure, social participation, or rest and sleep, with sufficient evidence to support only leisure-based interventions. The implications of this review for research, education, and practice in occupational therapy are also discussed.

Participation changes in sexual functioning after mild stroke.

The purpose of this study was to explore the extent to which people with mild stroke experience changes in participation in sexual activity post stroke. A cross-sectional study was completed with adults 6 to 18 months post mild stroke (N = 13); a brief case study was also done with one of the participants. Participants completed an assessment battery over the telephone that included the modified Quality of Sexual Function scale, the Stroke Impact Scale (SIS), and the Patient Health Questionnaire-9. The sample reported mild problems with sexual dysfunction (mean = 10.77, SD = 4.09). Sexual dysfunction post stroke was highly correlated (r(2) = -0.372 to -0.875) with all of the domains on the SIS. Several participants in this study reported that they would have liked more information about sexual functioning post stroke. These findings suggest that individuals with mild stroke are experiencing decreased participation in sexual activities post stroke and would like more information from the health care community on the potential for sexual changes.

Development of additional tasks for the executive function performance test.

OBJECTIVE. The Executive Function Performance Test (EFPT) is a reliable and valid performance-based assessment of executive function for people with stroke. The objective of this study was to enhance the clinical utility of the EFPT by developing and testing additional tasks for the EFPT in the Alternate EFPT (aEFPT). METHOD. We performed a cross-sectional study with poststroke participants (n = 25) and healthy control participants (n = 25). All participants completed a neuropsychological assessment battery and both the EFPT and the aEFPT. RESULTS. No statistically significant differences were found between the EFPT and the aEFPT when examining total scores, construct scores, and two overall task scores. Correlations between the aEFPT and the neuropsychological measures were adequate to strong (r2s = .59-.83). CONCLUSION. The aEFPT tasks are comparable to the original EFPT tasks, providing occupational therapy practitioners with additional tasks that can be used clinically to identify performance-based executive function deficits in people with stroke.

The Spinal Cord Injury Self-Management Program: A Pilot.

People with chronic spinal cord injury (SCI) experience a higher rate of secondary health conditions (SHCs) which affect their health and well-being. Self-management (SM) is a proven intervention approach, but formal programs may need to be tailored for the SCI population to reflect their needs and values. We sought to examine the feasibility and acceptability of the Spinal Cord Injury Self-Management (SCISM) Program and estimate its effect. A total of 32 individuals with SCI participated in the program. The primary outcomes were feasibility, acceptability, SHCs, and goal attainment. Participants were assessed at baseline, postintervention, and 3-month follow-up. Findings indicated that the SCISM Program was feasible and acceptable for use with moderate positive effects on SHCs and large positive effects in goal attainment. People with chronic SCI want to continue improving SM skills. The SCISM Program is feasible, acceptable, and should be examined further to reduce SHCs following SCI.

The Spinal Cord Injury Self-Management (SCISM) Program: A Pilot StudyPeople with spinal cord injuries (SCIs) have more health and medical problems than the general population due to their injury. This can result in poor health and premature death. Learning how to manage your health with SCI, called self-management, is a proven way to reduce this risk. However, most commonly available self-management programs do not address the unique needs of people with SCI. Therefore, programs tailored for people with SCI are needed. We sought to test a new program, the Spinal Cord Injury Self-Management (SCISM) Program, to see if people with SCI liked it and to see if it had any positive effects on their health. A total of 32 people with SCI participated and completed assessments related to mental health, physical health, reaching their goals, and their thoughts on the SCISM Program. Overall, participants liked the program, and there were some positive estimated effects on health and goal attainment. Overall, we should explore the use of the SCISM Program more because people with SCI want to be able to better manage their health.