Use of the iPRISM webtool in a learning community to assess implementation context and fit of a novel clinical decision support tool for physical therapy triage in acute care hospitals.

BACKGROUND: The iPRISM webtool is an interactive tool designed to aid the process of applying the Practical, Robust Implementation and Sustainability Model (PRISM) for the assessment of and fit with context. A learning community (LC) is a multidisciplinary group of partners addressing a complex problem. Our LC coproduced the Physical TheraPy frEqueNcy Clinical decIsion support tooL (PT-PENCIL) to guide the use of physical therapist services in acute care hospitals. OBJECTIVE: To describe our LC's activities to co-produce the PT-PENCIL, use of the iPRISM webtool to assess its preimplementation context and fit, and develop a multicomponent implementation strategy for the PT-PENCIL. DESIGN: A descriptive research design. SETTING: Three tertiary care hospitals. PARTICIPANTS: Thirteen LC partners: six clinical physical therapists, three rehabilitation managers, three researchers, and a bioinformaticist. INTERVENTIONS: Not applicable. OUTCOME MEASURES: Using the iPRISM webtool, expected fit of the PT-PENCIL was rated 1 (not aligned) to 6 (well aligned) for each PRISM domain and expected reach, effectiveness, adoption, implementation, and maintenance were rated 1 (not likely at all) to 6 (very likely). Discrete implementation strategies were identified from the Expert Recommendations for Implementing Change. RESULTS: The process spanned 18 meetings over 8 months. Ten LC partners completed the iPRISM webtool. PRISM domains with the lowest expected alignment were the "implementation and sustainability infrastructure" (mean = 4.7 out of 6; range = 3-6) and the "external environment" (mean = 4.9 of 6; range = 4-6). Adoption was the outcome with the lowest expected likelihood (mean = 4.5 out of 6; range = 1-6). Six discrete implementation strategies were identified and combined into a multicomponent strategy. CONCLUSIONS: Within a LC, we used existing implementation science resources to co-produce a novel clinical decision support tool for acute care physical therapists and develop a strategy for its implementation. Our methodology can be replicated for similar projects given the public availability of each resource used.

Key Data Elements for Longitudinal Tracking of Physical Function: A Modified Delphi Consensus Study.

OBJECTIVE: Physical function is associated with important outcomes, yet there is often a lack of continuity in routine assessment. The purpose of this study was to determine data elements and instruments for longitudinal measurement of physical function in routine care among patients transitioning from acute care hospital setting to home with home health care. METHODS: A 4-round modified Delphi process was conducted with 13 participants with expertise in physical therapy, health care administration, health services research, physiatry/medicine, and health informatics. Three anonymous rounds identified important and feasible data elements. A fourth in-person round finalized the recommended list of individual data elements. Next, 2 focus groups independently provided additional perspectives from other stakeholders. RESULTS: Response rates were 100% for online rounds 1, 3, and 4 and 92% for round 2. In round 1, 9 domains were identified: physical function, participation, adverse events, behavioral/emotional health, social support, cognition, complexity of illness/disease burden, health care utilization, and demographics. Following the fourth round, 27 individual data elements were recommended. Of these, 20 (74%) are "administrative" and available from most hospital electronic medical records. Additional focus groups confirmed these selections and provided input on standardizing collection methods. A website has been developed to share these results and invite other health care systems to participate in future data sharing of these identified data elements. CONCLUSION: A modified Delphi consensus process was used to identify critical data elements to track changes in patient physical function in routine care as they transition from acute hospital to home with home health. IMPACT: Expert consensus on comprehensive and feasible measurement of physical function in routine care provides health care professionals and institutions with guidance in establishing discrete medical records data that can improve patient care, discharge decisions, and future research.

Use of the Activity Measure for Post-Acute Care "6 Clicks" Basic Mobility Inpatient Short Form and National Institutes of Health Stroke Scale to Predict Hospital Discharge Disposition After Stroke.

OBJECTIVE: Therapists in the hospital are charged with making timely discharge recommendations to improve access to rehabilitation after stroke. The objective of this study was to identify the predictive ability of the Activity Measure for Post-Acute Care "6 Clicks" Basic Mobility Inpatient Short Form (6 Clicks mobility) score and the National Institutes of Health Stroke Scale (NIHSS) score for actual hospital discharge disposition after stroke. METHODS: In this retrospective cohort study, data were collected from an academic hospital in the United States for 1543 patients with acute stroke and a 6 Clicks mobility score. Discharge to home, a skilled nursing facility (SNF), or an inpatient rehabilitation facility (IRF) was the primary outcome. Associations among these outcomes and 6 Clicks mobility and NIHSS scores, alone or together, were tested using multinomial logistic regression, and the predictive ability of these scores was calculated using concordance statistics. RESULTS: A higher 6 Clicks mobility score alone was associated with a decreased odds of actual discharge to an IRF or an SNF. The 6 Clicks mobility score alone was a strong predictor of discharge to home versus an IRF or an SNF. However, predicting discharge to an IRF versus an SNF was stronger when the 6 Clicks mobility score was considered in combination with the NIHSS score, age, sex, and race. CONCLUSION: The 6 Clicks mobility score alone can guide discharge decision making after stroke, particularly for discharge to home versus an SNF or an IRF. Determining discharge to an SNF versus an IRF could be improved by also considering the NIHSS score, age, sex, and race. Future studies should seek to identify which additional characteristics improve predictability for these separate discharge destinations. IMPACT: The use of outcome measures can improve therapist confidence in making discharge recommendations for people with stroke, can enhance hospital throughput, and can expedite access to rehabilitation, ultimately affecting functional outcomes.

Minimally Clinically Important Change in the Activity Measure for Post-Acute Care (AM-PAC), a Generic Patient-Reported Outcome Tool, in People With Low Back Pain.

BACKGROUND: The Activity Measure for Post-Acute Care (AM-PAC) is a generic metric of patient-reported functional status. The minimal clinically important difference (MCID) in the AM-PAC score has not been determined. OBJECTIVE: The study objective was to determine the MCID for AM-PAC in people with low back pain. DESIGN: This was a retrospective cohort study. METHODS: Anchor-based and distribution-based methods were used to estimate the MCID. The Modified Low Back Pain Disability Questionnaire was used as the anchor. Adults who had a primary ICD-9 code for low back pain in at least 1 outpatient physical therapist visit during an episode of care and who completed both the AM-PAC and the Modified Low Back Pain Disability Questionnaire in at least 2 visits during the care episode were included. The MCID was calculated for the AM-PAC basic mobility version as well its adapted version, which the Cleveland Clinic uses for patients 65 years old or older. RESULTS: A total of 1,271 participants were eligible for study. For the AM-PAC basic mobility version, anchor-based methods yielded MCID estimates of between 3.4 and 5.1, whereas distribution-based methods yielded estimates of 1.7 to 4.2. The minimal detectable change (MDC) for the AM-PAC basic mobility version was 3.3. For the adapted AM-PAC basic mobility version, the MCID was estimated to be between 2.9 and 4.0 via anchor-based methods and between 1.2 to 3.5 via distribution-based methods. The MDC for the adapted AM-PAC basic mobility version was 3.5. LIMITATIONS: The estimated MCID was designed for people with low back pain only. CONCLUSIONS: The MCID ranged from 3.3 to 5.1 for the AM-PAC basic mobility version and 3.5 to 4 for the adapted version, with the MDC as the lower limit. Changes in the AM-PAC for people with low back pain may be interpreted using the estimated MCID. Future studies are needed to determine the AM-PAC MCID for populations other than those with low back pain.

Interrater Reliability of AM-PAC "6-Clicks" Basic Mobility and Daily Activity Short Forms.

BACKGROUND: The interrater reliability of 2 new inpatient functional short-form measures, Activity Measure for Post-Acute Care (AM-PAC) "6-Clicks" basic mobility and daily activity scores, has yet to be established. OBJECTIVE: The purpose of this study was to examine the interrater reliability of AM-PAC "6-Clicks" measures. DESIGN: A prospective observational study was conducted. METHODS: Four pairs of physical therapists rated basic mobility and 4 pairs of occupational therapists rated daily activity of patients in 1 of 4 hospital services. One therapist in a pair was the primary therapist directing the assessment while the other therapist observed. Each therapist was unaware of the other's AM-PAC "6-Clicks" scores. Reliability was assessed with intraclass correlation coefficients (ICCs), Bland-Altman plots, and weighted kappa. RESULTS: The ICCs for the overall reliability of basic mobility and daily activity were .849 (95% confidence interval [CI]=.784, .895) and .783 (95% CI=.696, .847), respectively. The ICCs for the reliability of each pair of raters ranged from .581 (95% CI=.260, .789) to .960 (95% CI=.897, .983) for basic mobility and .316 (95% CI=-.061, .611) to .907 (95% CI=.801, .958) for daily activity. The weighted kappa values for item agreement ranged from .492 (95% CI=.382, .601) to .712 (95% CI=.607, .816) for basic mobility and .251 (95% CI=.057, .445) to .751 (95% CI=.653, .848) for daily activity. Mean differences between raters' scores were near zero. LIMITATIONS: Raters were from one health system. Each pair of raters assessed different patients in different services. CONCLUSIONS: The ICCs for AM-PAC "6-Clicks" total scores were very high. Levels of agreement varied across pairs of raters, from large to nearly perfect for physical therapists and from moderate to nearly perfect for occupational therapists. Levels of agreement for individual item scores ranged from small to very large.

AM-PAC "6-Clicks" functional assessment scores predict acute care hospital discharge destination.

BACKGROUND: Physical therapists and occupational therapists practicing in acute care hospitals play a crucial role in discharge planning. A standardized assessment of patients' function could be useful for discharge recommendations. OBJECTIVES: The study objective was to determine the accuracy of "6-Clicks" basic mobility and daily activity measures for predicting discharge from an acute care hospital to a home or institutional setting. DESIGN: The study was retrospective and observational. METHODS: "6-Clicks" scores obtained at initial visits by physical therapists or occupational therapists and patients' discharge destinations were used to develop and validate receiver operating characteristic curves for predicting discharge destination. Positive predictive values (PPV), negative predictive values (NPV), and likelihood ratios were calculated. RESULTS: Areas under the receiver operating characteristic curves for basic mobility scores were 0.857 (95% confidence interval [CI]=0.852, 0.862) and 0.855 (95% CI=0.850, 0.860) in development and validation samples, respectively. Areas under the curves for daily activity scores were 0.846 (95% CI=0.841, 0.851) and 0.845 (95% CI=0.840, 0.850) in development and validation samples, respectively. Cutoff scores providing the best accuracy for determining discharge destination were 42.9 for basic mobility and 39.4 for daily activity. For basic mobility, the PPV was 0.748 and the NPV was 0.801 in both development and validation samples. For daily activity, the PPVs were 0.787 and 0.784 and the NPVs were 0.748 and 0.746 in development and validation samples, respectively. LIMITATIONS: Limitations included lack of information on the rater reliability of "6-Clicks" instruments, use of surrogate data for some discharge designations, and use of a clinical database for research purposes. CONCLUSIONS: This study provides evidence of the accuracy of "6-Clicks" scores for predicting destination after discharge from an acute care hospital.

Validity of the AM-PAC "6-Clicks" inpatient daily activity and basic mobility short forms.

BACKGROUND: Standardized assessment of patients' activity limitations in acute care settings can provide valuable information. Existing measures have not been widely implemented. OBJECTIVES: The aim of this study was to provide evidence for validity of scores on Activity Measure for Post-Acute Care (AM-PAC) "6-Clicks" measures of basic mobility and daily activity in acute care. DESIGN: A retrospective measurement study was conducted. METHODS: The study used a database from one health system containing "6-Clicks" scores from first and last physical therapist and occupational therapist visits for 84,446 patients. Validity was analyzed by examining differences in "6-Clicks" scores across categories of patient characteristics; the ability of "6-Clicks" scores to predict patients' having more than one therapy visit; correlation of "6-Clicks" scores with Functional Independence Measure (FIM) scores; and internal responsiveness over the episode of care. Internal consistency reliability also was determined. RESULTS: The "6-Clicks" scores differed across patients' age, preadmission living situation, and number of therapy visits. The areas under receiver operating characteristic curves derived using "6-Clicks" scores at the first visit to predict patients receiving more than one visit were 0.703 and 0.652 using basic mobility and daily activity scores, respectively. The "6-Clicks" scores at the final visit were correlated with scores on subscales of the FIM completed on admission to inpatient rehabilitation facilities (r=.65 and .69). Standardized response means were 1.06 and 0.95 and minimal detectable changes with 90% confidence level (MDC90) were 4.72 and 5.49 for basic mobility and daily activity scores, respectively. Internal consistency reliability of basic mobility and daily activity scores was .96 and .91, respectively. LIMITATIONS: Using clinical databases for research purposes has limitations, including missing data, misclassifications, and selection bias. Rater reliability is not known. CONCLUSIONS: This study provides evidence for the validity of "6-Clicks" scores for assessing patients' activity limitations in acute care settings.