Measuring nonspecific factors in treatment: item banks that assess the healthcare experience and attitudes from the patient's perspective.

PURPOSE: Nonspecific factors that accompany healthcare treatments, such as patients' attitudes and expectations, are important parts of the experience of care and can influence outcomes. However, no precise, concise, and generalizable instruments to measure these factors exist. We report on the development and calibration of new item banks, titled the Healing Encounters and Attitudes Lists (HEAL), that assess nonspecific factors across a broad range of treatments and conditions. METHODS: The instrument development methodology of the Patient-Reported Outcomes Measurement Information System (PROMIS(®)) was used. Patient focus groups and clinician interviews informed our HEAL conceptual model. Literature searches of eight databases yielded over 500 instruments and resulted in an initial item pool of several thousand items. After qualitative item analysis, including cognitive interviewing, 296 items were included in field testing. The calibration sample included 1657 respondents, 1400 obtained through an Internet panel and 257 from conventional and integrative medicine clinics. Following exploratory and confirmatory factor analyses, the HEAL item banks were calibrated using item response theory. RESULTS: The final HEAL item banks were Patient-Provider Connection (57 items), Healthcare Environment (25 items), Treatment Expectancy (27 items), Positive Outlook (27 items), and Spirituality (26 items). Short forms were also developed from each item bank. A six-item short form, Attitudes toward Complementary and Alternative Medicine (CAM), was also created. CONCLUSIONS: HEAL item banks provided substantial information across a broad range of each construct. HEAL item banks showed initial evidence of predictive and concurrent validity, suggesting that they are suitable for measuring nonspecific factors in treatment.

Validation of the depression item bank from the Patient-Reported Outcomes Measurement Information System (PROMIS) in a three-month observational study.

The Patient-Reported Outcomes Measurement Information System (PROMIS) is an NIH Roadmap initiative devoted to developing better measurement tools for assessing constructs relevant to the clinical investigation and treatment of all diseases-constructs such as pain, fatigue, emotional distress, sleep, physical functioning, and social participation. Following creation of item banks for these constructs, our priority has been to validate them, most often in short-term observational studies. We report here on a three-month prospective observational study with depressed outpatients in the early stages of a new treatment episode (with assessments at intake, one-month follow-up, and three-month follow-up). The protocol was designed to compare the psychometric properties of the PROMIS depression item bank (administered as a computerized adaptive test, CAT) with two legacy self-report instruments: the Center for Epidemiological Studies Depression scale (CESD; Radloff, 1977) and the Patient Health Questionnaire (PHQ-9; Spitzer et al., 1999). PROMIS depression demonstrated strong convergent validity with the CESD and the PHQ-9 (with correlations in a range from .72 to .84 across all time points), as well as responsiveness to change when characterizing symptom severity in a clinical outpatient sample. Identification of patients as "recovered" varied across the measures, with the PHQ-9 being the most conservative. The use of calibrations based on models from item response theory (IRT) provides advantages for PROMIS depression both psychometrically (creating the possibility of adaptive testing, providing a broader effective range of measurement, and generating greater precision) and practically (these psychometric advantages can be achieved with fewer items-a median of 4 items administered by CAT-resulting in less patient burden).

Implementing interpersonal and social rhythm therapy for mood disorders across a continuum of care.

OBJECTIVE: Interpersonal and social rhythm therapy (IPSRT) is an evidence-based psychotherapy for mood disorders. The goal of this quality improvement initiative was to demonstrate feasibility of implementing IPSRT across the continuum of outpatient and inpatient care within an academic medical center. METHODS: A multidisciplinary work group was convened to implement IPSRT in outpatient (N=48), inpatient (N=602), and intensive outpatient (N=68) programs of an academic medical center. Quality improvement performance markers (including symptoms and group attendance rates) were collected. RESULTS: Institutional preference for group treatments required adaptation of IPSRT from an individual to group psychotherapy format. Iterative problem solving and protocol development resulted in models of group IPSRT appropriate for each level of care. Performance outcome markers were favorable, indicating feasibility of implementation. CONCLUSIONS: At a single, multisite, urban, academic medical center, IPSRT proved a feasible evidence-based psychotherapy for implementation across levels of care in routine practice.