Development and validation of behavioral intention measures of an E-vapor product: intention to try, use, dual use, and switch.

BACKGROUND: The harm caused by tobacco use is primarily attributable to cigarette smoking. Switching completely to non-combustible products may reduce disease risks in adult cigarette smokers who are unable or unwilling to quit. Before a new tobacco product can enter the market or can be marketed as a modified risk tobacco product, the manufacturer must determine the impact that the product will have on the likelihood of changes in tobacco use behavior among both tobacco users and nonusers. One way to estimate change in tobacco use behavior is to assess tobacco users' and nonusers' behavioral intentions toward the product and its marketing, including intentions to try, use, dual use, and switch to the product from cigarettes. The purpose of this study was to develop and validate behavioral intention metrics appropriate for use with current, former, and never adult tobacco users. METHODS: Preliminary items were subjected to cognitive testing with adult (1) smokers planning to quit cigarettes in the next 30 days, (2) smokers not planning to quit cigarettes in the next 30 days, (3) e-vapor users, (4) former tobacco users, and (5) never tobacco users. Items were iteratively revised based on feedback during cognitive testing, and surviving items were administered to a large sample of adults (N = 2943) representing the aforementioned sub-groups. Rating scale functioning, reliability, validity, bias, and ability to detect change were evaluated. RESULTS: Examination of the response category thresholds generated by the Rasch model provided evidence that the rating scales were functioning appropriately. Results revealed good stability and excellent internal consistency and person reliability and provided evidence of unidimensionality and convergent validity. Estimates of reliability and validity were similar across sub-groups. A cross-validation sample generally confirmed findings from the validation sample. No items were discarded due to differential item function. Exploratory analyses provided support for ability to detect change. CONCLUSIONS: Results from this rigorous, empirical evaluation using large validation and cross-validation samples provide strong support for the psychometric properties of the Intention to Try, Use, Dual Use, and Switch scales with current, former, and never adult tobacco users.

Development of a Brief Version of the Current Opioid Misuse Measure (COMM): The COMM-9.

Objective: The Current Opioid Misuse Measure (COMM) is a commonly used self-report instrument to identify and monitor aberrant opioid-related behavior in chronic pain patients on opioid therapy. However, the length of the COMM may limit its clinical utility. Additionally, this paper-and-pencil screener requires hand scoring, which increases paperwork and staff burden. Therefore, the current study presents development of the "COMM-9," a brief electronically administered form of the COMM. Methods: Patients (N = 517) with chronic noncancer pain on opioid therapy completed the COMM. Patients were classified as either being positive or negative for aberrant drug-related behavior based on self-report data from a structured interview, physician-report data, and urine toxicology screen (the Aberrant Drug Behavior Index [ADBI]). COMM items with the strongest classification accuracy were identified using the LASSO method as the selection criterion in conjunction with the leave-one-out cross-validation method as the stop criterion. A sub-set of patients (n=55) completed a second administration of the COMM one week later to evaluate test-retest reliability. Results: Nine items were identified before the selection criterion stopped, and logistic regression was utilized to predict probabilities of positive ADBI from the 9 COMM items using all data and the cross-validation procedure. Receiver operating characteristic curves revealed high levels of classification accuracy that were essentially equivalent to the full COMM. Cut-points were identified to classify patients as having no/low risk, moderate risk, and high risk for aberrant opioid-related behavior. Test-retest reliability of the COMM-9 was comparable to the full 17-item COMM. Conclusions: This study presents the successful development of a brief electronic screener to identify current aberrant opioid-related behavior in chronic pain patients on long-term opioid therapy.

A Modular Health-Related Quality of Life Instrument for Electronic Assessment and Treatment Monitoring: Web-Based Development and Psychometric Validation of Core Thrive Items.

BACKGROUND: Patient-reported outcome (PRO) measures describe natural history, manage disease, and measure the effects of interventions in trials. Patients themselves increasingly use Web-based PRO tools to track their progress, share their data, and even self-experiment. However, existing PROs have limitations such as being: designed for paper (not screens), long and burdensome, negatively framed, under onerous licensing restrictions, either too generic or too specific. OBJECTIVE: This study aimed to develop and validate the core items of a modular, patient-centric, PRO system (Thrive) that could measure health status across a range of chronic conditions with minimal burden. METHODS: Thrive was developed in 4 phases, largely consistent with Food and Drug Administration guidance regarding PRO development. First, preliminary core items (common across multiple conditions: core Thrive items) were developed through literature review, analysis of approximately 20 existing PROs on PatientsLikeMe, and feedback from psychometric and content experts. Second, 2 rounds of cognitive interviews were iteratively conducted with patients (N=14) to obtain feedback on the preliminary items. Third, core Thrive items were administered electronically along with comparator measures, including 20-item Short-Form General Health Survey (SF)-20 and Patient Health Questionnaire (PHQ)-9, to a large sample (N=2002) of adults with chronic diseases through the PatientsLikeMe platform. On the basis of theoretical and empirical rationale, items were revised or removed. Fourth, the revised core Thrive items were administered to another sample of patients (N=704) with generic and condition-specific comparator measures. A psychometric evaluation, which included both modern and classical test theory approaches, was conducted on these items, and several more items were removed. RESULTS: Cognitive interviews helped to remove confusing or redundant items. Empirical testing of subscales revealed good internal consistency (Cronbach alpha=.712-.879), test-retest reliability (absolute intraclass correlations=.749-.912), and convergent validity with legacy PRO scales (eg, Pearson r=.5-.75 between Thrive subscales and PHQ-9 total). The finalized instrument consists of a 19-item core including 5 multi-item subscales: Core symptoms, Abilities, Mobility, Sleep, and Thriving. Results provide evidence of construct (content, convergent) validity, high levels of test-retest and internal consistency reliability, and the ability to detect change over time. The items did not exhibit bias based on gender or age, and the items generally functioned similarly across conditions. These results support the use of Thrive Core items across diverse chronic patient populations. CONCLUSIONS: Thrive appears to be a useful approach for capturing important domains for patients with chronic conditions. This core set serves as a foundation to begin developing modular condition-specific versions in the near future. Cross-walking against traditional PROs from the PatientsLikeMe platform is underway, in addition to clinical validation and comparison with biomarkers. Thrive is licensed under Creative Commons Attribution ShareAlike 4.0.

Measurement of Quality of Life in Patients with Mycosis Fungoides/Sézary Syndrome Cutaneous T-Cell Lymphoma: Development of an Electronic Instrument.

BACKGROUND: Although the quality of life (QoL) plays an important role in treatment decision making and clinical management of mycosis fungoides (MF) or Sézary syndrome (SS) subtypes of cutaneous T-cell lymphomas (MF/SS-CTCLs), an MF- or SS-specific measure of QoL does not exist. OBJECTIVE: The objective of this research was to develop and validate the first QoL instrument for MF/SS-CTCL using a patient-centered approach. METHODS: A conceptual framework for the MF/SS-CTCL QoL was developed through a literature review and interviews with key opinion leaders. Concept elicitation with patients was utilized to refine the conceptual model and generate preliminary items. The items were then revised based on qualitative and quantitative feedback obtained through cognitive debriefing surveys and interviews with patients. Next, participants (N=126) completed the preliminary MF/SS-CTCL QoL and a comparator measure of health-related QoL (Skindex-29) through the PatientsLikeMe Open Research Exchange. The MF/SS-CTCL QoL was completed again 5 days later by 66 participants for the purposes of evaluating test-retest reliability. The MF/SS-CTCL QoL was finalized based on results from an empirical evaluation, which included both classical and modern test theory approaches. Specifically, this included evaluation of (1) the optimal item response theory measurement model; (2) item fit; (3) unidimensionality; (4) rating scale performance; (5) reliability; (6) test information (precision); (7) person-to-item map; (8) convergent and discriminant validity; and (9) presence of bias via differential item function. RESULTS: Results from the comprehensive psychometric evaluation utilizing a Rasch-Grouped Rating Scale model yielded a final 12-item instrument. The rating scale functioned as expected, and the instrument exhibited adequate person reliability (.87), good to excellent test-retest reliability (r=.89, P<.001), high levels of measurement precision, and good person-to-item targeting. The correlation between the MF/SS-CTCL QoL and the Skindex-29 (r=.852, P<.001) was significantly greater than the correlation between the MF/SS-CTCL QoL and syndrome stage (r=.260, P<.001), providing support for convergent and discriminant validity. Items did not show significant bias based on gender, age, or race. Rasch scores were converted to scaled scores with qualitative descriptive categories for ease of interpretation. CONCLUSIONS: Empirical evaluation demonstrated strong evidence of excellent psychometric properties. Utilizing a patient-centered measure development approach ensures that this QoL instrument captures the information that is most meaningful and clinically relevant to patients.

Psychometric evaluation of the PainCAS Interference with Daily Activities, Psychological/Emotional Distress, and Pain scales.

PURPOSE: The PainCAS is a web-based clinical tool for assessing and tracking pain and opioid risk in chronic pain patients. Despite evidence for its utility within the clinical setting, the PainCAS scales have never been subject to psychometric evaluation. The current study is the first to evaluate the psychometric properties of the PainCAS Interference with Daily Activities, Psychological/Emotional Distress, and Pain scales. METHODS: Patients (N = 4797) from treatment centers and hospitals in 16 different states completed the PainCAS as part of routine clinical assessment. A subsample (n = 73) from two hospital-based treatment centers also completed comparator measures. Rasch Rating Scale Models were employed to evaluate the Interference with Daily Activities and Psychological/Emotional Distress scales, and empirical evaluation included assessment of dimensionality, discrimination, item fit, reliability, information, and person-to-item targeting. Additionally, convergent and discriminant validity were evaluated through classical test theory approaches. Convergent validity of the Pain scales was evaluated through correlations with corresponding comparator items. RESULTS: One Interference with Daily Activities item was removed due to poor functioning and discrimination. The retained items from the Interference with Daily Activities and Psychological/Emotional Distress scales conformed to unidimensional Rasch measurement models, yielding satisfactory item fit, reliability, precision, and coverage. Further, results provided support for the convergent and discriminant validity of these two scales. Convergent validity between the PainCAS Pain and BPI Pain items was also strong. CONCLUSION: Taken together, results provide strong psychometric support for these PainCAS Pain scales. Strengths and limitations of the current study are discussed.

Development and Validation of an Eight-Item Brief Form of the SOAPP-R (SOAPP-8).

Objective: Although the Screener and Opioid Assessment for Patients with Pain-Revised (SOAPP-R) has become a widely used screener for aberrant opioid-related behavior in adults, the length of the instrument may limit its utility. The purpose of the current study was to develop a short form of the SOAPP-R by retaining as few items as possible while maximizing predictive accuracy. Methods: Participants (N = 555), recruited from pain clinics, completed the 24-item SOAPP-R and participated in a five-month follow-up visit to evaluate aberrant drug-related behaviors. Opioid aberrant-related behavior was determined through self-report, physician report, and urine toxicology screen. The optimal subset of SOAPP-R items to predict aberrant opioid-related behavior was identified empirically by employing the LASSO selection method and the leave-one-out cross-validation (LOOCV) method offered in the GLMSELECT procedure in SAS 9.4 in conjunction with content expertise. Results: Eight items were identified before the selection method stopped. The receiver operating characteristic curve generated from the predicted probabilities from the model produced an area under the curve (AUC) value greater than the AUC value produced by the 24-item SOAPP-R total score and yielded a sensitivity of 0.74 and a specificity of 0.66. Conclusions: These results provide strong preliminary support for the SOAPP-8 as a brief screening tool of aberrant opioid-related behavior in chronic pain patients.

Characterization of Ad Libitum Use Behavior of On! Nicotine Pouches.

Objectives: Actual use of nicotine pouch products is not well studied. The objectives of this study were to characterize on ® nicotine pouch (Test Products (TP)) use behavior, including association with cigarette and smokeless tobacco (ST) product use. Methods: Adults who smoke cigarettes (AS) and/or adults who use ST (ASTU) (N=1147) that were not planning to quit and had expressed interest in trying and using TP after a 5-day trial were offered ad libitum use of TPs (7 flavors at 5 nicotine levels) for 6 weeks. Results: Participants used a median of ~5-6 pouches/day of a variety of flavors and nicotine levels. In the final week of the study, 27% of AS and 71% of ASTU reported no use of cigarettes or ST respectively, while reporting continued use of TPs. Additionally, 39% of AS and 14% of ASTU reduced consumption of cigarettes or ST products respectively by 50%-99%, compared to reported use at screening. We found a statistically significant inverse relationship between TP flavor varieties and number of cigarettes/ST. Conclusions: These data suggest that TPs can be potential substitutes for cigarettes/ST products, and complete switching may offer harm reduction potential for AS and ASTU not interested in quitting.

A New Questionnaire to Assess Respiratory Symptoms (The Respiratory Symptom Experience Scale): Quantitative Psychometric Assessment and Validation Study.

BACKGROUND: Smokers often experience respiratory symptoms (eg, morning cough), and those who stop smoking, including those who do so by switching completely to electronic nicotine delivery systems (ENDS), may experience reductions in symptoms. Existing respiratory symptom questionnaires may not be suitable for studying these changes, as they are intended for patient populations, such as those with chronic obstructive pulmonary disease (COPD). OBJECTIVE: This study aimed to develop a respiratory symptom questionnaire appropriate for current smokers and for assessing changes when smokers stop smoking. METHODS: The Respiratory Symptom Experience Scale (RSES) was derived from existing instruments and subject matter expert input and refined through cognitive debriefing interviews (n=49). Next, for purposes of the quantitative psychometric evaluation, the RSES was administered to smokers (n=202), former smokers (no tobacco use in >6 months; n=200), and switchers (n=208, smokers who switched to ENDS for >6 months), all of whom had smoked for at least 10 years (mean age 33 years). Participants, who averaged 62 (SD 12) years of age, included 28% (173/610) with respiratory allergy symptoms and 17% (104/610) with COPD. Test-retest reliability was assessed by repeat assessment after 1 week in 128 participants. RESULTS: A generalized partial credit model confirmed that the response options were ordered, and a parallel analysis using principal components confirmed that the scale was unidimensional. With allowance for 2 sets of correlated errors between pairs of items, a 1-factor graded response model fit the data. Discrimination parameters were approximately 1 or greater for all items. Scale reliability was 0.80 or higher across a broad range of severity (standardized scores -0.40 to 3.00). Test-retest reliability (absolute intraclass correlation) was good, at 0.89. RSES convergent validity was supported by substantial differences (Cohen d=0.74) between those with and without a diagnosis of respiratory disease (averaging 0.57 points, indicating that differences of this size or smaller represent meaningful differences). RSES scores also strongly differentiated those with and without COPD (d=1.52). Smokers' RSES scores were significantly higher than former smokers' scores (P<.001). Switchers' RSES scores were significantly lower than smokers' scores (P<.001) and no different from former smokers' scores (P=.34). CONCLUSIONS: The RSES fills an important gap in the existing toolkit of respiratory symptom questionnaires; it is a reliable and valid tool to assess respiratory symptoms in adult current and former smokers, including those who have switched to noncombusted nicotine products. This suggests that the scale is sensitive to respiratory symptoms that develop in smokers and to their remission when smokers quit or switch to noncombusted nicotine products intended to reduce the harm of smoking. The findings also suggest that switching from cigarettes to ENDS may improve respiratory health.

Understanding 'Good Health care' from the Patient's Perspective: Development of a Conceptual Model Using Group Concept Mapping.

BACKGROUND: There is an increasing focus on measuring performance indicators of health care providers, but there is a lack of patient input into what defines 'good care.' OBJECTIVE: The primary objective was to develop a conceptual model of 'good health care' from the patient's perspective. Exploratory analyses were also conducted to investigate (1) differences in patient priorities based on demographic and clinical factors, and (2) differences between patients and health stakeholders (e.g., clinicians, researchers) with respect to patient health care priorities. METHOD: These objectives were accomplished using group concept mapping. Following statement generation, PatientsLikeMe members, Baltimore community members recruited through a university-affiliated clinic, and stakeholders individually sorted the statements into meaningful categories and rated the statements with respect to importance. Qualitative and quantitative analyses generated a final conceptual model. RESULTS: One hundred and fifty-seven patients and 17 stakeholders provided input during statement generation. The 1779-statement pool was reduced to 79 statements for the structuring (sorting and rating) activities. In total, 221 patients and 16 stakeholders completed structuring activities through group concept mapping software. Results yielded a 10-cluster solution, and patient priorities were found to be relatively invariant across demographic/clinical groups. Results were also similar between patients and stakeholders. CONCLUSIONS: This comprehensive qualitative and quantitative investigation is an important first step in developing patient-reported outcome performance measures that capture the aspects of health care that are most important and relevant for patients. Limitations and future directions are discussed.

The natural history of prescription opioid abuse: A pilot study exploring change in routes of administration and motivation for changes.

OBJECTIVE: The purpose of this retrospective, observational pilot study was to explore change in route of administration (RoA) and motivation for changing RoA during the course of opioid abuse. DESIGN: This retrospective pilot study involved collecting and analyzing semistructured interview data. SETTING: Interviews were conducted with patients undergoing outpatient substance abuse treatment at a buprenorphine clinic. PARTICIPANTS: Twenty adult patients (50 percent male) participated in the interviews. MAIN OUTCOME MEASURES: Interview data were qualitatively and quantitatively analyzed to evaluate trends and motivations for changing RoA. RESULTS: In this sample, RoA varied over time. Most patients (75.0 percent) began abusing prescription opioids by swallowing intact pills, and 53.3 percent of patients eventually progressed to chewing. All patients who initiated abuse through chewing or insufflation (ie, intranasal use) progressed to injection. However, several patients (20.0 percent) did not exhibit a linear progression from RoAs with lesser to greater risk for serious adverse events. Of the eight motivations for changing RoA identified in the current study, the most frequently cited (38.2 percent) motivation was to achieve a desired effect (eg, euphoria). CONCLUSIONS: This pilot study is one of the first to investigate natural history of RoA in prescription opioid abuse and motivations for changing RoA. Results suggest that a defined pathway of RoA progression may not exist, and that achieving a desired effect is a common motivation for changing RoA. Although these findings need to be replicated in a larger sample, this research may help support the development of opioid risk mitigation strategies.

A computer adaptive testing version of the Addiction Severity Index-Multimedia Version (ASI-MV): The Addiction Severity CAT.

The purpose of this study was to develop and validate a computer adaptive testing (CAT) version of the Addiction Severity Index-Multimedia Version (ASI-MV), the Addiction Severity CAT. This goal was accomplished in 4 steps. First, new candidate items for Addiction Severity CAT domains were evaluated after brainstorming sessions with experts in substance abuse treatment. Next, this new item bank was psychometrically evaluated on a large nonclinical (n = 4,419) and substance abuse treatment (n = 845) sample. Based on these results, final items were selected and calibrated for the creation of the Addiction Severity CAT algorithms. Once the algorithms were developed for the entire assessment, a fully functioning prototype of an Addiction Severity CAT was created. CAT simulations were conducted, and optimal termination criteria were selected for the Addiction Severity CAT algorithms. Finally, construct validity of the CAT algorithms was evaluated by examining convergent and discriminant validity and sensitivity to change. The Addiction Severity CAT was determined to be valid, sensitive to change, and reliable. Further, the Addiction Severity CAT's time of completion was found to be significantly less than the average time of completion for the ASI-MV composite scores. This study represents the initial validation of an Addiction Severity CAT based on item response theory, and further exploration of the Addiction Severity CAT is needed. (PsycINFO Database Record