Improving Transparency to Build Trust in Real-World Secondary Data Studies for Hypothesis Testing-Why, What, and How: Recommendations and a Road Map from the Real-World Evidence Transparency Initiative.

Real-world data (RWD) and the derivations of these data into real-world evidence (RWE) are rapidly expanding from informing healthcare decisions at the patient and health system level to influencing major health policy decisions, including regulatory approvals and coverage. Recent examples include the approval of palbociclib in combination with endocrine therapy for male breast cancer and the inclusion of RWE in the label of paliperidone palmitate for schizophrenia. This interest has created an urgency to develop processes that promote trust in the evidence-generation process. Key stakeholders and decision-makers include patients and their healthcare providers; learning health systems; health technology assessment bodies and payers; pharmacoepidemiologists and other clinical reseachers, and policy makers interested in bioethical and regulatory issues. A key to optimal uptake of RWE is transparency of the research process to enable decision-makers to evaluate the quality of the methods used and the applicability of the evidence that results from the RWE studies. Registration of RWE studies-particularly for hypothesis evaluating treatment effectiveness (HETE) studies-has been proposed to improve transparency, trust, and research replicability. Although registration would not guarantee better RWE studies would be conducted, it would encourage the prospective disclosure of study plans, timing, and rationale for modifications. A joint task force of the International Society for Pharmacoeconomics and Outcomes Research (ISPOR) and the International Society for Pharmacoepidemiology (ISPE) recommended that investigators preregister their RWE studies and post their study protocols in a publicly available forum before starting studies to reduce publication bias and improve the transparency of research methods. Recognizing that published recommendations alone are insufficient, especially without accessible registration options and with no incentives, a group of experts gathered on February 25 and 26, 2019, in National Harbor, Maryland, to explore the structural and practical challenges to the successful implementation of the recommendations of the ISPOR/ISPE task force for preregistration. This positioning article describes a plan for making registration of HETE RWE studies routine. The plan includes specifying the rationale for registering HETE RWE studies, the studies that should be registered, where and when these studies should be registered, how and when analytic deviations from protocols should be reported, how and when to publish results, and incentives to encourage registration. Table 1 summarizes the rationale, goals, and potential solutions that increase transparency, in addition to unique concerns about secondary data studies. Definitions of terms used throughout this report are provided in Table 2.

Improving transparency to build trust in real-world secondary data studies for hypothesis testing-Why, what, and how: recommendations and a road map from the real-world evidence transparency initiative.

Real-world data (RWD) and the derivations of these data into real-world evidence (RWE) are rapidly expanding from informing healthcare decisions at the patient and health system level to influencing major health policy decisions, including regulatory approvals and coverage. Recent examples include the approval of palbociclib in combination with endocrine therapy for male breast cancer and the inclusion of RWE in the label of paliperidone palmitate for schizophrenia. This interest has created an urgency to develop processes that promote trust in the evidence-generation process. Key stakeholders and decision-makers include patients and their healthcare providers; learning health systems; health technology assessment bodies and payers; pharmacoepidemiologists and other clinical reseachers, and policy makers interested in bioethical and regulatory issues. A key to optimal uptake of RWE is transparency of the research process to enable decision-makers to evaluate the quality of the methods used and the applicability of the evidence that results from the RWE studies. Registration of RWE studies-particularly for hypothesis evaluating treatment effectiveness (HETE) studies-has been proposed to improve transparency, trust, and research replicability. Although registration would not guarantee better RWE studies would be conducted, it would encourage the prospective disclosure of study plans, timing, and rationale for modifications. A joint task force of the International Society for Pharmacoeconomics and Outcomes Research (ISPOR) and the International Society for Pharmacoepidemiology (ISPE) recommended that investigators preregister their RWE studies and post their study protocols in a publicly available forum before starting studies to reduce publication bias and improve the transparency of research methods. Recognizing that published recommendations alone are insufficient, especially without accessible registration options and with no incentives, a group of experts gathered on February 25 and 26, 2019, in National Harbor, Maryland, to explore the structural and practical challenges to the successful implementation of the recommendations of the ISPOR/ISPE task force for preregistration. This positioning article describes a plan for making registration of HETE RWE studies routine. The plan includes specifying the rationale for registering HETE RWE studies, the studies that should be registered, where and when these studies should be registered, how and when analytic deviations from protocols should be reported, how and when to publish results, and incentives to encourage registration. Table 1 summarizes the rationale, goals, and potential solutions that increase transparency, in addition to unique concerns about secondary data studies. Definitions of terms used throughout this report are provided in Table 2.

Adjusting for COPD severity in database research: developing and validating an algorithm.

PURPOSE: When comparing chronic obstructive lung disease (COPD) interventions in database research, it is important to adjust for severity. Global Initiative for Chronic Obstructive Lung Disease (GOLD) guidelines grade severity according to lung function. Most databases lack data on lung function. Previous database research has approximated COPD severity using demographics and healthcare utilization. This study aims to derive an algorithm for COPD severity using baseline data from a large respiratory trial (UPLIFT). METHODS: Partial proportional odds logit models were developed for probabilities of being in GOLD stages II, III and IV. Concordance between predicted and observed stage was assessed using kappa-statistics. Models were estimated in a random selection of 2/3 of patients and validated in the remainder. The analysis was repeated in a subsample with a balanced distribution across severity stages. Univariate associations of COPD severity with the covariates were tested as well. RESULTS: More severe COPD was associated with being male and younger, having quit smoking, lower BMI, osteoporosis, hospitalizations, using certain medications, and oxygen. After adjusting for these variables, co-morbidities, previous healthcare resource use (eg, emergency room, hospitalizations) and inhaled corticosteroids, xanthines, or mucolytics were no longer independently associated with COPD severity, although they were in univariate tests. The concordance was poor (kappa = 0.151) and only slightly better in the balanced sample (kappa = 0.215). CONCLUSION: COPD severity cannot be reliably predicted from demographics and healthcare use. This limitation should be considered when interpreting findings from database studies, and additional research should explore other methods to account for COPD severity.

Development and validation of a cough and sputum assessment questionnaire.

Although cough and sputum production may impact patients' well being and functioning in COPD and chronic bronchitis, there is no validated instrument for cough and sputum symptoms and their impact on patients' daily activities. To fill that gap, we developed and validated a specific, multilingual Cough and Sputum Assessment Questionnaire (CASA-Q) that evaluates clinical symptoms and their impact on patients with COPD or chronic bronchitis. In a three-country validation study (n=671), there was adequate internal consistency (Cronbach's alphas, 0.80-0.91) and test-retest reliability (correlation coefficients>0.70) for the CASA-Q. The cough impact and sputum impact domains correlated with the SGRQ impact domain and SGRQ total score, as did the cough impact domain with the SF-36 social functioning domain. The cough symptom and sputum symptom domains correlated with sputum wet weight (p<0.05; r=-0.56), but not with cough recordings. The mean CASA-Q cough symptom and sputum symptom domain scores indicated responsiveness towards both worse and improved symptoms, whereas the impact domains scored already in the upper third of the scale range, indicating the need for further improvement of its properties. Differences in the CASA-Q domain scores by smoking status (current vs. former smokers) were highest for cough symptoms and lowest for sputum impact. These data indicate that the CASA-Q may be a useful measure of cough and sputum production, and their impact in patients with COPD and/or chronic bronchitis. Further validation will need to assess the responsiveness of the CASA-Q to changes in symptoms.

Prescribing patterns of antidepressants in Europe: results from the Factors Influencing Depression Endpoints Research (FINDER) study.

Antidepressant prescribing patterns and factors influencing the choice of antidepressant for the treatment of depression were examined in the Factors Influencing Depression Endpoints Research (FINDER) study, a prospective, observational study in 12 European countries of 3468 adults about to start antidepressant medication for their first episode of depression or a new episode of recurrent depression. Selective serotonin reuptake inhibitors (SSRIs) were the most commonly prescribed antidepressant (63.3% patients), followed by serotonin-norepinephrine reuptake inhibitors (SNRIs, 13.6%), but there was considerable variation across countries. Notably, tricyclic and tetracyclic antidepressants (TCAs) were prescribed for 26.5% patients in Germany. The choice of the antidepressant prescribed was strongly influenced by the previous use of antidepressants, which was significantly associated with the prescription of a SSRI (OR 0.64; 95% CI 0.54, 0.76), a SNRI (OR 1.49; 95% CI 1.18, 1.88) or a combination of antidepressants (OR 2.78; 95% CI 1.96, 3.96). Physician factors (age, gender, speciality) and patient factors (severity of depression, age, education, smoking, number of current physical conditions and functional syndromes) were associated with initial antidepressant choice in some models. In conclusion, the prescribing of antidepressants varies by country, and the type of antidepressant chosen is influenced by physician- as well as patient-related factors.

Modelling the 5-year cost effectiveness of tiotropium, salmeterol and ipratropium for the treatment of chronic obstructive pulmonary disease in Spain.

Our objective was to assess the 5-year cost effectiveness of bronchodilator therapy with tiotropium, salmeterol or ipratropium for chronic obstructive pulmonary disease (COPD) from the perspective of the Spanish National Health System (NHS). A probabilistic Markov model was designed wherein patients moved between moderate, severe or very severe COPD and had the risk of exacerbation and death. Probabilities were derived from clinical trials. Spanish healthcare utilisation, costs and utilities were estimated for each COPD and exacerbation state. Outcomes were exacerbations, exacerbation-free months, quality-adjusted life years (QALYs), and cost(-effectiveness). The mean (SE) 5-year number of exacerbations was 3.50 (0.14) for tiotropium, 4.16 (0.40) for salmeterol and 4.71 (0.54) for ipratropium. The mean (SE) number of QALYs was 3.15 (0.08), 3.02 (0.15) and 3.00 (0.20), respectively. Mean (SE) 5-year costs were 6,424 euro (305 euro) for tiotropium, 5,869 euro (505 euro) for salmeterol, and 5,181 euro (682 euro) for ipratropium (2005 values). Ipratropium and tiotropium formed the cost-effectiveness frontier, with tiotropium being preferred when willingness to pay (WTP) exceeded 639 euro per exacerbation-free month and 8,157 euro per QALY. In Spain, tiotropium demonstrated the highest expected net benefit for ratios of the willingness to pay per QALY, well within accepted limits.

Patient characteristics associated with quality of life in European women seeking treatment for urinary incontinence: results from PURE.

OBJECTIVE: To investigate the association between patient characteristics and disease-specific and generic quality of life (QOL) as well as the degree of bother in women seeking treatment for urinary incontinence (UI). METHODS: The Prospective Urinary Incontinence Research (PURE) was a 6-mo observational study with 1055 physicians from 15 European countries enrolling 9487 women. QOL was assessed at the enrolment visit using the urinary Incontinence Quality of Life questionnaire (I-QOL) and the generic EQ-5D. A single-item instrument was used to measure the degree of bother. UI severity was assessed using the Sandvik Index. UI was categorised into stress (SUI), mixed (MUI), and urge (UUI) urinary incontinence by a patient-administered instrument (Stress and Urge Incontinence Questionnaire [S/UIQ]). Multivariate linear (I-QOL, EQ-5D Visual Analogue Scale) and logistic (bother, EQ-5D health state index) regressions were performed. RESULTS: Mean total I-QOL scores were significantly and independently associated with UI severity, nocturia, age, UI subtype, number of selected concomitant medical conditions, length of suffering from UI before contacting a doctor, smoking status, ongoing use of UI medication, and country. After adjusting for all the covariates, the total I-QOL scores for SUI, MUI, and UUI were 62.7, 53.8 and 60.1, respectively. As with I-QOL, UI severity was also the most important predictor for bother. The number of concomitant medical conditions, together with UI severity, was the variable most strongly associated with EQ-5D. CONCLUSION: In addition to the UI subtypes, severity of UI should be given more importance in treatment algorithms and in treatment decision-making by both the patient and the physician.

Does quality of life of COPD patients as measured by the generic EuroQol five-dimension questionnaire differentiate between COPD severity stages?

OBJECTIVE: To assess the discriminative properties of the EuroQol five-dimension questionnaire (EQ-5D) with respect to COPD severity according to Global Initiative for Chronic Obstructive Lung Disease (GOLD) criteria in a large multinational study. METHODS: Baseline EQ-5D visual analog scale (VAS) scores, EQ-5D utility scores, and St. George Respiratory Questionnaire scores were obtained from a subset of patients in the Understanding the Potential Long-term Impact on Function with Tiotropium trial, which was a 4-year placebo-controlled trial designed to assess the effect of tiotropium on the rate of decline in FEV(1) in COPD patients aged > or = 40 years, an FEV(1) of < 70% predicted, an FEV(1)/FVC ratio of < or = 70%, and a smoking history of >/= 10 pack-years. RESULTS: A total of 1,235 patients (mean post bronchodilator FEV(1), 48.8% predicted) from 13 countries completed the EQ-5D. The EQ-5D VAS and utility scores differed significantly among patients in GOLD stages 2, 3, and 4, also after correction for age, sex, smoking, body mass index (BMI), and comorbidity (p < 0.001). The mean EQ-5D VAS scores for patients in GOLD stages 2, 3, and 4 were 68 (SD, 16), 62 (SD, 17), and 58 (SD, 16), respectively. The mean utility scores were 0.79 (SD, 0.20) for patients in GOLD stage 2, 0.75 (SD, 0.21) for patients in GOLD stage 3, and 0.65 (SD, 0.23) for patients in GOLD stage 4. Effect sizes for the difference in utility scores between patients in GOLD stages 3 and 4 were more than twice as high as those for the difference between patients in GOLD stages 2 and 3. Gender, postbronchodilator FEV(1) percent predicted, the number of hospital admissions and emergency department visits in the year prior to baseline measurements, measures of comorbidity, and BMI were independently associated with EQ-5D utility. EQ-5D utility scores also differed between patients from different countries. French patients especially had lower utility scores than US patients. Utility scores calculated with the US value set were on average 5% higher than those calculated with the UK value set. CONCLUSIONS: Increasing severity of COPD was associated with a significant decline in EQ-5D VAS scores and utility scores. These results demonstrate that a generic instrument can assess COPD impact on quality of life and that the scores discriminate between patient groups of known severity. These utility scores will be useful in cost-effectiveness assessments.

A description of health care provision and access to treatment for women with urinary incontinence in Europe -- a five-country comparison.

BACKGROUND: Female urinary incontinence is a prevalent condition, but only about one-third of women seek treatment. OBJECTIVES: To describe the health care provision for women with urinary incontinence from a European perspective, selecting France, Germany, Spain, Sweden, and the United Kingdom as examples, and to investigate whether specific barriers for treatment exist. METHODS: Available health care system information, a literature review and clinical expert information identified patterns of treatment provision. RESULTS: In Spain, Sweden, and the UK, access to medical care in general is primarily through the general practitioners. However, in Spain and Sweden, women with urinary incontinence can directly visit specialists. In France and Germany, women have equal access to either general practitioners or specialists. Aside from general practitioners, gynaecologists play a major role in urinary incontinence care in all countries except the UK. In Germany, urologists are also involved in initial female urinary incontinence care; however, only in about 16% of women. There are no waiting lists in France and Germany for appointments with physicians or procedures, contrary to Spain, which has long waiting lists. Access to general practitioners in the UK is unrestricted whereas advanced diagnosis and treatment in secondary care requires long waits. A specific Swedish policy mandates that no woman is required to wait longer than 3 months for incontinence visits and related surgery. In Sweden and the UK, specialist nurses and other health care workers provide incontinence services. Almost all treatment options for urinary incontinence are at least in part reimbursed. However, various co-payments and fees in France, Germany, Spain and Sweden exist and constitute out-of-pocket expenses for women if no complementary additional private health insurance is available. In some countries, financial incentives for physicians to provide incontinence services are low, raising concerns about their interest to engage in continued patient care. CONCLUSIONS: Information about service provision in Europe for women with urinary incontinence is limited and makes it difficult to understand barriers to treatment seeking. A broad European perspective may promote optimised treatment access in the future for this widespread and under-recognised condition.

Cost effectiveness of adding folinic acid to fluorouracil plus levamisole as adjuvant chemotherapy in patients with colon cancer in Germany.

OBJECTIVE: To assess the cost effectiveness of the addition of folinic acid to fluorouracil plus levamisole in patients with colon cancer from the perspective of the German Social Health Insurance. STUDY DESIGN AND METHODS: Patients with International Union Against Cancer (Union International Contre Cancer; UICC) II/T(4) or UICC III colon cancer enrolled in an open-label randomised clinical trial in Germany (Forschungsgruppe Onkologie Gastrointestinaler Tumoren-1 [FOGT-1]) received either fluorouracil plus levamisole (A, standard) or fluorouracil plus levamisole and folinic acid (B) for 12 months as adjuvant chemotherapy after curative intended surgery. Outcome measures for economic evaluation were disease-free life-years gained (df-LYG) and overall life-years gained (LYG) derived from the respective Kaplan-Meier survival curves. Direct medical costs from the perspective of the German Social Health Insurance were estimated retrospectively (2000 values) and incremental cost-effectiveness ratios (ICERs) were calculated. A Markov model was used to project the trial results beyond 5 years for the patients' remaining life expectancy. RESULTS: Adding folinic acid to the fluorouracil/levamisole regimen results in an increase in time to progression and survival in patients with locally advanced colon cancer. Within the trial period of 5 years ICERs (B versus A) were 33,008 Euro per df-LYG and 51,225 Euro per LYG (costs and effects discounted at 5%). The Markov model yielded ICERs of 11,176 Euro per df-LYG and 11,020 Euro per LYG (costs and effects discounted at 5%). The model was robust for variations of key variables in the sensitivity analysis. CONCLUSIONS: Results of this cost-effectiveness analysis suggest that the addition of folinic acid offers clinical benefits at additional costs which are likely to be acceptable for decision makers in the long term. Cost-effectiveness ratios calculated within the clinical trial period were just above 50,000 Euro/LYG. Because treatment benefits, i.e. prolonged survival, are sustained beyond 5 years whereas incremental costs are mainly incurred in the first year, results of the Markov model yielded cost-effectiveness ratios that compare more favourably with other published ICERs.