How Are Debriefing Questions Used in Health Discrete Choice Experiments? An Online Survey.

OBJECTIVES: Debriefing questions can assess if respondents understand discrete choice experiments (DCEs) and are answering in a way consistent with theories of decision making and utility maximization. Nevertheless, there is limited literature about how often debriefing questions are included or how the results are used in health economics. The aim of this study was to conduct a survey of the frequency, type, and analysis of debriefing questions in health DCEs. METHODS: We conducted an online survey of authors of published health DCEs, asking about their use of debriefing questions, including frequency, type, and analysis. We descriptively analyzed the sample characteristics and responses. Free-text questions were analyzed with qualitative thematic analysis. RESULTS: We received 70 responses (43% response rate), of which 50% reported using debriefing questions. They were most commonly designed to assess difficulty (91%), understanding (49%), and attribute nonattendance (31%) rather than learning effects (3%) or monotonicity (11%). On average, 37% of debriefing questions were analyzed (range, 0% to 69%), and the results were used <50% of the time, usually to exclude respondents or interpret overall results. Researcher experience or confidence with DCEs did not affect their use of debriefing questions. CONCLUSIONS: These results suggest that although half of researchers conducting health DCEs use debriefing questions, many do not analyze, use, or report the responses. Given the additional respondent burden, there is a need for reliable and valid debriefing questions. In the meantime, the inclusion, analysis, and reporting of debriefing questions should be carefully considered before DCE implementation.

The effect of adverse information and positive promotion on women's preferences for prescribed contraceptive products.

Recent rapid growth in the range of contraceptive products has given women more choice, but also adds complexity to the resultant decision of which product to choose. This paper uses a discrete choice experiment (DCE) to investigate the effect of adverse information and positive promotion on women's stated preferences for prescribed contraceptive products. In November 2007, 527 Australian women aged 18-49 years were recruited from an online panel. Each was randomly allocated to one of three information conditions. The control group only received basic information on contraceptive products. One treatment group also received adverse information on the risks of the combined oral pill. The other group received basic information and promotional material on the vaginal ring, newly introduced into Australia and on the transdermal patch, which is unavailable in Australia. Respondents completed 32 choice sets with 3 product options where each option was described by a product label: either combined pill, minipill, injection, implant, hormonal IUD, hormonal vaginal ring, hormonal transdermal patch or copper IUD; and by the attributes: effect on acne, effect on weight, frequency of administration, contraceptive effectiveness, doctor's recommendation, effect on periods and cost. Women's choices were analysed using a generalized multinomial logit model (G-MNL) and model estimates were used to predict product shares for each information condition. The predictions indicated that adverse information did not affect women's preferences for products relative to only receiving basic information. The promotional material increased women's preferences for the transdermal patch. Women in all groups had a low preference for the vaginal ring which was not improved by promotion. The findings highlight the need for researchers to pay attention to setting the context when conducting DCEs as this can significantly affect results.

What's good and bad about contraceptive products?: a best-worst attribute experiment comparing the values of women consumers and GPs.

BACKGROUND: In the past decade, the range of contraceptives available has increased dramatically. There are limited data on the factors that determine women's choices on contraceptive alternatives or what factors providers consider most important when recommending contraceptive products to women. OBJECTIVES: Our objectives were to compare women's (consumers') preferences and GPs' (providers') views in relation to existing and new contraceptive methods, and particularly to examine what factors increase the acceptability of different contraceptive products. METHODS: A best-worst attribute stated-choice experiment was completed online. Participants (Australian women of reproductive age and Australian GPs) completed questions on 16 contraceptive profiles. 200 women of reproductive age were recruited through a commercial panel. GPs from all states of Australia were randomly sampled and approached by phone; 162 GPs agreed to participate. Participants chose the best and worst attribute levels of hypothetical but realistic prescribed contraceptive products. Best and worst choices were modelled using multinomial logit and product features were ranked from best to worst according to the size of model coefficients. RESULTS: The most attractive feature of the contraceptive products for both GPs and women consumers were an administration frequency of longer than 1 year and light or no bleeding. Women indicated that the hormonal vaginal ring was the least attractive mode of administration. CONCLUSIONS: Women and GPs agree that longer-acting methods with less bleeding are important features in preferred methods of contraception; however, women are also attracted to products involving less invasive modes of administration. While the vaginal ring may fill the niche in Australia for a relatively non-invasive, moderately long-acting and effective contraceptive, the results of this study indicate that GPs will need to promote the benefits of the vaginal ring to overcome negative perceptions about this method among women who may benefit from using it.

National health reform needs strategic investment in health services research.

With new funding for the National Health and Medical Research Council (NHMRC) to provide an evidence base for policy and practice reform, it is timely to revisit Australia's recent experiences with health services research and policy development. We provide a broad review of the contribution of Australian health services research to the development of health policy over the past 20 years. We conclude that three preconditions are necessary to influence policy: political will; sustained funding to encourage methodological rigour and build decision makers' confidence; and the development of sufficient capacity and skills.

Quality of life and survival in the 2 years after surgery for non small-cell lung cancer.

PURPOSE: Although surgery for early-stage non-small-cell lung cancer (NSCLC) is known to have a substantial impact on health-related quality of life (HRQOL), there are few published studies about HRQOL in the longer term. This article examines HRQOL and survival in the 2 years after surgery. PATIENTS AND METHODS: Patients with clinical stage I or II NSCLC (n = 173) completed HRQOL questionnaires before surgery, at discharge, 1 month after surgery, and then every 4 months for 2 years. HRQOL was measured with a generic cancer questionnaire (European Organisation for Research and Treatment of Cancer Quality of Life Questionnaire [EORTC-QLQ] C30) and a lung cancer-specific questionnaire (EORTC QLQ-LC13). Data were analyzed to examine the impact of surgery and any subsequent therapy, and to describe the trajectories of those who remained disease free at 2 years and those with recurrent cancer diagnosed during follow-up. RESULTS: Disease recurred within 2 years for 36% of patients and 2-year survival was 65%. Surgery substantially reduced HRQOL across all dimensions except emotional functioning. HRQOL improved in the 2 years after surgery for patients without disease recurrence, although approximately half continued to experience symptoms and functional limitations. For those with recurrence within 2 years, there was some early postoperative recovery in HRQOL, with subsequent deterioration across most dimensions. CONCLUSION: Surgery had a substantial impact on HRQOL, and although many disease-free survivors experienced recovery, some lived with long-term HRQOL impairment. HRQOL generally worsened with disease recurrence. The study results are important for informed decision making and ongoing supportive care for patients with operable NSCLC.

Randomized controlled trial of the role of positron emission tomography in the management of stage I and II non-small-cell lung cancer.

PURPOSE: Positron emission tomography (PET) is a costly new technology with potential to improve preoperative evaluation for patients with non-small-cell lung cancer (NSCLC). There is increasing pressure for PET to be included in standard diagnostic work-up before decisions about surgical management of NSCLC. The resource implications of its widespread use in staging NSCLC are significant. METHODS: A randomized controlled trial was conducted to investigate the impact of PET on clinical management and surgical outcomes for patients with stage I-II NSCLC. The primary hypothesis was that PET would reduce the proportion of patients with stage I-II NSCLC who underwent thoracotomy by at least 10% through identification of patients with inoperable disease. RESULTS: One hundred eighty-four patients with stage I-II NSCLC were recruited and randomly assigned; 92% had stage I disease. Following exclusion of one ineligible patient, 92 patients were assigned to no PET and 91 to PET. Compared with conventional staging, PET upstaged 22 patients, confirmed staging in 61 and staged two patients as benign. Stage IV disease was rarely detected (two patients). PET led to further investigation or a change in clinical management in 13% of patients and provided information that could have affected management in a further 13% of patients. There was no significant difference between the trial arms in the number of thoracotomies avoided (P =.2). CONCLUSION: For patients who are carefully and appropriately staged as having stage I-II disease, PET provides potential for more appropriate stage-specific therapy but may not lead to a significant reduction in the number of thoracotomies avoided.