Testing 2 Alternative Time Trade-Off Methods for Valuation of Children's Health States.

OBJECTIVES: Composite time trade-off (cTTO) values for EQ-5D-Y-3L health states tend to be high, raising concerns about sensitivity particularly for mild or moderate health states. We conceptualized and pilot tested 2 alternative time trade-off (TTO) variants: the caregiver TTO (CGTTO) and lag-time TTO (LTTO). METHODS: We collected CGTTO and LTTO data in China for 10 EQ-5D-Y-3L health states and compared the resulting values, respondent feedback, and task completion times with those from an EQ-5D-Y-3L valuation study using cTTO. We also examined how age and parental status of respondents could affect TTO values. RESULTS: A total of 304 participants were included in this study. Overall, cTTO showed statistically better results in all feedback questions. On a 5-point Likert scale where lower score means greater agreement, the mean (SD) feedback scores for cTTO, LTTO, and CGTTO were 1.18 (0.58), 1.45 (0.91), and 1.65 (1.02) for "easy to understand"; 1.45 (0.91), 1.94 (1.08), and 1.86 (1.24) for "easy to differentiate"; and 3.61 (1.29), 2.97 (1.33), and 3.02 (1.50) for "difficult to decide," respectively. The mean (SD) TTO values of all 10 states were 0.463 (0.494), 0.387 (0.555), and 0.123 (0.710) for cTTO, LTTO, and CGTTO, respectively. The effects of age and parental status on TTO values differed by the 3 methods. CONCLUSIONS: LTTO and CGTTO produce values with good characteristics and merit further investigation. Researchers need to be aware of the differences in design and values when using the TTO method to value children's health states.

Understanding the measurement relationship between EQ-5D-5L, PROMIS-29 and PROPr.

PURPOSE: Many generic patient-reported instruments are available for the measurement of health outcomes, including EQ-5D-5L, and the Patient-Reported Outcome Measurement Information System (PROMIS). Assessing their measurement characteristics informs users about the consistency between, and limits of, evidence produced. The aim was to assess the measurement relationship between the EQ-5D-5L descriptive system and value sets, the PROMIS-29 and PROPr (PROMIS value set). METHODS: Data were extracted from a cross-sectional survey administering measures of quality of life online in Australia. Descriptive analysis, agreement and construct validity assessment methods were used to compare instruments at the item, domain and value set level. RESULTS: In total, 794 Australians completed the survey. Convergent validity analysis found that similar dimensions across instruments were highly correlated (> 0.50), but the PROMIS-29 assesses additional health concepts not explicitly covered by EQ-5D (sleep and fatigue). Known-group assessment found that EQ-5D-5L and PROPr were able to detect those with and without a condition (ES range 0.78-0.83) but PROPr could more precisely detect differing levels of self-reported health. Both instruments were sensitive to differences in levels of pain. DISCUSSION: There is some consistency in what the EQ-5D-5L, PROMIS-29 and PROPr measure. Differences between value set characteristics can be linked to differences what is measured and the valuation approaches used. This has implications for the use of each in assessing health outcomes, and the results can inform decisions about which instrument should be used in which context.

New methods for modelling EQ-5D-5L value sets: An application to English data.

Value sets for the EQ-5D-5L are required to facilitate its use in estimating quality-adjusted life years. An international protocol has been developed to guide the collection of stated preference data for this purpose and has been used to generate EQ-5D-5L valuation data for England. The aim of this paper is report the innovative methods used for modelling those data to obtain a value set. Nine hundred and ninety-six members of the English general public completed time trade-off (TTO) and discrete choice experiment (DCE) tasks. We estimate models, with and without interactions, using DCE data only, TTO data only, and TTO/DCE data combined. TTO data are interpreted as both left and right censored. Heteroskedasticity and preference heterogeneity between individuals are accounted for. We use Bayesian methods in the econometric analysis. The final model is chosen based on the deviance information criterion (DIC). Censoring and taking account of heteroskedasticity have important effects on parameter estimation. For DCE data only, TTO data only, and DCE/TTO data combined, models with parameters for all dimensions and levels perform best, as judged by the DIC. Taking account of heterogeneity improves fit, and the multinomial model reports the lowest DIC. This paper presents approaches that suit observed characteristics of EQ-5D-5L valuation data and recognise respondents' preference heterogeneity. The methods described are potentially relevant to other value set studies.

Valuing health-related quality of life: An EQ-5D-5L value set for England.

A new version of the EQ-5D, the EQ-5D-5L, is available. The aim of this study is to produce a value set to support use of EQ-5D-5L data in decision-making. The study design followed an international research protocol. Randomly selected members of the English general public completed 10 time trade-off and 7 discrete choice experiment tasks in face-to-face interviews. A 20-parameter hybrid model was used to combine time trade-off and discrete choice experiment data to generate values for the 3,125 EQ-5D-5L health states. Valuation data are available for 996 respondents. Face validity of the data has been demonstrated, with more severe health states generally given lower values. Problems with pain/discomfort and anxiety/depression received the greatest weight. Compared to the existing EQ-5D-3L value set, there are considerably fewer "worse than dead" states (5.1%, compared with over one third), and the minimum value is higher. Values range from -0.285 (extreme problems on all dimensions) to 0.950 (for health states 11211 and 21111). Results have important implications for users of the EQ-5D-5L both in England and internationally. Quality-adjusted life year gains from interventions seeking to improve very poor health may be smaller using this value set and may previously have been overestimated.

An exploration of differences between Japan and two European countries in the self-reporting and valuation of pain and discomfort on the EQ-5D.

PURPOSE: To investigate the systematic differences in the self-reporting and valuation of overall health and, in particular, pain/discomfort between three countries (England/UK, Japan, and Spain) on the EQ-5D. METHODS: Existing datasets were used to explore differences in responses on the EQ-5D descriptive system between Japan (3L and 5L), the UK (3L), England (5L), and Spain (5L), particularly on the dimension of pain/discomfort. The role of different EQ dimensions in determining self-reported overall health scores for the EuroQol visual analog scale (EQ-VAS) was investigated using ordinary least squares regression. Time trade-off (TTO) results from Japanese and UK respondents for the EQ-5D-3L as well as Japanese and English respondents for the EQ-5D-5L were compared using t tests. RESULTS: For the EQ-5D-3L, a higher percentage of respondents in Japan than in the UK reported 'no pain/discomfort' (81.6 vs 67.0%, respectively); for the EQ-5D-5L, the proportions were 79.2% in Spain, 73.2% in Japan, and 63-64% in England, after adjusting for age differences in samples. The 'pain/discomfort' dimension had the largest impact on respondents' self-reported EQ-VAS only for EQ-5D-3L in Japan. Using the EQ-5D-3L, Japanese respondents were considerably less willing to trade off time to avoid pain/discomfort than the UK respondents; for example, moving from health state, 11121 (some problems with pain/discomfort) to 11131 (extreme pain/discomfort) represented a decrement of 0.65 on the observed TTO value in the UK compared with 0.15 in Japan. Using the EQ-5D-5L, Japanese respondents were also less willing to trade off time to avoid pain/discomfort than respondents in England; however, the difference in values was much smaller than that observed using EQ-5D-3L data. CONCLUSIONS: This study provides evidence of between-country differences in the self-reporting and valuation of health, including pain/discomfort, when using EQ-5D in general population samples. The results suggest a need for caution when comparing or aggregating EQ-5D self-reported data in multi-country studies.

Multinational evidence of the applicability and robustness of discrete choice modeling for deriving EQ-5D-5L health-state values.

AIMS: To investigate the feasibility of discrete choice experiments for valuing EQ-5D-5L states using computer-based data collection, the consistency of the estimated regression coefficients produced after modeling the preference data, and to examine the similarity of the values derived across countries. METHODS: Data were collected in Canada, England, The Netherlands, and the United States (US). Interactive software was developed to standardize the format of the choice tasks across countries, except for face-to-face interviewing in England. The choice task required respondents to choose between 2 suboptimal health states. A Bayesian design was used to generate 200 pairs of states that were randomly grouped into 20 blocks. Each respondent completed 1 block of 10 pairs. A main-effects probit model was used to estimate regression coefficients and to derive values. RESULTS: Approximately 400 respondents participated from each country. The mean time to perform 1 choice task was between 29.2 (US) and 45.2 (England) seconds. All regression coefficients were statistically significant, except level 2 for Usual Activities in The Netherlands (P=0.51). Predictions for the complete set of 3125 EQ-5D-5L health states were similar for the 4 countries. Intraclass correlation coefficients between the countries were high: from 0.80 (England vs. US) through 0.98 (Canada vs. US) CONCLUSIONS: Derivation of value sets from the general population using computer-based choice tasks for the EQ-5D-5L is feasible. Parameter estimates were generally consistent and logical, and health-state values were similar across the 4 countries.

A program of methodological research to arrive at the new international EQ-5D-5L valuation protocol.

OBJECTIVES: To describe the research that has been undertaken by the EuroQol Group to improve current methods for health state valuation, to summarize the results of an extensive international pilot program, and to outline the key elements of the five-level EuroQol five-dimensional (EQ-5D-5L) questionnaire valuation protocol, which is the culmination of that work. METHODS: To improve on methods of health state valuation for the EQ-5D-5L questionnaire, we investigated the performance of different variants of time trade-off and discrete choice tasks in a multinational setting. We also investigated the effect of three modes of administration on health state valuation: group interviews, online self-completion, and face-to-face interviews. RESULTS: The research program provided the basis for the EQ-5D-5L questionnaire valuation protocol. Two different types of tasks are included to derive preferences: a newly developed composite time trade-off task and a forced-choice paired comparisons discrete choice task. Furthermore, standardized blocked designs for the selection of the states to be valued by participants were created and implemented together with all other elements of the valuation protocol in a digital aid, the EuroQol Valuation Technology, which was developed in conjunction with the protocol. CONCLUSIONS: The EuroQol Group has developed a standard protocol, with accompanying digital aid and interviewer training materials, that can be used to create value sets for the EQ-5D-5L questionnaire. The use of a well-described, consistent protocol across all countries enhances the comparability of value sets between countries, and allows the exploration of the influence of cultural and other factors on health state values.

Assessing the performance of the EQ-VAS in the NHS PROMs programme.

OBJECTIVES: The study aims to increase knowledge about the performance of the EuroQol-visual analogue scales (EQ-VAS) in the UK NHS patient-reported outcome measures (PROMs) programme, which covers groin hernia, hip and knee replacement and varicose vein surgery, and make suggestions for improved collection, coding and analysis of data. METHODS: Four hundred scanned images of matched before-and-after EQ-VAS PROMs responses were selected at random. These were classified according to the different ways in which they were completed. Patient-level PROMs programme data linked to Hospital Episode Statistics for all patients from April 2009 to February 2011 were used to analyse the relationship between the EQ-VAS and the EQ-5D profile, index-weighted profile and condition-specific instruments. The linked PROMs and HES data comprise 331,951 anonymised patient records. RESULTS: A large majority (95 %) of EQ-VAS responses were completed in an unambiguous way, but only a minority (45 %) conformed strictly to the instructions given, posing challenges for data coding. The EQ-VAS data have a predictable and consistent relationship with the EQ-5D profile, although the correlations between the EQ-VAS and other measures of patient-reported health, both before and after surgery and in the change between them, are weak. CONCLUSIONS: EQ-VAS data might be improved by providing better guidance on collection and coding. It is argued that the observed differences in results from EQ-VAS and other measures of health reflect the fact that it measures a broader underlying construct of health, arguably providing a means of summarising overall health that is closer to the patient's perspective.

The Validity of the EuroQol Health and Wellbeing Short Version (EQ-HWB-S) Instrument in Parents of Children With and Without Health Conditions.

BACKGROUND:  The EuroQol Health and Wellbeing Short Version (EQ-HWB-S) instrument has been developed to measure the health and wellbeing of care-recipients and their caregivers for use in economic evaluation.The EQ-HWB-S has nine items, and pilot UK preference weights have now been developed. OBJECTIVE: We aimed to investigate the validity of the instrument in parents of children with and without health conditions. METHODS: EQ-HWB-S data were sourced from an Australian paediatric multi-instrument comparison study. We analysed the baseline characteristics and response distribution of the EQ-HWB-S items. Assessment of known-group validity was conducted for EQ-HWB-S items, level sum-scores and preference-weighted scores, including partial effects. Known-group analyses included three child health variables and where caregivers reported coronavirus disease 2019 (COVID-19) had impacted their wellbeing. We included analyses across gender, controlled for child and parent demographic variables, and compared scores across child health conditions. RESULTS:  Item responses were distributed as expected, with higher skew for mobility and activities. Parents experienced high levels of exhaustion. We detected significant differences between groups for level sum-scores and preference-weighted scores, as hypothesised; all tests were significant (p < 0.001), with moderate effect sizes (effect sizes were slightly higher for female than male parents). The regression analysis identified significantly different EQ-HWB-S scores for child health samples compared with the general population after controlling for demographic variables. Differences were observed between child health conditions. CONCLUSION: The EQ-HWB-S is a useful instrument to measure parent quality of life for economic evaluation in this population. Data were limited to one time point; further research should investigate the instrument's sensitivity to change and test-retest reliability in this population.

The performance of the EQ-HWB-S as a measure of quality-of-life of caregivers in families that have experienced adverse events.

PURPOSE: The recently developed EQ Health and Wellbeing Instrument (EQ-HWB) is a broad, generic measure of quality-of-life designed to be suitable for caregivers. The aim of this study was to investigate performance and validity of the 9-item version (EQ-HWB-S) for caregivers where families had experienced adverse-life-events. METHODS: Using survey data from caregivers of children aged 0-8 years attending a community-health centre in 2021-2022, the general performance, feasibility, convergent and known-group validity, responsiveness-to-change, and test-retest reliability of the EQ-HWB-S was assessed. Twelve semi-structured interviews were conducted with survey respondents to assess acceptability and content validity. RESULTS: The sample included  234 caregivers at baseline (81% female, mean age 36-years, 38% Australian-born) and 190 at 6-months follow-up. Most EQ-HWB-S item responses were evenly spread, except for 'Mobility'. The instrument showed good convergent validity with psychological distress (Kessler 6 (K6)) and personal-wellbeing (PWI-A) scales. EQ-HWB-S level sum-scores and preference-weighted scores were significantly different in all known-group analyses, in expected directions, and the instrument was responsive to change. For test-retest reliability, Intraclass Correlation Coefficients were excellent and individual item Kappa scores were moderate. The instrument was well received by interviewees who found the questions clear and relevant. The items were appropriate for parents experiencing adversity and carers of children with additional needs. CONCLUSION: The EQ-HWB-S appeared valid, responsive to change, feasible, and well accepted by caregivers. By demonstrating the validity of the EQ-HWB-S in this hard-to-reach population of caregivers in families experiencing adverse events, this study adds to existing international evidence supporting its use.

Systematic Review of the Relative Social Value of Child and Adult Health.

OBJECTIVES: We aimed to synthesise knowledge on the relative social value of child and adult health. METHODS: Quantitative and qualitative studies that evaluated the willingness of the public to prioritise treatments for children over adults were included. A search to September 2023 was undertaken. Completeness of reporting was assessed using a checklist derived from Johnston et al. Findings were tabulated by study type (matching/person trade-off, discrete choice experiment, willingness to pay, opinion survey or qualitative). Evidence in favour of children was considered in total, by length or quality of life, methodology and respondent characteristics. RESULTS: Eighty-eight studies were included; willingness to pay (n = 9), matching/person trade-off (n = 12), discrete choice experiments (n = 29), opinion surveys (n = 22) and qualitative (n = 16), with one study simultaneously included as an opinion survey. From 88 studies, 81 results could be ascertained. Across all studies irrespective of method or other characteristics, 42 findings supported prioritising children, while 12 provided evidence favouring adults in preference to children. The remainder supported equal prioritisation or found diverse or unclear views. Of those studies considering prioritisation within the under 18 years of age group, nine findings favoured older children over younger children (including for life saving interventions), six favoured younger children and five found diverse views. CONCLUSIONS: The balance of evidence suggests the general public favours prioritising children over adults, but this view was not found across all studies. There are research gaps in understanding the public's views on the value of health gains to very young children and the motivation behind the public's views on the value of child relative to adult health gains. CLINICAL TRIAL REGISTRATION: The review is registered at PROSPERO number: CRD42021244593. There were two amendments to the protocol: (1) some additional search terms were added to the search strategy prior to screening to ensure coverage and (2) a more formal quality assessment was added to the process at the data extraction stage. This assessment had not been identified at the protocol writing stage.

Truly inefficient or providing better quality of care? Analysing the relationship between risk-adjusted hospital costs and patients' health outcomes.

Observed variation in hospital costs may be attributable to differences in patients' health outcomes. Previous studies have resorted to inherently incomplete outcome measures such as mortality or re-admission rates to assess this claim. This study makes use of a novel dataset of routinely collected patient-reported outcome measures (PROMs) linked to inpatient records to (i) access the degree to which cost variation is associated with variation in patients' health gain and (ii) explore how far judgement about hospital cost performance changes when health outcomes are accounted for. We use multilevel modelling to address the clustering of patients in providers and isolate unexplained cost variation. We find some evidence of a U-shaped relationship between risk-adjusted costs and outcomes for hip replacement surgery. For three other procedures (knee replacement, varicose vein and groin hernia surgery), the estimated relationship is sensitive to the choice of PROM instrument. We do not observe substantial changes in cost performance estimates when outcomes are explicitly accounted for.

Using Age-Specific Values for Pediatric HRQoL in Cost-Effectiveness Analysis: Is There a Problem to Be Solved? If So, How?

Value sets for the EQ-5D-Y-3L published to date appear to have distinctive characteristics compared with value sets for corresponding adult instruments: in many cases, the value for the worst health state is higher and there are fewer values < 0. The aim of this paper is to consider how and why values for child and adult health differ; and what the implications of that are for the use of EQ-5D-Y-3L values in economic evaluations to inform healthcare resource allocation decisions. We posit four potential explanations for the differences in values: (a) The wording of severity labels may mean the worst problems on the EQ-5D-Y-3L are descriptively less severe than those on the EQ-5D-5L; (b) Adults may genuinely consider that children are less badly affected than adults by descriptively similar health issues. That is, for any given health problem, adult respondents in valuation studies consider children's overall health-related quality of life (HRQoL) on average to be higher than that for adults; (c) Values are being sought by eliciting adults' stated preferences for HRQoL in another person, rather than in themselves (regardless of whether the 'other person' concerned is a child); and (d) The need to elicit preferences for child HRQoL that are anchored at dead = 0 invokes special considerations regarding children's survival. Existing evidence does not rule out the possibility that (c) and (d) exert an upward bias in values. We consider the implications of that for the interpretation and use of values for pediatric HRQoL. Alternative methods for valuing children's HRQoL in a manner that is not 'age specific' are possible and may help to avoid issues of non-comparability. Use of these methods would place the onus on health technology assessment bodies to reflect any special considerations regarding child quality-adjusted life-year gains.

Value Insider Season 1 Episode 2: How to Measure Quality of Life and Utility? (QoL) [Podcast].

How do we measure quality of life and utility of interventions? In this episode of the Value Insider podcast, host Mike Chambers speaks with Prof. Nancy Devlin about incorporating quality of life in value assessment. Prof. Devlin is professor of health economics at the University of Melbourne. Her past roles include Director of Research at the Office of Health Economics (OHE) London, Professor of Health Economics at City University of London, and she has been director of the International Society of Pharmacoeconomics and Outcomes Research (ISPOR). She is the Chair of the Board of the EuroQol Research Foundation, the international research organization which has developed and maintains the EQ-5D patient-reported outcome (PRO) instrument. Prof Devlin explains the value of the patient voice and how it can be measured and taken into account when considering the value of healthcare interventions.

Analytical Considerations When Anchoring Discrete Choice Experiment Values Using Composite Time Trade-Off Data: The Case of EQ-5D-Y-3L.

Discrete choice experiments (DCEs) are becoming increasingly used to elicit preferences for children's health states. However, DCE data need to be anchored to produce value sets, and composite time trade-off (cTTO) data are typically used in the context of EQ-5D-Y-3L valuation. The objective of this paper is to compare different anchoring methods, summarise the characteristics of the value sets they produce, and outline key considerations for analysts. Three anchoring methods were compared using data from published studies: (1) rescaling using the mean value for the worst health state; (2) linear mapping; and (3) hybrid modelling. The worst state rescaling value set had the largest range. The worst state rescaling and linear mapping value sets preserved the relative importance of the dimensions from the DCE, whereas the hybrid model value set did not. Overall, the predicted values from the hybrid model value set were more closely aligned with the cTTO values. These findings are relatively generalisable. Deciding upon which anchoring approach to use is challenging, as there are numerous considerations. Where cTTO data are collected for more than one health state, anchoring on the worst health state will arguably be suboptimal. However, the final choice of approach may require value judgements to be made. Researchers should seek input from relevant stakeholders when commencing valuation studies to help guide decisions and should clearly set out their rationale for their preferred anchoring approach in study outputs.

Preference Elicitation Techniques Used in Valuing Children's Health-Related Quality-of-Life: A Systematic Review.

BACKGROUND AND OBJECTIVES: Valuing children's health states for use in economic evaluations is globally relevant and is of particular relevance in jurisdictions where a cost-utility analysis is the preferred form of analysis for decision making. Despite this, the challenges with valuing child health mean that there are many remaining questions for debate about the approach to elicitation of values. The aim of this paper was to identify and describe the methods used to value children's health states and the specific issues that arise in the use of these methods. METHODS: We conducted a systematic search of electronic databases to identify studies published in English since 1990 that used preference elicitation methods to value child and adolescent (under 18 years of age) health states. Eligibility criteria comprised valuation studies concerning both child-specific patient-reported outcome measures and child health states defined in other ways, and methodological studies of valuation approaches that may or may not have yielded a value set algorithm. RESULTS: A total of 77 eligible studies were identified from which data on country setting, aims, condition (general population or clinically specific), sample size, age of respondents, the perspective that participants were asked to adopt, source of values (respondents who completed the preference elicitation tasks) and methods questions asked were extracted. Extracted data were classified and evaluated using narrative synthesis methods. The studies were classified into three groups: (1) studies comparing elicitation methods (n = 30); (2) studies comparing perspectives (n = 23); and (3) studies where no comparisons were presented (n = 26); selected studies could fall into more than one group. Overall, the studies varied considerably both in methods used and in reporting. The preference elicitation tasks included time trade-off, standard gamble, visual analogue scaling, rating/ranking, discrete choice experiments, best-worst scaling and willingness to pay elicited through a contingent valuation. Perspectives included adults' considering the health states from their own perspective, adults taking the perspective of a child (own, other, hypothetical) and a child/adolescent taking their own or the perspective of another child. There was some evidence that children gave lower values for comparable health states than did adults that adopted their own perspective or adult/parents that adopted the perspective of children. CONCLUSIONS: Differences in reporting limited the conclusions that can be formed about which methods are most suitable for eliciting preferences for children's health and the influence of differing perspectives and values. Difficulties encountered in drawing conclusions from the data (such as lack of consensus and poor reporting making it difficult for users to choose and interpret available values) suggest that reporting guidelines are required to improve the consistency and quality of reporting of studies that value children's health using preference-based techniques.

A uniform time trade off method for states better and worse than dead: feasibility study of the 'lead time' approach.

The way time trade off (TTO) values are elicited for states of health considered 'worse than being dead' has important implications for the mean values used in economic evaluation. Conventional approaches to TTO, as used in the UK's 'MVH' value set, are problematic because they require fundamentally different trade-offs tasks for the valuation of states better and worse than dead. This study aims to refine and test the feasibility of a new approach described by Robinson and Spencer (2006. Health Economics 15: 393-402), and to explore the characteristics of the valuation data it generates. The approach introduces a 'lead time' into the TTO, producing a uniform procedure for generating values either >0 or<0. We used this lead time TTO to value 10 moderate to severe EQ-5D states using a sample of the general public (n=109). We conclude that the approach is feasible for use in valuation studies and appears to overcome the discontinuity in values around 0 evident in conventional methods. However, further research is required to resolve the issue of how to handle participants who 'use up' all lead time; to develop ways of controlling for individual time preferences; and to better understand the implications for valuations of states better than dead.