RESUMEN
Patient-reported outcomes (PROs) are increasingly used in single-arm cancer studies. We reviewed 60 papers published between 2018 and 2021 of single-arm studies of cancer treatment with PRO data for current practice on design, analysis, reporting, and interpretation. We further examined the studies' handling of potential bias and how they informed decision making. Most studies (58; 97%) analysed PROs without stating a predefined research hypothesis. 13 (22%) of the 60 studies used a PRO as a primary or co-primary endpoint. Definitions of PRO objectives, study population, endpoints, and missing data strategies varied widely. 23 studies (38%) compared the PRO data with external information, most often by using a clinically important difference value; one study used a historical control group. Appropriateness of methods to handle missing data and intercurrent events (including death) were seldom discussed. Most studies (51; 85%) concluded that PRO results supported treatment. Conducting and reporting of PROs in cancer single-arm studies need standards and a critical discussion of statistical methods and possible biases. These findings will guide the Setting International Standards in Analysing Patient-Reported Outcomes and Quality of Life Data in Cancer Clinical Trials-Innovative Medicines Initiative (SISAQOL-IMI) in developing recommendations for the use of PRO-measures in single-arm studies.
Asunto(s)
Neoplasias , Calidad de Vida , Humanos , Medición de Resultados Informados por el Paciente , Neoplasias/terapia , Oncología Médica , Proyectos de InvestigaciónRESUMEN
It is common and important to include the patient's perspective of the impact of treatment on health-related quality of life (HRQoL) outcomes. In this commentary, we focus on applying the new addendum to ICH E9 guideline E9 (R1) relating to the estimand framework to Patient Reported Outcomes (PROs) collected in cancer clinical trials, from a statistician's viewpoint. Currently, common practice for statistical analysis of PRO endpoints of published cancer clinical trials demonstrates ambiguity, leaving critical questions unspecified, hindering conclusions about the effect of treatment on PRO endpoints as well as comparability between clinical trials. To avoid this scenario, we advocate the systematic use of the estimand framework which requires the prospective definition of clear PRO research questions. Among the five attributes of the estimands framework, the definition of the endpoint (what is the right PRO measure and timeframe to target and why?), the intercurrent event identification and management (what happens with PRO data post-disease progression, what is the impact of death?) and the population-level summary (what is an acceptable statistical summary for PRO data?) require the most attention for PRO estimands. We identify good practice and highlight discussion points including the challenges of statistical analysis in the presence of missing and/or unobservable data and in relation to death. Through this discussion we highlight that there is no "statistical magic", but that the estimand framework will help you find out what you really want to know when quantifying the benefit of treatments from the patients' perspective.
RESUMEN
Performance outcome (PerfO) measures are based on tasks performed by patients in a controlled environment, making their meaningful interpretation challenging to establish. Co-calibrating PerfO and patient-reported outcome (PRO) measures of the same target concept allow for interpretation of the PerfO with the item content of the PRO. The Rasch model applied to the discretized PerfO measure together with the PRO items allows expressing parameters related to the PerfO measure in the PRO metric for it to be linked to the PRO responses. We applied this approach to two PerfO measures used in multiple sclerosis (MS) for walking and manual ability: the Timed 25-Foot Walk (T25FW) and the 9-Hole Peg Test (9HPT). To determine meaningful interpretation of these two PerfO measures, they were co-calibrated with two PRO measures of closely related concepts, the MS walking scale - 12 items (MSWS-12) and the ABILHAND, using the data of 2,043 subjects from five global clinical trials in MS. The probabilistic relationships between the PerfO measures and the PRO metrics were used to express the response pattern to the PRO items as a function of the unit of the PerfOs. This example illustrates the promises of the co-calibration approach for the interpretation of PerfO measures but also highlights the challenges associated with it, mostly related to the quality of the PRO metric in terms of coverage of the targeted concept. Co-calibration with PRO measures could also be an adequate solution for interpretation of digital sensor measures whose meaningfulness is also often questioned.
RESUMEN
OBJECTIVES: This study aimed to implement a patient-centred and evidence-based approach to develop a novel patient-reported outcome (PRO) instrument to measure fatigue in patients with SLE. METHODS: A three-step mixed methods psychometric (MMP) approach was followed. Steps comprised first draft item generation and review using interview data; evaluation and refinement of second draft items using mixed methods data, including interview and quantitative data from a phase 2 clinical study in SLE analysed using Rasch Measurement Theory (RMT) analysis; and evaluation of the final FATIGUE-PRO items using RMT and complementary Classical Test Theory (CTT) analyses. Guided by MMP criteria, a team of clinicians and outcome-measurement experts assessed evidence to inform instrument development. RESULTS: Step 1 culminated in 55 items (n = 39 patients interviewed). Their refinement in step 2 using mixed methods evidence led to the final FATIGUE-PRO instrument comprising 31 items across three scales of fatigue: physical fatigue (9 items), mental and cognitive fatigue (11 items) and susceptibility to fatigue (11 items). Qualitative (n = 43 patients) and quantitative (n = 106 patients) evidence strongly supported the scales' content comprehensiveness and targeting, item quality and fit, conceptual uniqueness and appropriateness of the response scale. The FATIGUE-PRO further benefited from excellent reliability (RMT: 0.92-0.94 and CTT: 0.95-0.96) and supportive evidence of construct validity from assessments against other PROs. CONCLUSION: The conceptual advances, comprehensive coverage and strong psychometric properties of the FATIGUE-PRO will significantly advance the measurement and management of fatigue in SLE, both in clinical trials and routine practice. TRIAL REGISTRATION: ClinicalTrials.gov (https://clinicaltrials.gov), NCT02804763.
Asunto(s)
Lupus Eritematoso Sistémico , Medición de Resultados Informados por el Paciente , Humanos , Lupus Eritematoso Sistémico/complicaciones , Lupus Eritematoso Sistémico/psicología , Psicometría/métodos , Calidad de Vida/psicología , Reproducibilidad de los Resultados , Encuestas y CuestionariosRESUMEN
BACKGROUND: Meaningfully interpreting patient-reported outcomes (PRO) results from randomized clinical trials requires that the PRO scores obtained in the trial have the same meaning across patients and previous applications of the PRO instrument. Calibration of PRO instruments warrants this property. In the Rasch measurement theory (RMT) framework, calibration is performed by fixing the item parameter estimates when measuring the targeted concept for each individual of the trial. The item parameter estimates used for this purpose are typically obtained from a previous "calibration" study. But imposing this constraint on item parameters, instead of freely estimating them directly in the specific sample of the trial, may hamper the ability to detect a treatment effect. The objective of this simulation study was to explore the potential negative impact of calibration of PRO instruments that were developed using RMT on the comparison of results between treatment groups, using different analysis methods. METHODS: PRO results were simulated following a polytomous Rasch model, for a calibration and a trial sample. Scenarios included varying sample sizes, with instrument of varying number of items and modalities, and varying item parameters distributions. Different treatment effect sizes and distributions of the two patient samples were also explored. Cross-sectional comparison of treatment groups was performed using different methods based on a random effect Rasch model. Calibrated and non-calibrated approaches were compared based on type-I error, power, bias, and variance of the estimates for the difference between groups. RESULTS: There was no impact of the calibration approach on type-I error, power, bias, and dispersion of the estimates. Among other findings, mistargeting between the PRO instrument and patients from the trial sample (regarding the level of measured concept) resulted in a lower power and higher position bias than appropriate targeting. CONCLUSIONS: Calibration does not compromise the ability to accurately assess a treatment effect using a PRO instrument developed within the RMT paradigm in randomized clinical trials. Thus, given its essential role in producing interpretable results, calibration should always be performed when using a PRO instrument developed using RMT as an endpoint in a randomized clinical trial.
Asunto(s)
Medición de Resultados Informados por el Paciente , Sesgo , Calibración , Estudios Transversales , Humanos , Psicometría/métodos , Tamaño de la Muestra , Encuestas y CuestionariosRESUMEN
BACKGROUND: Evaluating severity of illness of patients with prolonged mechanical ventilation (PMV) is important to adopt the best appropriate care management for each individual. Yet, no severity-of-illness scoring system has been specifically designed for this type of patients. The aim of this study was to develop and validate a new instrument, the Multi-INdependence Dimensions (MIND) questionnaire designed to comprehensively measure the severity of illness of patients under PMV. METHODS: The validation of the MIND questionnaire was performed during a longitudinal observational study conducted with PMV subjects in weaning facilities in three countries (Argentina, Colombia and Germany). The questionnaire validity was tested in 3 stages: 1) Specification of components, with description of item responses, inter-item and Cronbach alpha correlations; 2) Creation of the composite scores; 3) Measurement properties determination including test-retest reliability after 30 days, clinical validity (Medical Research Council (MRC) muscle strength score, Sepsis-related Organ Failure Assessment (SOFA), Glasgow Coma Scale (GCS), Dependence Nursing Scale and EuroQol-5 Dimension evaluated at inclusion), and ability to detect change. RESULTS: A total of 128 subjects participated in the validation study. Eleven component scores and four composite scores were created. MIND scores significantly correlated with MRC muscle strength, SOFA, DNS, GCS and EQ-5D, supporting the validity of the new scores. Intraclass Correlation Coefficient greater than 0.82 were observed for all composite scores, indicating good test-retest reliability. MIND scores were able to detect improvement in subject severity of illness. CONCLUSION: The MIND questionnaire is a valid and reliable instrument for measuring comprehensively the multiple dimensions characterizing the severity of illness of PMV patients. TRIAL REGISTRATION: NCT02255058 .
Asunto(s)
Enfermedad Crítica/terapia , Psicometría/instrumentación , Respiración Artificial/métodos , Encuestas y Cuestionarios , Adulto , Anciano , Argentina , Colombia , Femenino , Alemania , Estado de Salud , Humanos , Estudios Longitudinales , Masculino , Persona de Mediana Edad , Análisis Multivariante , Estudios Prospectivos , Análisis de Regresión , Reproducibilidad de los Resultados , Índice de Severidad de la EnfermedadRESUMEN
Importance: Patient-reported outcome (PRO) data from clinical trials can provide valuable evidence to inform shared decision making, labeling claims, clinical guidelines, and health policy; however, the PRO content of clinical trial protocols is often suboptimal. The SPIRIT (Standard Protocol Items: Recommendations for Interventional Trials) statement was published in 2013 and aims to improve the completeness of trial protocols by providing evidence-based recommendations for the minimum set of items to be addressed, but it does not provide PRO-specific guidance. Objective: To develop international, consensus-based, PRO-specific protocol guidance (the SPIRIT-PRO Extension). Design, Setting, and Participants: The SPIRIT-PRO Extension was developed following the Enhancing Quality and Transparency of Health Research (EQUATOR) Network's methodological framework for guideline development. This included (1) a systematic review of existing PRO-specific protocol guidance to generate a list of potential PRO-specific protocol items (published in 2014); (2) refinements to the list and removal of duplicate items by the International Society for Quality of Life Research (ISOQOL) Protocol Checklist Taskforce; (3) an international stakeholder survey of clinical trial research personnel, PRO methodologists, health economists, psychometricians, patient advocates, funders, industry representatives, journal editors, policy makers, ethicists, and researchers responsible for evidence synthesis (distributed by 38 international partner organizations in October 2016); (4) an international Delphi exercise (n = 137 invited; October 2016 to February 2017); and (5) consensus meeting (n = 30 invited; May 2017). Prior to voting, consensus meeting participants were informed of the results of the Delphi exercise and given data from structured reviews evaluating the PRO protocol content of 3 defined samples of trial protocols. Results: The systematic review identified 162 PRO-specific protocol recommendations from 54 sources. The ISOQOL Taskforce (n = 21) reduced this to 56 items, which were considered by 138 international stakeholder survey participants and 99 Delphi panelists. The final wording of the SPIRIT-PRO Extension was agreed on at a consensus meeting (n = 29 participants) and reviewed by external group of experts during a consultation period. Eleven extensions and 5 elaborations to the SPIRIT 2013 checklist were recommended for inclusion in clinical trial protocols in which PROs are a primary or key secondary outcome. Extension items focused on PRO-specific issues relating to the trial rationale, objectives, eligibility criteria, concepts used to evaluate the intervention, time points for assessment, PRO instrument selection and measurement properties, data collection plan, translation to other languages, proxy completion, strategies to minimize missing data, and whether PRO data will be monitored during the study to inform clinical care. Conclusions and Relevance: The SPIRIT-PRO guidelines provide recommendations for items that should be addressed and included in clinical trial protocols in which PROs are a primary or key secondary outcome. Improved design of clinical trials including PROs could help ensure high-quality data that may inform patient-centered care.
Asunto(s)
Protocolos Clínicos/normas , Ensayos Clínicos como Asunto/normas , Guías como Asunto , Medición de Resultados Informados por el Paciente , Toma de Decisiones , HumanosRESUMEN
This descriptive, cross-sectional analysis evaluated the impact of baseline characteristics on health-related quality of life (HR-QoL) at different stages of multiple myeloma (MM). The bortezomib clinical-trial programme evaluated HR-QoL early and consistently, producing a large multi-study dataset. Baseline data, captured using the European Organization for Research and Treatment of Cancer (EORTC) quality-of-life questionnaire (QLQ-C30), were pooled from six bortezomib randomized trials conducted in different disease-stage categories: 'New' (previously untreated; n = 753), 'Early' (1-3 prior therapies; n = 1569) and 'Late' (≥4 prior therapies; n = 239) disease. Mean EORTC global health scores were similar across the three stages. Unexpectedly, emotional, physical and role functioning were higher in the later stages, indicating better perceived health. Symptom scores, including pain, were largely similar or lower in the later versus earlier stages, signifying a lower symptom burden/better symptom control with more advanced disease. Notable variation in HR-QoL was observed by age and clinical parameters within and across stages. Multivariate modelling indicated that opioid use and performance status were key factors driving overall HR-QoL across stages. Using an age-restricted analysis, transplant eligibility had little impact on HR-QoL in New disease patients. Thus, changes in HR-QoL over the treatment course of MM are complex and impacted by baseline factors. A prospective observational international inception cohort study that captures key clinical, HR-QoL and demographic characteristics, along with safety and supportive care information, is needed.
Asunto(s)
Mieloma Múltiple , Calidad de Vida , Adulto , Anciano , Anciano de 80 o más Años , Estudios Transversales , Femenino , Estado de Salud , Humanos , Masculino , Persona de Mediana Edad , Mieloma Múltiple/diagnóstico , Mieloma Múltiple/psicología , Mieloma Múltiple/terapia , Calidad de Vida/psicología , Índice de Severidad de la Enfermedad , Encuestas y CuestionariosRESUMEN
PURPOSE: Symptoms of schizophrenia fall into three categories (positive, negative and cognitive symptoms), which probably impact differently on patient's health-related quality of life (HRQoL). The present study aimed to explore HRQoL in patients with prominent negative symptoms. METHODS: In the 323 patients with prominent negative symptoms included in a multicenter Phase II trial investigating the safety and efficacy of bitopertin, HRQoL was assessed using the Schizophrenia Quality of Life Scale (SQLS), symptoms severity using the Positive and Negative Syndrome Scale and functioning using the Personal and Social Performance Scale. SQLS measurement properties were assessed; HRQoL was compared between treatment arms, and relationships between HRQoL, symptoms and functioning at baseline were explored. RESULTS: Both SQLS scores (Vitality/Cognition and Psychosocial Feelings) demonstrated good test-retest (ICC = 0.77 and 0.74) and internal consistency reliability (Cronbach's α = 0.86 and 0.93). Clinical validity with regard to schizophrenia severity and ability to detect change in severity of symptoms of schizophrenia were satisfactory. The SQLS structure was not formally disconfirmed. No statistically significant difference was observed between treatment arms. Negative symptoms were more strongly associated with functioning than positive symptoms. Functioning and Anxiety/Depression were strongly related to both SQLS domains. CONCLUSION: Overall, SQLS measurement properties were supported in these patients with prominent negative symptoms of schizophrenia. The impact of negative symptoms on functioning and HRQoL suggests that improving these symptoms will be a meaningful benefit in this population of patients.
Asunto(s)
Estado de Salud , Piperazinas/uso terapéutico , Calidad de Vida/psicología , Esquizofrenia/tratamiento farmacológico , Sulfonas/uso terapéutico , Adulto , Femenino , Humanos , Masculino , Persona de Mediana Edad , Reproducibilidad de los Resultados , Esquizofrenia/diagnóstico , Encuestas y CuestionariosRESUMEN
BACKGROUND: The Schizophrenia Caregiver Questionnaire (SCQ) was developed to assess the impact on caregivers of caring for patients with schizophrenia. The objective of this study was to develop a scoring algorithm for the SCQ, and evaluate its measurement properties. METHODS: The SCQ was administered to 358 caregivers of patients with schizophrenia included in the observational PATTERN study of stabilized patients with persistent symptoms of schizophrenia receiving outpatient care. SCQ item selection and creation of scores were based on exploration of item response distribution, factor analyses, and Rasch model. Construct validity, reliability, and ability to detect change of the SCQ scores were investigated. RESULTS: The final questionnaire comprised a 'Humanistic impact' supra-domain composed of a global score and four subdomain scores ('Physical'; 'Emotional'; 'Social'; 'Daily life'), and eight other domain scores related to the caregiving role ('Exhaustion with caregiving'; 'Feeling alone'; 'Patient Dependence'; 'Worries for the patient'; 'Perception of caregiving'; 'Financial dependence of the patient'; 'Financial impact of caregiving'; 'Overall difficulty of caregiving'). Two items from the SCQ were deleted. SCQ scores showed very good construct validity: Item convergent/discriminant validity were satisfactory; SCQ scores of caregivers of patients with more severe symptoms were higher indicating more impact (p < 0.05 for all scores); SCQ scores were meaningfully associated with measures of schizophrenia severity (PANSS and PSP) and caregivers' Health-Related Quality of Life (Medical Outcome Survey Short Form 36 items). The SCQ Humanistic impact supra-domain scores demonstrated very good internal consistency reliability (Cronbach's alphas between 0.80 and 0.96) and test-retest reliability (Intraclass Coefficient correlations ranging from 0.75 and 0.87); Other SCQ domain scores showed lower but still acceptable reliability coefficients. SCQ scores clearly increased for caregivers of patients whose schizophrenia worsened. CONCLUSIONS: Overall, the 30-item SCQ demonstrated very good measurement properties supporting its relevance to comprehensively measure the experience of caregivers of patients with schizophrenia.
Asunto(s)
Cuidadores/psicología , Esquizofrenia/enfermería , Encuestas y Cuestionarios , Adulto , Análisis Factorial , Femenino , Humanos , Masculino , Modelos Estadísticos , Psicometría , Calidad de Vida , Reproducibilidad de los Resultados , Adulto JovenRESUMEN
BACKGROUND: The Schizophrenia Caregiver Questionnaire (SCQ) was developed to provide a comprehensive view of caregivers' subjective experiences of the impacts of caring for someone with schizophrenia. The Caregiver Global Impression (CaGI) scales were designed to assess their perception of the severity of the schizophrenia symptoms, of change in schizophrenia symptoms and in the experience of caring since the beginning of the study. The objectives of the study were to translate the SCQ and CaGI scales in 11 languages [French (Canada, France), English (Canada, UK, Australia), German (Germany), Italian (Italy), Spanish (Spain), Dutch (the Netherlands), Finnish (Finland), and Swedish (Sweden)], to present evidence that the translations capture the concepts of the original questionnaires and are well understood by caregivers of patients with schizophrenia in each target country. METHODS: The different language versions were developed using a standard or adjusted linguistic validation process fully complying with the International Society for Pharmacoeconomics and Outcomes Research (ISPOR) recommended procedures. RESULTS: Interviews were conducted with 55 caregivers of patients with schizophrenia from 10 countries representing the 11 different languages. Participants ranged in age from 28 to 84 years and had 5 to 16 years of education. Women represented 69.1 % (38/55) of the sample. Fourteen out of the 32 items of the SCQ generated difficulties which were mostly of semantic origin (13 items). The translation of the CaGI scales did not raise any major difficulty. Only five out of the 55 caregivers had difficulty understanding the meaning of the translations of "degree" in the expressions "degree of change in experience of caring" and "degree of change in symptoms". CONCLUSIONS: Translations of the SCQ and CaGI scales into 11 languages adequately captured the concepts in the original English versions of the questionnaires, thereby demonstrating the conceptual, semantic, and cultural equivalence of each translation.
Asunto(s)
Cuidadores/psicología , Comparación Transcultural , Lenguaje , Esquizofrenia/terapia , Encuestas y Cuestionarios/normas , Adulto , Femenino , Estado de Salud , Humanos , Masculino , Persona de Mediana Edad , Calidad de Vida , Psicología del Esquizofrénico , Traducciones , Adulto JovenRESUMEN
PURPOSE: The cross-cultural equivalence of patient-reported outcome (PRO) instruments is critical when they are used in international settings. The Universalist model of equivalence was proposed as a framework to investigate cross-cultural equivalence. The purpose of this paper was to illustrate how quantitative methods can be used to investigate cross-cultural equivalence within this framework. METHODS: The six types of equivalence of the Universalist model were reviewed from a statistical perspective and statistical techniques allowing addressing the underlying question were identified. These methods are described and examples are provided of how they can be applied. An integrated pragmatic approach to the exploration of cross-cultural equivalence was developed based on these methods. RESULTS: The statistical techniques identified were factor analysis to explore conceptual equivalence, differential item functioning to explore semantic and item equivalence, and comparison of measurement properties for the measurement equivalence. The statistical techniques addressing operational equivalence were found to be diverse and highly specific to the operational aspect under investigation. Functional equivalence involves a comprehensive appraisal of the potential impact of the results of the other equivalences on the conclusions of the research. This structured appraisal of functional equivalence offers a framework for a comprehensive, but flexible, approach for the efficient application of statistical analyses to explore cross-cultural equivalence of PRO instruments. CONCLUSION: The different types of equivalence of the Universalist model can be investigated using quantitative methods. An integrated approach, which could be used in a variety of settings, was developed to allow the whole notion of cross-cultural equivalence to be comprehensively and efficiently addressed.
Asunto(s)
Comparación Transcultural , Evaluación del Resultado de la Atención al Paciente , Calidad de Vida , Análisis Factorial , Humanos , Modelos Teóricos , AutoinformeRESUMEN
AIMS: Cultural differences and/or poor linguistic validation of patient-reported outcome (PRO) instruments may result in differences in the assessment of the targeted concept across languages. In the context of multinational clinical trials, these measurement differences may add noise and potentially measurement bias to treatment effect estimation. Our objective was to explore the potential effect on treatment effect estimation of the "contamination" of a cultural subgroup by a flawed PRO measurement. METHODS: We ran a simulation exercise in which the distribution of the score in the overall sample was considered a mixture of two normal distributions: a standard normal distribution was assumed in a "main" subgroup and a normal distribution which differed either in mean (bias) or in variance (noise) in a "contaminated" subgroup (the subgroup with potential flaws in the PRO measurement). The observed power was compared to the expected power (i.e., the power that would have been observed if the subgroup had not been contaminated). RESULTS: Even if differences between the expected and observed power were small, some substantial differences were obtained (up to a 0.375 point drop in power). No situation was systematically protected against loss of power. CONCLUSION: The impact of poor PRO measurement in a cultural subgroup may induce a notable drop in the study power and consequently reduce the chance of showing an actual treatment effect. These results illustrate the importance of the efforts to optimize conceptual and linguistic equivalence of PRO measures when pooling data in international clinical trials.
Asunto(s)
Ensayos Clínicos como Asunto/estadística & datos numéricos , Competencia Cultural , Modelos Estadísticos , Evaluación del Resultado de la Atención al Paciente , Autoinforme , Humanos , Lenguaje , Calidad de VidaRESUMEN
PURPOSE: New patient reported outcome (PRO) measures are regularly developed to assess various aspects of the patients' perspective on their disease and treatment. For these instruments to be useful in clinical research, they must undergo a proper psychometric validation, including demonstration of cross-sectional and longitudinal measurement properties. This quantitative evaluation requires a study to be conducted on an appropriate sample size. The aim of this research was to list and describe practices in PRO and proxy PRO primary psychometric validation studies, focusing primarily on the practices used to determine sample size. METHODS: A literature review of articles published in PubMed between January 2009 and September 2011 was conducted. Three selection criteria were applied including a search strategy, an article selection strategy, and data extraction. Agreements between authors were assessed, and practices of validation were described. RESULTS: Data were extracted from 114 relevant articles. Within these, sample size determination was low (9.6%, 11/114), and were reported as either an arbitrary minimum sample size (n = 2), a subject to item ratio (n = 4), or the method was not explicitly stated (n = 5). Very few articles (4%, 5/114) compared a posteriori their sample size to a subject to item ratio. Content validity, construct validity, criterion validity and internal consistency were the most frequently measurement properties assessed in the validation studies. Approximately 92% of the articles reported a subject to item ratio greater than or equal to 2, whereas 25% had a ratio greater than or equal to 20. About 90% of articles had a sample size greater than or equal to 100, whereas 7% had a sample size greater than or equal to 1000. CONCLUSIONS: The sample size determination for psychometric validation studies is rarely ever justified a priori. This emphasizes the lack of clear scientifically sound recommendations on this topic. Existing methods to determine the sample size needed to assess the various measurement properties of interest should be made more easily available.
Asunto(s)
Evaluación del Resultado de la Atención al Paciente , Psicometría , Calidad de Vida , Tamaño de la Muestra , Estudios Transversales , Humanos , Reproducibilidad de los Resultados , Estudios de Validación como AsuntoRESUMEN
OBJECTIVE: An international panel of pain specialists (anesthesiology, neurology, neurosurgery, and psychology) and research methodologists developed a screening tool to identify patients who may be suitable for spinal cord stimulation (SCS)--the Refractory Chronic Pain Screening Tool (RCPST) prototype. We describe a feasibility study to explore practicality and validity of this prototype. DESIGN: Consecutive outpatients were screened in two centers (United Kingdom and United States). Sixty chronic pain adults without satisfactory pain relief despite treatment were assessed using RCPST (by pain specialist without expertise in neurostimulation) and then evaluated by two pain specialists experienced in SCS implantation and management to determine whether the patient should be referred for SCS. To maintain blinding, the participating physicians did not inform each other or the patient of assessment outcome. Sensitivity and specificity of the RCPST prototype were calculated using implanters' judgment as "gold standard." RESULTS: The average age of patients was 47.7 years; 53% were female. Fifty-seven patients completed the study (one withdrew consent, two lost to follow-up). The pain specialists agreed the prototype was easy to use and took <10 minutes to complete. Implanter agreement was moderate (Kappa: 0.63, 95% confidence interval: 0.35-0.91). The prototype had low sensitivity (40%, 19-61%) and moderate specificity (78%, 65-92%). Using the same questionnaire with a modified decision algorithm, new prototypes were generated with range of high sensitivity (80-100%) and specificity (89-97%) values. CONCLUSIONS: The RCPST aims to identify patients that should be referred for consideration for neurostimulation. The final implant decision requires appropriate neurological diagnostic workup, psychological assessment, and trial stimulation. RCPST was considered practical for routine clinical practice and contained appropriate questions. Sensitivity needs to be improved. A future study should select and validate the ideal RCPST prototype.
Asunto(s)
Algoritmos , Dolor Intratable/diagnóstico , Estimulación de la Médula Espinal , Encuestas y Cuestionarios , Estudios de Factibilidad , Femenino , Humanos , Masculino , Persona de Mediana Edad , Sensibilidad y EspecificidadRESUMEN
Objectives: The objective of this research was to generate psychometric evidence supporting the myasthenia gravis (MG) symptoms patient-reported outcome (PRO) scales as a fit-for-purpose measure of severity of core symptoms of MG and provide information allowing their meaningful interpretation using data from a phase 3 study in MG. Methods: Data from the MycarinG study, a phase 3 study of rozanolixizumab in patients with generalized MG who experience moderate to severe symptoms (ClinicalTrials.gov Identifier: NCT03971422) were analyzed with both classical test theory (CTT) and Rasch measurement theory (RMT). Meaningful within-individual change and group-level meaningful change were estimated for three MG Symptoms PRO scales using anchor- and distribution-based methods. Anchor-based methods used patient global impression of severity (PGIS) and change (PGIC) in MG symptoms as anchors. Results: Good measurement properties of the MG Symptoms PRO scales were shown in the sample of 200 participants: good to excellent reliability (test-retest and internal consistency reliability) and validity (associations between items and scores within the MG Symptoms PRO scales and between the MG Symptoms PRO scores and other clinical outcomes-MG ADL, QMG score, MGC score, and MGFA classes-were as expected); and the items showed good coverage of the continuum and fit to the Rasch model. Triangulation of the anchor- and distribution-based method results led to the definition of clinically meaningful within-patient improvement in scores for Muscle Weakness Fatigability (-16.67), Physical Fatigue (-20.00), and Bulbar Muscle Weakness (-20.00), with associated ranges. Benchmarks are also proposed for the interpretation of group-level results. Conclusion: The strong psychometric performance of the MG Symptoms PRO scales and the information generated to guide its interpretation supports its use in clinical trials for demonstrating the clinical benefits of new treatments targeting core symptoms of MG (muscle weakness fatigability, physical fatigue, bulbar muscle weakness, respiratory muscle weakness, and ocular muscle weakness).
RESUMEN
BACKGROUND: No specific measures exist to assess patient-reported symptoms experienced by individuals with chronic lymphocytic leukemia (CLL)/small lymphocytic lymphoma (SLL) or mantle cell lymphoma (MCL). This study was conducted to elicit patient-reported CLL/SLL- and MCL-related symptoms and their impact on patients' lives. The study qualitatively and quantitatively evaluated sets of conceptually-selected EORTC Item Library items for assessing CLL/SLL- and MCL-related symptoms. METHODS: The qualitative component of the research included a literature review, clinician consultations, and patient interviews. Concepts important to patients were identified and coded; cognitive debriefing of the selected library items was completed with patients. CLL/SLL and MCL-related symptoms and impacts were organized in a structured conceptual model, which was mapped to item sets from the Item Library. The quantitative component comprised exploratory macro-level Rasch measurement theory (RMT) analysis conducted to provide supportive quantitative insight on the item sets. RESULTS: 41 patients (21-MCL; 20-CLL/SLL) and 5 clinicians participated in the qualitative study; 57 unique patients (30-MCL; 27-CLL/SLL) completed the EORTC items. The conceptual models generated from the qualitative work included symptoms and functional impacts of CLL/SLL and MCL. Symptom domains included swollen lymph nodes, B symptoms, abdominal issues, pain, fatigue, subjective cognitive impairment, anemia-related symptoms, bleeding, infection, and other issues (appetite loss, temperature fluctuation, rash, weight gain, sleep problems, cough). Impacts included physical function, role function, and other functions (psychological, social). Cognitive debriefing demonstrated that the separate item sets for CLL/SLL and MCL-related symptoms were well understood and aligned with patients' experiences. All selected items were included in the conceptual models. The exploratory RMT analysis showed that the item sets provided adequate coverage of the continuum of CLL/SLL- and MCL-related symptom severity. CONCLUSIONS: This study gathered qualitative and early quantitative evidence supporting use of the EORTC Item Library to assess CLL/SLL- and MCL-related symptoms and impacts. These items are promising candidates for measurement of patient-reported disease symptoms in these populations. A larger sample size will be essential to establish the psychometric properties necessary to support use in clinical trials. Patients who suffer from rare cancers of the blood, bone marrow, and lymph nodes can experience chronic and debilitating symptoms. At present, however, there are no dedicated instruments for assessing the patient's experience of symptoms of conditions like chronic lymphocytic leukemia (CLL)/small lymphocytic lymphoma (SLL) or mantle cell lymphoma (MCL), or for assessing their impact on patients' lives. This research project aimed to address that need. The researchers selected relevant and clinically meaningful symptoms from the EORTC Item Library that assess fatigue, B symptoms, and CLL/SLL- and MCL-specific symptoms. Using patients and clinician interviews as well as quantitative analyses, the research revealed no major concerns with using these item sets to assess symptoms of CLL/SLL and MCL. Interviews with patients demonstrated that the separate item sets for CLL/SLL and MCL-related symptoms were well understood and aligned with patients' experiences. All selected items were included in the conceptual models. Item sets identified in this study can potentially be used to assess patient-reported symptom endpoints in clinical trial settings in these disease areas.
Asunto(s)
Leucemia Linfocítica Crónica de Células B , Linfadenopatía , Linfoma de Células del Manto , Humanos , Adulto , Leucemia Linfocítica Crónica de Células B/diagnóstico , Linfoma de Células del Manto/diagnóstico , Fatiga/diagnóstico , Medición de Resultados Informados por el PacienteRESUMEN
Patient-reported outcomes (PROs) are increasingly used in healthcare research to provide evidence of the benefits and risks of interventions from the patient perspective and to inform regulatory decisions and health policy. The use of PROs in clinical practice can facilitate symptom monitoring, tailor care to individual needs, aid clinical decision-making and inform value-based healthcare initiatives. Despite their benefits, there are concerns that the potential burden on respondents may reduce their willingness to complete PROs, with potential impact on the completeness and quality of the data for decision-making. We therefore conducted an initial literature review to generate a list of candidate recommendations aimed at reducing respondent burden. This was followed by a two-stage Delphi survey by an international multi-stakeholder group. A consensus meeting was held to finalize the recommendations. The final consensus statement includes 19 recommendations to address PRO respondent burden in healthcare research and clinical practice. If implemented, these recommendations may reduce PRO respondent burden.
Asunto(s)
Evaluación del Resultado de la Atención al Paciente , Medición de Resultados Informados por el Paciente , Humanos , Consenso , Toma de Decisiones ClínicasRESUMEN
BACKGROUND: Bronchiolitis is a distressing respiratory condition and the most common cause of hospitalization during the first year of life. The hospitalization of an infant is a stressful event for parents and deserves careful consideration. The objective of this work was to develop and validate a self-administered instrument that comprehensively assesses the impact on parents of the hospitalization of their infant for bronchiolitis. METHODS: The Impact of Bronchiolitis Hospitalization Questionnaire (IBHQ©) was developed using a literature review and pre-study interviews with both parents and clinicians. For finalization and psychometric validation, it was included in a multicenter, longitudinal, observational study conducted in France. Parents of infants under the age of 1 year and hospitalized for bronchiolitis were asked to complete the questionnaire at hospital discharge, and 3 months after. RESULTS: Seven hundred and seven questionnaires were completed by the parents of the 463 eligible infants. After finalization, based on principal component analyses, the IBHQ included 30 core items allowing the calculation of 7 dimension core scores (Worries and distress; Fear for future; Guilt; Impact on daily organization; Physical impact; Impact on behavior with hospitalized infant; Financial impact), as well as 16 optional items, allowing the calculation of 5 optional dimension scores (Disturbed breastfeeding; Physical reaction of hospitalized infant; Impact on feeding; Impact on behavior with other infants; Siblings' reaction). Internal consistency reliability and construct validity of the IBHQ were satisfactory. The highest impact was observed for "Worries and distress", "Fear for future" and "Impact on daily organization" scores. CONCLUSIONS: The IBHQ is a reliable and valid instrument for assessing the multifaceted impact on parents of the hospitalization of their infant for bronchiolitis.