RESUMO
Comparative bioavailability studies often involve multiple groups of subjects for a variety of reasons, such as clinical capacity limitations. This raises questions about the validity of pooling data from these groups in the statistical analysis and whether a group-by-treatment interaction should be evaluated. We investigated the presence or absence of group-by-treatment interactions through both simulation techniques and a meta-study of well-controlled trials. Our findings reveal that the test falsely detects an interaction when no true group-by-treatment interaction exists. Conversely, when a true group-by-treatment interaction does exist, it often goes undetected. In our meta-study, the detected group-by-treatment interactions were observed at approximately the level of the test and, thus, can be considered false positives. Testing for a group-by-treatment interaction is both misleading and uninformative. It often falsely identifies an interaction when none exists and fails to detect a real one. This occurs because the test is performed between subjects in crossover designs, and studies are powered to compare treatments within subjects. This work demonstrates a lack of utility for including a group-by-treatment interaction in the model when assessing single-site comparative bioavailability studies, and the clinical trial study structure is divided into groups.
Assuntos
Projetos de Pesquisa , Humanos , Disponibilidade Biológica , Estudos Cross-OverRESUMO
BACKGROUND: It has been suggested that a relevant proportion of patients do not respond to nonselective beta-blockers (NSBB)s, which raises questions regarding the need for individualized therapy. The existence of potential heterogeneity in the treatment response can be assessed using the variability ratio (VR) of the outcome measurement (in this case, HVPG) between the treated and placebo groups. We conducted a systematic review and meta-analysis of randomized controlled trials to assess the potential heterogeneity in the portal pressure response to NSBBs. METHODS: After a systematic search, we quantified the heterogeneity of treatment response with the VR between the treatment and control groups, with VR > 1 indicating potential heterogeneity. We used a similar approach to compare carvedilol with propranolol and statins with placebo. RESULTS: We identified 18 studies that included 965 patients. A comparison between beta-blockers and placebo showed a pooled VR of 0.99 (95% CI:0.87-1.14), which suggests a homogeneous HVPG response to NSBB at the individual patient level (ie, no evidence to support that some patients responded to beta-blockers and others did not). For the comparison between carvedilol and propranolol, pooled VR was 0.97 (95% CI 0.82-1.14), suggesting that carvedilol achieves a greater average response (rather than an increase in the proportion of responders). There was no evidence of a heterogeneous response to statins. CONCLUSION: Our analysis did not support the existence of a heterogeneous patient-by-patient response to NSBBs in cirrhosis. These findings challenge the concept of personalized therapy based on portal pressure response and indicate that routine portal pressure measurement may not be necessary to guide NSBB therapy.
Assuntos
Inibidores de Hidroximetilglutaril-CoA Redutases , Hipertensão Portal , Humanos , Propranolol/uso terapêutico , Carvedilol/uso terapêutico , Inibidores de Hidroximetilglutaril-CoA Redutases/uso terapêutico , Antagonistas Adrenérgicos beta/uso terapêutico , Hipertensão Portal/tratamento farmacológicoRESUMO
Importance: ApTOLL is a TLR4 antagonist with proven preclinical neuroprotective effect and a safe profile in healthy volunteers. Objective: To assess the safety and efficacy of ApTOLL in combination with endovascular treatment (EVT) for patients with ischemic stroke. Design, Setting, and Participants: This phase 1b/2a, double-blind, randomized, placebo-controlled study was conducted at 15 sites in Spain and France from 2020 to 2022. Participants included patients aged 18 to 90 years who had ischemic stroke due to large vessel occlusion and were seen within 6 hours after stroke onset; other criteria were an Alberta Stroke Program Early CT Score of 6 to 10, estimated infarct core volume on baseline computed tomography perfusion of 5 to 70 mL, and the intention to undergo EVT. During the study period, 4174 patients underwent EVT. Interventions: In phase 1b, 0.025, 0.05, 0.1, or 0.2 mg/kg of ApTOLL or placebo; in phase 2a, 0.05 or 0.2 mg/kg of ApTOLL or placebo; and in both phases, treatment with EVT and intravenous thrombolysis if indicated. Main Outcomes and Measures: The primary end point was the safety of ApTOLL based on death, symptomatic intracranial hemorrhage (sICH), malignant stroke, and recurrent stroke. Secondary efficacy end points included final infarct volume (via MRI at 72 hours), NIHSS score at 72 hours, and disability at 90 days (modified Rankin Scale [mRS] score). Results: In phase Ib, 32 patients were allocated evenly to the 4 dose groups. After phase 1b was completed with no safety concerns, 2 doses were selected for phase 2a; these 119 patients were randomized to receive ApTOLL, 0.05 mg/kg (n = 36); ApTOLL, 0.2 mg/kg (n = 36), or placebo (n = 47) in a 1:1:â2 ratio. The pooled population of 139 patients had a mean (SD) age of 70 (12) years, 81 patients (58%) were male, and 58 (42%) were female. The primary end point occurred in 16 of 55 patients (29%) receiving placebo (10 deaths [18.2%], 4 sICH [7.3%], 4 malignant strokes [7.3%], and 2 recurrent strokes [3.6%]); in 15 of 42 patients (36%) receiving ApTOLL, 0.05 mg/kg (11 deaths [26.2%], 3 sICH [7.2%], 2 malignant strokes [4.8%], and 2 recurrent strokes [4.8%]); and in 6 of 42 patients (14%) receiving ApTOLL, 0.2 mg/kg (2 deaths [4.8%], 2 sICH [4.8%], and 3 recurrent strokes [7.1%]). ApTOLL, 0.2 mg/kg, was associated with lower NIHSS score at 72 hours (mean difference log-transformed vs placebo, -45%; 95% CI, -67% to -10%), smaller final infarct volume (mean difference log-transformed vs placebo, -42%; 95% CI, -66% to 1%), and lower degrees of disability at 90 days (common odds ratio for a better outcome vs placebo, 2.44; 95% CI, 1.76 to 5.00). Conclusions and Relevance: In acute ischemic stroke, 0.2 mg/kg of ApTOLL administered within 6 hours of onset in combination with EVT was safe and associated with a potential meaningful clinical effect, reducing mortality and disability at 90 days compared with placebo. These preliminary findings await confirmation from larger pivotal trials. Trial Registration: ClinicalTrials.gov Identifier: NCT04734548.
Assuntos
Isquemia Encefálica , Procedimentos Endovasculares , AVC Isquêmico , Acidente Vascular Cerebral , Humanos , Masculino , Feminino , AVC Isquêmico/diagnóstico por imagem , AVC Isquêmico/tratamento farmacológico , AVC Isquêmico/cirurgia , Isquemia Encefálica/diagnóstico por imagem , Isquemia Encefálica/tratamento farmacológico , Isquemia Encefálica/complicações , Resultado do Tratamento , Acidente Vascular Cerebral/diagnóstico por imagem , Acidente Vascular Cerebral/tratamento farmacológico , Infarto Cerebral/complicações , Hemorragias Intracranianas/etiologia , Trombectomia/métodos , Procedimentos Endovasculares/métodosRESUMO
In the reperfusion era, a new paradigm of treating patients with endovascular treatment (EVT) and neuroprotective drugs is emerging as a promising therapeutic option for patients with acute ischemic stroke (AIS). In this context, ApTOLL, a Toll-like receptor 4 (TLR4) antagonist with proven neuroprotective effect in preclinical models of stroke and a very good pharmacokinetic and safety profile in healthy volunteers, is a promising first-in-class aptamer with the potential to address this huge unmet need. This protocol establishes the clinical trial procedures to conduct a Phase Ib/IIa clinical study (APRIL) to assess ApTOLL tolerability, safety, pharmacokinetics, and biological effect in patients with AIS who are eligible for EVT. This will be a multicenter, double-blind, randomized, placebo-controlled, Phase Ib/IIa clinical study to evaluate the administration of ApTOLL together with EVT in patients with AIS. The study population will be composed of men and non-pregnant women with confirmed AIS with a <6h window from symptoms onset to ApTOLL/placebo administration. The trial is currently being conducted and is divided into two parts: Phase Ib and Phase IIa. In Phase Ib, 32 patients will be allocated to four dose ascending levels to select, based on safety criteria, the best two doses to be administered in the following Phase IIa in which 119 patients will be randomized to three arms of treatment (dose A, dose B, and placebo). Identification of the trial: EudraCT: 2020-002059-38 and ClinicalTrials.gov Identifier: NCT04734548 https://clinicaltrials.gov/ct2/show/NCT04734548?term=ApTOLL&cond=Stroke&draw=2&rank=1.
RESUMO
Importance: In nonurban areas with limited access to thrombectomy-capable centers, optimal prehospital transport strategies in patients with suspected large-vessel occlusion stroke are unknown. Objective: To determine whether, in nonurban areas, direct transport to a thrombectomy-capable center is beneficial compared with transport to the closest local stroke center. Design, Setting, and Participants: Multicenter, population-based, cluster-randomized trial including 1401 patients with suspected acute large-vessel occlusion stroke attended by emergency medical services in areas where the closest local stroke center was not capable of performing thrombectomy in Catalonia, Spain, between March 2017 and June 2020. The date of final follow-up was September 2020. Interventions: Transportation to a thrombectomy-capable center (n = 688) or the closest local stroke center (n = 713). Main Outcomes and Measures: The primary outcome was disability at 90 days based on the modified Rankin Scale (mRS; scores range from 0 [no symptoms] to 6 [death]) in the target population of patients with ischemic stroke. There were 11 secondary outcomes, including rate of intravenous tissue plasminogen activator administration and thrombectomy in the target population and 90-day mortality in the safety population of all randomized patients. Results: Enrollment was halted for futility following a second interim analysis. The 1401 enrolled patients were included in the safety analysis, of whom 1369 (98%) consented to participate and were included in the as-randomized analysis (56% men; median age, 75 [IQR, 65-83] years; median National Institutes of Health Stroke Scale score, 17 [IQR, 11-21]); 949 (69%) comprised the target ischemic stroke population included in the primary analysis. For the primary outcome in the target population, median mRS score was 3 (IQR, 2-5) vs 3 (IQR, 2-5) (adjusted common odds ratio [OR], 1.03; 95% CI, 0.82-1.29). Of 11 reported secondary outcomes, 8 showed no significant difference. Compared with patients first transported to local stroke centers, patients directly transported to thrombectomy-capable centers had significantly lower odds of receiving intravenous tissue plasminogen activator (in the target population, 229/482 [47.5%] vs 282/467 [60.4%]; OR, 0.59; 95% CI, 0.45-0.76) and significantly higher odds of receiving thrombectomy (in the target population, 235/482 [48.8%] vs 184/467 [39.4%]; OR, 1.46; 95% CI, 1.13-1.89). Mortality at 90 days in the safety population was not significantly different between groups (188/688 [27.3%] vs 194/713 [27.2%]; adjusted hazard ratio, 0.97; 95% CI, 0.79-1.18). Conclusions and Relevance: In nonurban areas in Catalonia, Spain, there was no significant difference in 90-day neurological outcomes between transportation to a local stroke center vs a thrombectomy-capable referral center in patients with suspected large-vessel occlusion stroke. These findings require replication in other settings. Trial Registration: ClinicalTrials.gov Identifier: NCT02795962.
Assuntos
Arteriopatias Oclusivas , Procedimentos Endovasculares , AVC Isquêmico , Trombectomia , Ativador de Plasminogênio Tecidual , Idoso , Idoso de 80 Anos ou mais , Arteriopatias Oclusivas/complicações , Arteriopatias Oclusivas/tratamento farmacológico , Arteriopatias Oclusivas/cirurgia , Isquemia Encefálica/tratamento farmacológico , Isquemia Encefálica/etiologia , Isquemia Encefálica/cirurgia , Feminino , Instalações de Saúde , Humanos , AVC Isquêmico/tratamento farmacológico , AVC Isquêmico/etiologia , AVC Isquêmico/cirurgia , Masculino , Espanha , Acidente Vascular Cerebral/tratamento farmacológico , Acidente Vascular Cerebral/etiologia , Acidente Vascular Cerebral/cirurgia , Trombectomia/efeitos adversos , Ativador de Plasminogênio Tecidual/administração & dosagem , Ativador de Plasminogênio Tecidual/efeitos adversos , Resultado do Tratamento , População UrbanaRESUMO
Bioequivalence studies are the pivotal clinical trials submitted to regulatory agencies to support the marketing applications of generic drug products. Average bioequivalence (ABE) is used to determine whether the mean values for the pharmacokinetic measures determined after administration of the test and reference products are comparable. Two-stage 2×2 crossover adaptive designs (TSDs) are becoming increasingly popular because they allow making assumptions on the clinically meaningful treatment effect and a reliable guess for the unknown within-subject variability. At an interim look, if ABE is not declared with an initial sample size, they allow to increase it depending on the estimated variability and to enroll additional subjects at a second stage, or to stop for futility in case of poor likelihood of bioequivalence. This is crucial because both parameters must clearly be prespecified in protocols, and the strategy agreed with regulatory agencies in advance with emphasis on controlling the overall type I error. We present an iterative method to adjust the significance levels at each stage which preserves the overall type I error for a wide set of scenarios which should include the true unknown variability value. Simulations showed adjusted significance levels higher than 0.0300 in most cases with type I error always below 5%, and with a power of at least 80%. TSDs work particularly well for coefficients of variation below 0.3 which are especially useful due to the balance between the power and the percentage of studies proceeding to stage 2. Our approach might support discussions with regulatory agencies.
Assuntos
Projetos de Pesquisa , Estudos Cross-Over , Humanos , Tamanho da Amostra , Equivalência TerapêuticaRESUMO
OBJECTIVE: To evaluate the impact of an editorial intervention to improve completeness of reporting of reports of randomised trials. DESIGN: Randomised controlled trial (RCT). SETTING: BMJ Open's quality improvement programme. PARTICIPANTS: 24 manuscripts describing RCTs. INTERVENTIONS: We used an R Shiny application to randomise manuscripts (1:1 allocation ratio, blocks of 4) to the intervention (n=12) or control (n=12) group. The intervention was performed by a researcher with expertise in the content of the Consolidated Standards of Reporting Trials (CONSORT) and consisted of an evaluation of completeness of reporting of eight core CONSORT items using the submitted checklist to locate information, and the production of a report containing specific requests for authors based on the reporting issues found, provided alongside the peer review reports. The control group underwent the usual peer review. OUTCOMES: The primary outcome is the number of adequately reported items (0-8 scale) in the revised manuscript after the first round of peer review. The main analysis was intention-to-treat (n=24), and we imputed the scores of lost to follow-up manuscripts (rejected after peer review and not resubmitted). The secondary outcome is the proportion of manuscripts where each item was adequately reported. Two blinded reviewers assessed the outcomes independently and in duplicate and solved disagreements by consensus. We also recorded the amount of time to perform the intervention. RESULTS: Manuscripts in the intervention group (mean: 7.01; SD: 1.47) were more completely reported than those in the control group (mean: 5.68; SD: 1.43) (mean difference 1.43, 95% CI 0.31 to 2.58). We observed the main differences in items 6a (outcomes), 9 (allocation concealment mechanism), 11a (blinding) and 17a (outcomes and estimation). The mean time to perform the intervention was 87 (SD 42) min. CONCLUSIONS: We demonstrated the benefit of involving a reporting guideline expert in the editorial process. Improving the completeness of RCTs is essential to enhance their usability. TRIAL REGISTRATION NUMBER: NCT03751878.
Assuntos
Lista de Checagem , Relatório de Pesquisa , Consenso , Humanos , Revisão por Pares , Melhoria de QualidadeRESUMO
Background: Improving the completeness of reporting of biomedical research is essential for improving its usability. For this reason, hundreds of reporting guidelines have been created in the last few decades but adherence to these remains suboptimal. This survey aims to inform future evaluations of interventions to improve adherence to reporting guidelines. In particular, it gathers editors' perceptions of a range of interventions at various stages in the editorial process. Methods: We surveyed biomedical journal editors that were knowledgeable about this topic. The questionnaire included open and closed questions that explored (i) the current practice of their journals, (ii) their perceptions of the ease of implementation and the potential effectiveness of different interventions, (iii) the barriers and facilitators associated with these interventions, and (iv) suggestions for future interventions and incentives. Results: Of the 99 editors invited, 24 (24%) completed the survey. Involving trained editors or administrative staff was deemed the potentially most effective intervention but, at the same time, it was considered moderately difficult to implement due to logistic and resource issues. Participants believed that checking adherence to guidelines goes beyond the role of peer reviewers and could decrease the overall quality of reviews. Journals incentivising adherence, and publishers and medical institutions encouraging journals to adopt strategies to boost adherence were two recurrent themes. Conclusions: Further evaluation of interventions are required. These evaluations could take into account the points raised in this survey.
Assuntos
Inquéritos e Questionários , Pesquisa Biomédica , Políticas Editoriais , Humanos , MotivaçãoRESUMO
BACKGROUND: From 2005 to 2010, we conducted 2 randomized studies on a journal (Medicina Clínica), where we took manuscripts received for publication and randomly assigned them to either the standard editorial process or to additional processes. Both studies were based on the use of methodological reviewers and reporting guidelines (RG). Those interventions slightly improved the items reported on the Manuscript Quality Assessment Instrument (MQAI), which assesses the quality of the research report. However, masked evaluators were able to guess the allocated group in 62% (56/90) of the papers, thus presenting a risk of detection bias. In this post-hoc study, we analyse whether those interventions that were originally designed for improving the completeness of manuscript reporting may have had an effect on the number of citations, which is the measured outcome that we used. METHODS: Masked to the intervention group, one of us used the Web of Science (WoS) to quantify the number of citations that the participating manuscripts received up December 2016. We calculated the mean citation ratio between intervention arms and then quantified the uncertainty of it by means of the Jackknife method, which avoids assumptions about the distribution shape. RESULTS: Our study included 191 articles (99 and 92, respectively) from the two previous studies, which all together received 1336 citations. In both studies, the groups subjected to additional processes showed higher averages, standard deviations and annual rates. The intervention effect was similar in both studies, with a combined estimate of a 43% (95% CI: 3 to 98%) increase in the number of citations. CONCLUSIONS: We interpret that those effects are driven mainly by introducing into the editorial process a senior methodologist to find missing RG items. Those results are promising, but not definitive due to the exploratory nature of the study and some important caveats such as: the limitations of using the number of citations as a measure of scientific impact; and the fact that our study is based on a single journal. We invite journals to perform their own studies to ascertain whether or not scientific repercussion is increased by adhering to reporting guidelines and further involving statisticians in the editorial process.
Assuntos
Fidelidade a Diretrizes/estatística & dados numéricos , Fator de Impacto de Revistas , Revisão por Pares/normas , Editoração/normas , Políticas Editoriais , HumanosRESUMO
BACKGROUND: Although peer reviewers play a key role in the manuscript review process, their roles and tasks are poorly defined. Clarity around this issue is important as it may influence the quality of peer reviewer reports. This scoping review explored the roles and tasks of peer reviewers of biomedical journals. METHODS: Comprehensive literature searches were conducted in Cochrane Library, Cumulative Index to Nursing and Allied Health Literature, Educational Resources Information Center, EMBASE, MEDLINE, PsycINFO, Scopus and Web of Science from inception up to May 2017. There were no date and language restrictions. We also searched for grey literature. Studies with statements mentioning roles, tasks and competencies pertaining to the role of peer reviewers in biomedical journals were eligible for inclusion. Two reviewers independently performed study screening and selection. Relevant statements were extracted, collated and classified into themes. RESULTS: After screening 2763 citations and 600 full-text papers, 209 articles and 13 grey literature sources were included. A total of 1426 statements related to roles were extracted, resulting in 76 unique statements. These were grouped into 13 emergent themes: proficient experts in their field (3 items), dutiful/altruistic towards scientific community (7 items), familiar with journal (2 items), unbiased and ethical professionals (18 items), self-critical professionals (4 items), reliable professionals (7 items), skilled critics (15 items), respectful communicators (6 items), gatekeepers (2 items), educators (2 items), advocates for author/editor/reader (3 items) and advisors to editors (2 items). Roles that do not fall within the remit of peer reviewers were also identified (5 items). We also extracted 2026 statements related to peer reviewers' tasks, resulting in 73 unique statements. These were grouped under six themes: organisation and approach to reviewing (10 items), make general comments (10 items), assess and address content for each section of the manuscript (36 items), address ethical aspects (5 items), assess manuscript presentation (8 items) and provide recommendations (4 items). CONCLUSIONS: Peer reviewers are expected to perform a large number of roles and tasks for biomedical journals. These warrant further discussion and clarification in order not to overburden these key actors.
Assuntos
Revisão por Pares/métodos , Publicações Periódicas como Assunto/normas , HumanosRESUMO
RATIONALE: Optimal pre-hospital delivery pathways for acute stroke patients suspected to harbor a large vessel occlusion have not been assessed in randomized trials. AIM: To establish whether stroke subjects with rapid arterial occlusion evaluation scale based suspicion of large vessel occlusion evaluated by emergency medical services in the field have higher rates of favorable outcome when transferred directly to an endovascular center (endovascular treatment stroke center), as compared to the standard transfer to the closest local stroke center (local-SC). DESIGN: Multicenter, superiority, cluster randomized within a cohort trial with blinded endpoint assessment. PROCEDURE: Eligible patients must be 18 or older, have acute stroke symptoms and not have an immediate life threatening condition requiring emergent medical intervention. They must be suspected to have intracranial large vessel occlusion based on a pre-hospital rapid arterial occlusion evaluation scale of ≥5, be located in geographical areas where the default health authority assigned referral stroke center is a non-thrombectomy capable hospital, and estimated arrival at a thrombectomy capable stroke hospital in less than 7 h from time last seen well. Cluster randomization is performed according to a pre-established temporal sequence (temporal cluster design) with three strata: day/night, distance to the endovascular treatment stroke center, and week/week-end day. STUDY OUTCOME: The primary endpoint is the modified Rankin Scale score at 90 days. The primary safety outcome is mortality at 90 days. ANALYSIS: The primary endpoint based on the modified intention-to-treat population is the distribution of modified Rankin Scale scores at 90 days analyzed under a sequential triangular design. The maximum sample size is 1754 patients, with two planned interim analyses when 701 (40%) and 1227 patients have completed follow-up. Hypothesized common odds ratio is 1.35.
Assuntos
Transferência de Pacientes/métodos , Projetos de Pesquisa , Acidente Vascular Cerebral/terapia , Tempo para o Tratamento , Procedimentos Endovasculares , Unidades Hospitalares , Humanos , Trombectomia , Terapia TrombolíticaRESUMO
OBJECTIVES: The goal of this study is to identify, analyse and classify interventions to improve adherence to reporting guidelines in order to obtain a wide picture of how the problem of enhancing the completeness of reporting of biomedical literature has been tackled so far. DESIGN: Scoping review. SEARCH STRATEGY: We searched the MEDLINE, EMBASE and Cochrane Library databases and conducted a grey literature search for (1) studies evaluating interventions to improve adherence to reporting guidelines in health research and (2) other types of references describing interventions that have been performed or suggested but never evaluated. The characteristics and effect of the evaluated interventions were analysed. Moreover, we explored the rationale of the interventions identified and determined the existing gaps in research on the evaluation of interventions to improve adherence to reporting guidelines. RESULTS: 109 references containing 31 interventions (11 evaluated) were included. These were grouped into five categories: (1) training on the use of reporting guidelines, (2) improving understanding, (3) encouraging adherence, (4) checking adherence and providing feedback, and (5) involvement of experts. Additionally, we identified lack of evaluated interventions (1) on training on the use of reporting guidelines and improving their understanding, (2) at early stages of research and (3) after the final acceptance of the manuscript. CONCLUSIONS: This scoping review identified a wide range of strategies to improve adherence to reporting guidelines that can be taken by different stakeholders. Additional research is needed to assess the effectiveness of many of these interventions.
Assuntos
Pesquisa Biomédica/normas , Fidelidade a Diretrizes , Relatório de Pesquisa/normas , Humanos , Fator de Impacto de Revistas , Publicações Periódicas como AssuntoRESUMO
BACKGROUND: A strong need exists for a validated tool that clearly defines peer review report quality in biomedical research, as it will allow evaluating interventions aimed at improving the peer review process in well-performed trials. We aim to identify and describe existing tools for assessing the quality of peer review reports in biomedical research. METHODS: We conducted a methodological systematic review by searching PubMed, EMBASE (via Ovid) and The Cochrane Methodology Register (via The Cochrane Library) as well as Google® for all reports in English describing a tool for assessing the quality of a peer review report in biomedical research. Data extraction was performed in duplicate using a standardized data extraction form. We extracted information on the structure, development and validation of each tool. We also identified quality components across tools using a systematic multi-step approach and we investigated quality domain similarities among tools by performing hierarchical, complete-linkage clustering analysis. RESULTS: We identified a total number of 24 tools: 23 scales and 1 checklist. Six tools consisted of a single item and 18 had several items ranging from 4 to 26. None of the tools reported a definition of 'quality'. Only 1 tool described the scale development and 10 provided measures of validity and reliability. Five tools were used as an outcome in a randomized controlled trial (RCT). Moreover, we classified the quality components of the 18 tools with more than one item into 9 main quality domains and 11 subdomains. The tools contained from two to seven quality domains. Some domains and subdomains were considered in most tools such as the detailed/thorough (11/18) nature of reviewer's comments. Others were rarely considered, such as whether or not the reviewer made comments on the statistical methods (1/18). CONCLUSION: Several tools are available to assess the quality of peer review reports; however, the development and validation process is questionable and the concepts evaluated by these tools vary widely. The results from this study and from further investigations will inform the development of a new tool for assessing the quality of peer review reports in biomedical research.
Assuntos
Pesquisa Biomédica/normas , Revisão por Pares/normas , Projetos de Pesquisa/normas , Relatório de Pesquisa/normas , Pesquisa Biomédica/métodos , Lista de Checagem , Medicina Baseada em Evidências/métodos , Medicina Baseada em Evidências/normas , Humanos , Avaliação de Resultados em Cuidados de Saúde/métodos , Revisão por Pares/métodos , Ensaios Clínicos Controlados Aleatórios como Assunto/métodos , Ensaios Clínicos Controlados Aleatórios como Assunto/normas , Reprodutibilidade dos TestesRESUMO
BACKGROUND: Evidence regarding whether imaging can be used effectively to select patients for endovascular thrombectomy (EVT) is scarce. We aimed to investigate the association between baseline imaging features and safety and efficacy of EVT in acute ischaemic stroke caused by anterior large-vessel occlusion. METHODS: In this meta-analysis of individual patient-level data, the HERMES collaboration identified in PubMed seven randomised trials in endovascular stroke that compared EVT with standard medical therapy, published between Jan 1, 2010, and Oct 31, 2017. Only trials that required vessel imaging to identify patients with proximal anterior circulation ischaemic stroke and that used predominantly stent retrievers or second-generation neurothrombectomy devices in the EVT group were included. Risk of bias was assessed with the Cochrane handbook methodology. Central investigators, masked to clinical information other than stroke side, categorised baseline imaging features of ischaemic change with the Alberta Stroke Program Early CT Score (ASPECTS) or according to involvement of more than 33% of middle cerebral artery territory, and by thrombus volume, hyperdensity, and collateral status. The primary endpoint was neurological functional disability scored on the modified Rankin Scale (mRS) score at 90 days after randomisation. Safety outcomes included symptomatic intracranial haemorrhage, parenchymal haematoma type 2 within 5 days of randomisation, and mortality within 90 days. For the primary analysis, we used mixed-methods ordinal logistic regression adjusted for age, sex, National Institutes of Health Stroke Scale score at admission, intravenous alteplase, and time from onset to randomisation, and we used interaction terms to test whether imaging categorisation at baseline modifies the association between treatment and outcome. This meta-analysis was prospectively designed by the HERMES executive committee but has not been registered. FINDINGS: Among 1764 pooled patients, 871 were allocated to the EVT group and 893 to the control group. Risk of bias was low except in the THRACE study, which used unblinded assessment of outcomes 90 days after randomisation and MRI predominantly as the primary baseline imaging tool. The overall treatment effect favoured EVT (adjusted common odds ratio [cOR] for a shift towards better outcome on the mRS 2·00, 95% CI 1·69-2·38; p<0·0001). EVT achieved better outcomes at 90 days than standard medical therapy alone across a broad range of baseline imaging categories. Mortality at 90 days (14·7% vs 17·3%, p=0·15), symptomatic intracranial haemorrhage (3·8% vs 3·5%, p=0·90), and parenchymal haematoma type 2 (5·6% vs 4·8%, p=0·52) did not differ between the EVT and control groups. No treatment effect modification by baseline imaging features was noted for mortality at 90 days and parenchymal haematoma type 2. Among patients with ASPECTS 0-4, symptomatic intracranial haemorrhage was seen in ten (19%) of 52 patients in the EVT group versus three (5%) of 66 patients in the control group (adjusted cOR 3·94, 95% CI 0·94-16·49; pinteraction=0·025), and among patients with more than 33% involvement of middle cerebral artery territory, symptomatic intracranial haemorrhage was observed in 15 (14%) of 108 patients in the EVT group versus four (4%) of 113 patients in the control group (4·17, 1·30-13·44, pinteraction=0·012). INTERPRETATION: EVT achieves better outcomes at 90 days than standard medical therapy across a broad range of baseline imaging categories, including infarcts affecting more than 33% of middle cerebral artery territory or ASPECTS less than 6, although in these patients the risk of symptomatic intracranial haemorrhage was higher in the EVT group than the control group. This analysis provides preliminary evidence for potential use of EVT in patients with large infarcts at baseline. FUNDING: Medtronic.
Assuntos
Isquemia Encefálica , Procedimentos Endovasculares/estatística & dados numéricos , Avaliação de Resultados em Cuidados de Saúde/estatística & dados numéricos , Acidente Vascular Cerebral , Trombectomia/estatística & dados numéricos , Terapia Trombolítica/estatística & dados numéricos , Idoso , Isquemia Encefálica/diagnóstico por imagem , Isquemia Encefálica/patologia , Isquemia Encefálica/terapia , Procedimentos Endovasculares/efeitos adversos , Feminino , Humanos , Masculino , Pessoa de Meia-Idade , Acidente Vascular Cerebral/diagnóstico por imagem , Acidente Vascular Cerebral/patologia , Acidente Vascular Cerebral/terapia , Trombectomia/efeitos adversos , Terapia Trombolítica/efeitos adversosRESUMO
BACKGROUND: Compulsory submission of a checklist from the relevant reporting guideline is one of the most widespread journal requirements aiming to improve completeness of reporting. However, the current suboptimal levels of adherence to reporting guidelines observed in the literature may indicate that this journal policy is not having a significant effect. FINDINGS: We explored whether authors provided the appropriate CONSORT checklist extension for their study and whether there were inconsistencies between what authors claimed on the submitted checklist and what was actually reported in the published paper. We randomly selected 12 randomized trials from three journals that provide the originally submitted checklist and analyzed six core CONSORT items. Only one paper used the appropriate checklist extension and had no inconsistencies between what was claimed in the submitted checklist and what was reported in the published paper. CONCLUSION: Journals should take further actions to take full advantage of the requirement for the submission of fulfilled CONSORT checklists, thus ensuring that these checklists reflect what is reported in the manuscript.
Assuntos
Autoria/normas , Lista de Checagem/normas , Políticas Editoriais , Fidelidade a Diretrizes/normas , Guias como Assunto/normas , Publicações Periódicas como Assunto/normas , Ensaios Clínicos Controlados Aleatórios como Assunto/normas , Confiabilidade dos Dados , HumanosRESUMO
Background: Precision medicine is the Holy Grail of interventions that are tailored to a patient's individual characteristics. However, conventional clinical trials are designed to find differences in averages, and interpreting these differences depends on untestable assumptions. Although only an ideal, a constant effect of treatment would facilitate individual management. A direct consequence of a constant effect is that the variance of the outcome measure would be the same in the treated and control arms. We reviewed the literature to explore the similarity of these variances as a foundation for examining whether and how often precision medicine is definitively required. Methods: We reviewed parallel clinical trials with numerical primary endpoints published in 2004, 2007, 2010 and 2013. We collected the baseline and final standard deviations of the main outcome measure. We assessed homoscedasticity by comparing the variance of the primary endpoint between arms through the outcome variance ratio (treated to control group). Results: The review provided 208 articles with enough information to conduct the analysis. One out of five studies (n = 40, 19.2%) had statistically different variances between groups, implying a non-constant-effect. The adjusted point estimate of the mean outcome variance ratio (treated to control group) is 0.89 (95% CI 0.81 to 0.97). Conclusions: The mean variance ratio is significantly lower than 1 and the lower variance was found more often in the intervention group than in the control group, suggesting it is more usual for treated patients to be stable. This observed reduction in variance might also imply that there could be a subgroup of less ill patients who derive no benefit from treatment. This would require further study as to whether the treatment effect outweighs the side effects as well as the economic costs. We have shown that there are ways to analyze the apparently unobservable constant effect.
Assuntos
Motivação , Medicina de Precisão , HumanosRESUMO
INTRODUCTION: There is evidence that the use of some reporting guidelines, such as the Consolidated Standards for Reporting Trials, is associated with improved completeness of reporting in health research. However, the current levels of adherence to reporting guidelines are suboptimal. Over the last few years, several actions aiming to improve compliance with reporting guidelines have been taken and proposed. We will conduct a scoping review of interventions to improve adherence to reporting guidelines in health research that have been evaluated or suggested, in order to inform future interventions. METHODS AND ANALYSIS: Our review will follow the Joanna Briggs Institute scoping review methods manual. We will search for relevant studies in MEDLINE, EMBASE and Cochrane Library databases. Moreover, we will carry out lateral searches from the reference lists of the included studies, as well as from the lists of articles citing the included ones. One reviewer will screen the full list, which will be randomly split into two halves and independently screened by the other two reviewers. Two reviewers will perform data extraction independently. Discrepancies will be solved through discussion. In addition, this search strategy will be supplemented by a grey literature search. The interventions found will be classified as assessed or suggested, as well as according to different criteria, in relation to their target (journal policies, journal editors, authors, reviewers, funders, ethical boards or others) or the research stage at which they are performed (design, conducting, reporting or peer review). Descriptive statistical analysis will be performed. ETHICS AND DISSEMINATION: A paper summarising the findings from this review will be published in a peer-reviewed journal. This scoping review will contribute to a better understanding and a broader perspective on how the problem of adhering better to reporting guidelines has been tackled so far. This could be a major first step towards developing future strategies to improve compliance with reporting guidelines in health research.
Assuntos
Pesquisa Biomédica/normas , Fidelidade a Diretrizes , Relatório de Pesquisa/normas , Humanos , Fator de Impacto de Revistas , Publicações Periódicas como Assunto , Projetos de PesquisaRESUMO
OBJECTIVES: To analyse the total number of newspaper articles citing the four leading general medical journals and to describe national citation patterns. DESIGN: Quantitative content analysis. SETTING/SAMPLE: Full text of 22 general newspapers in 14 countries over the period 2008-2015, collected from LexisNexis. The 14 countries have been categorised into four regions: the USA, the UK, Western World (European countries other than the UK, and Australia, New Zealand and Canada) and Rest of the World (other countries). MAIN OUTCOME MEASURE: Press citations of four medical journals (two American: NEJM and JAMA; and two British: The Lancet and The BMJ) in 22 newspapers. RESULTS: British and American newspapers cited some of the four analysed medical journals about three times a week in 2008-2015 (weekly mean 3.2 and 2.7 citations, respectively); the newspapers from other Western countries did so about once a week (weekly mean 1.1), and those from the Rest of the World cited them about once a month (monthly mean 1.1). The New York Times cited above all other newspapers (weekly mean 4.7). The analysis showed the existence of three national citation patterns in the daily press: American newspapers cited mostly American journals (70.0% of citations), British newspapers cited mostly British journals (86.5%) and the rest of the analysed press cited more British journals than American ones. The Lancet was the most cited journal in the press of almost all Western countries outside the USA and the UK. Multivariate correspondence analysis confirmed the national patterns and showed that over 85% of the citation data variability is retained in just one single new variable: the national dimension. CONCLUSION: British and American newspapers are the ones that cite the four analysed medical journals more often, showing a domestic preference for their respective national journals; non-British and non-American newspapers show a common international citation pattern.