Methodological and Reporting Quality of Noninferiority Randomized Controlled Trials Comparing Antiretroviral Therapies: A Systematic Review.

BACKGROUND: It is unclear whether the reporting quality of antiretroviral (ARV) noninferiority (NI) randomized controlled trials (RCTs) has improved since the CONSORT guideline release in 2006. The primary objective of this systematic review was assessing the methodological and reporting quality of ARV NI-RCTs. We also assessed reporting quality by funding source and publication year. METHODS: We searched Medline, Embase, and Cochrane Central from inception to 14 November 2022. We included NI-RCTs comparing ≥2 ARV regimens used for human immunodeficiency virus treatment or prophylaxis. We used the Cochrane Risk of Bias 2.0 tool to assess risk of bias. Screening and data extraction were performed blinded and in duplicate. Descriptive statistics were used to summarize data; statistical tests were 2 sided, with significance defined as P < .05. The systematic review was prospectively registered (PROSPERO CRD42022328586), and not funded. RESULTS: We included 160 articles reporting 171 trials. Of these articles, 101 (63.1%) did not justify the NI margin used, and 28 (17.5%) did not provide sufficient information for sample size calculation. Eighty-nine of 160 (55.6%) reported both intention-to-treat and per-protocol analyses, while 118 (73.8%) described missing data handling. Ten of 171 trials (5.9%) reported potentially misleading results. Pharmaceutical industry-funded trials were more likely to be double-blinded (28.1% vs 10.3%; P = .03) and to describe missing data handling (78.5% vs 59.0%; P = .02). The overall risk of bias was low in 96 of 160 studies (60.0%). CONCLUSIONS: ARV NI-RCTs should improve NI margin justification, reporting of intention-to-treat and per-protocol analyses, and missing data handling to increase CONSORT adherence.

Secondary Analysis of a Systematic Review: Are Antifungal Noninferiority Trials at Risk of Eroding Effectiveness Because of Biocreep?

Noninferiority randomized controlled trial (RCT) effectiveness may erode when results favor the active control over time and when a decreasingly effective control arm is used in serial trials. We analyzed 32 antifungal noninferiority RCTs (NI-RCTs) for these scenarios in this secondary analysis of a systematic review. Our exploratory analysis suggests that the erosion risk in the effectiveness of antifungal noninferiority trials is uncommon. Findings are limited by small sample size and overall risk of bias.

Methodological and Reporting Quality of Noninferiority Randomized Controlled Trials Comparing Antibiotic Therapies: A Systematic Review.

BACKGROUND: Antibiotic noninferiority randomized controlled trials (RCTs) are used for approval of new antibiotics and making changes to antibiotic prescribing in clinical practice. We conducted a systematic review to assess the methodological and reporting quality of antibiotic noninferiority RCTs. METHODS: We searched MEDLINE, Embase, the Cochrane Database of Systematic Reviews, and the Food and Drug Administration drug database from inception until November 22, 2019, for noninferiority RCTs comparing different systemic antibiotic therapies. Comparisons between antibiotic types, doses, administration routes, or durations were included. Methodological and reporting quality indicators were based on the Consolidated Standards of Reporting Trials reporting guidelines. Two independent reviewers extracted the data. RESULTS: The systematic review included 227 studies. Of these, 135 (59.5%) studies were supported by pharmaceutical industry. Only 83 (36.6%) studies provided a justification for the noninferiority margin. Reporting of both intention-to-treat (ITT) and per-protocol (PP) analyses were done in 165 (72.7%) studies. The conclusion was misleading in 34 (15.0%) studies. The studies funded by pharmaceutical industry were less likely to be stopped early because of logistical reasons (3.0% vs 19.1%; odds ratio [OR] = 0.13; 95% confidence interval [CI], .04-.37) and to show inconclusive results (11.1% vs 42.9%; OR = 0.17; 95% CI, .08-.33). The quality of studies decreased over time with respect to blinding, early stopping, reporting of ITT with PP analysis, and having misleading conclusions. CONCLUSIONS: There is room for improvement in the methodology and reporting of antibiotic noninferiority trials. Quality can be improved across the entire spectrum from investigators, funding agencies, as well as during the peer-review process.There is room for improvement in the methodology and reporting of antibiotic noninferiority trials including justification of noninferiority margin, reporting of intention-to-treat analysis with per-protocol analysis, and having conclusions that are concordant with study results.Clinical Trials Registration PROSPERO registration number CRD42020165040.

Intention-to-treat analysis may be more conservative than per protocol analysis in antibiotic non-inferiority trials: a systematic review.

BACKGROUND: In non-inferiority trials, there is a concern that intention-to-treat (ITT) analysis, by including participants who did not receive the planned interventions, may bias towards making the treatment and control arms look similar and lead to mistaken claims of non-inferiority. In contrast, per protocol (PP) analysis is viewed as less likely to make this mistake and therefore preferable in non-inferiority trials. In a systematic review of antibiotic non-inferiority trials, we compared ITT and PP analyses to determine which analysis was more conservative. METHODS: In a secondary analysis of a systematic review, we included non-inferiority trials that compared different antibiotic regimens, used absolute risk reduction (ARR) as the main outcome and reported both ITT and PP analyses. All estimates and confidence intervals (CIs) were oriented so that a negative ARR favored the control arm, and a positive ARR favored the treatment arm. We compared ITT to PP analyses results. The more conservative analysis between ITT and PP analyses was defined as the one having a more negative lower CI limit. RESULTS: The analysis included 164 comparisons from 154 studies. In terms of the ARR, ITT analysis yielded the more conservative point estimate and lower CI limit in 83 (50.6%) and 92 (56.1%) comparisons respectively. The lower CI limits in ITT analysis favored the control arm more than in PP analysis (median of - 7.5% vs. -6.9%, p = 0.0402). CIs were slightly wider in ITT analyses than in PP analyses (median of 13.3% vs. 12.4%, p < 0.0001). The median success rate was 89% (interquartile range IQR 82 to 93%) in the PP population and 44% (IQR 23 to 60%) in the patients who were included in the ITT population but excluded from the PP population (p < 0.0001). CONCLUSIONS: Contrary to common belief, ITT analysis was more conservative than PP analysis in the majority of antibiotic non-inferiority trials. The lower treatment success rate in the ITT analysis led to a larger variance and wider CI, resulting in a more conservative lower CI limit. ITT analysis should be mandatory and considered as either the primary or co-primary analysis for non-inferiority trials. TRIAL REGISTRATION: PROSPERO registration number CRD42020165040 .

Novel Antibiotics May Be Noninferior but Are They Becoming Less Effective?: a Systematic Review.

Novel antibiotics approved by noninferiority trials may become less effective over time in two scenarios: (i) the treatment effect in studies of novel antibiotics may be consistently worse than studies of older antibiotics; (ii) when a decreasingly effective control arm is used in a series of noninferiority trials. Our systematic review of 175 noninferiority antibiotic trials found these scenarios to be rare.

Verification, Analytical Sensitivity, Cost-effectiveness, and Comparison of 4 Candida auris Screening Methods.

In this verification study, we compare and contrast the performance characteristics of chromogenic agar culture, direct polymerase chain reaction (PCR), and broth enrichment followed by culture or PCR for the detection of Candida auris colonization. We find that culture and PCR both offer excellent performance, with broth enrichment offering little performance advantage given its cost.

Evaluation of the utility and cost of secondary confirmatory testing for Neisseria gonorrhoeae identification from culture.

Current guideline recommends the use of two identification methods for Neisseria gonorrhoeae. Matrix-assisted laser desorption/ionization time-of-flight mass spectrometry (MALDI-TOF) is now used for primary identification and may be sufficient for definitive identification of N. gonorrhoeae. The performance of three secondary tests (BactiCard, RapID NH and NET test) were compared using 45 bacterial isolates, including 37 Neisseria species. These secondary tests demonstrated diminished specificity (67% - 88%) for N. gonorrhoeae compared with MALDI-TOF. Additionally, data from six clinical microbiology laboratories was used to compare confirmatory test costs and the agreement of results with MALDI-TOF. Discrepancies were documented for 9.4% of isolates, though all isolates (n= 288) identified by MALDI-TOF as N. gonorrhoeae were confirmed by the reference laboratory. These data demonstrate that MALDI-TOF alone is sufficient for N. gonorrhoeae identification, as secondary did not add diagnostic value but do add costs to the testing process.

Methodological and reporting quality of non-inferiority randomized controlled trials comparing antifungal therapies: a systematic review.

BACKGROUND: Detailed reporting is essential in non-inferiority randomized controlled trials (NI-RCTs) to assess evidence quality, as these trials inform standards of care. OBJECTIVES: The primary objective was to evaluate the methodological and reporting quality of antifungal NI-RCTs. DATA SOURCES: Medline, EMBASE, the Cochrane CENTRAL and the United States Federal Drug Administration (FDA) drugs database were searched to 9 September 2020. STUDY ELIGIBILITY CRITERIA: NI-RCTs differing by antifungal formulation, type, dose, administration and/or duration were included. Articles were independently assessed in duplicate using quality indicators developed by the Consolidated Standards of Reporting Trials (CONSORT) group. PARTICIPANTS: Patients enrolled in antifungal trials for prophylactic and therapeutic use. METHODS: The Cochrane RoB 2.0 tool was used to assess risk of bias. Descriptive statistics were used; all statistical tests were two sided. RESULTS: Of 32 included studies, 22 (68.7%) did not justify the NIM. Handling of missing data was not described in 20 (62.5%). Intention-to-treat (ITT) and per-protocol (PP) analyses were both reported in 12/32 (37.5%) studies. Eleven of 32 studies (34.3%) reported potentially misleading conclusions. Industry-financed studies were more likely to report only the ITT analysis (n = 14/27, 51.9%). Methodological and reporting quality was unaffected by publication year; risk of bias from missing data changed over time. Overall risk of bias across included studies was moderate to high, with high risk in randomization process (n = 8/32, 25%), missing outcome data (n = 5/32, 15.6%), and selection of reported result (n = 9/32, 28.1%). CONCLUSIONS: Justification of the non-inferiority margin, reporting of ITT and PP analyses, missing data handling description, and ensuring conclusions are consistent with reported data is necessary to improve CONSORT adherence. Small sample size and overall risk of bias are study limitations. (Systematic Review Registration Number PROSPERO CRD42020219497).

Confidence interval of risk difference by different statistical methods and its impact on the study conclusion in antibiotic non-inferiority trials.

BACKGROUND: Numerous statistical methods can be used to calculate the confidence interval (CI) of risk differences. There is consensus in previous literature that the Wald method should be discouraged. We compared five statistical methods for estimating the CI of risk difference in terms of CI width and study conclusion in antibiotic non-inferiority trials. METHODS: In a secondary analysis of a systematic review, we included non-inferiority trials that compared different antibiotic regimens, reported risk differences for the primary outcome, and described the number of successes and/or failures as well as patients in each arm. For each study, we re-calculated the risk difference CI using the Wald, Agresti-Caffo, Newcombe, Miettinen-Nurminen, and skewness-corrected asymptotic score (SCAS) methods. The CIs by different statistical methods were compared in terms of CI width and conclusion on non-inferiority. A wider CI was considered to be more conservative. RESULTS: The analysis included 224 comparisons from 213 studies. The statistical method used to calculate CI was not reported in 134 (59.8%) cases. The median (interquartile range IQR) for CI width by Wald, Agresti-Caffo, Newcombe, Miettinen-Nurminen, and SCAS methods was 13.0% (10.8%, 17.4%), 13.3% (10.9%, 18.5%), 13.6% (11.1%, 18.9%), 13.6% (11.1% and 19.0%), and 13.4% (11.1%, 18.9%), respectively. In 216 comparisons that reported a non-inferiority margin, the conclusion on non-inferiority was the same across the five statistical methods in 211 (97.7%) cases. The differences in CI width were more in trials with a sample size of 100 or less in each group and treatment success rate above 90%. Of the 18 trials in this subgroup with a specified non-inferiority margin, non-inferiority was shown in 17 (94.4%), 16 (88.9%), 14 (77.8%), 14 (77.8%), and 15 (83.3%) cases based on CI by Wald, Agresti-Caffo, Newcombe, Miettinen-Nurminen, and SCAS methods, respectively. CONCLUSIONS: The statistical method used to calculate CI was not reported in the majority of antibiotic non-inferiority trials. Different statistical methods for CI resulted in different conclusions on non-inferiority in 2.3% cases. The differences in CI widths were highest in trials with a sample size of 100 or less in each group and a treatment success rate above 90%. TRIAL REGISTRATION: PROSPERO CRD42020165040 . April 28, 2020.

Recurrent multidrug-resistant Salmonella enterica serovar Typhimurium bacteremia in a returned traveller.

This case report describes a 68-year-old male with recurrent multidrug-resistant Salmonella enterica serovar Typhimurium bacteremia acquired during travel abroad. He experienced a recurrence of bacteremia without a clear source and was successfully treated with 10 weeks of intravenous ertapenem. Post hoc genome sequencing revealed an isolate bearing class A, C, and D extended-spectrum ß-lactamases (ESBLs). A review of English- and French-language literature since 2000 revealed eight publications that discussed recurrent S. enterica serovar Typhimurium bacteremia. Patients with multidrug-resistant S. enterica serovar Typhimurium should be monitored frequently for recrudescence, even in the absence of risk factors.

Le présent rapport décrit le cas d'un homme de 68 ans atteint d'une bactériémie à Salmonella enterica sérovar Typhimurium multirésistante contractée lors d'un voyage à l'étranger. Un traitement à l'ertapénem par voie intraveineuse pendant dix semaines a guéri cette récidive de la bactériémie, dont la source n'a pu être décelée. Le séquençage génétique de l'isolat clinique effectué a posteriori a révélé des bêta-lactamases à spectre élargi de classe A, C et D. Grâce à une analyse bibliographique des publications en anglais et en français après 2000, huit publications sur la bactériémie récurrente à S. enterica sérovar Typhimurium ont été recensées. Les patients atteints d'une bactériémie à S. enterica sérovar Typhimurium multirésistante devraient faire l'objet d'une surveillance fréquente pour écarter les recrudescences, même en l'absence de facteurs de risque.