The impact of an online course on agreement rates of the certainty of evidence assessment using Grading of Recommendations, Assessment, Development, and Evaluation Approach: a before-and-after study.

BACKGROUND AND OBJECTIVE: The Grading of Recommendations, Assessment, Development, and Evaluation (GRADE) approach is a systematic method for assessing the certainty of evidence (CoE) and strength of recommendations in health care. We aimed to verify the effects of an online-based GRADE course on multirater consistency in the evaluation of the CoE in systematic reviews (SRs) analysis. STUDY DESIGN AND SETTINGS: Sixty-five Brazilian methodologists and researchers participated in an online course over 8 weeks. Asynchronous lessons and weekly synchronous meetings addressed the GRADE system in the context of CoE assessment. We asked participants to evaluate the CoE of random SRs (two before and another two after the course). Analyzes focused on the multirater agreement with a standard response, in the interrater agreement, and before-after changes in the proportion of participants that rated down the domains. RESULTS: 48 individuals completed the course. Participants presented improvements in the raters' assessment of the CoE using the GRADE approach after the course. The multirater consistency of indirectness, imprecision, and the overall CoE increased after the course, as well as the agreement between raters and the standard response. Furthermore, interrater reliability increased for risk of bias, inconsistency, indirectness, publication bias, and overall CoE, indicating progress in between-raters consistency. After the course, approximately 78% of individuals rated down the overall CoE to a low/very low degree, and participants presented more explanations for the judgment of each domain. CONCLUSION: An online GRADE course improved the consistency and agreement of the CoE assessment by Brazilian researchers. Online training courses have the potential to improve skills in guideline methodology development.

Economic Rationality in Decision-Making Regarding Newborn Screening: A Case Study in Quebec.

Health systems in high-resource countries recognize the importance of making decisions about the services offered to the population based on scientific evidence. Producing this evidence is especially challenging in areas such as newborn care where the frequency of conditions is rare. However, methodological advances in the field of economic evaluation could change how this evidence is used in decision-making. This study aimed to investigate how decision-makers in the Canadian province of Quebec perceive the value of recent advances in economic evaluations for perinatal studies and how these advances might affect the offer of neonatal interventions in the public health care system. A qualitative study was conducted. A total of 10 policymakers were interviewed. A neo-institutional conceptual framework highlighting three dimensions, structure, power, and interpretive schemes, was used for data collection and analyses. Structural factors, interpretative schemes, and power management between the groups concerned concur to ensure that providing services to newborns is not hindered by the difficulty of producing evidence. They also ensure that the decisions regarding which disease to screen for take into consideration the specificity of neonatology, in particular, the social value given to children not captured by available evidence.

Measuring evidence-based clinical guideline compliance in the paediatric intensive care unit.

BACKGROUND: Evidence-based clinical care guidelines improve medical treatment by reducing error, improving outcomes and possibly lowering healthcare costs. While some data exist on individual guideline compliance, no data exist on overall compliance to multiple nuanced guidelines in a paediatric intensive care setting. METHODS: Guideline compliance was observed and measured with a prospective cohort at a tertiary academic paediatric medical-surgical intensive care unit. Adherence to 19 evidence-based clinical care guidelines was evaluated in 814 patients, and reasons for non-compliance were noted along with other associated outcomes. MEASUREMENTS AND MAIN RESULTS: Overall facility compliance was unexpectedly high at 77.8% over 4512 compliance events, involving 826 admissions. Compliance varied widely between guidelines. Guidelines with the highest compliance were stress ulcer prophylaxis (97.1%) and transfusion administration such as fresh frozen plasma (97.4%) and platelets (94.8%); guidelines with the lowest compliance were ventilator-associated pneumonia prevention (28.7%) and vitamin K administration (34.8%). There was no significant change in compliance over time with observation. Guidelines with binary decision branch points or single-page decision flow diagrams had a higher average compliance of 90.6%. Poor compliance was more often observed with poor perception of guideline trustworthiness and time limitations. CONCLUSIONS: Measuring guideline compliance, though onerous, allowed for evaluation of current clinical practices and identified actionable areas for institutional improvement.

Calculated Medicine: Seven Decades of Accelerating Growth.

The field of Calculated Medicine has grown substantially over the last 7 decades. Comprised of objective, evidence-based medical decision tools, Calculated Medicine has broad application in medical practice, medical research, and health care management. This article reviews the history and varied methodologies of Calculated Medicine, starting with the 1953 Apgar score and concluding with a look into modern computational tools of the field: machine learning, natural language processing, artificial intelligence, and in silico research techniques. We'll also review and quantify the rapidly accelerating growth of Calculated Medicine in the medical literature. Our database of journal articles referring to the field has accumulated over 1.8 million citations, with more than 460 new citations (on average) posted every day. Using natural language processing, we examine and analyze this burgeoning database. Lastly, we examine an important new direction of Calculated Medicine: self-reflection on its potential effect on racial and ethnic disparities in health care. Our field is making great strides promoting health care egality, and some of the most prominent contributions will be reviewed.

Extending the Grading of Recommendations Assessment, Development and Evaluation (GRADE) in Traditional Chinese Medicine (TCM): The GRADE-TCM.

AIM: To extend and form the "Grading of Recommendations Assessment, Development and Evaluation in Traditional Chinese Medicine" (GRADE-TCM). METHODS: Methodologies were systematically reviewed and analyzed concerning evidence-based TCM guidelines worldwide. A survey questionnaire was developed based on the literature review and open-end expert interviews. Then, we performed expert consensus, discussion meeting, opinion collection, external examination, and the GRADE-TCM was formed eventually. RESULTS: 265 Chinese and English TCM guidelines were included and analyzed. Five experts completed the open-end interviews. Ten methodological entries were summarized, screened and selected. One round of consensus was conducted, including a total of 22 experts and 220 valid questionnaire entries, concerning 1) selection of the GRADE, 2) GRADE-TCM upgrading criteria, 3) GRADE-TCM evaluation standard, 4) principles of consensus and recommendation, and 5) presentation of the GRADE-TCM and recommendation. Finally, consensus was reached on the above 10 entries, and the results were of high importance (with voting percentages ranging from 50 % to 81.82 % for "very important" rating) and strong reliability (with the Cr ranging from 0.93 to 0.99). Expert discussion meeting (with 40 experts), opinion collection (in two online platforms) and external examination (with 14 third-party experts) were conducted, and the GRADE-TCM was established eventually. CONCLUSION: GRADE-TCM provides a new extended evidence-based evaluation standard for TCM guidelines. In GRADE-TCM, international evidence-based norms, characteristics of TCM intervention, and inheritance of TCM culture were combined organically and followed. This is helpful for localization of the GRADE in TCM and internationalization of TCM guidelines.

Radiology AI Deployment and Assessment Rubric (RADAR) to bring value-based AI into radiological practice.

OBJECTIVE: To provide a comprehensive framework for value assessment of artificial intelligence (AI) in radiology. METHODS: This paper presents the RADAR framework, which has been adapted from Fryback and Thornbury's imaging efficacy framework to facilitate the valuation of radiology AI from conception to local implementation. Local efficacy has been newly introduced to underscore the importance of appraising an AI technology within its local environment. Furthermore, the RADAR framework is illustrated through a myriad of study designs that help assess value. RESULTS: RADAR presents a seven-level hierarchy, providing radiologists, researchers, and policymakers with a structured approach to the comprehensive assessment of value in radiology AI. RADAR is designed to be dynamic and meet the different valuation needs throughout the AI's lifecycle. Initial phases like technical and diagnostic efficacy (RADAR-1 and RADAR-2) are assessed pre-clinical deployment via in silico clinical trials and cross-sectional studies. Subsequent stages, spanning from diagnostic thinking to patient outcome efficacy (RADAR-3 to RADAR-5), require clinical integration and are explored via randomized controlled trials and cohort studies. Cost-effectiveness efficacy (RADAR-6) takes a societal perspective on financial feasibility, addressed via health-economic evaluations. The final level, RADAR-7, determines how prior valuations translate locally, evaluated through budget impact analysis, multi-criteria decision analyses, and prospective monitoring. CONCLUSION: The RADAR framework offers a comprehensive framework for valuing radiology AI. Its layered, hierarchical structure, combined with a focus on local relevance, aligns RADAR seamlessly with the principles of value-based radiology. CRITICAL RELEVANCE STATEMENT: The RADAR framework advances artificial intelligence in radiology by delineating a much-needed framework for comprehensive valuation. KEYPOINTS: • Radiology artificial intelligence lacks a comprehensive approach to value assessment. • The RADAR framework provides a dynamic, hierarchical method for thorough valuation of radiology AI. • RADAR advances clinical radiology by bridging the artificial intelligence implementation gap.

Undertaking Studies Within A Trial to evaluate recruitment and retention strategies for randomised controlled trials: lessons learnt from the PROMETHEUS research programme.

Background: Randomised controlled trials ('trials') are susceptible to poor participant recruitment and retention. Studies Within A Trial are the strongest methods for testing the effectiveness of strategies to improve recruitment and retention. However, relatively few of these have been conducted. Objectives: PROMoting THE Use of Studies Within A Trial aimed to facilitate at least 25 Studies Within A Trial evaluating recruitment or retention strategies. We share our experience of delivering the PROMoting THE Use of Studies Within A Trial programme, and the lessons learnt for undertaking randomised Studies Within A Trial. Design: A network of 10 Clinical Trials Units and 1 primary care research centre committed to conducting randomised controlled Studies Within A Trial of recruitment and/or retention strategies was established. Promising recruitment and retention strategies were identified from various sources including Cochrane systematic reviews, the Study Within A Trial Repository, and existing prioritisation exercises, which were reviewed by patient and public members to create an initial priority list of seven recruitment and eight retention interventions. Host trial teams could apply for funding and receive support from the PROMoting THE Use of Studies Within A Trial team to undertake Studies Within A Trial. We also tested the feasibility of undertaking co-ordinated Studies Within A Trial, across multiple host trials simultaneously. Setting: Clinical trials unit-based trials recruiting or following up participants in any setting in the United Kingdom were eligible. Participants: Clinical trials unit-based teams undertaking trials in any clinical context in the United Kingdom. Interventions: Funding of up to £5000 and support from the PROMoting THE Use of Studies Within A Trial team to design, implement and report Studies Within A Trial. Main outcome measures: Number of host trials funded. Results: Forty-two Studies Within A Trial were funded (31 host trials), across 12 Clinical Trials Units. The mean cost of a Study Within A Trial was £3535. Twelve Studies Within A Trial tested the same strategy across multiple host trials using a co-ordinated Study Within A Trial design, and four used a factorial design. Two recruitment and five retention strategies were evaluated in more than one host trial. PROMoting THE Use of Studies Within A Trial will add 18% more Studies Within A Trial to the Cochrane systematic review of recruitment strategies, and 79% more Studies Within A Trial to the Cochrane review of retention strategies. For retention, we found that pre-notifying participants by card, letter or e-mail before sending questionnaires was effective, as was the use of pens, and sending personalised text messages to improve questionnaire response. We highlight key lessons learnt to guide others planning Studies Within A Trial, including involving patient and public involvement partners; prioritising and selecting strategies to evaluate and elements to consider when designing a Study Within A Trial; obtaining governance approvals; implementing Studies Within A Trial, including individual and co-ordinated Studies Within A Trials; and reporting Study Within A Trials. Limitations: The COVID-19 pandemic negatively impacted five Studies Within A Trial, being either delayed (n = 2) or prematurely terminated (n = 3). Conclusions: PROMoting THE Use of Studies Within A Trial significantly increased the evidence base for recruitment and retention strategies. When provided with both funding and practical support, host trial teams successfully implemented Studies Within A Trial. Future work: Future research should identify and target gaps in the evidence base, including widening Study Within A Trial uptake, undertaking more complex Studies Within A Trial and translating Study Within A Trial evidence into practice. Study registration: All Studies Within A Trial in the PROMoting THE Use of Studies Within A Trial programme had to be registered with the Northern Ireland Network for Trials Methodology Research Study Within A Trial Repository. Funding: This award was funded by the National Institute for Health and Care Research (NIHR) Health Technology Assessment programme (NIHR award ref: 13/55/80) and is published in full in Health Technology Assessment; Vol. 28, No. 2. See the NIHR Funding and Awards website for further award information.

A Study Within A Trial is a research study nested inside a larger 'host trial', promoting the use of Studies Within A Trial aimed to do Study Within A Trial routine practice in clinical trial units by funding and supporting at least 25 Studies Within A Trial. The best way to test health and social care treatments is to do a randomised controlled trial ('trial'), where some patients get the treatment being tested and some do not. The results of different groups are compared to see if the treatment improves care. Recruiting patients and keeping them involved in trials is often very difficult. Research teams often do not know how best to recruit and keep patients engaged as the methods have not been tested to see if they work. The best way to test these methods is by doing a Study Within A Trial. We test a programme of Studies Within A Trial for recruiting and keeping patients engaged in trials. Trial teams were able to apply for funding of up to £5000 and receive support from Promoting the use of Study Within A Trial team to do Studies Within A Trial. We used our experience of doing Studies Within A Trial to outline lessons learnt for doing Studies Within A Trial. We funded 42 Studies Within A Trial and gave teams necessary advice to do them. We significantly increased the knowledge for both recruitment and retention strategies, and found 'pre-notifying' before sending questionnaires, sending pens and personalised text messages were all effective for increasing responses by participants. We tested Studies Within A Trial across several different trials at the same time to find out more quickly whether their methods worked. We highlight key lessons learnt to guide others doing Studies Within A Trial, including involving patient partners; picking the right strategy to test; getting ethical approvals; how to do and report Studies Within A Trial. Promoting the use of studies within a trial was successful and supported more Studies Within A Trial than planned. We hope our experience will support those doing Studies Within A Trial in the future.

Early technology review: towards an expedited pathway.

OBJECTIVES: Evidence development for medical devices is often focused on satisfying regulatory requirements with the result that health professional and payer expectations may not be met, despite considerable investment in clinical trials. Early engagement with payers and health professionals could allow companies to understand these expectations and reflect them in clinical study design, increasing chances of positive coverage determination and adoption into clinical practice. METHODS: An example of early engagement through the EXCITE International model using an early technology review (ETR) is described which includes engagement with payers and health professionals to better inform companies to develop data that meet their expectations. ETR is based on an early evidence review, a framework of expectations that guides the process and identified gaps in evidence. The first fourteen ETRs were reviewed for examples of advice to companies that provided additional information from payers and health professionals that was thought likely to impact on downstream outcomes or strategic direction. Given that limitations were imposed by confidentiality, examples were genericized. RESULTS: Advice through early engagement can inform evidence development that coincides with expectations of payers and health professionals through a structured, objective, evidence-based approach. This could reduce the risk of business-related adverse outcomes such as failure to secure a positive coverage determination and/or acceptance by expert health professionals. CONCLUSIONS: Early engagement with key stakeholders exemplified by the ETR approach offers an alternative to the current approach of focusing on regulatory expectations. This could reduce the time to reimbursement and clinical adoption and benefit patient outcomes and/or health system efficiencies.

Translating radiological research into practice-from discovery to clinical impact.

At the European Society of Radiology (ESR), we strive to provide evidence for radiological practices that improve patient outcomes and have a societal impact. Successful translation of radiological research into clinical practice requires multiple factors including tailored methodology, a multidisciplinary approach aiming beyond technical validation, and a focus on unmet clinical needs. Low levels of evidence are a threat to radiology, resulting in low visibility and credibility. Here, we provide the background and rationale for the thematic series Translating radiological research into practice-from discovery to clinical impact, inviting authors to describe their processes of achieving clinically impactful radiological research. We describe the challenges unique to radiological research. Additionally, a survey was sent to non-radiological clinical societies. The majority of respondents (6/11) were in the field of gastrointestinal/abdominal medicine. The implementation of CT/MRI techniques for disease characterisation, detection and staging of cancer, and treatment planning and radiological interventions were mentioned as the most important radiological developments in the past years. The perception was that patients are substantially unaware of the impact of these developments. Unmet clinical needs were mostly early diagnosis and staging of cancer, microstructural/functional assessment of tissues and organs, and implant assessment. All but one respondent considered radiology important for research in their discipline, but five indicated that radiology is currently not involved in their research. Radiology research holds the potential for being transformative to medical practice. It is our responsibility to take the lead in studies including radiology and strive towards the highest levels of evidence.Critical relevance statement For radiological research to make a clinical and societal impact, radiologists should take the lead in radiological studies, go beyond the assessment of technical feasibility and diagnostic accuracy, and-in a multidisciplinary approach-address clinical unmet needs.Key points• Multiple factors are essential for radiological research to make a clinical and societal impact.• Radiological research needs to go beyond diagnostic accuracy and address unmet clinical needs.• Radiologists should take the lead in radiological studies with a multidisciplinary approach.

Assessment and management of vestibular migraine within ENT.

OBJECTIVE: Vestibular migraine is a newly recognised and debilitating condition. This article aims to provide an overview of what is known of vestibular migraine, delineating its diagnostic criteria and presenting some initial management strategies to aid ENT professionals in delivering optimal care when patients first present to the otolaryngology clinic. METHOD: Although traditionally underdiagnosed, there are now clearly defined diagnostic criteria to aid accurate diagnosis of vestibular migraine. RESULTS: A detailed history and clinical examination are the cornerstone of the diagnostic process, but supportive evidence is required from appropriate audio-vestibular tests and imaging. CONCLUSION: This is a unique condition that commonly initially presents to ENT. This article provides a summary of diagnostic and management strategies to facilitate early diagnosis and first-line treatment that can be employed in general ENT settings, which may be particularly useful given the limited availability of specialist audio-vestibular medicine and neuro-otology services.

A systematic assessment of the characteristics of randomized controlled trials cited by acute coronary syndrome clinical practice guidelines.

AIMS: The aim of this study was to describe the methodological features of the randomized controlled trials (RCTs) cited in American and European clinical practice guidelines (CPGs) for ST elevation myocardial infarction (STEMI) and non-ST elevation acute coronary syndrome (NSTE-ACS). METHODS AND RESULTS: Out of 2128 non-duplicated references cited in the 2013 and 2014 American College of Cardiology/American Heart Association and 2017 and 2020 European Society of Cardiology CPGs for STEMI and NSTE-ACS, we extracted data for 407 RCTs (19.1% of total references). The majority were multicenter studies (81.8%), evaluated pharmacological interventions (63.1%), had a 2-arm (82.6%), and superiority (90.4%) design. Most RCTs (60.2%) had an active comparator, and 46.2% were funded by industry. The median observed sample size was 1001 patients (84.2% of RCTs achieved ≥80% of the intended sample size). Most RCTs had a single primary outcome (90.9%), which was a composite in just over half (51.9%). Among the RCTs testing for superiority, 44.0% reported a P-value of ≥0.05 for the primary outcome and 61.9% observed a risk reduction of >15%. The observed treatment effect was lower-than-expected in 67.6% of RCTs, with 34.4% having at least a 20% lower-than-expected treatment effect. The calculated post hoc statistical power was ≥80% for 33.9% of cited RCTs. CONCLUSIONS: This analysis demonstrates that RCTs cited by CPGs can still have significant methodological issues and limitations, highlighting that a better understanding of the methodological aspects of RCTs is crucial in order to formulate recommendations relevant to clinical practice.

Assessing the methodological strengths and limitations of the Spanish Society of Medical Oncology (SEOM) guidelines: a critical appraisal using AGREE II and AGREE-REX tool.

BACKGROUND: The Spanish Society of Medical Oncology (SEOM) has provided open-access guidelines for cancer since 2014. However, no independent assessment of their quality has been conducted to date. This study aimed to critically evaluate the quality of SEOM guidelines on cancer treatment. METHODS: Appraisal of Guidelines for Research and Evaluation II (AGREE II) and AGREE-REX tool was used to evaluate the qualities of the guidelines. RESULTS: We assessed 33 guidelines, with 84.8% rated as "high quality". The highest median standardized scores (96.3) were observed in the domain "clarity of presentation", whereas "applicability" was distinctively low (31.4), with only one guideline scoring above 60%. SEOM guidelines did not include the views and preferences of the target population, nor did specify updating methods. CONCLUSIONS: Although developed with acceptable methodological rigor, SEOM guidelines could be improved in the future, particularly in terms of clinical applicability and patient perspectives.

Scholarship of Drug Information and Library Sciences Instruction in North American Pharmacy Education: A Systematic Review of English-Language Research.

OBJECTIVES: This study aimed to characterize the scholarship of teaching and learning specific to drug information and library sciences (DILS) in pharmacy education and provide a comprehensive, evidence-based resource for faculty, detailing published practices for content delivery and scholarly research gaps. FINDINGS: Systematic searches of PubMed, Embase, International Pharmaceutical Abstracts, Educational Resources Information Center, Scopus, Library Literature & Information Science Full Text, and Library, Information Science & Technology Abstracts were conducted from January 1997 through early February 2022. Included studies were published in English, involved DILS content, were specific to pharmacy education, were original research, and were conducted in North America. The review excluded abstract-only records and studies that did not include learners (ie, pharmacy students and residents) as participants. Duplicate records were removed. After screening and review, 166 articles met the eligibility criteria, 60% of which (n = 100/166) were published in the last 10 years. Most studies focused on literature evaluation (45/166, 27%), fundamentals of drug information (43/166, 25%), evidence-based medicine (21/166, 13%), and resource utilization (21/166, 13%). Studied learners were mainly pharmacy students (77%), and 82% of research included authors who were pharmacists, whereas 14% included librarians. Assessment techniques used primarily focused on student perception (61/166, 37%), followed by summative assessment (46/166, 28%), other (25/166, 15%), and formative assessment (18/166, 11%). SUMMARY: This article presents a systematically identified collection of North American literature examining the education in DILS of pharmacy learners. Areas for continued research of DILS content include evaluating underrepresented educational domains (ie, systematic approach, response development and provision, literature searching, study design), using librarians more in scholarship of teaching and learning research, and using formative and summative assessments as outcomes.

Improving methods of clinical practice guidelines: From guidelines to pathways to fast-and-frugal trees and decision analysis to develop individualised patient care.

BACKGROUND: Current methods for developing clinical practice guidelines have several limitations: they are characterised by the "black box" operation-a process with defined inputs and outputs but an incomplete understanding of its internal workings; they have "the integration problem"-a lack of framework for explicitly integrating factors such as patient preferences and trade-offs between benefits and harms; they generate one recommendation at a time that typically are not connected in a coherent analytical framework; and they apply to "average" patients, while clinicians and their patients seek advice tailored to individual circumstances. METHODS: We propose augmenting the current guideline development method by converting evidence-based pathways into fast-and-frugal decision trees (FFTs) and integrating them with generalised decision curve analysis to formulate clear, individualised management recommendations. RESULTS: We illustrate the process by developing recommendations for the management of heparin-induced thrombocytopenia (HIT). We converted evidence-based pathways for HIT, developed by the American Society of Hematology, into an FFT. Here, we consider only thrombotic complications and major bleeding. We leveraged the predictive potential of FFTs to compare the effects of argatroban, bivalirudin, fondaparinux, and direct oral anticoagulants (DOACs) using generalised decision curve analysis. We found that DOACs were superior to other treatments if the FFT-predicted probability of HIT exceeded 3%. CONCLUSIONS: The proposed analytical framework connects guidelines, pathways, FFTs, and decision analysis, offering risk-tailored personalised recommendations and addressing current guideline development critiques.

Cough in Children and Adults: Diagnosis, Assessment and Management (CICADA). Summary of an updated position statement on chronic cough in Australia.

INTRODUCTION: Cough is the most common symptom leading to medical consultation. Chronic cough results in significant health care costs, impairs quality of life, and may indicate the presence of a serious underlying condition. Here, we present a summary of an updated position statement on cough management in the clinical consultation. MAIN RECOMMENDATIONS: Assessment of children and adults requires a focused history of chronic cough to identify any red flag cough pointers that may indicate an underlying disease. Further assessment with examination should include a chest x-ray and spirometry (when age > 6 years). Separate paediatric and adult diagnostic management algorithms should be followed. Management of the underlying condition(s) should follow specific disease guidelines, as well as address adverse environmental exposures and patient/carer concerns. First Nations adults and children should be considered a high risk group. The full statement from the Thoracic Society of Australia and New Zealand and Lung Foundation Australia for managing chronic cough is available at https://lungfoundation.com.au/resources/cicada-full-position-statement. CHANGES IN MANAGEMENT AS A RESULT OF THIS STATEMENT: Algorithms for assessment and diagnosis of adult and paediatric chronic cough are recommended. High quality evidence supports the use of child-specific chronic cough management algorithms to improve clinical outcomes, but none exist in adults. Red flags that indicate serious underlying conditions requiring investigation or referral should be identified. Early and effective treatment of chronic wet/productive cough in children is critical. Culturally specific strategies for facilitating the management of chronic cough in First Nations populations should be adopted. If the chronic cough does not resolve or is unexplained, the patient should be referred to a respiratory specialist or cough clinic.

Association of a Heart Failure Management Incentive in Primary Care With Clinical Outcomes: A Retrospective Cohort Study.

BACKGROUND: We aim to examine the association between primary care physicians' billing of Q050A, a pay-for-performance heart failure (HF) management incentive fee code, and the composite outcome of mortality, hospitalization, and emergency department visits. METHODS AND RESULTS: This population-based cohort study linked administrative health databases in Ontario, Canada, for patients with HF aged >66 years between January 1, 2008, and March 31, 2020. Cases were patients with HF who had a Q050A fee code billed. Cases and controls were matched 1:1 on age, sex, patient status on being rostered to a primary care physician, cardiologist, or internist visit in the 6 months before study enrollment, Johns Hopkins Adjusted Clinical Group resource use bands, days between HF diagnosis and study enrollment (±2 years), and the logit of the propensity score. A Cox proportional hazards model assessed the association of Q050A with the outcome. A total of 59 664 cases had a Q050A billed, whereas 244 883 patients did not. Before matching, patients who had a Q050A billed were more likely to be men (52% versus 49%), were rostered to a primary care physician (100% versus 96%), had a higher Charlson Comorbidity Index, and had higher health care costs. The mean follow-up was 481 days for cases and 530 days for controls. The composite outcome (hazard ratio, 1.11 [95% CI, 1.09-1.12]) was significantly higher for cases than controls. CONCLUSIONS: The Q050A incentive improved financial compensation for primary care physicians managing patients with HF but was not associated with improvements in the outcome. Research on promoting evidence-based HF management is warranted.

Financial Conflicts of Interest Among the Authors of the Clinical Practice Guidelines for Rheumatoid Arthritis in Japan.

Objective To assess the financial relationships between pharmaceutical companies and authors of the 2020 Japan College of Rheumatology Clinical Practice Guidelines (CPG) for the Management of Rheumatoid Arthritis and to evaluate the quality of evidence supporting the guideline recommendations. Methods This retrospective study evaluated financial relationships between all 27 authors of the CPG and pharmaceutical companies in Japan. Personal payments from pharmaceutical companies to these authors between 2016 and 2020 were extracted from publicly disclosed databases for each pharmaceutical company. The quality of the evidence supporting the CPG recommendations was also assessed. Results All 27 authors received personal payments from pharmaceutical companies, totaling $3,683,048 over five years. The median and mean payments per author were $101,624 and $136,409, respectively. Speaking compensations accounted for more than 80% of all personal payments. More than 77.8% (21 authors), 66.7% (18 authors), and 51.9% (14 authors) received more than $10,000, $50,000, and $100,000 in total payments over the five years, respectively. Nevertheless, these financial relationships between the CPG authors and pharmaceutical companies were not disclosed. More than 81.8% of the CPG recommendations were supported by low- or very-low-quality evidence. Of the strong recommendations, 66.7% were supported by low- or very-low-quality evidence. Conclusion Even though all CPG authors received substantial amounts of personal payments from pharmaceutical companies, these conflicts of interest (COIs) were not disclosed in the CPG. These findings underscore the urgent need for policy interventions to enhance transparency, integrity, and reliability in the development of CPGs in Japan.

Evaluation of Publications from the American Academy of Ophthalmology: A 5-Year Analysis of Ophthalmology Literature.

Objective: To analyze recent publications in Ophthalmology, the journal of the American Academy of Ophthalmology. Design: Retrospective review of published articles. Participants: No human participants were involved in the study. Methods: Articles published in Ophthalmology from January 2018 to December 2022 were reviewed and analyzed. Main Outcome Measures: Research and review articles were included and analyzed per the following: total number of published articles based on related subspecialty area, level of evidence using the modified Oxford level of evidence, number of citations, number of listed authors, gender of the corresponding author, country of affiliation of the corresponding and contributing author(s), and involvement of consortium(s), group(s), or committee(s). Results: A total of 965 articles were included. The mean (standard deviation) number of authors per article was 8.6 (5.7) and the majority of corresponding authors were male (665, 70.7%). The greatest number of published articles were related to retina (296, 30.7%) followed by glaucoma (172, 17.8%). The greatest number of Preferred Practice Pattern guidelines were also related to retina (7/24, 29.1%), followed by cornea/dry eye syndrome/external disease (6/24, 25%). Retina (77) had the most level 1 evidence, glaucoma (30) for level 2 evidence, and retina for levels 3 (69) and 4 (65). There were 223 articles contributed by consortia/groups/committees, with most from retina (73, 32.7%) followed by glaucoma (40, 17.9%). The mean number of citations per subspecialty article was highest in retina (45.8/article), followed by uveitis (31.7/article). The United States had the greatest number of affiliated corresponding authors (544, 56.4%), followed by the United Kingdom (68, 7.0%). There were 357 (37.0%) articles with coauthors affiliated outside the corresponding author's country of affiliation, although with a downward trend over the most recent 5-year period. There has been an increasing trend in the number of authors and consortia/group/committee involvement in publications. Conclusions: Although team science and collaborations have increased recently, ongoing efforts to diversify individuals, groups, and subspecialties may be needed. Financial Disclosures: Proprietary or commercial disclosure may be found in the Footnotes and Disclosures at the end of this article.

Utilization of innovative medical technologies in German inpatient care: does evidence matter?

BACKGROUND: The reimbursement of new technologies in inpatient care is not always linked to a requirement for evidence-based evaluation of patient benefit. In Germany, every new technology approved for market was until recently eligible for reimbursement in inpatient care unless explicitly excluded. The aim of this work was (1) to investigate the type of evidence that was available at the time of introduction of 25 innovative technologies and how this evidence evolved over time, and (2) to explore the relationship between clinical evidence and utilization for these technologies in German inpatient care. METHODS: This study combined different methods. A systematic search for evidence published between 2003 and 2017 was conducted in four bibliographic databases, clinical trial registries, resources for clinical guidelines, and health technology assessment-databases. Information was also collected on funding mechanisms and safety notices. Utilization was measured by hospital procedures captured in claims data. The body of evidence, funding and safety notices per technology were analyzed descriptively. The relationship between utilization and evidence was explored empirically using a multilevel regression analysis. RESULTS: The number of included publications per technology ranges from two to 498. For all technologies, non-comparative studies form the bulk of the evidence. The number of randomized controlled clinical trials per technology ranges from zero to 19. Some technologies were utilized for several years without an adequate evidence base. A relationship between evidence and utilization could be shown for several but not all technologies. CONCLUSIONS: This study reveals a mixed picture regarding the evidence available for new technologies, and the relationship between the development of evidence and the use of technologies over time. Although the influence of funding and safety notices requires further investigation, these results re-emphasize the need for strengthening market approval standards and HTA pathways as well as approaches such as coverage with evidence development.

The utility of ChatGPT in the assessment of literature on the prevention of migraine: an observational, qualitative study.

Background: It is not known how large language models, such as ChatGPT, can be applied toward the assessment of the efficacy of medications, including in the prevention of migraine, and how it might support those claims with existing medical evidence. Methods: We queried ChatGPT-3.5 on the efficacy of 47 medications for the prevention of migraine and then asked it to give citations in support of its assessment. ChatGPT's evaluations were then compared to their FDA approval status for this indication as well as the American Academy of Neurology 2012 evidence-based guidelines for the prevention of migraine. The citations ChatGPT generated for these evaluations were then assessed to see if they were real papers and if they were relevant to the query. Results: ChatGPT affirmed that the 14 medications that have either received FDA approval for prevention of migraine or AAN Grade A/B evidence were effective for migraine. Its assessments of the other 33 medications were unreliable including suggesting possible efficacy for four medications that have never been used for the prevention of migraine. Critically, only 33/115 (29%) of the papers ChatGPT cited were real, while 76/115 (66%) were "hallucinated" not real papers and 6/115 (5%) shared the names of real papers but had not real citations. Conclusion: While ChatGPT produced tailored answers on the efficacy of the queried medications, the results were unreliable and inaccurate because of the overwhelming volume of "hallucinated" articles it generated and cited.