Transparency in Artificial Intelligence Reporting in Ophthalmology-A Scoping Review.

Topic: This scoping review summarizes artificial intelligence (AI) reporting in ophthalmology literature in respect to model development and validation. We characterize the state of transparency in reporting of studies prospectively validating models for disease classification. Clinical Relevance: Understanding what elements authors currently describe regarding their AI models may aid in the future standardization of reporting. This review highlights the need for transparency to facilitate the critical appraisal of models prior to clinical implementation, to minimize bias and inappropriate use. Transparent reporting can improve effective and equitable use in clinical settings. Methods: Eligible articles (as of January 2022) from PubMed, Embase, Web of Science, and CINAHL were independently screened by 2 reviewers. All observational and clinical trial studies evaluating the performance of an AI model for disease classification of ophthalmic conditions were included. Studies were evaluated for reporting of parameters derived from reporting guidelines (CONSORT-AI, MI-CLAIM) and our previously published editorial on model cards. The reporting of these factors, which included basic model and dataset details (source, demographics), and prospective validation outcomes, were summarized. Results: Thirty-seven prospective validation studies were included in the scoping review. Eleven additional associated training and/or retrospective validation studies were included if this information could not be determined from the primary articles. These 37 studies validated 27 unique AI models; multiple studies evaluated the same algorithms (EyeArt, IDx-DR, and Medios AI). Details of model development were variably reported; 18 of 27 models described training dataset annotation and 10 of 27 studies reported training data distribution. Demographic information of training data was rarely reported; 7 of the 27 unique models reported age and gender and only 2 reported race and/or ethnicity. At the level of prospective clinical validation, age and gender of populations was more consistently reported (29 and 28 of 37 studies, respectively), but only 9 studies reported race and/or ethnicity data. Scope of use was difficult to discern for the majority of models. Fifteen studies did not state or imply primary users. Conclusion: Our scoping review demonstrates variable reporting of information related to both model development and validation. The intention of our study was not to assess the quality of the factors we examined, but to characterize what information is, and is not, regularly reported. Our results suggest the need for greater transparency in the reporting of information necessary to determine the appropriateness and fairness of these tools prior to clinical use. Financial Disclosures: Proprietary or commercial disclosure may be found in the Footnotes and Disclosures at the end of this article.

Librarian-Led Assessment of Medical Students' Evidence-Based Medicine Competency: Facilitators and Barriers.

Introduction: We must ensure, through rigorous assessment that physicians have the evidence-based medicine (EBM) skills to identify and apply the best available information to their clinical work. However, there is limited guidance on how to assess EBM competency. With a better understanding of their current role in EBM education, Health Sciences Librarians (HSLs), as experts, should be able to contribute to the assessment of medical student EBM competence. The purpose of this study is to explore the HSLs perspective on EBM assessment practices, both current state and potential future activities. Methods: We conducted focus groups with librarians from across the United States to explore their perceptions of assessing EBM competence in medical students. Participants had been trained to be raters of EBM competence as part of a novel Objective Structured Clinical Examination (OSCE). This OSCE was just the starting point and the discussion covered topics of current EBM assessment and possibility for expanded responsibilities at their own institutions. We used a reflexive thematic analysis approach to construct themes from our conversations. Results: We constructed eight themes in four broad categories that influence the success of librarians being able to engage in effective assessment of EBM: administrative, curricular, medical student, and librarian. Conclusion: Our results inform medical school leadership by pointing out the modifiable factors that enable librarians to be more engaged in conducting effective assessment. They highlight the need for novel tools, like EBM OSCEs, that can address multiple barriers and create opportunities for deeper integration of librarians into assessment processes.

A critical systematic review assessing undergraduate neurology pipeline programs.

Background: Although current programs exist to encourage undergraduate interest in neuroscience and neurology, few students go on to pursue a career in neurology. Thus, there is a need for more neurologists in the US. To assess undergraduate pipeline programs and their goals of garnering interest and knowledge of neurology, we systematically reviewed available literature on existing undergraduate neurology pipeline programs. Methods: A medical librarian conducted an electronic database search of PubMed, EMBASE, PsycINFO, Education Source, and ERIC based on a search strategy developed with a team of undergraduates and a neurologist. Of the 2,852 articles screened, 33 met the systematic review criteria and were evaluated based on the type and goal of the pipeline program, its delivery, and efficacy. Results: The 33 programs were classified into subtypes of pipeline programs, with focuses ranging from student-led projects to early clinical research opportunities. All programs were found to be successful in attracting student interest in neurology, providing exposure to relevant opportunities, and classroom enrichment. Discussion: The existing literature shows that neurology pipeline programs successfully inspire interest in a career in neurology among undergraduate students. These programs are valuable supplements to undergraduate neuroscience curricula and instrumental in introducing students to various fields.

A critical systematic review of K-12 neurology/neuroscience pipeline programs.

Background: Early exposure to neuroscience is imperative to strengthening the neuroscience and neurology pipeline and may present an avenue for increasing the number of practicing neurologists and diversifying the neuroscience workforce. Our objective was to systematically review existing K-12 neuroscience education and outreach programs to understand what educational programs have been developed and implemented. Methods: We conducted an electronic database search of PubMed, EMBASE, PsycINFO, Education Source, and ERIC. All eligible articles were systematically reviewed to examine the type of program developed, target age group, implementation, and efficacy. Results: Our search produced 2,574 results, from which 23 articles were deemed eligible. The breakdown by age group was as follows: 5 elementary school, 8 middle school, 8 high school, and 2 general K-12 range of students. Six articles described programs intended for URM students. All programs were found to be successful in exposing students to neuroscience and inspiring interest in pursuing a career in the field of neurology. Discussion: Further efforts are necessary to analyze the long-term effectiveness of K-12 neuroscience education and outreach programs in overcoming the shortage of neurologists and explore the impact of mentorship for various age groups among K-12.Systematic review registrationhttps://doi.org/10.17605/OSF.IO/2G8CN.

Are brief febrile seizures benign? A systematic review and narrative synthesis.

Febrile seizures affect 2%-5% of U.S. children and are considered benign although associated with an increased risk of epilepsy and, rarely, with sudden unexplained death. We compared rates of mortality, neurodevelopmental disorders, and neuropathology in young children with simple and complex febrile seizures to healthy controls. We systematically reviewed studies of 3- to 72-month-old children with simple or complex febrile seizures ≤30 min. We searched studies with outcome measures on mortality, neurodevelopment, or neuropathology through July 18, 2022. Bias risk was assessed per study design. Each outcome measure was stratified by study design. PROSPERO registration is CRD42022361645. Twenty-six studies met criteria reporting mortality (11), neurodevelopment (11), and neuropathology (13), including 2665 children with febrile seizures and 1206 seizure-free controls. Study designs varied: 15 cohort, 2 cross-sectional, 3 case-control, 5 series, and 1 case report. Mortality outcomes showed stark contrasts. Six cohort studies following children after febrile seizure (n = 1348) reported no deaths, whereas four child death series and 1 case report identified 24.1% (108/449) deaths associated with simple (n = 104) and complex (n = 3) febrile seizures ≤30 min. Minor hippocampal histopathological anomalies were common in sudden deaths with or without febrile seizure history. Most electroencephalography (EEG) studies were normal. Neuroimaging studies suggested increased right hippocampal volumes. When present, neurodevelopmental problems usually preexisted febrile-seizure onset. Risk bias was medium or high in 95% (18/19) of cohort and case-control studies vs medium to low across remaining study designs. Research on outcomes after simple or brief complex febrile seizures is limited. Cohort studies suffered from inadequate sample size, bias risk, and limited follow-up durations to make valid conclusions on mortality, neurodevelopment, and neuropathology. Sudden death registries, focused on a very small percentage of all cases, strongly suggest that simple febrile seizures are associated with increased mortality. Although most children with febrile seizures have favorable outcomes, longer-term prospective studies are needed.