YouTube as a source of education in perioperative anesthesia for patients and trainees: a systematic review.

BACKGROUND: Online video sharing platforms like YouTube (Google LLC, San Bruno, CA, USA) have become a substantial source of health information. We sought to conduct a systematic review of studies assessing the overall quality of perioperative anesthesia videos on YouTube. METHODS: We searched Embase, MEDLINE, and Ovid for articles published from database inception to 1 May 2023. We included primary studies evaluating YouTube videos as a source of information regarding perioperative anesthesia. We excluded studies not published in English and studies assessing acute or chronic pain. Studies were screened and data were extracted in duplicate by two reviewers. We appraised the quality of studies according to the social media framework published in the literature. We used descriptive statistics to report the results using mean, standard deviation, range, and n/total N (%). RESULTS: Among 8,908 citations, we identified 14 studies that examined 796 videos with 59.7 hr of content and 47.5 million views. Among the 14 studies that evaluated the video content quality, 17 different quality assessment tools were used, only three of which were externally validated (Global Quality Score, modified DISCERN score, and JAMA score). Per global assessment rating of video quality, 11/13 (85%) studies concluded the overall video quality as poor. CONCLUSIONS: Overall, the educational content quality of YouTube videos evaluated in the literature accessible as an educational resource regarding perioperative anesthesia was poor. While these videos are in demand, their impact on patient and trainee education remains unclear. A standardized methodology for evaluating online videos is merited to improve future reporting. A peer-reviewed approach to online open-access videos is needed to support patient and trainee education in anesthesia. STUDY REGISTRATION: Open Science Framework ( https://osf.io/ajse9 ); first posted, 1 May 2023.

RéSUMé: CONTEXTE: Les plateformes de partage de vidéos en ligne comme YouTube (Google LLC, San Bruno, CA, États-Unis) sont devenues une source importante d'informations sur la santé. Nous avons cherché à réaliser une revue systématique des études évaluant la qualité globale des vidéos d'anesthésie périopératoire sur YouTube. MéTHODE: Nous avons recherché des articles dans Embase, MEDLINE et Ovid publiés depuis la création de ces bases de données jusqu'au 1er mai 2023. Nous avons inclus des études primaires évaluant les vidéos YouTube comme source d'information sur l'anesthésie périopératoire. Nous avons exclu les études publiées dans une langue autre que l'anglais et les études évaluant la douleur aiguë ou chronique. Les études ont été examinées et les données ont été extraites en double par deux personnes. Nous avons évalué la qualité des études selon le cadre des médias sociaux publié dans la littérature. Nous avons utilisé des statistiques descriptives pour rapporter les résultats en utilisant la moyenne, l'écart type, la plage et n/total N (%). RéSULTATS: Parmi 8908 citations, nous avons identifié 14 études qui ont examiné 796 vidéos avec 59,7 heures de contenu et 47,5 millions de vues. Parmi les 14 études qui ont évalué la qualité du contenu vidéo, 17 outils d'évaluation de la qualité différents ont été utilisés, dont seulement trois ont été validés en externe (Score Global Quality, score DISCERN modifié et score JAMA). Selon l'évaluation globale de la qualité des vidéos, 11 études sur 13 (85 %) ont conclu que la qualité globale des vidéos était médiocre. CONCLUSION: Dans l'ensemble, la qualité du contenu éducatif des vidéos YouTube évaluées dans la littérature accessible en tant que ressource éducative concernant l'anesthésie périopératoire était médiocre. Bien que ces vidéos soient très demandées, leur impact sur la formation de la patientèle et des stagiaires reste incertain. Une méthodologie normalisée d'évaluation des vidéos en ligne est nécessaire pour améliorer les évaluations futures. Une approche évaluée par les pairs pour les vidéos en libre accès en ligne est nécessaire pour soutenir la formation de la patientèle et des stagiaires en anesthésie. ENREGISTREMENT DE L'éTUDE: Open Science Framework ( https://osf.io/ajse9 ); première publication le 1er mai 2023.

Harnessing artificial intelligence in bariatric surgery: comparative analysis of ChatGPT-4, Bing, and Bard in generating clinician-level bariatric surgery recommendations.

BACKGROUND: The formulation of clinical recommendations pertaining to bariatric surgery is essential in guiding healthcare professionals. However, the extensive and continuously evolving body of literature in bariatric surgery presents considerable challenge for staying abreast of latest developments and efficient information acquisition. Artificial intelligence (AI) has the potential to streamline access to the salient points of clinical recommendations in bariatric surgery. OBJECTIVES: The study aims to appraise the quality and readability of AI-chat-generated answers to frequently asked clinical inquiries in the field of bariatric and metabolic surgery. SETTING: Remote. METHODS: Question prompts inputted into AI large language models (LLMs) and were created based on pre-existing clinical practice guidelines regarding bariatric and metabolic surgery. The prompts were queried into 3 LLMs: OpenAI ChatGPT-4, Microsoft Bing, and Google Bard. The responses from each LLM were entered into a spreadsheet for randomized and blinded duplicate review. Accredited bariatric surgeons in North America independently assessed appropriateness of each recommendation using a 5-point Likert scale. Scores of 4 and 5 were deemed appropriate, while scores of 1-3 indicated lack of appropriateness. A Flesch Reading Ease (FRE) score was calculated to assess the readability of responses generated by each LLMs. RESULTS: There was a significant difference between the 3 LLMs in their 5-point Likert scores, with mean values of 4.46 (SD .82), 3.89 (.80), and 3.11 (.72) for ChatGPT-4, Bard, and Bing (P < .001). There was a significant difference between the 3 LLMs in the proportion of appropriate answers, with ChatGPT-4 at 85.7%, Bard at 74.3%, and Bing at 25.7% (P < .001). The mean FRE scores for ChatGPT-4, Bard, and Bing, were 21.68 (SD 2.78), 42.89 (4.03), and 14.64 (5.09), respectively, with higher scores representing easier readability. CONCLUSIONS: LLM-based AI chat models can effectively generate appropriate responses to clinical questions related to bariatric surgery, though the performance of different models can vary greatly. Therefore, caution should be taken when interpreting clinical information provided by LLMs, and clinician oversight is necessary to ensure accuracy. Future investigation is warranted to explore how LLMs might enhance healthcare provision and clinical decision-making in bariatric surgery.

YouTube as a Source of Patient and Trainee Education in Vascular Surgery: A Systematic Review.

Objective: Due to its video based approach, YouTube has become a widely accessed educational resource for patients and trainees. This systematic review characterised and evaluated the peer reviewed literature investigating YouTube as a source of patient or trainee education in vascular surgery. Data sources: A comprehensive literature search was conducted using EMBASE, MEDLINE, and Ovid HealthStar from inception until 19 January 2023. All primary studies and conference abstracts evaluating YouTube as a source of vascular surgery education were included. Review methods: Video educational quality was analysed across several factors, including pathology, video audience, and length. Results: Overall, 24 studies were identified examining 3 221 videos with 123.1 hours of content and 37.1 million views. Studies primarily examined YouTube videos on diabetic foot care (7/24, 29%), peripheral arterial disease (3/24, 13%), carotid artery stenosis (3/24, 13%), varicose veins (3/24, 13%), and abdominal aortic aneurysm (2/24, 8%). Video educational quality was analysed using standardised assessment tools, author generated scoring systems, or global author reported assessment of quality. Six studies assessed videos for trainee education, while 18 studies evaluated videos for patient education. Among the 20 studies which reported on the overall quality of educational content, 10/20 studies deemed it poor, and 10/20 studies considered it fair, with 53% of studies noting poor educational quality for videos intended for patients and 40% of studies noting poor educational quality in videos intended for trainees. Poor quality videos had more views than fair quality videos (mean 27 348, 95% CI 15 154-39 543 views vs. 11 372, 95% CI 3 115-19 629 views, p = .030). Conclusion: The overall educational quality of YouTube videos for vascular surgery patient and trainee education is suboptimal. There is significant heterogeneity in the quality assessment tools used in their evaluation. A standardised approach to online education with a consistent quality assessment tool is required to better support online patient and trainee education in vascular surgery.

Assessing the robustness of positive vascular surgery randomized controlled trials using their fragility index.

OBJECTIVE: The fragility index (FI) measures the robustness of statistically significant findings in randomized controlled trials (RCTs) by quantifying the minimum number of event conversions required to reverse a dichotomous outcome's statistical significance. In vascular surgery, many clinical guidelines and critical decision-making points are informed by a handful of key RCTs, especially regarding open surgical versus endovascular treatment. The objective of this study is to evaluate the FI of RCTs with statistically significant primary outcomes that compared open vs endovascular surgery in vascular surgery. METHODS: In this meta-epidemiological study and systematic review, MEDLINE, Embase, and CENTRAL were searched for RCTs comparing open versus endovascular treatments for abdominal aortic aneurysms, carotid artery stenosis, and peripheral arterial disease to December 2022. RCTs with statistically significant primary outcomes were included. Data screening and extraction were conducted in duplicate. The FI was calculated by adding an event to the group with the smaller number of events while subtracting a nonevent to the same group until Fisher's exact test produced a nonstatistically significant result. The primary outcome was the FI and proportion of outcomes where the loss to follow-up was greater than the FI. The secondary outcomes assessed the relationship of the FI to disease state, presence of commercial funding, and study design. RESULTS: Overall, 5133 articles were captured in the initial search with 21 RCTs reporting 23 different primary outcomes being included in the final analysis. The median FI (first quartile, third quartile) was 3 (3, 20) with 16 outcomes (70%) reporting a loss to follow-up greater than its FI. Mann-Whitney U test revealed that commercially funded RCTs and composite outcomes had greater FIs (median, 20.0 [5.5, 24.5] vs median, 3.0 [2.0, 5.5], P = .035; median, 21 [8, 38] vs median, 3.0 [2.0, 8.5], P = .01, respectively). The FI did not vary between disease states (P = .285) or between index and follow-up trials (P = .147). There were significant correlations between the FI and P values (Pearson r = 0.90; 95% confidence interval, 0.77-0.96), and the number of events (r = 0.82; 95% confidence interval, 0.48-0.97). CONCLUSIONS: A small number of event conversions (median, 3) are needed to alter the statistical significance of primary outcomes in vascular surgery RCTs evaluating open surgical and endovascular treatments. Most studies had loss to follow-up greater than its FI, which can call into question trial results, and commercially funded studies had a greater FI. The FI and these findings should be considered in future trial design in vascular surgery.

Development of an Artificial Intelligence Tool for Intraoperative Guidance During Endovascular Abdominal Aortic Aneurysm Repair.

BACKGROUND: Adverse events during surgery can occur in part due to errors in visual perception and judgment. Deep learning is a branch of artificial intelligence (AI) that has shown promise in providing real-time intraoperative guidance. This study aims to train and test the performance of a deep learning model that can identify inappropriate landing zones during endovascular aneurysm repair (EVAR). METHODS: A deep learning model was trained to identify a "No-Go" landing zone during EVAR, defined by coverage of the lowest renal artery by the stent graft. Fluoroscopic images from elective EVAR procedures performed at a single institution and from open-access sources were selected. Annotations of the "No-Go" zone were performed by trained annotators. A 10-fold cross-validation technique was used to evaluate the performance of the model against human annotations. Primary outcomes were intersection-over-union (IoU) and F1 score and secondary outcomes were pixel-wise accuracy, sensitivity, specificity, positive predictive value (PPV), and negative predictive value (NPV). RESULTS: The AI model was trained using 369 images procured from 110 different patients/videos, including 18 patients/videos (44 images) from open-access sources. For the primary outcomes, IoU and F1 were 0.43 (standard deviation ± 0.29) and 0.53 (±0.32), respectively. For the secondary outcomes, accuracy, sensitivity, specificity, NPV, and PPV were 0.97 (±0.002), 0.51 (±0.34), 0.99 (±0.001). 0.99 (±0.002), and 0.62 (±0.34), respectively. CONCLUSIONS: AI can effectively identify suboptimal areas of stent deployment during EVAR. Further directions include validating the model on datasets from other institutions and assessing its ability to predict optimal stent graft placement and clinical outcomes.

Intraoperative use of balanced crystalloids versus 0.9% saline: a systematic review and meta-analysis of randomised controlled studies.

BACKGROUND: The evidence regarding optimal crystalloid use in the perioperative period remains unclear. As the primary aim of this study, we sought to summarise the data from RCTs examining whether use of balanced crystalloids compared with 0.9% saline (saline) leads to differences in patient-important outcomes. METHODS: We searched Ovid MEDLINE, Embase, the Cochrane library, and Clinicaltrials.gov, from inception until December 15, 2022, and included RCTs that intraoperatively randomised adult participants to receive either balanced fluids or saline. We pooled data using a random-effects model and present risk ratios (RRs) or mean differences (MDs), along with 95% confidence intervals (CIs). We assessed individual study risk of bias using the modified Cochrane tool, and certainty of evidence using GRADE. RESULTS: Of 5959 citations, we included 38 RCTs (n=3776 patients). Pooled analysis showed that intraoperative use of balanced fluids compared with saline had an uncertain effect on postoperative mortality analysed at the longest point of follow-up (RR 1.51, 95% CI: 0.42-5.36) and postoperative need for renal replacement therapy (RR 0.95, 95% CI: 0.56-1.59), both very low certainty. Furthermore, use of balanced crystalloids probably leads to a higher postoperative serum pH (MD 0.05, 95% CI: 0.04-0.06), moderate certainty. CONCLUSIONS: Use of balanced crystalloids, compared with saline, in the perioperative setting has an uncertain effect on mortality and need for renal replacement therapy but probably improves postoperative acid-base status. Further research is needed to determine whether balanced crystalloid use affects patient-important outcomes. CLINICAL TRIAL REGISTRATION: CRD42022367593.

Six ways to maximize survey response rates: lessons from a medical school accreditation survey in a Canadian setting.

Background: Surveys are being increasingly used to gather feedback and study data in healthcare professions. However, it may be challenging to achieve high response rates in surveys administered to healthcare professionals. The aim of this paper is to report six strategies that contributed to a high response rate on the Independent Student Analysis at the University of Toronto (U of T), which can be applied to other surveys to achieve strong response rates amongst healthcare professionals. Methods: In 2019, as part of accreditation for the U of T MD Program, we conducted the Independent Student Analysis, a student-led survey examining a medical student's experience. We review and critically evaluate the factors that contributed to a robust response rate amongst one of the largest cohorts of medical students in Canada. Results: Among 1080 students in the MD program, we achieved an unprecedented response rate of 87.2%. Six factors were identified that most contributed to our high response rate, including: faculty support, student representation, eliciting participant feedback, creating protected time for completion, offering incentives, and generating awareness. Conclusions: Eliciting high survey response rates from medical learners can be challenging. However, with careful consideration of learner feedback and effective employment of the strategies discussed in this paper, medical school faculty may better engage students in survey completion, achieving higher response rates and gathering richer insight, which can be used to more effectively enact meaningful change amongst healthcare professionals.

Contexte: Les enquêtes auprès de professionnels de la santé sont de plus en plus utilisées pour recueillir et étudier des perspectives et des données, mais il peut s'avérer difficile d'obtenir des taux de réponse élevés. Cet article vise à présenter six stratégies qui ont permis de susciter une forte participation à l'enquête de l'Analyse indépendante des étudiants à l'Université de Toronto et qui peuvent être transposées à d'autres contextes de sondage auprès des professionnels du domaine.En 2019, dans le cadre du processus d'agrément du programme de doctorat en médecine de l'Université de Toronto, nous avons réalisé l'Analyse indépendante des étudiants, une enquête dirigée par les étudiants en médecine visant à examiner leur expérience. Nous passons en revue et évaluons de manière critique les facteurs qui ont contribué à l'atteinte d'un taux de réponse élevé auprès d'une des plus grandes cohortes d'étudiants en médecine au Canada. Résultats: Nous avons obtenu un taux de réponse sans précédent de 87,2 % parmi les 1 080 étudiants inscrits au programme de médecine. Les six facteurs qui ont le plus contribué à ce taux de réponse élevé sont : le soutien du corps professoral, la représentation des étudiants, leur participation à la conception de l'enquête, la création de plages horaires réservées pour remplir le questionnaire, l'offre d'incitatifs et la sensibilisation. Conclusions: Il peut être difficile de susciter une forte participation aux questionnaires chez les étudiants en médecine. Cependant, en considérant attentivement les commentaires des apprenants et en utilisant efficacement les stratégies présentées dans cet article, le corps professoral seront en mesure de mobiliser les étudiants à participer davantage aux enquêtes et de tirer profit de leur apport pour éclairer la promotion de changements pertinents chez les professionnels de la santé.

Evaluating YouTube as a Source of Education for Patients Undergoing Surgery: A Systematic Review.

OBJECTIVE: The objective of this systematic review is to characterize the peer-reviewed literature investigating YouTube as a source of patient education for patients undergoing surgery. SUMMARY BACKGROUND DATA: YouTube is the largest online video sharing platform and has become a substantial source of health information that patients are likely to access before surgery, yet there has been no systematic assessment of peer-reviewed studies. A comprehensive literature search was conducted using EMBASE, MEDLINE, and Ovid HealthStar from inception through to December of 2021. METHODS: All primary studies evaluating YouTube as a source of patient education relating to surgical procedures (general, cardiac, urology, otolaryngology, plastic, vascular) were included. Study screening and data extraction occurred in duplicate with two reviewers. Characteristics extracted included video length, view count, upload source, overall video educational quality, and quality of individual studies. RESULTS: Among 6,453 citations, 56 studies were identified that examined 6,797 videos with 547 hours of content and 1.39 billion views. There were 49 studies that evaluated the educational quality of the videos. A total of 43 quality assessment tools were used, with each study using a mean of 1.90 assessment tools. Per the global rating for assessments, 34/49 studies (69%) concluded that the overall quality of educational content was poor. CONCLUSIONS: While the impact of non-peer-reviewed YouTube videos on patient knowledge for surgery is unclear, the large amount of online content suggests that they are in demand. The overall educational content of these videos is poor, however, and there is substantial heterogeneity in the quality assessment tools used in their evaluation. A peer-reviewed and standardized approach to online education with video content is needed to better support patients.

Fragility of statistically significant outcomes in randomized trials comparing bariatric surgeries.

BACKGROUND: Randomized controlled trials (RCTs) are regarded as high-level evidence, but the strength of their P values can be difficult to ascertain. The Fragility Index (FI) is a novel metric that evaluates the frailty of trial findings. It is defined as the minimum number of patients required to change from a non-event to event for the findings to lose statistical significance. This study aims to characterize the robustness of bariatric surgery RCTs by examining their FIs. METHODS: A search was conducted in MEDLINE, EMBASE, and CENTRAL from January 2000 to February 2022 for RCTs comparing two bariatric surgeries with statistically significant dichotomous outcomes. Bivariate correlation was conducted to identify associations between FI and trial characteristics. RESULTS: A total of 35 RCTs were included with a median sample size of 80 patients (Interquartile range [IQR] 58-109). The median FI was 2 (IQR 0-5), indicating that altering the status of two patients in one treatment arm would overturn the statistical significance of results. Subgroup analyses of RCTs evaluating diabetes-related outcomes produced a FI of 4 (IQR 2-6.5), while RCTs comparing Roux-en-Y gastric bypass and sleeve gastrectomy had an FI of 2 (IQR 0.5-5). Increasing FI was found to be correlated with decreasing P value, increasing sample size, increasing number of events, and increasing journal impact factor. CONCLUSION: Bariatric surgery RCTs are fragile, with only a few patients required to change from non-events to events to reverse the statistical significance of most trials. Future research should examine the use of FI in trial design.

Fragility of statistically significant findings from randomized trials in comparing laparoscopic versus robotic abdominopelvic surgeries.

BACKGROUND: Utility of robotic over laparoscopic approach has been an area of debate across all surgical specialties over the past decade. The fragility index (FI) is a metric that evaluates the frailty of randomized controlled trials (RCTs) findings by altering the status of patients from an event to non-event until significance is lost. This study aims to evaluate the robustness of RCTs comparing laparoscopic and robotic abdominopelvic surgeries through the FI. METHODS: A search was conducted in MEDLINE and EMBASE for RCTs with dichotomous outcomes comparing laparoscopic and robot-assisted surgery in general surgery, gynecology, and urology. The FI and reverse fragility Index (RFI) metrics were used to assess the strength of findings reported by RCTs, and bivariate correlation was conducted to analyze relationships between FI and trial characteristics. RESULTS: A total of 21 RCTs were included, with a median sample size of 89 participants (Interquartile range [IQR] 62-126). The median FI was 2 (IQR 0-15) and median RFI 5.5 (IQR 4-8.5). The median FI was 3 (IQR 1-15) for general surgery (n = 7), 2 (0.5-3.5) for gynecology (n = 4), and 0 (IQR 0-8.5) for urology RCTs (n = 4). Correlation was found between increasing FI and decreasing p-value, but not sample size, number of outcome events, journal impact factor, loss to follow-up, or risk of bias. CONCLUSION: RCTs comparing laparoscopic and robotic abdominal surgery did not prove to be very robust. While possible advantages of robotic surgery may be emphasized, it remains novel and requires further concrete RCT data.

Implementing the IMIST-AMBO tool for paramedic to trauma team handovers: a video review analysis.

OBJECTIVE: Patient handover between paramedics and the trauma team is vulnerable to communication errors that may adversely affect patient care. This study assesses the feasibility of a handover tool, IMIST-AMBO (acronym of categories), implementation in the trauma bay and evaluates the degree to which it improves handover metrics. METHODS: This is a prospective observational cohort study conducted at Canada's largest level-one trauma center. Feasibility of the tool implementation and improvement in handover metrics were assessed. Strategies for implementation included distribution of an educational video and posters, and point-of-care reminders in the trauma bay. Two reviewers independently assessed video recordings of handovers to evaluate handover metrics. Findings were compared to data obtained during a knowledge gap analysis conducted prior to the initiation of this study at the same institution. RESULTS: Over 13 weeks (August to November 2020), 140 videos were recorded, of which 80 used the IMIST-AMBO tool (compliance of 57%). Paramedic adherence to the handover structure occurred in 70.4% of cases, with greater adherence to the IMIST (82.2%) compared to the AMBO (47.1%) section. The mean (± standard deviation) handover duration was shorter (1 min:58 s ± 0:44 s during implementation vs. 2 min:47 s ± 1:14 s pre-implementation, [p < 0.001]). Frequency of parallel conversations and informal handovers improved (61% to 30% and 65% to 13%, [p < 0.001], respectively). Interruptions during the handover decreased from 3.05 (± 1.95) to 1.5 (± 1.7), p < 0.001. The tool was received favorably among study participants. CONCLUSION: The IMIST-AMBO tool reduced the frequency of interruptions, parallel conversations, and informal handovers during paramedic-trauma team handovers at our institution. The quality and amount of information communicated per handover improved, all with a decrease in handover duration. The IMIST-AMBO tool may be applied to other trauma centers across Canada, or more broadly on an international scale.

RéSUMé: OBJECTIFS: Le transfert des patients entre les ambulanciers paramédicaux et l'équipe de traumatologie est vulnérable aux erreurs de communication qui peuvent nuire aux soins aux patients. Cette étude évalue la faisabilité d'un outil de transfert, IMIST-AMBO (acronyme des catégories), mis en œuvre dans le service de traumatologie et évalue dans quelle mesure il améliore les paramètres de transfert. MéTHODES: Il s'agit d'une étude de cohorte observationnelle prospective menée dans le plus grand centre de traumatologie de niveau 1 du Canada. La faisabilité de la mise en œuvre de l'outil et l'amélioration des paramètres de transfert ont été évaluées. Les stratégies de mise en œuvre comprenaient la distribution d'une vidéo et d'affiches éducatives, ainsi que des rappels au point de service dans la salle de traumatologie. Deux examinateurs ont évalué indépendamment les enregistrements vidéo des transferts pour évaluer les paramètres de transfert. Les résultats ont été comparés aux données obtenues lors d'une analyse des lacunes en matière de connaissances réalisée avant le lancement de cette étude dans le même établissement. RéSULTATS: Sur 13 semaines (août à novembre 2020), 140 vidéos ont été enregistrées, dont 80 ont utilisé l'outil IMIST-AMBO (conformité de 57%). L'adhésion des ambulanciers paramédicaux à la structure de transfert s'est produite dans 70.4% des cas, avec une plus grande adhésion à l'IMIST (82.2%) que l'AMBO (47,1%). La durée moyenne (± écart-type) du transfert était plus courte (1 min: 58 s ± 0: 44 s pendant la mise en œuvre contre 2 min: 47 s ± 1: 14 s avant la mise en œuvre, p < 0.001). La fréquence des conversations parallèles et des transferts informels s'est améliorée (de 61% à 30% et de 65% à 13%, [p < 0.001], respectivement). Les interruptions pendant le transfert ont diminué de 3.05 (± 1.95) à 1.5 (± 1.7), p < 0.001. L'outil a été accueilli favorablement par les participants à l'étude. CONCLUSION: L'outil IMIST-AMBO a réduit la fréquence des interruptions, des conversations parallèles et des transferts informels pendant les transferts de l'équipe paramédicale de traumatologie dans notre établissement. La qualité et la quantité d'informations communiquées par transfert se sont améliorées, tout en réduisant la durée du transfert. L'outil IMIST-AMBO peut être appliqué à d'autres centres de traumatologie à travers le Canada, ou plus largement à l'échelle internationale.

Completeness of reporting in systematic reviews and meta-analyses in vascular surgery.

OBJECTIVE: Systematic reviews (SRs) and meta-analyses are essential in informing clinical guidelines and decision-making. Complete reporting of SRs through compliance to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines promotes transparency, reproducibility, and consistency across the literature. The purpose of this meta-epidemiological study is to assess the completeness of reporting of SRs in the vascular surgery literature. METHODS: MEDLINE and Embase were used to search through four major vascular surgery journals and four high impact general medical journals for SRs published between 2018 and October 2022 evaluating clinical treatments for any pathology treated by a vascular surgeon. Data screening and extraction were conducted in duplicate. The reporting completeness of each included SR was measured with reference to the 27-item PRISMA checklist, and methodological quality was evaluated using the Assessing the Methodological Quality of Systematic Reviews 2 (AMSTAR 2) tool. Parametric tests were used to evaluate for associations between PRISMA score and study funding, protocol registration, publication in a higher impact factor journal, and AMSTAR 2 score. The protocol is available online: 10.17605/OSF.IO/VBC5N. RESULTS: Of 1653 articles captured in the initial search, 162 SRs were included in the final analysis. All SRs had more than one incomplete PRISMA item. The mean PRISMA score was 21.2/27 (standard deviation: 2.9, 78.5% compliance), and the mean AMSTAR 2 score was 11.7/16 (standard deviation: 1.9, 73%). SRs that had a prospectively registered protocol had a higher PRISMA score (22.9 vs 20.6, P < .001) as did those that were published in higher impact factor journals (23.3 vs 21.0, P = .017). There was a large positive correlation between an SR's PRISMA and AMSTAR 2 scores (Pearson r = 0.655, 95% confidence interval: 0.55-0.74). There were no associations between the PRISMA score and publication year (P = .067) or funding status (P = .076). CONCLUSIONS: Overall, the reporting of SRs and meta-analyses in vascular surgery is less than ideal, with several key items being consistently under-reported. Prospective registration and methodological quality as measured by AMSTAR 2 scores are positively associated with improved reporting. Authors, reviewers, and journal editors should consider these findings moving forward to encourage completeness of SR reporting. Raising awareness surrounding the value of complete reporting of SRs can aid in enhancing the quality of evidence, and journals should consider these findings in methods used to promote SR reporting.

The fragility of significant results from randomized controlled trials in esophageal surgeries.

While randomized controlled trials (RCTs) are regarded as one of the highest forms of clinical research, the robustness of their P values can be difficult to ascertain. Defined as the minimum number of patients in a study arm that would need to be changed from a non-event to event for the findings to lose significance, the Fragility Index is a method for evaluating results from these trials. This study aims to calculate the Fragility Index for trials evaluating perioperative esophagectomy-related interventions to determine the strength of RCTs in this field. MEDLINE and EMBASE were searched for RCTs related to esophagectomy that reported a significant dichotomous outcome. Two reviewers independently screened articles and performed the data extractions with risk of bias assessment. The Fragility Index was calculated using a two-tailed Fisher's exact test. Bivariate correlation was conducted to evaluate associations between the Fragility Index and study characteristics. 41 RCTs were included, and the median sample size was 80 patients [Interquartile range (IQR) 60-161]. Of the included outcomes, 29 (71%) were primary, and 12 (29%) were secondary. The median Fragility Index was 1 (IQR 1-3), meaning that by changing one patient from a non-event to event, the results would become non-significant. Fragility Index was correlated with P value, number of events, and journal impact factor. The RCTs related to esophagectomy did not prove to be robust, as the significance of their results could be changed by altering the outcome status of a handful of patients in one study arm.

Assessing the robustness of negative vascular surgery randomized controlled trials using their reverse fragility index.

OBJECTIVE: The reverse fragility index (RFI) describes the number of event conversions needed to convert a statistically nonsignificant dichotomous outcome to a significant one. The objective of the present study was to assess the RFI of vascular surgery randomized controlled trials (RCTs) comparing endovascular vs open surgery for the treatment of abdominal aortic aneurysms (AAAs), carotid artery stenosis (CAS), and peripheral artery disease (PAD). METHODS: MEDLINE and Embase were searched for RCTs that had investigated AAAs, CAS, or PAD with statistically nonsignificant binary primary outcomes. The primary outcome for the present study was the median RFI. Calculation of the RFI was performed by creating two-by-two contingency tables and subtracting events from the group with fewer events and adding nonevents to the same group until a two-tailed Fisher exact test had produced a statistically significant result (P ≤ .05). RESULTS: Of 4187 reports, 49 studies reporting 103 different primary end points were included. The overall median RFI was 7 (interquartile range [IQR], 5-13). The specific RFIs for AAA, CAS, and PAD were 10 (IQR, 6-15.5), 6 (IQR, 5-9.5), and 7 (IQR, 5.5-10), respectively. Of the 103 end points, 42 (47%) had had a loss to follow-up greater than the RFI, of which 10 were AAA trials (24%), 23 were CAS trials (55%), and 9 were PAD trials (21%). The Pearson correlation demonstrated a significant positive relationship between a study's RFI and the impact factor of its publishing journal (r = 0.38; 95% confidence interval [CI], 0.20-0.54; P < .01), length of follow-up (r = 0.43; 95% CI, 0.26-0.58; P < .01), and sample size (r = 0.28; 95% CI, 0.09-0.45; P < .01). CONCLUSIONS: A small number of events (median, 7) was required to change the outcome of negative RCTs from statistically nonsignificant to significant, with 47% of the studies having missing data that could have reversed the finding of its primary outcome. Reporting of the RFI relative to the loss to follow-up could be of benefit in future trials and provide confidence regarding the robustness of the P value.

A Systematic Review and Bibliometric Analysis of Applications of Artificial Intelligence and Machine Learning in Vascular Surgery.

BACKGROUND: Artificial intelligence (AI) and machine learning (ML) have seen increasingly intimate integration with medicine and healthcare in the last 2 decades. The objective of this study was to summarize all current applications of AI and ML in the vascular surgery literature and to conduct a bibliometric analysis of published studies. METHODS: A comprehensive literature search was conducted through Embase, MEDLINE, and Ovid HealthStar from inception until February 19, 2021. Reporting of this study was conducted using the Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines. Title and abstract screening, full-text screening, and data extraction were conducted in duplicate. Data extracted included study metadata, the clinical area of study within vascular surgery, type of AI/ML method used, dataset, and the application of AI/ML. Publishing journals were classified as having either a clinical scope or technical scope. The author academic background was classified as clinical, nonclinical (e.g., engineering), or both, depending on author affiliation. RESULTS: The initial search identified 7,434 studies, of which 249 were included for a final analysis. The rate of publications is exponentially increasing, with 158 (63%) studies being published in the last 5 years alone. Studies were most commonly related to carotid artery disease (118, 47%), abdominal aortic aneurysms (51, 20%), and peripheral arterial disease (26, 10%). Study authors employed an average of 1.50 (range: 1-6) distinct AI methods in their studies. The application of AI/ML methods broadly related to predictive models (54, 22%), image segmentation (49, 19.4%), diagnostic methods (46, 18%), or multiple combined applications (91, 37%). The most commonly used AI/ML methods were artificial neural networks (155/378 use cases, 41%), support vector machines (64, 17%), k-nearest neighbors algorithm (26, 7%), and random forests (23, 6%). Datasets to which these AI/ML methods were applied frequently involved ultrasound images (87, 35%), computed tomography (CT) images (42, 17%), clinical data (34, 14%), or multiple datasets (36, 14%). Overall, 22 (9%) studies were published in journals specific to vascular surgery, with the majority (147/249, 59%) being published in journals with a scope related to computer science or engineering. Among 1,576 publishing authors, 46% had exclusively a clinical background, 48% a nonclinical background, and 5% had both a clinical and nonclinical background. CONCLUSIONS: There is an exponentially growing body of literature describing the use of AI and ML in vascular surgery. There is a focus on carotid artery disease and abdominal aortic disease, with many other areas of vascular surgery under-represented. Neural networks and support vector machines composed most AI methods in the literature. As AI/ML continue to see expanded applications in the field, it is important that vascular surgeons appreciate its potential and limitations. In addition, as it sees increasing use, there is a need for clinicians with expertise in AI/ML methods who can optimize its transition into daily practice.

Assessing effective mask use by the public in two countries: an observational study.

OBJECTIVES: During the COVID-19 pandemic wearing a mask in public has been recommended in some settings and mandated in others. How often this advice is followed, how well, and whether it inadvertently leads to more disease transmission opportunities due to a combination of improper use and physical distancing lapses is unknown. DESIGN: Cross-sectional observational study performed in June-August 2020. SETTING: Eleven outdoor and indoor public settings (some with mandated mask use, some without) each in Toronto, Ontario, and in Portland, Oregon. PARTICIPANTS: All passers-by in the study settings. OUTCOME MEASURES: Mask use, incorrect mask use, and number of breaches (ie, coming within 2 m of someone else where both parties were not properly masked). RESULTS: We observed 36 808 persons, the majority of whom were estimated to be aged 31-65 years (49%). Two-thirds (66.7%) were wearing a mask and 13.6% of mask-wearers wore them incorrectly. Mandatory mask-use settings were overwhelmingly associated with mask use (adjusted OR 79.2; 95% CI 47.4 to 135.1). Younger age, male sex, Torontonians, and public transit or airport settings (vs in a store) were associated with lower adjusted odds of wearing a mask. Mandatory mask-use settings were associated with lower adjusted odds of mask error (OR 0.30; 95% CI 0.14 to 0.73), along with female sex and Portland subjects. Subjects aged 81+ years (vs 31-65 years) and those on public transit and at the airport (vs stores) had higher odds of mask errors. Mask-wearers had a large reduction in adjusted mean number of breaches (rate ratio (RR) 0.19; 95% CI 0.17 to 0.20). The 81+ age group had the largest association with breaches (RR 7.77; 95% CI 5.32 to 11.34). CONCLUSIONS: Mandatory mask use was associated with a large increase in mask-wearing. Despite 14% of them wearing their masks incorrectly, mask users had a large reduction in the mean number of breaches (disease transmission opportunities). The elderly and transit users may warrant public health interventions aimed at improving mask use.

Examination of a Canada-Wide Collaboration Platform for Order Sets: Retrospective Analysis.

BACKGROUND: Knowledge translation and dissemination are some of the main challenges that affect evidence-based medicine. Web 2.0 platforms promote the sharing and collaborative development of content. Executable knowledge tools, such as order sets, are a knowledge translation tool whose localization is critical to its effectiveness but a challenge for organizations to develop independently. OBJECTIVE: This paper describes a Web 2.0 resource, referred to as the collaborative network (TCN), for order set development designed to share executable knowledge (order sets). This paper also analyzes the scope of its use, describes its use through network analysis, and examines the provision and use of order sets in the platform by organizational size. METHODS: Data were collected from Think Research's TxConnect platform. We measured interorganization sharing across Canadian hospitals using descriptive statistics. A weighted chi-square analysis was used to evaluate institutional size to share volumes based on institution size, with post hoc Cramer V score to measure the strength of association. RESULTS: TCN consisted of 12,495 order sets across 683 diagnoses or processes. Between January 2010 and March 2015, a total of 131 health care organizations representing 360 hospitals in Canada downloaded order sets 105,496 times. Order sets related to acute coronary syndrome, analgesia, and venous thromboembolism were most commonly shared. COVID-19 order sets were among the most actively shared, adjusting for order set lifetime. A weighted chi-square analysis showed nonrandom downloading behavior (P<.001), with medium-sized institutions downloading content from larger institutions acting as the most significant driver of this variance (chi-gram=124.70). CONCLUSIONS: In this paper, we have described and analyzed a Web 2.0 platform for the sharing of order set content with significant network activity. The robust use of TCN to access customized order sets reflects its value as a resource for health care organizations when they develop or update their own order sets.

How prepared are Canadian trauma centres for mass casualty incidents?

OBJECTIVES: Mass Casualty Incidents (MCIs) are rare but devastating events that require extensive planning in order to minimize morbidity and mortality. There are two broad categories limiting a hospital's response: physical assets (e.g., critical care beds, operating rooms, food, communication devices) as well as operating procedures (e.g., MCI committees, regional coordination, provider training). The purpose of this study is to provide an examination of MCI preparedness according to these categories in Level 1 Trauma Centre across Canada. METHODS: This study surveyed all Level 1 Trauma Centres across Canada in order to assess the physical assets and operating procedures they had in place in the event of a hypothetical MCI on one of the busiest days of the year for trauma care. RESULTS: Of the 28 Trauma Centres contacted, 13 completed surveys (46%). Most hospitals had sufficient food (9/13) water (9/13), fuel (7/13), and communication assets (8/13) for a hypothetical MCI. A median of 38 mechanical ventilators could be mobilized. No hospitals mandated physician training for MCIs, and 6/13 centres were certain that they had a Strategic Emergency Management Plan (SEMP). Only 6/13 hospitals had dedicated MCI committees, Overall, 4/13 hospitals had explicit plans developed with community hospitals. CONCLUSION: This study demonstrated that physical assets are generally less limiting than operating procedures. Four key areas of potential improvement have been identified: 1) provider training (especially physicians), 2) coordination with small hospitals, 3) mechanical ventilator availability, and 4) MCI committees with explicit Strategic Emergency Management Plans.

The International Federation for Emergency Medicine report on emergency department crowding and access block: A brief summary.

OBJECTIVE: To develop comprehensive guidance that captures international impacts, causes, and solutions related to emergency department crowding and access block. METHODS: Emergency physicians representing 15 countries from all IFEM regions composed the Task Force. Monthly meetings were held via video-conferencing software to achieve consensus for report content. The report was submitted and approved by the IFEM Board on June 1, 2020. RESULTS: A total of 14 topic dossiers, each relating to an aspect of ED crowding, were researched and completed collaboratively by members of the Task Force. CONCLUSIONS: The IFEM report is a comprehensive document intended to be used in whole or by section to inform and address aspects of ED crowding and access block. Overall, ED crowding is a multifactorial issue requiring systems-wide solutions applied at local, regional, and national levels. Access block is the predominant contributor of ED crowding in most parts of the world.

RéSUMé: OBJECTIFS: Développer des directives détaillées qui saisissent les impacts internationaux, les causes et les solutions liés au surpeuplement et blocages d'accès des urgences. MéTHODES: Des médecins d'urgence représentant 15 pays de toutes les régions de la Fédération Internationale de Médecine d'Urgence (IFEM) ont composé le groupe de travail. Des réunions mensuelles ont été organisées par le biais d'un logiciel de visioconférence afin de parvenir à un consensus sur le contenu du rapport. Le rapport a été soumis et approuvé par le Conseil d'administration de l'IFEM le 1er juin 2020. RéSULTATS : Au total, 14 dossiers thématiques, chacun se rapportant à un aspect de l'engorgement des urgences, ont été documentés et complétés conjointement par les membres du groupe de travail. CONCLUSIONS: Le rapport IFEM est un document détaillé destiné à être utilisé dans son intégralité ou par section pour renseigner et aborder les aspects du surpeuplement et du blocage d'accès des urgences. Dans l'ensemble, l'encombrement dans les services d'urgence est un problème multifactoriel qui nécessite des solutions à l'échelle systémique appliquées aux niveaux local, régional et national. Le blocage d'accès est le principal contributeur à l'engorgement des urgences dans la plupart des régions du monde.

The International Federation for Emergency Medicine report on emergency department crowding and access block: A brief summary.

OBJECTIVE: To develop comprehensive guidance that captures international impacts, causes, and solutions related to ED crowding and access block. METHODS: Emergency physicians representing 15 countries from all the International Federation for Emergency Medicine (IFEM) regions composed the task force. Monthly meetings were held via video-conferencing software to achieve consensus for report content. The report was submitted and approved by the IFEM Board on June 1, 2020. RESULTS: A total of 14 topic dossiers, each relating to an aspect of ED crowding, were researched and completed collaboratively by members of the task force. CONCLUSIONS: The IFEM report is a comprehensive document intended to be used in whole or by section to inform and address aspects of ED crowding and access block. Overall, ED crowding is a multifactorial issue requiring systems-wide solutions applied at local, regional, and national levels. Access block is the predominant contributor of ED crowding in most parts of the world.