Examining the application of the IDEAL framework in the reporting and evaluation of innovative invasive procedures: secondary qualitative analysis of a systematic review.

OBJECTIVES: The development of new surgical procedures is fundamental to advancing patient care. The Idea, Developments, Exploration, Assessment and Long-term (IDEAL) framework describes study designs for stages of innovation. It can be difficult to apply due to challenges in defining and identifying innovative procedures. This study examined how the IDEAL framework is operationalised in real-world settings; specifically, the types of innovations evaluated using the framework and how authors justify their choice of IDEAL study design. DESIGN: Secondary qualitative analysis of a systematic review. DATA SOURCES: Citation searches (Web of Science and Scopus) identified studies following the IDEAL framework and citing any of the ten key IDEAL/IDEAL_D papers. ELIGIBILITY CRITERIA: Studies of invasive procedures/devices of any design citing any of the ten key IDEAL/IDEAL_D papers. DATA EXTRACTION AND SYNTHESIS: All relevant text was extracted. Three frameworks were developed, namely: (1) type of innovation under evaluation; (2) terminology used to describe stage of innovation and (3) reported rationale for IDEAL stage. RESULTS: 48 articles were included. 19/48 described entirely new procedures, including those used for the first time in a different clinical context (n=15/48), reported as IDEAL stage 2a (n=8, 53%). Terminology describing stage of innovation was varied, inconsistent and ambiguous and was not defined. Authors justified their choice of IDEAL study design based on limitations in published evidence (n=36) and unknown feasibility and safety (n=32) outcomes. CONCLUSION: Identifying stage of innovation is crucial to inform appropriate study design and governance decisions. Authors' rationale for choice of IDEAL stage related to the existing evidence base or lack of sufficient outcome data for procedures. Stage of innovation was poorly defined with inconsistent descriptions. Further work is needed to develop methods to identify innovation to inform practical application of the IDEAL framework. Defining the concept of innovation in terms of uncertainty, risk and degree of evidence may help to inform decision-making.

Development and pilot testing of a patient-reported outcome measure to assess symptoms of parastomal hernia.

AIM: The aim was to develop and pilot a patient-reported outcome measure (PROM) to assess symptoms of parastomal hernia (PSH). METHODS: Standard questionnaire development was undertaken (phases 1-3). An initial list of questionnaire domains was identified from validated colorectal cancer PROMs and from semi-structured interviews with patients with a PSH and health professionals (phase 1). Domains were operationalized into items in a provisional questionnaire, and 'think-aloud' patient interviews explored face validity and acceptability (phase 2). The updated questionnaire was piloted in patients with a stoma who had undergone colorectal surgery and had a computed tomography scan available for review. Patient-reported symptoms were examined in relation to PSH (phase 3). Three sources determined PSH presence: (i) data about PSH presence recorded in hospital notes, (ii) independent expert review of the computed tomography scan and (iii) patient report of being informed of a PSH by a health professional. RESULTS: For phase 1, 169 and 127 domains were identified from 70 PROMs and 29 interviews respectively. In phase 2, 14 domains specific to PSH were identified and operationalized into questionnaire items. Think-aloud interviews led to three minor modifications. In phase 3, 44 completed questionnaires were obtained. Missing data were few: 5/660 items. PSH symptom scores associated with PSH presence varied between different data sources. The scale with the most consistent differences between PSH presence and absence and all data sources was the stoma appearance scale. CONCLUSION: A PROM to examine the symptoms of PSH has been developed from the literature and views of key informants. Although preliminary testing shows it to be understandable and acceptable it is uncertain if it is sensitive to PSH-specific symptoms and further psychometric testing is needed.

How surgical Trainee Research Collaboratives achieve success: a mixed methods study to develop trainee engagement strategies.

OBJECTIVES: This study aimed to understand the role of surgical Trainee Research Collaboratives (TRCs) in conducting randomised controlled trials and identify strategies to enhance trainee engagement in trials. DESIGN: This is a mixed methods study. We used observation of TRC meetings, semi-structured interviews and an online survey to explore trainees' motivations for engagement in trials and TRCs, including barriers and facilitators. Interviews were analysed thematically, alongside observation field notes. Survey responses were analysed using descriptive statistics. Strategies to enhance TRCs were developed at a workshop by 13 trial methodologists, surgical trainees, consultants and research nurses. SETTING: This study was conducted within a secondary care setting in the UK. PARTICIPANTS: The survey was sent to registered UK surgical trainees. TRC members and linked stakeholders across surgical specialties and UK regions were purposefully sampled for interviews. RESULTS: We observed 5 TRC meetings, conducted 32 semi-structured interviews and analysed 73 survey responses. TRCs can mobilise trainees thus gaining wider access to patients. Trainees engaged with TRCs to improve patient care, surgical evidence and to help progress their careers. Trainees valued the TRC infrastructure, research expertise and mentoring. Challenges for trainees included clinical and other priorities, limited time and confidence, and recognition, especially by authorship. Key TRC strategies were consultant support, initial simple rapid studies, transparency of involvement and recognition for trainees (including authorship policies) and working with Clinical Trials Units and research nurses. A 6 min digital story on YouTube disseminated these strategies. CONCLUSION: Trainee surgeons are mostly motivated to engage with trials and TRCs. Trainee engagement in TRCs can be enhanced through building relationships with key stakeholders, maximising multi-disciplinary working and offering training and career development opportunities.

A systematic scoping review protocol to summarise and appraise the use of artificial intelligence in the analysis of digital videos of invasive general surgical procedures.

Background: Intraoperative video recordings are a valuable addition to operative written documentation. However, the review of these videos often requires surgical expertise and takes considerable time. While a large amount of work has been undertaken to understand the role of artificial intelligence (AI) in healthcare more generally, the application of these techniques to automate the analysis of surgical videos is currently unclear. In this systematic scoping review, we sought to give a contemporary overview of the use of AI research in the analysis of digital videos of invasive general surgical procedures. We will describe and summarise the study characteristics, purpose of the applications and stage of development, to ascertain how these techniques might be applied in future research and to identify gaps in current knowledge (e.g. uncertainties about the study methods). Methods: Systematic searches will be conducted in OVID Medline and Embase, using terms related to 'artificial intelligence', 'surgery' and 'video' to identify all potentially relevant studies published since 1st January 2012. All primary studies where AI has been applied to the analysis of videos (recorded by conventional digital cameras or laparoscopic or robotic-assisted technology) of general surgical procedures will be included. Data extraction will include study characteristics, governance, details of video datasets and AI models, measures of accuracy, validation and any reported limitations. Ethics and dissemination: No ethical approval is required as primary data will not be collected. The results will be disseminated at relevant conferences, on social media and published in a peer-reviewed journal.

How do pilot and feasibility studies inform randomised placebo-controlled trials in surgery? A systematic review.

INTRODUCTION: Randomised controlled trials (RCTs) with a placebo comparator are considered the gold standard study design when evaluating healthcare interventions. These are challenging to design and deliver in surgery. Guidance recommends pilot and feasibility work to optimise main trial design and conduct; however, the extent to which this occurs in surgery is unknown. METHOD: A systematic review identified randomised placebo-controlled surgical trials. Articles published from database inception to 31 December 2020 were retrieved from Ovid-MEDLINE, Ovid-EMBASE and CENTRAL electronic databases, hand-searching and expert knowledge. Pilot/feasibility work conducted prior to the RCTs was then identified from examining citations and reference lists. Where studies explicitly stated their intent to inform the design and/or conduct of the future main placebo-controlled surgical trial, they were included. Publication type, clinical area, treatment intervention, number of centres, sample size, comparators, aims and text about the invasive placebo intervention were extracted. RESULTS: From 131 placebo surgical RCTs included in the systematic review, 47 potentially eligible pilot/feasibility studies were identified. Of these, four were included as true pilot/feasibility work. Three were original articles, one a conference abstract; three were conducted in orthopaedic surgery and one in oral and maxillofacial surgery. All four included pilot RCTs, with an invasive surgical placebo intervention, randomising 9-49 participants in 1 or 2 centres. They explored the acceptability of recruitment and the invasive placebo intervention to patients and trial personnel, and whether blinding was possible. One study examined the characteristics of the proposed invasive placebo intervention using in-depth interviews. CONCLUSION: Published studies reporting feasibility/pilot work undertaken to inform main placebo surgical trials are scarce. In view of the difficulties of undertaking placebo surgical trials, it is recommended that pilot/feasibility studies are conducted, and more are reported to share key findings and optimise the design of main RCTs. PROSPERO REGISTRATION NUMBER: CRD42021287371.

Development of a conceptual framework for reporting modifications in surgical innovation: scoping review.

BACKGROUND: Innovative surgical procedures and devices are often modified throughout their development and introduction into clinical practice. A systematic approach to reporting modifications may support shared learning and foster safe and transparent innovation. Definitions of 'modifications', and how they are conceptualized and classified so they can be reported and shared effectively, however, are lacking. This study aimed to explore and summarize existing definitions, perceptions, classifications and views on modification reporting to develop a conceptual framework for understanding and reporting modifications. METHODS: A scoping review was conducted in accordance with PRISMA Extension for Scoping Reviews (PRISMA-ScR) guidelines. Targeted searches and two database searches were performed to identify relevant opinion pieces and review articles. Included were articles relating to modifications to surgical procedures/devices. Data regarding definitions, perceptions and classifications of modifications, and views on modification reporting were extracted verbatim. Thematic analysis was undertaken to identify themes, which informed development of the conceptual framework. RESULTS: Forty-nine articles were included. Eight articles included systems for classifying modifications, but no articles reported an explicit definition of modifications. Some 13 themes relating to perception of modifications were identified. The derived conceptual framework comprises three overarching components: baseline data about modifications, details about modifications and impact/consequences of modifications. CONCLUSION: A conceptual framework for understanding and reporting modifications that occur during surgical innovation has been developed. This is a first necessary step to support consistent and transparent reporting of modifications, to facilitate shared learning and incremental innovation of surgical procedures/devices. Testing and operationalization is now needed to realize the value of this framework.

Results of the ARROW survey of anti-reflux practice in the United Kingdom.

Gastro-esophageal reflux disease (GERD) is a common, significant health burden. United Kingdom guidance states that surgery should be considered for patients with a diagnosis of GERD not suitable for long-term acid suppression. There is no consensus on many aspects of patient pathways and optimal surgical technique, and an absence of information on how patients are currently selected for surgery. Further detail on the delivery of anti-reflux surgery (ARS) is required. A United Kingdom-wide survey was designed to gather surgeon opinion regarding pre-, peri- and post-operative practice of ARS. Responses were received from 155 surgeons at 57 institutions. Most agreed that endoscopy (99%), 24-hour pH monitoring (83%) and esophageal manometry (83%) were essential investigations prior to surgery. Of 57 units, 30 (53%) had access to a multidisciplinary team to discuss cases; case-loads were higher in those units (median 50 vs. 30, P < 0.024). The most popular form of fundoplication was a Nissen posterior 360° (75% of surgeons), followed by a posterior 270° Toupet (48%). Only seven surgeons stated they had no upper limit of body mass index prior to surgery. A total of 46% of respondents maintain a database of their practice and less than a fifth routinely record quality of life scores before (19%) or after (14%) surgery. While there are areas of consensus, a lack of evidence to support workup, intervention and outcome evaluation is reflected in the variability of practice. ARS patients are not receiving the same level of evidence-based care as other patient groups.

Artificial intelligence as a diagnostic aid in cross-sectional radiological imaging of surgical pathology in the abdominopelvic cavity: a systematic review.

OBJECTIVES: There is emerging use of artificial intelligence (AI) models to aid diagnostic imaging. This review examined and critically appraised the application of AI models to identify surgical pathology from radiological images of the abdominopelvic cavity, to identify current limitations and inform future research. DESIGN: Systematic review. DATA SOURCES: Systematic database searches (Medline, EMBASE, Cochrane Central Register of Controlled Trials) were performed. Date limitations (January 2012 to July 2021) were applied. ELIGIBILITY CRITERIA: Primary research studies were considered for eligibility using the PIRT (participants, index test(s), reference standard and target condition) framework. Only publications in the English language were eligible for inclusion in the review. DATA EXTRACTION AND SYNTHESIS: Study characteristics, descriptions of AI models and outcomes assessing diagnostic performance were extracted by independent reviewers. A narrative synthesis was performed in accordance with the Synthesis Without Meta-analysis guidelines. Risk of bias was assessed (Quality Assessment of Diagnostic Accuracy Studies-2 (QUADAS-2)). RESULTS: Fifteen retrospective studies were included. Studies were diverse in surgical specialty, the intention of the AI applications and the models used. AI training and test sets comprised a median of 130 (range: 5-2440) and 37 (range: 10-1045) patients, respectively. Diagnostic performance of models varied (range: 70%-95% sensitivity, 53%-98% specificity). Only four studies compared the AI model with human performance. Reporting of studies was unstandardised and often lacking in detail. Most studies (n=14) were judged as having overall high risk of bias with concerns regarding applicability. CONCLUSIONS: AI application in this field is diverse. Adherence to reporting guidelines is warranted. With finite healthcare resources, future endeavours may benefit from targeting areas where radiological expertise is in high demand to provide greater efficiency in clinical care. Translation to clinical practice and adoption of a multidisciplinary approach should be of high priority. PROSPERO REGISTRATION NUMBER: CRD42021237249.

The Impact of Personal Protective Equipment on Speech Discrimination and Verbal Communication in the Operating Room and the Role of Audio Communication Devices.

INTRODUCTION: Recent work has highlighted communication difficulties when wearing personal protective equipment (PPE) in the clinical setting, but currently, there are little objective data on its effects. We assessed the impact of PPE on verbal communication in a simulated operating room and evaluated use of an audio communication device. METHODOLOGY: Frontline health professionals across specialties including surgery, anesthetics, and nursing undertook speech discrimination testing with and without standardized levels of PPE in a simulated operating room environment. Background noise (30- and 70-a-weighted decibel multitalker babble) at 2 distances (2 and 4 m) were selected representative of operating room environments. Bamford-Kowal-Bench (BKB) scoring (192 sentences per participant) was performed. A Digital Multichannel Transceiver System (DMTS) was evaluated. We assessed the effects of PPE use, distance, and use of the DMTS with pairwise comparisons, using a Bonferroni correction, and assessed participant experience via Likert scales. RESULTS: Thirty-one healthcare professionals were tested. Without PPE in 70-a-weighted decibel "babble," median BKB sentence scores were 90% and 76% at 2 and 4 m (adjusted P < 0.0005). The median BKB sentence scores dropped to 8% and 4% at 2 and 4 m in PPE (adjusted P < 0.0005). Improved speech discrimination was achieved with DMTS use to 70% and 76% at 2 and 4 m. Personal protective equipment led to a statistically significant reduction in BKB scores across all conditions compared with baseline. Overall participant confidence in PPE clinical communication was low. CONCLUSIONS: Addition of PPE dramatically impairs speech discrimination and communication in high levels of background noise characteristic of clinical environments, which can be significantly improved using DMTS. Measures should be taken by teams through both through reduction of background noise and consideration of assistive technologies maximizing patient safety. This may be further rehearsed in a simulation environment.

A systematic review of robot-assisted anti-reflux surgery to examine reporting standards.

Robot-assisted anti-reflux surgery (RA-ARS) is increasingly being used to treat refractory gastro-oesophageal reflux disease. The IDEAL (Idea, Development, Exploration, Assessment, Long-term follow up) Collaboration's framework aims to improve the evaluation of surgical innovation, but the extent to which the evolution of RA-ARS has followed this model is unclear. This study aims to evaluate the standard to which RA-ARS has been reported during its evolution, in relation to the IDEAL framework. A systematic review from inception to June 2020 was undertaken to identify all primary English language studies pertaining to RA-ARS. Studies of paraoesophageal or giant hernias were excluded. Data extraction was informed by IDEAL guidelines and summarised by narrative synthesis. Twenty-three studies were included: two case reports, five case series, ten cohort studies and six randomised controlled trials. The majority were single-centre studies comparing RA-ARS and laparoscopic Nissen fundoplication. Eleven (48%) studies reported patient selection criteria, with high variability between studies. Few studies reported conflicts of interest (30%), funding arrangements (26%), or surgeons' prior robotic experience (13%). Outcome reporting was heterogeneous; 157 distinct outcomes were identified. No single outcome was reported in all studies.The under-reporting of important aspects of study design and high degree of outcome heterogeneity impedes the ability to draw meaningful conclusions from the body of evidence. There is a need for further well-designed prospective studies and randomised trials, alongside agreement about outcome selection, measurement and reporting for future RA-ARS studies.

What Are Patients Told About Innovative Surgical Procedures? A Qualitative Synthesis of 7 Case Studies in the United Kingdom.

OBJECTIVES: To investigate how information about innovative surgical procedures is communicated to patients. BACKGROUND: Despite the national and international guidance that patients should be informed whether a procedure is innovative and has uncertain outcomes, little is known about current practice. METHODS: This qualitative study followed 7 "case studies" of surgical innovation in hospitals across the United Kingdom. Preoperative interviews were conducted with clinician innovators (n=9), preoperative real-time consultations between clinicians and patients were audio-recorded (n=37). Patients were interviewed postoperatively (n=30). Data were synthesized using thematic analytical methods. RESULTS: Interviews with clinicians demonstrated strong intentions to inform patients about the innovative nature of the procedure in a neutral manner, although tensions between fully informing patients and not distressing them were raised. In the consultations, only a minority of clinicians actually made explicit statements about, (1) the procedure being innovative, (2) their limited clinical experience with it, (3) the paucity of evidence, and (4) uncertainty/unknown outcomes. Discussions about risks were generalized and often did not relate to the innovative component. Instead, all clinicians optimistically presented potential benefits and many disclosed their own positive beliefs. Postoperative patient interviews revealed that many believed that the procedure was more established than it was and were unaware of the unknown risks. CONCLUSIONS: There were contradictions between clinicians' intentions to inform patients about the uncertain outcomes of innovative and their actual discussions with patients. There is a need for communication interventions and training to support clinicians to provide transparent data and shared decision-making for innovative procedures.

Qualitative documentary analysis of guidance on information provision and consent for the introduction of innovative invasive procedures including surgeries within NHS organisations' policies in England and Wales.

OBJECTIVE: To review guidance, included in written local UK National Health Service (NHS) organisation policies, on information provision and consent for the introduction of new invasive procedures- including surgeries, and devices (IPs/Ds). DESIGN: A qualitative documentary analysis of data on patient information provision and consent extracted from policies for the introduction of IP/Ds from NHS organisations in England and Wales. SETTING: NHS trusts in England and health boards in Wales, UK. PARTICIPANTS: Between December 2017 and July 2018, 150 acute trusts in England and 7 health boards in Wales were approached for their policies for the introduction of new IP/Ds. In total, 123 policies were received, 11 did not fit the inclusion criteria and a further policy was included from a trust website resulting in 113 policies included for review. RESULTS: From the 113 policies, 22 did not include any statements on informed consent/information provision or lacked guidance on the information to be provided to patients and were hence excluded. Consequently, 91 written local NHS policies were included in the final dataset. Within the guidance obtained, variation existed on disclosure of the procedure's novelty, potential risks, benefits, uncertainties, alternative treatments and surgeon's experience. Few policies stated that clinicians should discuss the existing evidence associated with a procedure. Additionally, while the majority of policies referred to patients needing written information, this was often not mandated and few policies specified the information to be included. CONCLUSIONS: Nearly a fifth of all the policies lacked guidance on information to be provided to patients. There was variability in the policy documents regarding what patients should be told about innovative procedures. Further research is needed to ascertain the information and level of detail appropriate for patients when considering innovative procedures. A core information set including patients' and clinicians' views is required to address variability around information provision/consent for innovative procedures.

Managing surgical demand when needs outstrip resource: qualitative investigation of colorectal cancer surgery provision in the first wave of the COVID-19 pandemic.

BACKGROUND: At the onset of the COVID-19 pandemic, elective surgical provision was severely affected by the need for hospital reorganization to care for critically ill patients. In response, National Health Service (NHS) England issued national guidance proposing acceptable time intervals for postponing different types of surgical procedure. This study reports healthcare professionals' private accounts of the strategies adopted to manage the imbalance of demand and resource, using colorectal cancer surgery as a case study. METHODS: Twenty-seven semistructured interviews were conducted with healthcare professionals between June and November 2020. A key informant sampling approach was used, followed by snowballing to achieve maximum regional variation across the UK. Data were analysed thematically using the constant comparison approach. RESULTS: In the context of considerable resource constraint, surgical teams overcame challenges to continue elective cancer provision. They achieved this by pursuing a combination of strategies: relocating surgical services; prioritizing patients within and across surgical specialties; adapting patient treatment plans; and introducing changes to surgical team working practices. Despite national guidance, prioritization decisions were framed as complex, and the most challenging of the strategies to implement, both practically and emotionally. CONCLUSION: There is a need to better support surgeons tasked with prioritizing patients when capacity exceeds demand.

What should be included in case report forms? Development and application of novel methods to inform surgical study design: a mixed methods case study in parastomal hernia prevention.

OBJECTIVES: To describe the development and application of methods to optimise the design of case report forms (CRFs) for clinical studies evaluating surgical procedures, illustrated with an example of abdominal stoma formation. DESIGN: (1) Literature reviews, to identify reported variations in surgical components of stoma formation, were supplemented by (2) intraoperative qualitative research (observations, videos and interviews), to identify unreported variations used in practice to generate (3) a 'long list' of items, which were rationalised using (4) consensus methods, providing a pragmatic list of CRF items to be captured in the Cohort study to Investigate the Prevention of parastomal HERnias (CIPHER) study. SETTING: Two secondary care surgical centres in England. PARTICIPANTS: Patients undergoing stoma formation, surgeons undertaking stoma formation and stoma nurses. OUTCOME MEASURES: Successful identification of key CRF items to be captured in the CIPHER study. RESULTS: 59 data items relating to stoma formation were identified and categorised within six themes: (1) surgical approach to stoma formation; (2) trephine formation; (3) reinforcing the stoma trephine with mesh; (4) use of the stoma as a specimen extraction site; (5) closure of other wounds during the procedure; and (6) spouting the stoma. CONCLUSIONS: This study used multimodal data collection to understand and capture the technical variations in stoma formation and design bespoke CRFs for a multicentre cohort study. The CIPHER study will use the CRFs to examine associations between the technical variations in stoma formation and risks of developing a parastomal hernia. TRIAL REGISTRATION NUMBER: ISRCTN17573805.

A systematic review of robot-assisted cholecystectomy to examine the quality of reporting in relation to the IDEAL recommendations: systematic review.

INTRODUCTION: Robotic cholecystectomy (RC) is a recent innovation in minimally invasive gallbladder surgery. The IDEAL (idea, development, exploration, assessment, long-term study) framework aims to provide a safe method for evaluating innovative procedures. This study aimed to understand how RC was introduced, in accordance with IDEAL guidelines. METHODS: Systematic searches were used to identify studies reporting RC. Eligible studies were classified according to IDEAL stage and data were collected on general study characteristics, patient selection, governance procedures, surgeon/centre expertise, and outcome reporting. RESULTS: Of 1425 abstracts screened, 90 studies were included (5 case reports, 38 case series, 44 non-randomized comparative studies, and 3 randomized clinical trials). Sixty-four were single-centre and 15 were prospective. No authors described their work in the context of IDEAL. One study was classified as IDEAL stage 1, 43 as IDEAL 2a, 43 as IDEAL 2b, and three as IDEAL 3. Sixty-four and 51 provided inclusion and exclusion criteria respectively. Ethical approval was reported in 51 and conflicts of interest in 34. Only 21 reported provision of training for surgeons in RC. A total of 864 outcomes were reported; 198 were used in only one study. Only 30 reported a follow-up interval which, in 13, was 1 month or less. CONCLUSION: The IDEAL framework was not followed during the adoption of RC. Few studies were conducted within a research setting, many were retrospective, and outcomes were heterogeneous. There is a need to implement appropriate tools to facilitate the incremental evaluation and reporting of surgical innovation.

Shared Learning Utilizing Digital Methods in Surgery to Enhance Transparency in Surgical Innovation: Protocol for a Scoping Review.

BACKGROUND: Surgical innovation can lead to important improvements in patient outcomes. Currently, information and knowledge about novel procedures and devices are disseminated informally and in an unstandardized way (eg, through social media). This can lead to ineffective and inefficient knowledge sharing among surgeons, which can result in the harmful repetition of mistakes and delay in the uptake of promising innovation. Improvements are needed in the way that learning in surgical innovation is shared through the development of novel, real-time methods, informed by a contemporary and comprehensive investigation of existing methods. OBJECTIVE: The aim of this scoping review is to explore the application of existing digital methods for training/education and feedback to surgeons in the context of performing invasive surgical procedures. This work will (1) summarize existing methods for shared learning in surgery and how they are characterized and operationalized, (2) examine the impact of their application, and (3) explore their benefits and barriers to implementation. The findings of this scoping review will inform the development of novel, real-time methods to optimize shared learning in surgical innovation. METHODS: This study will adhere to the recommended guidelines for conducting scoping reviews. A total of 6 different searches will be conducted within multiple sources (2 electronic databases, journals, social media, gray literature, commercial websites, and snowball searches) to comprehensively identify relevant articles and data. Searches will be limited to articles published in the English language within the last 5 years. Wherever possible, a 2-stage study selection process will be followed whereby the eligibility of articles will be assessed through the title, abstract, and full-text screening independently by 2 reviewers. Inclusion criteria will be articles providing data on (1) fully qualified theater staff involved in performing invasive procedures, (2) one or more methods for shared learning (ie, digital means for training/education and feedback), and (3) qualitative or quantitative evaluations of this method. Data will be extracted (10% double data extraction by an independent reviewer) into a piloted proforma and analyzed using descriptive statistics, narrative summaries, and principles of thematic analysis. RESULTS: The study commenced in October 2021 and is planned to be completed in 2023. To date, systematic searches were applied to 2 electronic databases (MEDLINE and Web of Science) and returned a total of 10,093 records. The results of this scoping review will be published as open access in a peer-reviewed journal. CONCLUSIONS: This scoping review of methods for shared learning in surgery is, to our knowledge, the most comprehensive and up-to-date investigation that maps current information on this topic. Ultimately, efficient and effective sharing of information and knowledge of novel procedures and devices has the potential to optimize the evaluation of early-phase surgical research and reduce harmful innovation. INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID): PRR1-10.2196/37544.

Healthcare organization policy recommendations for the governance of surgical innovation: review of NHS policies.

BACKGROUND: The governance for introducing innovative surgical procedures/devices differs from the research requirements needed for new drugs. New invasive procedures/devices may be offered to patients outside of research protocols with local organization oversight alone. Such institutional arrangements exist in many countries and written policies provide guidance for their use, but little is known about their scope or standards. METHODS: One hundred and fifty acute NHS trusts in England and seven health boards in Wales were systematically approached for information about their policies. A modified framework approach was used to analyse when policies considered new procedures/devices to be within local organization remit and/or requiring research ethics committee (REC) approval. RESULTS: Of 113 policies obtained, 109 and 34 described when local organization and REC approval was required, respectively. Procedures/devices being used for the first time in the organization (n = 69) or by a clinician (n = 67) were commonly within local remit, and only 36 stated that evidence was required. Others stated limited evidence as a rationale for needing REC approval (n = 13). External guidance categorizing procedures as 'research only' was the most common reason for gaining REC approval (n = 15). Procedures/devices with uncertain outcomes (n = 28), requiring additional training (n = 26), and not previously used (n = 6) were within the remit of policies, while others recommended REC application in these situations (n = 5, 2 and 7, respectively). CONCLUSION: This study on NHS policies for surgical innovation shows variability in the introduction of procedures/devices in terms of local oversight and/or need for REC approval. Current NHS standards allow untested innovations to occur without the safety of research oversight and thus a standard approach is urgently needed.

Novel device for assisted vaginal birth: using integrated qualitative case study methodology to optimise Odon Device use within a feasibility study in a maternity unit in the Southwest of England.

OBJECTIVE: When novel devices are used 'in human' for the first time, their optimal use is uncertain because clinicians only have experience from preclinical studies. This study aimed to investigate factors that might optimise use of the Odon Device for assisted vaginal birth. DESIGN: We undertook qualitative case studies within the ASSIST Study, a feasibility study of the Odon Device. Each 'case' was defined as one use of the device and included at least one of the following: observation of the attempted assisted birth, and an interview with the obstetrician, midwife or woman. Data collection and thematic analysis ran iteratively and in parallel. SETTING: Tertiary referral National Health Service maternity unit in the Southwest of England. PARTICIPANTS: Women requiring a clinically indicated assisted vaginal birth. INTERVENTION: The Odon Device, an innovative device for assisted vaginal birth. PRIMARY AND SECONDARY OUTCOME MEASURES: Determining the optimal device technique, device design and defining clinical parameters for use. RESULTS: Thirty-nine cases involving an attempted Odon-assisted birth were included in this study, of which 19 resulted in a successful birth with the device. Factors that improved use included optimisation of device technique, device design and clinical parameters for use. Technique adaptations included: applying the device during, rather than between, contractions; having a flexible approach to the application angle; and deflating the air cuff sooner than originally proposed. Three design modifications were proposed involving the deflation button and sleeve. Although use of the device was found to be appropriate in all fetal positions, it was considered contraindicated when the fetal station was at the ischial spines. CONCLUSIONS: Case study methodology facilitated the acquisition of rapid insights into device function in clinical practice, providing key insights regarding use, design and key clinical parameters for success. This methodology should be considered whenever innovative devices are introduced into clinical practice. TRIAL REGISTRATION NUMBER: ISRCTN10203171.

Identification of outcomes to inform the development of a core outcome set for surgical innovation: a targeted review of case studies of novel surgical devices.

OBJECTIVE: Outcome selection and reporting in studies of novel surgical procedures and devices lacks standardisation, hindering safe and effective evaluation. A core outcome set (COS) to measure and report in all studies of surgical innovation is needed. We explored outcomes in a specific sample of innovative surgical device case studies to identify outcome domains specifically relevant to innovation to inform the development of a COS. DESIGN: A targeted review of 11 purposive selected case studies of innovative surgical devices. METHODS: Electronic database searches in PubMed (July 2018) identified publications reporting the introduction and evaluation of each device. Outcomes were extracted and categorised into domains until no new domains were conceptualised. Outcomes specifically relevant to evaluating innovation were further scrutinised. RESULTS: 112 relevant publications were identified, and 5926 outcomes extracted. Heterogeneity in study type, outcome selection and reporting was observed across surgical devices. Categorisation of outcomes was performed for 2689 (45.4%) outcomes into five broad outcome domains. Outcomes considered key to the evaluation of innovation (n=66; 2.5%) were further categorised as surgeon/operator experience (n=40; 1.5%), unanticipated events (n=15, 0.6%) and modifications (n=11; 0.4%). CONCLUSION: Outcome domains unique to evaluating innovative surgical devices have been identified. Findings have been combined with multiple other data sources relevant to the evaluation of surgical innovation to inform the development of a COS to measure and report in all studies evaluating novel surgical procedures/devices.