Distinct molecular profile of the chick organizer as a stem zone during axial elongation.

The vertebrate organizer plays a crucial role in building the main (antero-posterior) axis of the embryo: it neuralizes the surrounding ectoderm, and is the site of emigration for cells making axial and paraxial mesendoderm during elongation. The chick organizer becomes a stem zone at the onset of elongation; it stops recruiting cells from the neighbouring ectoderm and generates all its derivatives from the small number of resident cells it contains at the end of gastrulation stages. Nothing is known about the molecular identity of this stem zone. Here, we specifically labelled long-term resident cells of the organizer and compared their RNA-seq profile to that of the neighbouring cell populations. Screening by reverse transcription-polymerase chain reaction and in situ hybridization identified four genes (WIF1, PTGDS, ThPO and UCKL1) that are upregulated only in the organizer region when it becomes a stem zone and remain expressed there during axial elongation. In experiments specifically labelling the resident cells of the mature organizer, we show that only these cells express these genes. These findings molecularly define the organizer as a stem zone and offer a key to understanding how this zone is set up, the molecular control of its cells' behaviour and the evolution of axial growth zones.

The Mean Delta Method: Quantifying Assessor Stringency and Leniency and Identifying Outliers in Workplace-Based Assessments.

ABSTRACT: Assessor stringency and leniency (ASL)-an assessor's tendency to award low or high scores-has a significant effect on workplace-based assessments. Outliers on this spectrum have a disproportionate effect. However, no method has been published for quantifying ASL or identifying outlier stringent or lenient assessors using workplace-based assessment data. The authors propose the mean delta method, which compares the scores that an assessor awards to trainees with those trainees' mean scores. This novel, simple method can be used to quantify ASL and identify outlier assessors without requiring specialized statistical knowledge or software. As a worked example, the mean delta method was applied to a set of end-of-shift assessments completed in a large Canadian academic emergency department from July 1, 2017, to May 31, 2018, and used to examine the net effect of ASL on learners' assessment scores. A total of 3,908 assessments were completed by 99 assessors for 151 trainees, with a median (interquartile range) of 37 (12-39) completed assessments per trainee. Using cutoff values of 1.5 and 2 standard deviations, a total of 11 and 3 outlier assessors were identified, respectively. Moreover, ASL changed overall scores by more than the mean difference between years of training for nearly 1 in 4 learners. The mean delta method was able to quantify ASL and identify outlier lenient and stringent assessors. It was also used to quantify the net effect of ASL on individual trainees. This method could be used to further study outlier assessors, to identify assessors who may benefit most from targeted coaching and feedback, and to measure changes in assessors' tendencies over time or with specific intervention.

The use of virtual nominal groups in healthcare research: An extended scoping review.

INTRODUCTION: The Nominal Group Technique (NGT) is a consensus group method used to synthesize expert opinions. Given the global shift to virtual meetings, the extent to which researchers leveraged virtual platforms is unclear. This scoping review explores the use of the vNGT in healthcare research during the COVID-19 pandemic. METHODS: Following the Arksey and O'Malley's framework, eight cross-disciplinary databases were searched (January 2020-July 2022). Research articles that reported all four vNGT stages (idea generation, round robin sharing, clarification, voting) were included. Media Synchronicity Theory informed analysis. Corresponding authors were surveyed for additional information. RESULTS: Of 2,589 citations, 32 references were included. Articles covered healthcare (27/32) and healthcare education (4/32). Platforms used most were Zoom, MS Teams and GoTo but was not reported in 44% of studies. Only 22% commented on the benefits/challenges of moving the NGT virtually. Among authors who responded to our survey (16/32), 80% felt that the vNGT was comparable or superior. CONCLUSIONS: The vNGT provides several advantages such as the inclusion of geographically dispersed participants, scheduling flexibility and cost savings. It is a promising alternative to the traditional in-person meeting, but researchers should carefully describe modifications, potential limitations, and impact on results.

The Ottawa resident observation form for nurses (O-RON): evaluation of an assessment tool's psychometric properties in different specialties.

BACKGROUND: Workplace-based assessment (WBA) used in post-graduate medical education relies on physician supervisors' feedback. However, in a training environment where supervisors are unavailable to assess certain aspects of a resident's performance, nurses are well-positioned to do so. The Ottawa Resident Observation Form for Nurses (O-RON) was developed to capture nurses' assessment of trainee performance and results have demonstrated strong evidence for validity in Orthopedic Surgery. However, different clinical settings may impact a tool's performance. This project studied the use of the O-RON in three different specialties at the University of Ottawa. METHODS: O-RON forms were distributed on Internal Medicine, General Surgery, and Obstetrical wards at the University of Ottawa over nine months. Validity evidence related to quantitative data was collected. Exit interviews with nurse managers were performed and content was thematically analyzed. RESULTS: 179 O-RONs were completed on 30 residents. With four forms per resident, the ORON's reliability was 0.82. Global judgement response and frequency of concerns was correlated (r = 0.627, P < 0.001). CONCLUSIONS: Consistent with the original study, the findings demonstrated strong evidence for validity. However, the number of forms collected was less than expected. Exit interviews identified factors impacting form completion, which included clinical workloads and interprofessional dynamics.

The burden of HMPV and influenza associated hospitalizations in adults in New Zealand, 2012-2015.

BACKGROUND: Unlike influenza, information on the burden of human metapneumovirus (HMPV) as a cause of hospitalizations in adults with acute respiratory illness (ARI) is limited. METHODS: We compared the population-based incidence, seasonality, and clinical characteristics of these two viral infections among adults aged 20 years and over with ARI hospitalisations in Auckland, New Zealand, during 2012-2015 through the Southern Hemisphere Influenza Vaccine Effectiveness Research and Surveillance (SHIVERS) project. RESULTS: Of the 14,139 ARI hospitalisations, 276 (4.3%) of 6484 tested positive for HMPV and 1342 (19.1%) of 7027 tested positive for influenza. Crude rates of 9.8 (95% CI: 8.7-11.0) HMPV and 47.6 (95% CI: 45.1-50.1) influenza-associated ARI hospitalisations were estimated for every 100,000 adult residents annually. The highest rates for both viruses were in those aged 80 years or older, of Maori or Pacific ethnicity, or living in low socioeconomic status (SES) areas. HMPV infections were more common than influenza in those with chronic medical conditions. CONCLUSIONS: Although HMPV infections accounted for fewer hospitalisations than influenza in adults aged 20 years and over, HMPV-associated ARI hospitalisation rates were higher than influenza in older adults, Maori and Pacific people and those of low SES. This highlighted a need for vaccine/antiviral development.

Morphology of ctenostome bryozoans: 7. Hislopia, Echinella and Timwoodiellina.

Ctenostome bryozoans are a small group of gymnolaemates comprising less than 400 recent species. They are paraphyletic and ctenostome-grade ancestors gave rise to Cheilostomata, the most dominant and speciose taxon of Bryozoa in the present day. Investigations into ctenostomes are important for reconstructing character evolution among Gymnolaemata. As a continuation of studies on a morphological series of ctenostome bryozoans, we herein investigate six species of hislopiids, a small clade of three genera occurring in freshwater habitats. The general morphology of all species is similar in having primarily uniserial chains of encrusting zooids, which are mostly oval to ellipsoid and have a flattened frontobasal axis. Hislopia prolixa and Echinella placoides often have more slender zooids with a higher frontobasal axis. Apertures of hislopiids are quadrangular, lined by a thickened cuticle. Apertural spines are present in various lengths in E. placoides, Hislopia lacustris and Hislopia corderoi. The remaining cuticle is rather thin except at lateral areas, close to the pore-plates which are prominent in hislopiids because of abundant special and limiting cells. All species except H. corderoi and Timwoodiellina natans have a prominent collar obstructing the vestibulum, whereas the latter two species instead have an 'external collar' as cuticular, outer folds projecting over the aperture. Hislopiid lophophores carry eight, or more commonly 12-18 tentacles. The digestive tract is distinguished by an often highly elongated esophagus and/or cardia, with the latter always having a prominent bulbous part in the form of a proventriculus-or gizzard in E. placoides. The caecum is extensive in all species. In Hislopia the intestine is characteristically two-chambered with a proximal and distal part before entering an anal tube of various length. The latter is present in all species except T. natans and terminates in mid-lophophoral area. Oocytes in E. placoides are large and macrolecithal indicating brooding and the production of lecithotrophic larvae. Hislopia species produce small, oligolecithal ones, which suggests zygote spawning and planktotrophy. In general, the morphology is similar among the different hislopiids with characters of the gut aiding in delineating the genera Echinella and Timwoodiellina.

Biomarkers of Glycosaminoglycans (GAG) accumulation in patients with mucopolysaccharidosis type VI-LeukoGAG, Corneal Opacification (COM) and Carotid Intima Media Thickening (CIMT).

Mucopolysaccharidosis type VI (MPS VI) is an autosomal recessive lysosomal storage disorder characterized by deficient activity of arylsulfatase B enzyme (ASB) resulting in cellular accumulation of dermatan sulfate (DS) and chondroitin sulfate (CS) that leads to cell injury. Urinary glycosaminoglycans (GAG) are often used as a biomarker in MPS diseases for diagnosis and to monitor treatment efficacy. This study evaluated leukocyte GAGs (leukoGAG) and skin GAGs as alternate biomarkers representing intracellular GAG changes in patients with MPS VI and treated with enzyme replacement therapy (ERT). In addition, we evaluated corneal opacification measurements (COM) and carotid intima media thickness (CIMT) as indicators of GAG accumulation and tissue injury. The study was performed in a serial two-step design in a single center. A quantitative method to measure leukoGAG levels in leukocytes was developed in Study 1 to compare the GAG levels between MPS VI patients and a control group and to assess correlations between leukoGAG and urineGAG. Study 2 validated the leukoGAG measurement, assessed the effect of ERT infusion on leukoGAG and ASB activity in leukocytes, identified correlations between leukoGAG and other biomarkers, and assessed differences in GAG accumulation between MPS VI patients and control subjects. In Study 1, leukoCS and leukoDS levels were significantly higher in the MPS VI group than the control group (leukoCS: 37.9 ± 10.2 and 2.9 ± 1.5 µg/µg protein, respectively, p = 0.005; leukoDS: 0.26 ± 0.2 and 0.0 ± 0.0 µg/µg protein, respectively, p = 0.028) with positive correlations between leukoCS and urine CS and leukoDS and urineDS. In Study 2, leukoCS (32.0 ± 11.8 vs 6.9 ± 3.1 µg/mg protein, p = 0.005) and leukoDS (0.4 ± 0.1 and 0.2 ± 0.1 µg/mg protein, p = 0.020) were significantly higher compared with control subjects. Thus, these results highlight the potential of leukoGAG as a new biomarker representing intracellular GAG accumulation in MPS VI patients and may be valuable for patient management.

Having a Bad Day Is Not an Option: Learner Perspectives on Learner Handover.

PURPOSE: Learner handover is the sharing of learner-related information between supervisors involved in their education. The practice allows learners to build upon previous assessments and can support the growth-oriented focus of competency-based medical education. However, learner handover also carries the risk of biasing future assessments and breaching learner confidentiality. Little is known about learner handover's educational impact, and what is known is largely informed by faculty and institutional perspectives. The purpose of this study was to explore learner handover from the learner perspective. METHOD: Constructivist grounded theory was used to explore learners' perspectives and beliefs around learner handover. Twenty-nine semistructured interviews were completed with medical students and residents from the University of Ottawa and University of California, San Francisco. Interviews took place between April and December 2020. Using the constant comparative approach, themes were identified through an iterative process. RESULTS: Learners were generally unaware of specific learner handover practices, although most recognized circumstances where both formal and informal handovers may occur. Learners appreciated the potential for learner handover to tailor education, guide entrustment and supervision decisions, and support patient safety, but worried about its potential to bias future assessments and breach confidentiality. Furthermore, learners were concerned that information-sharing may be more akin to gossip rather than focused on their educational needs and feared unfair scrutiny and irreversible long-term career consequences from one shared mediocre performance. Altogether, these concerns fueled an overwhelming pressure to perform. CONCLUSIONS: While learners recognized the rationale for learner handover, they feared the possible inadvertent short- and long-term impact on their training and future careers. Designing policies that support transparency and build awareness around learner handover may mitigate unintended consequences that can threaten learning and the learner-supervisor relationship, ensuring learner handover benefits the learner as intended.

Implicit versus explicit first impressions in performance-based assessment: will raters overcome their first impressions when learner performance changes?

First impressions can influence rater-based judgments but their contribution to rater bias is unclear. Research suggests raters can overcome first impressions in experimental exam contexts with explicit first impressions, but these findings may not generalize to a workplace context with implicit first impressions. The study had two aims. First, to assess if first impressions affect raters' judgments when workplace performance changes. Second, whether explicitly stating these impressions affects subsequent ratings compared to implicitly-formed first impressions. Physician raters viewed six videos where learner performance either changed (Strong to Weak or Weak to Strong) or remained consistent. Raters were assigned two groups. Group one (n = 23, Explicit) made a first impression global rating (FIGR), then scored learners using the Mini-CEX. Group two (n = 22, Implicit) scored learners at the end of the video solely with the Mini-CEX. For the Explicit group, in the Strong to Weak condition, the FIGR (M = 5.94) was higher than the Mini-CEX Global rating (GR) (M = 3.02, p < .001). In the Weak to Strong condition, the FIGR (M = 2.44) was lower than the Mini-CEX GR (M = 3.96 p < .001). There was no difference between the FIGR and the Mini-CEX GR in the consistent condition (M = 6.61, M = 6.65 respectively, p = .84). There were no statistically significant differences in any of the conditions when comparing both groups' Mini-CEX GR. Therefore, raters adjusted their judgments based on the learners' performances. Furthermore, raters who made their first impressions explicit showed similar rater bias to raters who followed a more naturalistic process.

Circulation of influenza and other respiratory viruses during the COVID-19 pandemic in Australia and New Zealand, 2020-2021.

Objective: Circulation patterns of influenza and other respiratory viruses have been globally disrupted since the emergence of coronavirus disease (COVID-19) and the introduction of public health and social measures (PHSMs) aimed at reducing severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) transmission. Methods: We reviewed respiratory virus laboratory data, Google mobility data and PHSMs in five geographically diverse regions in Australia and New Zealand. We also described respiratory virus activity from January 2017 to August 2021. Results: We observed a change in the prevalence of circulating respiratory viruses following the emergence of SARS-CoV-2 in early 2020. Influenza activity levels were very low in all regions, lower than those recorded in 2017-2019, with less than 1% of laboratory samples testing positive for influenza virus. In contrast, rates of human rhinovirus infection were increased. Respiratory syncytial virus (RSV) activity was delayed; however, once it returned, most regions experienced activity levels well above those seen in 2017-2019. The timing of the resurgence in the circulation of both rhinovirus and RSV differed within and between the two countries. Discussion: The findings of this study suggest that as domestic and international borders are opened up and other COVID-19 PHSMs are lifted, clinicians and public health professionals should be prepared for resurgences in influenza and other respiratory viruses. Recent patterns in RSV activity suggest that these resurgences in non-COVID-19 viruses have the potential to occur out of season and with increased impact.

Baseline innate and T cell populations are correlates of protection against symptomatic influenza virus infection independent of serology.

Evidence suggests that innate and adaptive cellular responses mediate resistance to the influenza virus and confer protection after vaccination. However, few studies have resolved the contribution of cellular responses within the context of preexisting antibody titers. Here, we measured the peripheral immune profiles of 206 vaccinated or unvaccinated adults to determine how baseline variations in the cellular and humoral immune compartments contribute independently or synergistically to the risk of developing symptomatic influenza. Protection correlated with diverse and polyfunctional CD4+ and CD8+ T, circulating T follicular helper, T helper type 17, myeloid dendritic and CD16+ natural killer (NK) cell subsets. Conversely, increased susceptibility was predominantly attributed to nonspecific inflammatory populations, including γδ T cells and activated CD16- NK cells, as well as TNFα+ single-cytokine-producing CD8+ T cells. Multivariate and predictive modeling indicated that cellular subsets (1) work synergistically with humoral immunity to confer protection, (2) improve model performance over demographic and serologic factors alone and (3) comprise the most important predictive covariates. Together, these results demonstrate that preinfection peripheral cell composition improves the prediction of symptomatic influenza susceptibility over vaccination, demographics or serology alone.

Posterior Shoulder Instability in Tennis Players: Aetiology, Classification, Assessment and Management.

Background: Micro-traumatic posterior shoulder instability (PSI) is an often missed and misdiagnosed pathology presenting in tennis players. The aetiology of micro-traumatic PSI in tennis players is multifactorial, including congenital factors, loss of strength and motor control, and sport-specific repetitive microtrauma. Repetitive forces placed on the dominant shoulder, particularly combinations of flexion, horizontal adduction, and internal rotation contribute to the microtrauma. These positions are characteristic for kick serves, backhand volleys, and the follow-through phase of forehands and serves. The aim of this clinical commentary is to present an overview of the aetiology, classification, clinical presentation, and treatment of micro-traumatic PSI, with a particular focus on tennis players. Level of Evidence: 5.

The influence of clinical coaching teams on quality of entrustable professional activity assessments.

Background: Coaching is an important component of workplace-based assessment in competency-based medical education. Longitudinal coaching relationships have been proposed to enhance the trainee-supervisor relationship and promote high-quality assessment. Objective: The objective of this study was to determine the influence of longitudinal coaching relationships on the quality of entrustable professional activity (EPA) assessments. Methods: EPAs (n = 174) completed by emergency medicine (EM) supervisors between July 2020 and June 2021 were extracted and divided into two groups; one group consisted of EPAs completed by supervisors when a longitudinal coaching relationship existed (n = 87) and the other group consisted of EPAs completed by the same supervisors when no coaching relationship existed (n = 87). Three physicians were recruited to rate the EPAs using the Quality of Assessment and Learning (QuAL) score, a previously published measure of EPA quality. An analysis of variance was performed to compare mean QuAL scores between the groups. Linear regression analysis was conducted to examine the relationship between trainee performance (EPA rating) and EPA assessment quality (QuAL score). Results: All raters completed the survey. The mean ± SD QuAL score in the coaching relationship group (3.63 ± 0.91) was higher than the no coaching relationship group (3.51 ± 1.10) but the difference was not statistically significant (p = 0.40). Supervisor was a significant predictor of QuAL score (p = 0.012) and supervisor alone accounted for 26% of the variability in QuAL scores (R2 = 0.26). There was no significant relationship between trainee performance and EPA assessment quality. Conclusions: The presence of a longitudinal coaching relationship did not influence the quality of EPA assessments.

Assessing the utility of a novel entrustment-supervision assessment tool.

BACKGROUND: Work-based assessments (WBAs) are increasingly used to inform decisions about trainee progression. Unfortunately, WBAs often fail to discriminate between trainees of differing abilities and have poor reliability. Entrustment-supervision scales may improve WBA performance, but there is a paucity of literature directly comparing them to traditional WBA tools. METHODS: The Ottawa Emergency Department Shift Observation Tool (O-EDShOT) is a previously published WBA tool employing an entrustment-supervision scale with strong validity evidence. This pre-/post-implementation study compares the performance of the O-EDShOT with that of a traditional WBA tool using norm-based anchors. All assessments completed in 12-month periods before and after implementing the O-EDShOT were collected, and generalisability analysis was conducted with year of training, trainees within year and forms within trainee as nested factors. Secondary analysis included assessor as a factor. RESULTS: A total of 3908 and 3679 assessments were completed by 99 and 116 assessors, for 152 and 138 trainees in the pre- and post-implementation phases respectively. The O-EDShOT generated a wider range of awarded scores than the traditional WBA, and mean scores increased more with increasing level of training (0.32 vs. 0.14 points per year, p = 0.01). A significantly greater proportion of overall score variability was attributable to trainees using the O-EDShOT (59%) compared with the traditional tool (21%, p < 0.001). Assessors contributed less to overall score variability for the O-EDShOT than for the traditional WBA (16% vs. 37%). Moreover, the O-EDShOT required fewer completed assessments than the traditional tool (27 vs. 51) for a reliability of 0.8. CONCLUSION: The O-EDShOT outperformed a traditional norm-referenced WBA in discriminating between trainees and required fewer assessments to generate a reliable estimate of trainee performance. More broadly, this study adds to the body of literature suggesting that entrustment-supervision scales generate more useful and reliable assessments in a variety of clinical settings.

Multiplex tandem mass spectrometry enzymatic activity assay for the screening and diagnosis of Mucolipidosis type II and III.

Mucolipidosis type II and III (MLII/III) is caused by defects in the mannose-6-phosphate system, which is essential to target most of the lysosomal hydrolases to the lysosome. MLII/III patients present with marked elevations in the activities of most lysosomal enzymes in plasma, but their profiles in dried blood spots (DBS) have not been well described. In the current study, we measured the activities of 12 lysosomal enzymes in DBS, among which acid sphingomyelinase, iduronate-2-sulfatase, and alpha-N-acetylglucosaminidase were significantly elevated in MLII/III patients when compared to random newborns. This sets the stage for using DBS to diagnose MLII/III. Furthermore, given an increasing number of lysosomal storage disorders are being included in the recommended uniform screening panel, our results also indicate that population-based newborn screening for MLII/III can be implemented with minimal efforts.

Safe Prescribing Practices: Clinicians' Views on Prescribing Opioids to Patients With Early-Stage Cancer.

PURPOSE: Opioids are often necessary for patients experiencing high-intensity pain. However, side effects exist and some patients may misuse opioids. To better understand how opioids are prescribed to patients with early-stage cancer and how to enhance opioid safety, clinicians' views of opioid prescribing were explored. METHODS: This was a qualitative inquiry including any Alberta clinician prescribing opioids to patients with early-stage cancer. Semistructured interviews were conducted with nurse practitioners (NP), medical oncologists (MO), radiation oncologists (RO), surgeons (S), primary care physicians (PCP), and palliative care physicians (PC) between June 2021 and March 2022. Interpretive description was used to analyze the data using two coders (C.C. and T.W.). Debriefing sessions were used to resolve and discrepancies. RESULTS: Twenty-four clinicians were interviewed (NP [n = 5], MO [n = 4], RO [n = 4], S [n = 5], PCP [n = 3], and PC [n = 3]). The majority had been in practice at least 10 years. Prescribing practices were related to disciplinary perspective, goals of care, patient condition, and resource availability. Most clinicians did not see opioid misuse as a problem but were aware that specific patient risk factors are present and that long-term use can be problematic. Most clinicians undertake safe prescribing approaches tacitly (eg, screening for past opioid misuse and reviewing number of prescribers) and not all agreed they should be universally applied. Barriers (eg, procedural and time) and facilitators (eg, education) to safe prescribing approaches were identified. CONCLUSION: To enhance uptake and cross-disciplinary consistency of safe prescribing approaches, clinician education regarding opioid misuse and benefits of safe prescribing practices, and addressing procedural barriers are necessary.

Rescue of glutaric aciduria type I in mice by liver-directed therapies.

Glutaric aciduria type I (GA-1) is an inborn error of metabolism with a severe neurological phenotype caused by the deficiency of glutaryl-coenzyme A dehydrogenase (GCDH), the last enzyme of lysine catabolism. Current literature suggests that toxic catabolites in the brain are produced locally and do not cross the blood-brain barrier. In a series of experiments using knockout mice of the lysine catabolic pathway and liver cell transplantation, we uncovered that toxic GA-1 catabolites in the brain originated from the liver. Moreover, the characteristic brain and lethal phenotype of the GA-1 mouse model was rescued by two different liver-directed gene therapy approaches: Using an adeno-associated virus, we replaced the defective Gcdh gene or we prevented flux through the lysine degradation pathway by CRISPR deletion of the aminoadipate-semialdehyde synthase (Aass) gene. Our findings question the current pathophysiological understanding of GA-1 and reveal a targeted therapy for this devastating disorder.

Development of eConsult reflective learning tools for healthcare providers: a pragmatic mixed methods approach.

BACKGROUND: Electronic consultation (eConsult) programs are crucial components of modern healthcare that facilitate communication between primary care providers (PCPs) and specialists. eConsults between PCPs and specialists. They also provide a unique opportunity to use real-world patient scenarios for reflective learning as part of professional development. However, tools that guide and document learning from eConsults are limited. The purpose of this study was to develop and pilot two eConsult reflective learning tools (RLTs), one for PCPs and one for specialists, for those participating in eConsults. METHODS: We performed a four-phase pragmatic mixed methods study recruiting PCPs and specialists from two public health systems located in two countries: eConsult BASE in Canada and San Francisco Health Network eConsult in the United States. In phase 1, subject matter experts developed preliminary RLTs for PCPs and specialists. During phase 2, a Delphi survey among 20 PCPs and 16 specialists led to consensus on items for each RLT. In phase 3, we conducted cognitive interviews with three PCPs and five specialists as they applied the RLTs on previously completed consults. In phase 4, we piloted the RLTs with eConsult users. RESULTS: The RLTs were perceived to elicit critical reflection among participants regarding their knowledge and practice habits and could be used for quality improvement and continuing professional development. CONCLUSION: PCPs and specialists alike perceived that eConsult systems provided opportunities for self-directed learning wherein they were motivated to investigate topics further through the course of eConsult exchanges. We recommend the RLTs be subject to further evaluation through implementation studies at other sites.

Protocol for an extended scoping review on the use of virtual nominal group technique in research.

INTRODUCTION: Consensus group methods such as the Nominal Group Technique (NGT) and Delphi method are commonly used in research to elicit and synthesize expert opinions when evidence is lacking. Traditionally, the NGT involves a face-to-face interaction. However, due to the COVID-19 pandemic, many in-person meetings have moved to online settings. It is unclear to what extent the NGT has been undertaken in virtual settings. The overarching aim of this scoping review is to explore the use of the virtual NGT in research. Our specific objectives are to answer the following questions: To what extent has the NGT been used virtually? What modifications were made to accommodate this online format? What advantages and disadvantages were noted by authors in comparison with the face-to-face mode of the technique? MATERIALS AND METHODS: This scoping review will follow the steps outlined by Arksey and O'Malley and the PRISMA-ScR guidelines. Several pilot searches were completed to refine inclusion and exclusion criteria. Media Synchronicity Theory will provide a conceptual framework to inform the research, including data extraction and summarizing results. As an additional extension to the literature review, online interviews with corresponding authors will be conducted to gather further information.