Best practice recommendations for the management of anxiety during the pegvaliase journey.

BACKGROUND: Pegvaliase, an enzyme substitution therapy, is a treatment option for phenylketonuria (PKU). Due to the neuropathophysiology and disease burden of PKU, individuals can experience baseline anxiety unrelated to pegvaliase therapy. In addition, there are aspects of pegvaliase therapy that may be anxiety-inducing for those considering or receiving treatment. The aim of this manuscript is to present best practice recommendations for the identification and management of anxiety symptoms that can occur along the pegvaliase journey. METHODS: A modified Delphi approach was used to seek consensus among a multidisciplinary panel of experts. To this end, an in-person meeting was held that was preceded by a medical specialist- and patient-specific survey to develop preliminary recommendations on ways to address anxiety along the pegvaliase journey. After the meeting, an additional survey was conducted to rank the proposed solutions and mitigation strategies from which a set of recommendations was developed. All recommendations were voted on with the aim of consensus generation, defined as achieving ≥75% agreement among experts. RESULTS: The panel reached consensus on a total of 28 best practice recommendations for the management of anxiety during the pre-treatment, induction and titration, early maintenance (pre-efficacy), and late maintenance (post-efficacy) stages. The recommendations offer strategies to identify and address the most common causes of pegvaliase-related anxiety, including self-injection, side effects, the titration schedule, prescribed dietary changes, and variable time to efficacy. Overall, managing anxiety in those considering or receiving pegvaliase involves patient-centered communication, shared decision-making, and personalized treatment plans. CONCLUSIONS: The best practice recommendations described herein can guide healthcare providers in proactively addressing anxiety during the different stages of pegvaliase treatment, and support providers with initiating and managing pegvaliase in individuals who may experience baseline and treatment-related anxiety.

Treatment for central centrifugal cicatricial alopecia-Delphi consensus recommendations.

BACKGROUND: There is no established standard of care for treating central centrifugal cicatricial alopecia (CCCA), and treatment approaches vary widely. OBJECTIVE: To develop consensus statements regarding the use of various pharmacological therapies in treating adults with CCCA. METHODS: We invited 27 dermatologists with expertise in hair and scalp disorders to participate in a 3-round modified Delphi study between January and March 2023. Statements met strong consensus if 75% of respondents agreed or disagreed. Statements met moderate consensus if 55% or more but less than 75% agreed or disagreed. RESULTS: In round 1, 5 of 33 (15.2%) statements met strong consensus, followed by 9 of 28 (32.1%) in round 2. After the final round 3 meeting, strong consensus was reached for 20 of 70 (28.6%) overall statements. Two statements achieved moderate consensus. LIMITATIONS: This study included only English-speaking, US-based dermatologists and did not consider nonpharmacological therapies. CONCLUSION: Despite varying opinions among dermatologists, consensus was reached for several statements to help clinicians manage CCCA. We also highlight areas that lack expert consensus with the goal of advancing research and therapeutic options for CCCA.

Exploring lifelong overactive bladder: Transitions, evidence, and clinical implications; A modified Delphi process.

INTRODUCTION: Overactive bladder (OAB) is a prevalent urological condition characterized by urinary urgency, with or without urgency urinary incontinence, accompanied by increased daytime frequency and nocturia. However, the current definition of OAB lacks a specified time frame, hindering our understanding of the temporal aspects and transitions that occur within the OAB spectrum. METHODS: A modified Delphi study was conducted in three rounds, involving a panel of international experts in functional urology, urogynaecology, geriatrics, transitional medicine, and pediatric urology. The study took place between February 2023 and June 2023 and employed two sequential rounds of online surveys, followed by a final hybrid group discussion session in June 2023. RESULTS: The Delphi process resulted in a consensus definition of lifelong OAB as a persistent and continuous condition that may manifest differently from birth and evolve over time, with varying levels of clinical perception. The course of its progression is influenced by transition periods and modifying factors, mainly anatomical, hormonal, and psychosocial/stressors. Three main transition periods were identified: achievement of daytime continence, adulthood to elderly, and transition to frail elderly. The panel also considered the therapeutic and diagnostic implications of lifelong OAB, as well as future research prospects in terms of importance and feasibility. CONCLUSIONS: Future longitudinal research is needed to develop this concept and further identify transitions and temporal dynamics.

Health literacy competency requirements for health professionals: a Delphi consensus study in Taiwan.

BACKGROUND: Cumulative evidence supports the importance of health literacy in determining the quality of healthcare delivery and outcomes. To enhance health literacy competencies among professionals and alleviate healthcare barriers owing to patients' inadequate health literacy, evidence-based health literacy competency guidelines are needed for the development of health professionals' training curricula. The aim of this study was to validate and refine a set of health literacy competencies, including knowledge, attitude, and skills of health professionals, and to prioritize the importance of health literacy practices among healthcare professionals. METHODS: We employed a consensus-building approach that utilized a modified three-round Delphi process conducted in 2017. An online Delphi panel was assembled, comprising 20 Taiwanese health literacy experts from diverse fields such as medicine, nursing, public health, language, and communication. A set of health literacy competencies previously identified and validated by an international panel of health literacy experts was cross-culturally translated. RESULTS: After three rounds of ratings and modifications, a consensus agreement was reached on 42 of 62 health literacy competencies, including 12 of 24 knowledge items, 9 of 11 attitude items, and 21 of 27 skill items. Of the 32 health literacy practices, "avoidance using medical jargon," "speaking slowly and clearly with patients," and "using analogies and examples" were deemed most important by the panelists. CONCLUSIONS: The Delphi panel's consensus helped to identify a set of core health literacy competencies that could serve as measurable learning objectives to guide the development of a health literacy curriculum for health professionals. The prioritized health literacy practices can be employed as indicators of health literacy competencies that health professionals should learn and routinely use in clinical settings.

International Delphi Study on Wound Closure and Incision Management in Joint Arthroplasty Part 2: Total Hip Arthroplasty.

BACKGROUND: This modified Delphi study aimed to develop a consensus on optimal wound closure and incision management strategies for total hip arthroplasty (THA). Given the critical nature of wound care and incision management in influencing patient outcomes, this study sought to synthesize evidence-based best practices for wound care in THA procedures. METHODS: An international panel of 20 orthopedic surgeons from Europe, Canada, and the United States evaluated a targeted literature review of 18 statements (14 specific to THA and 4 related to both THA and total knee arthroplasty). There were 3 rounds of anonymous voting per topic using a modified 5-point Likert scale with a predetermined consensus threshold of ≥ 75% agreement necessary for a statement to be accepted. RESULTS: After 3 rounds of voting, consensus was achieved for all 18 statements. Notable recommendations for THA wound management included (1) the use of barbed sutures over non-barbed sutures (shorter closing times and overall cost savings); (2) the use of subcuticular sutures over skin staples (lower risk of superficial infections and higher patient preferences, but longer closing times); (3) the use of mesh-adhesives over silver-impregnated dressings (lower rate of wound complications); (4) for at-risk patients, the use of negative pressure wound therapy over other dressings (lower wound complications and reoperations, as well as fewer dressing changes); and (5) the use of triclosan-coated sutures (lower risk of surgical site infection) over standard sutures. CONCLUSIONS: Through a structured modified Delphi approach, a panel of 20 orthopedic surgeons reached consensus on all 18 statements pertaining to wound closure and incision management in THA. This study provides a foundational framework for establishing evidence-based best practices, aiming to reduce variability in patient outcomes and to enhance the overall quality of care in THA procedures.

Technical guideline for intra-prepontine cisternal drug delivery via spinal puncture through subarachnoid catheterization. / ç»è„ŠæŸ±æ¤Žé—´éš™ç©¿åˆºè››ç½‘è†œä¸‹è ”è„‘æ¡¥å‰æ± ç½®ç®¡è¯ç‰©è¾“æ³¨æŠ€æœ¯åº”ç”¨æŒ‡å—.

OBJECTIVES: The distribution characteristics of intrathecal drugs and the limitation of current catheterization techniques make traditional intrathecal analgesic treatment nearly useless for refractory craniofacial pain, such as trigemina neuralgia. This technical guideline aims to promote the widespread and standardize the application of intra-prepontine cisternal drug delivery via spinal puncture and catheterization. METHODS: A modified Delphi approach was used to work for this guideline. On the issues related to the intra-prepontine cisternal targeted drug delivery technique, the working group consulted 10 experts from the field with 3 rounds of email feedback and 3 rounds of conference discussion. RESULTS: For the efficacy and safety of the intra-prepontine cisternal targeted drug delivery technique, a consensus was formed on 7 topics (with an agreement rate of more than 80%), including the principles of the technique, indications and contraindications, patient preparation, surgical specifications for intra-prepontine cisternal catheter placement, analgesic dosage coordination, analgesic management, and prevention and treatment of complications. CONCLUSIONS: Utilizing the intra-prepontine cisternal drug infusion system to manage refractory craniofacial pain could provide advantages in terms of minimally invasive, secure, and effective treatment. This application can not only alleviate the suffering of individuals experiencing the prolonged pain but also support the maintenance of quality of life and dignity in their final moments, justifiing its widespread dissemination and standardized adoption in domestic and international professional fields.

Consensus Recommendations for Sick Day Medication Guidance for People With Diabetes, Kidney, or Cardiovascular Disease: A Modified Delphi Process.

RATIONALE & OBJECTIVE: Sick day medication guidance (SDMG) involves withholding or adjusting specific medications in the setting of acute illnesses that could contribute to complications such as hypotension, acute kidney injury (AKI), or hypoglycemia. We sought to achieve consensus among clinical experts on recommendations for SDMG that could be studied in future intervention studies. STUDY DESIGN: A modified Delphi process following guidelines for conducting and reporting Delphi studies. SETTING & PARTICIPANTS: An international group of clinicians with expertise relevant to SDMG was recruited through purposive and snowball sampling. A scoping review of the literature was presented, followed by 3 sequential rounds of development, refinement, and voting on recommendations. Meetings were held virtually and structured to allow the participants to provide their input and rapidly prioritize and refine ideas. OUTCOME: Opinions of participants were measured as the percentage who agreed with each recommendation, whereas consensus was defined as >75% agreement. ANALYTICAL APPROACH: Quantitative data were summarized using counts and percentages. A qualitative content analysis was performed to capture the context of the discussion around recommendations and any additional considerations brought forward by participants. RESULTS: The final panel included 26 clinician participants from 4 countries and 10 clinical disciplines. Participants reached a consensus on 42 specific recommendations: 5 regarding the signs and symptoms accompanying volume depletion that should trigger SDMG; 6 regarding signs that should prompt urgent contact with a health care provider (including a reduced level of consciousness, severe vomiting, low blood pressure, presence of ketones, tachycardia, and fever); and 14 related to scenarios and strategies for patient self-management (including frequent glucose monitoring, checking ketones, fluid intake, and consumption of food to prevent hypoglycemia). There was consensus that renin-angiotensin system inhibitors, diuretics, nonsteroidal anti-inflammatory drugs, sodium/glucose cotransporter 2 inhibitors, and metformin should be temporarily stopped. Participants recommended that insulin, sulfonylureas, and meglitinides be held only if blood glucose was low and that basal and bolus insulin be increased by 10%-20% if blood glucose was elevated. There was consensus on 6 recommendations related to the resumption of medications within 24-48 hours of the resolution of symptoms and the presence of normal patterns of eating and drinking. LIMITATIONS: Participants were from high-income countries, predominantly Canada. Findings may not be generalizable to implementation in other settings. CONCLUSIONS: A multidisciplinary panel of clinicians reached a consensus on recommendations for SDMG in the presence of signs and symptoms of volume depletion, as well as self-management strategies and medication instructions in this setting. These recommendations may inform the design of future trials of SDMG strategies.

Defining ruxolitinib failure and transition to next-line therapy for patients with myelofibrosis: a modified Delphi panel consensus study.

Aim: To define ruxolitinib failure and develop parameters to guide transition to next-line therapy for patients with myelofibrosis. Methods: A modified Delphi panel with 14 hematologists-oncologists. Survey concepts included defining primary refractory status, loss of response, disease progression, intolerance and transition to next-line therapy. Results: Ruxolitinib failure may be defined as no improvement in symptoms or spleen size, progressive disease or ruxolitinib intolerance, following a maximally tolerated dose for ≥3 months. Loss of spleen response 1 month after initial response may prompt discontinuation. Lack of evidence to inform transition to next-line therapy was noted; tapering ruxolitinib should be considered according to ruxolitinib dose and patient characteristics. Conclusion: Expert consensus was provided on defining ruxolitinib failure and transition to next-line therapy as summarized in this position paper, which may support considerations in the development of future clinical practice guidelines.

People with myelofibrosis who receive treatment with ruxolitinib may need to stop treatment because it is not working or they cannot tolerate the side effects. There is little good scientific information available about how and when to stop ruxolitinib treatment, and how to move to another treatment after stopping ruxolitinib. A group of clinical experts in hematology and oncology followed a scientific process, called the Delphi method, to discuss this topic and to reach agreement on the most important aspects of this challenge. The experts agreed that ruxolitinib failure may be defined as having no improvement in symptoms or spleen size, progressive disease or ruxolitinib intolerance, after the patient was receiving the highest dose they could tolerate for ≥3 months. The results of this expert discussion may support patients and their healthcare providers making decisions in real life, and development of future clinical practice guidelines.

The role of modeling studies in asthma management and clinical decision-making: a Delphi survey of physician knowledge and perceptions.

OBJECTIVE: To investigate the knowledge and perceptions of physicians on the role of modeling studies in asthma, using a modified Delphi procedure. METHODS: Group opinions among a panel of respiratory experts were obtained using two online questionnaires and a virtual scientific workshop. A consensus was pre-defined as agreement by >75% of participants. RESULTS: From 26 experts who agreed to participate, 22 completed both surveys. At the end of the process, the panel rated their own understanding of modeling as good (77%) but that among physicians in general as poor (77%). Participants agreed that data from modeling studies should be used, at least sometimes, to inform treatment guidelines (91%) and could be useful for guiding clinical decisions (100%). Perceived barriers to using modeling studies were 'A lack of understanding' (81%) and 'A lack of standardized methodology' (82%). Based on data from two modeling studies, no consensus was reached on physicians recommending regular inhaled corticosteroids (ICS) versus as-needed therapy for patients with mild asthma, whereas 77% agreed that they would recommend regular ICS over maintenance and reliever therapy for ≥80% of their patients with moderate asthma. No consensus was reached on the value of modeling data in relation to empirical data. CONCLUSION: There is overall support among respiratory experts for the usefulness of modeling data to guide asthma treatment guidelines and clinical decision making. More publications on modeling data using robust models and accessible terminology will aid the understanding of physicians in general and help clarify the evidence-based value of modeling studies.

Defining new roles and competencies for administrative staff and faculty in the age of competency-based medical education.

PURPOSE: These authors sought to define the new roles and competencies required of administrative staff and faculty in the age of CBME. METHOD: A modified Delphi process was used to define the new CBME roles and competencies needed by faculty and administrative staff. We invited international experts in CBME (volunteers from the ICBME Collaborative email list), as well as faculty members and trainees identified via social media to help us determine the new competencies required of faculty and administrative staff in the CBME era. RESULTS: Thirteen new roles were identified. The faculty-specific roles were: National Leader/Facilitator in CBME; Institutional/University lead for CBME; Assessment Process & Systems Designer; Local CBME Leads; CBME-specific Faculty Developers or Trainers; Competence Committee Chair; Competence Committee Faculty Member; Faculty Academic Coach/Advisor or Support Person; Frontline Assessor; Frontline Coach. The staff-specific roles were: Information Technology Lead; CBME Analytics/Data Support; Competence Committee Administrative Assistant. CONCLUSIONS: The authors present a new set of faculty and staff roles that are relevant to the CBME context. While some of these new roles may be incorporated into existing roles, it may be prudent to examine how best to ensure that all of them are supported within all CBME contexts in some manner.

How much is enough? Proposing achievement thresholds for core EPAs of graduating medical students in Canada.

PURPOSE: The transition towards Competency-Based Medical Education at the Cumming School of Medicine was accelerated by the reduced clinical time caused by the COVID-19 pandemic. The purpose of this study was to define a standard protocol for setting Entrustable Professional Activity (EPA) achievement thresholds and examine their feasibility within the clinical clerkship. METHODS: Achievement thresholds for each of the 12 AFMC EPAs for graduating Canadian medical students were set by using sequential rounds of revision by three consecutive groups of stakeholders and evaluation experts. Structured communication was guided by a modified Delphi technique. The feasibility/consequence models of these EPAs were then assessed by tracking their completion by the graduating class of 2021. RESULTS: The threshold-setting process resulted in set EPA achievement levels ranging from 1 to 8 across the 12 AFMC EPAs. Estimates were stable after the first round for 9 of 12 EPAs. 96.27% of EPAs were successfully completed by clerkship students despite the shortened clinical period. Feasibility was predicted by the slowing rate of EPA accumulation overtime during the clerkship. CONCLUSION: The process described led to consensus on EPA achievement thresholds. Successful completion of the assigned thresholds was feasible within the shortened clerkship.[Box: see text].

Standards for evaluating the quality of undergraduate nursing e-learning programme in low- and middle-income countries: a modified Delphi study.

BACKGROUND: The lack of standards for evaluating the quality of undergraduate nursing programmes hampers the evaluation of e-learning programmes in low- and middle-income countries. Fragmented approaches to evaluation coupled with a lack of uniform criteria have been a major deterrent to the growth of e-learning. Adopting standards from high-income countries has contextual challenges in low- and middle-income countries (LMICs). Holistic approaches coupled with uniform standards provide information to stakeholders hence the quality of the programmes is measurable. The e-learning situation in low-and middle-income countries provided an impetus to develop and validate these standards. DESIGN: A modified Delphi technique. REVIEW METHODS: Fourteen experts with experience and expertise in e-learning and regulation of undergraduate nursing from fourteen countries from LMICs participated in three rounds of the modified Delphi process. A pre-described set of standards was shared electronically for independent and blinded ratings. An 80% threshold was set for consensus decisions. The standards were modified based on experts' comments, and two subsequent rounds were used to refine the standards and criteria. RESULTS: At the end of round one, the expert consensus was to keep 67, modify 39 and remove three criteria. At the end of the second round, the consensus was to modify 38 and remove one criteria. In the third round, experts agreed that the standards were feasible, usable, and practical in LMICs. A total of six broad standards with 104 criteria were developed. CONCLUSION: The Technological bloom permeating all spheres of society, including education is an essential component in the development of e-learning programmes. E-learning in nursing education requires critical evaluation to ensure quality in undergraduate nursing programmes. The intricacies of the Low and middle-income context were taken into consideration in developing the standards to offer sustainable evaluation of the quality of e-learning in LMICs, and local solutions to local problems.

Establishing a Standardized Clinical Consensus for Reporting Complications Following Lateral Lumbar Interbody Fusion.

Background and Objectives: Mitigating post-operative complications is a key metric of success following interbody fusion. LLIF is associated with a unique complication profile when compared to other approaches, and while numerous studies have attempted to report the incidence of post-operative complications, there is currently no consensus regarding their definitions or reporting structure. The aim of this study was to standardize the classification of complications specific to lateral lumbar interbody fusion (LLIF). Materials and Methods: A search algorithm was employed to identify all the articles that described complications following LLIF. A modified Delphi technique was then used to perform three rounds of consensus among twenty-six anonymized experts across seven countries. Published complications were classified as major, minor, or non-complications using a 60% agreement threshold for consensus. Results: A total of 23 articles were extracted, describing 52 individual complications associated with LLIF. In Round 1, forty-one of the fifty-two events were identified as a complication, while seven were considered to be approach-related occurrences. In Round 2, 36 of the 41 events with complication consensus were classified as major or minor. In Round 3, forty-nine of the fifty-two events were ultimately classified into major or minor complications with consensus, while three events remained without agreement. Vascular injuries, long-term neurologic deficits, and return to the operating room for various etiologies were identified as important consensus complications following LLIF. Non-union did not reach significance and was not classified as a complication. Conclusions: These data provide the first, systematic classification scheme of complications following LLIF. These findings may improve the consistency in the future reporting and analysis of surgical outcomes following LLIF.

[Establishing Age-Friendly Community Guidelines in Taiwan].

As Taiwan heads steadily toward becoming a super-aged society, the impact of aging on society at large will become increasingly extensive and intense. Therefore, establishing an age-friendly environment in Taiwan is an important issue for the government. Feasible guidelines for age-friendly communities are necessary to ensure that appropriate social welfare measures are enacted to achieve the national goal of aging in place. The first draft of the guideline questionnaire was developed based on the World Health Organization Guidelines for Age-Friendly Cities, a literature review, and input from seven experts on aging. Three rounds of questionnaire surveys were then conducted to assess the correctness, appropriateness, and importance of the guidelines, with amendments, additions, and deletions made based on the experts' responses until they all expressed a high degree of satisfaction with all of the guidelines. The Taiwan Age-friendly Community Guidelines document discussed in this article includes 38 guidelines that address the eight facets of "outdoor spaces and buildings", "transportation", "housing", "social participation", "respect and social inclusion", "civil participation and employment", "communication and information", and "community support and health services". The guidelines document describes in detail the goals of age-friendly communities in specific and easy-to-understand terms. Moreover, it provides a reference for frontline personnel in the community to promote age-friendly environs.

Optimal Urine Culture Diagnostic Stewardship Practice-Results from an Expert Modified-Delphi Procedure.

BACKGROUND: Urine cultures are nonspecific and often lead to misdiagnosis of urinary tract infection and unnecessary antibiotics. Diagnostic stewardship is a set of procedures that modifies test ordering, processing, and reporting in order to optimize diagnosis and downstream treatment. In this study, we aimed to develop expert guidance on best practices for urine culture diagnostic stewardship. METHODS: A RAND-modified Delphi approach with a multidisciplinary expert panel was used to ascertain diagnostic stewardship best practices. Clinical questions to guide recommendations were grouped into three thematic areas (ordering, processing, reporting) in practice settings of emergency department, inpatient, ambulatory, and long-term care. Fifteen experts ranked recommendations on a 9-point Likert scale. Recommendations on which the panel did not reach agreement were discussed during a virtual meeting, then a second round of ranking by email was completed. After secondary review of results and panel discussion, a series of guidance statements was developed. RESULTS: One hundred and sixty-five questions were reviewed. The panel reaching agreement on 104, leading to 18 overarching guidance statements. The following strategies were recommended to optimize ordering urine cultures: requiring documentation of symptoms, sending alerts to discourage ordering in the absence of symptoms, and cancelling repeat cultures. For urine culture processing, conditional urine cultures and urine white blood cell count as criteria were supported. For urine culture reporting, appropriate practices included nudges to discourage treatment under specific conditions and selective reporting of antibiotics to guide therapy decisions. CONCLUSIONS: These 18 guidance statements can optimize use of urine cultures for better patient outcomes.

Management of early treated adolescents and young adults with phenylketonuria: Development of international consensus recommendations using a modified Delphi approach.

BACKGROUND: Early treated patients with phenylketonuria (PKU) often become lost to follow-up from adolescence onwards due to the historical focus of PKU care on the pediatric population and lack of programs facilitating the transition to adulthood. As a result, evidence on the management of adolescents and young adults with PKU is limited. METHODS: Two meetings were held with a multidisciplinary international panel of 25 experts in PKU and comorbidities frequently experienced by patients with PKU. Based on the outcomes of the first meeting, a set of statements were developed. During the second meeting, these statements were voted on for consensus generation (≥70% agreement), using a modified Delphi approach. RESULTS: A total of 37 consensus recommendations were developed across five areas that were deemed important in the management of adolescents and young adults with PKU: (1) general physical health, (2) mental health and neurocognitive functioning, (3) blood Phe target range, (4) PKU-specific challenges, and (5) transition to adult care. The consensus recommendations reflect the personal opinions and experiences from the participating experts supported with evidence when available. Overall, clinicians managing adolescents and young adults with PKU should be aware of the wide variety of PKU-associated comorbidities, initiating screening at an early age. In addition, management of adolescents/young adults should be a joint effort between the patient, clinical center, and parents/caregivers supporting adolescents with gradually gaining independent control of their disease during the transition to adulthood. CONCLUSIONS: A multidisciplinary international group of experts used a modified Delphi approach to develop a set of consensus recommendations with the aim of providing guidance and offering tools to clinics to aid with supporting adolescents and young adults with PKU.

Consensus Current Procedural Terminology Code Definition of Source Control for Sepsis.

INTRODUCTION: Unlike antibiotic and perfusion support, guidelines for sepsis source control lack high-quality evidence and are ungraded. Internally valid administrative data methods are needed to identify cases representing source control procedures to evaluate outcomes. METHODS: Over five modified Delphi rounds, two independent reviewers identified Current Procedural Terminology (CPT) codes pertinent to source control. In each round, codes with perfect agreement were retained or excluded, whereas disagreements were reviewed by the panelists. Manual review of 400 patient records meeting Sepsis-3 criteria (2010-2017) clinically adjudicated which encounters included source control procedures (gold standard). The performance of consensus codes was compared with the gold standard to assess sensitivity, specificity, predictive values, and likelihood ratios. RESULTS: Of 5752 CPT codes, 609 consensus codes represented source control procedures. Of 400 hospitalizations for sepsis, 39 (9.8%; 95% confidence interval [CI] 7.0%-13.1%) underwent gold standard source control procedures and 29 (7.3%; 95% CI 4.9-10.3%) consensus code-defined source control procedures. Thirty consensus codes were identified (20.0% gastrointestinal/intraabdominal, 10.0% genitourinary, 13.3% hepatopancreatobiliary, 23.3% orthopedic/cranial, 23.3% soft tissue, and 10.0% intrathoracic), which had 61.5% (95% CI 44.6%-76.6%) sensitivity, 98.6% (95% CI 96.8%-99.6%) specificity, 83.2% (95% CI 66.6%-92.4%) positive, and 95.9% (95% CI 93.9%-97.2%) negative predictive values. With pretest probability at sample prevalence, an identified consensus code had a posttest probability of 83.0% (95% CI 66.0%-92.0%), whereas consensus code absence had a probability of 4.0% (95% CI 3.0-6.0) for undergoing a source control procedure. CONCLUSIONS: Using modified Delphi methodology, we created and validated CPT codes identifying source control procedures, providing a framework for evaluation of the surgical care of patients with sepsis.

The impact of panel composition and topic on stakeholder perspectives: Generating hypotheses from online maternal and child health modified-Delphi panels.

INTRODUCTION: Multistakeholder engagement is crucial for conducting health services research. Delphi-based methodologies combining iterative rounds of questions with feedback on and discussion of group results are a well-documented approach to multistakeholder engagement. This study develops hypotheses about the impact of panel composition and topic on the propensity and meaningfulness of response changes in multistakeholder modified-Delphi panels. METHODS: We conducted three online modified-Delphi (OMD) multistakeholder panels using the same protocol. We assigned 60 maternal and child health professionals to a homogeneous (professionals only) panel, 60 pregnant or postpartum women (patients) to a homogeneous panel, and 30 professionals and 30 patients to a mixed panel. In Round 1, participants rated the seriousness of 11 maternal and child health outcomes using a 0-100 scale and explained their ratings. In Round 2, participants saw their own and their panel's Round 1 results and discussed them using asynchronous, anonymous discussion boards moderated by the study investigators. In Round 3, participants revised their original ratings. Our outcome measures included binary indicators of response changes to ratings of the low, medium and high severity maternal and child health outcomes and their meaningfulness, measured by a change of 10 or more points. RESULTS: Participants changed 818 of 1491 (55%) of responses; the majority of response changes were meaningful. Patterns of response changes were different for patients and professionals and for different levels of outcome seriousness. Using study results and the literature, we developed three hypotheses. First, OMD participants, regardless of their stakeholder group, are more likely to change their responses on preference-sensitive topics where there is a range of viable alternatives or perspectives. Second, patients are more likely to change their responses and to do so meaningfully in mixed panels, whereas professionals are more likely to do so in homogeneous panels. Third, the association between panel composition and response change varies according to the topic (e.g., the level of outcome seriousness). CONCLUSIONS: Results of our work not only helped generate empirically derived hypotheses to be tested in future research but also offer practical recommendations for designing multistakeholder OMD panels. PATIENT OR PUBLIC CONTRIBUTION: Pregnant or postpartum women were involved in this study.

Development of a social distancing monitoring system in Republic of Korea: results of a modified Delphi process.

BACKGROUND: Social distancing policies work in different ways and at different levels. In addition, various forms of monitoring systems have been implemented in different countries. However, there is an almost complete lack of specific monitoring system in Republic of Korea to effectively monitor social distancing measures compliance and outcome. This study aims to develop a monitoring system for social distancing measures compliance and outcome in Korea to evaluate and improve the implemented policy. METHODS: A draft monitoring system was developed after reviewing Korea's social distancing measures (central and local government briefings) and checking available data about social distancing behavior. The modified Delphi process was used to evaluate the draft of the social distancing monitoring system. In total, 27 experts participated in the evaluation. The round 1 evaluation includes (1) commenting on the composition of the monitoring fields (open response), (2) monitoring indicators for each monitoring field (10-point Likert scale), and (3) commenting on the source of data used to develop the monitoring system (open response). In the round 2 evaluation, 55 indicators, excepting open responses, were re-evaluated. RESULTS: The response rate for the Delphi survey was 100% in both the first and second rounds. Of the 55 indicators, 1 indicator, which did not satisfy the quantitative criteria, was excluded. According to the experts' open response comments, 15 indicators were excluded, as these indicators overlapped with other indicators or had little relevance to social distancing. Instead, 23 new indicators were added. Finally, 62 indicators were included with 12 available data sources. The monitoring system domain was divided into 'social distancing measures state, social distancing measures compliance, social distancing outcome'. CONCLUSIONS: This study is significant in that it is the first in Korea to develop a comprehensive monitoring system for checking if social distancing measures are being followed well, and is applicable to estimates utilizing data that are immediately available for each indicator. Furthermore, the developed monitoring system could be a reference for other countries that require the development of such systems to monitor social distancing.

Attributes development for a discrete choice experiment on preferences in sexual and reproductive health services for adolescents and young people in Nigeria.

BACKGROUND: A major component of the validity of the discrete choice experiment (DCE) research design lies in the correct specification of attributes and levels relevant to the research focus. In this paper, we set out the validation steps we took in designing the tool for a DCE on preferences in sexual and reproductive health (SRH) services for adolescents and young people. METHODOLOGY: This study was carried out among adolescents and young people (AYP) in Ogun State, Southwest Nigeria. We used a three-step mixed-methods process in developing the attributes and attribute-levels for our DCE tool. The first was to conduct a series of 16 focus group discussions (FGD) with AYP ensuring maximal variation (by age group, sex, marital status, and location). The FGD included a priority listing process in which participants were asked to list and rank the most important characteristics of optimal SRH services for AYP. The lists were harmonized and items were scored. The main (highest scoring) themes emerging from the harmonized priority list were converted into an initial set of attributes and the subthemes as level. These initial attributes and levels were presented to a panel of methods and content experts in a virtual modified Delphi process. This was for deciding on the importance of the attributes in providing optimum sexual and reproductive health services for young people, and the appropriateness of the levels. The same set of attributes was presented to another set of AYP in a series of four FGD to clarify meanings, and test whether the wordings were well understood. We applied some decision rules for including and excluding attributes and levels in the different phases of the development process. RESULTS: We extracted an initial set of nine attributes with 2-4 levels each from the first FGD sessions. These were revised to a final set of seven attributes with 2-4 levels each based on findings from the expert review and final validation FGDs with AYP. The final attributes were: the type of staff, physical environment, health worker attitude, cost, waiting time, contraceptive availability, and opening hours. CONCLUSION: The final set of attributes covered those relating to the services provided, the health workers providing the services, and the AYP. Our three-step process which included both quantitative and qualitative approaches ensured a rigorous process that produced a reliable combination of attributes and levels. Although we had to trade off some competing attributes to come to a final list, our decision rules helped us to conduct a transparent and reproducible process.