The Quality of Assessment for Learning score for evaluating written feedback in anesthesiology postgraduate medical education: a generalizability and decision study.

Background: Competency based residency programs depend on high quality feedback from the assessment of entrustable professional activities (EPA). The Quality of Assessment for Learning (QuAL) score is a tool developed to rate the quality of narrative comments in workplace-based assessments; it has validity evidence for scoring the quality of narrative feedback provided to emergency medicine residents, but it is unknown whether the QuAL score is reliable in the assessment of narrative feedback in other postgraduate programs. Methods: Fifty sets of EPA narratives from a single academic year at our competency based medical education post-graduate anesthesia program were selected by stratified sampling within defined parameters [e.g. resident gender and stage of training, assessor gender, Competency By Design training level, and word count (≥17 or <17 words)]. Two competency committee members and two medical students rated the quality of narrative feedback using a utility score and QuAL score. We used Kendall's tau-b co-efficient to compare the perceived utility of the written feedback to the quality assessed with the QuAL score. The authors used generalizability and decision studies to estimate the reliability and generalizability coefficients. Results: Both the faculty's utility scores and QuAL scores (r = 0.646, p < 0.001) and the trainees' utility scores and QuAL scores (r = 0.667, p < 0.001) were moderately correlated. Results from the generalizability studies showed that utility scores were reliable with two raters for both faculty (Epsilon=0.87, Phi=0.86) and trainees (Epsilon=0.88, Phi=0.88). Conclusions: The QuAL score is correlated with faculty- and trainee-rated utility of anesthesia EPA feedback. Both faculty and trainees can reliability apply the QuAL score to anesthesia EPA narrative feedback. This tool has the potential to be used for faculty development and program evaluation in Competency Based Medical Education. Other programs could consider replicating our study in their specialty.

Contexte: La qualité de la rétroaction à la suite de l'évaluation d'activités professionnelles confiables (APC) est d'une importance capitale dans les programmes de résidence fondés sur les compétences. Le score QuAL (Quality of Assessment for Learning) est un outil développé pour évaluer la qualité de la rétroaction narrative dans les évaluations en milieu de travail. Sa validité a été démontrée dans le cas des commentaires narratifs fournis aux résidents en médecine d'urgence, mais sa fiabilité n'a pas été évaluée dans d'autres programmes de formation postdoctorale. Méthodes: Cinquante ensembles de commentaires portant sur des APC d'une seule année universitaire dans notre programme postdoctoral en anesthésiologie ­ un programme fondé sur les compétences ­ ont été sélectionnés par échantillonnage stratifié selon des paramètres préétablis [par exemple, le sexe du résident et son niveau de formation, le sexe de l'évaluateur, le niveau de formation en Compétence par conception, et le nombre de mots (≥17 ou <17 mots)]. Deux membres du comité de compétence et deux étudiants en médecine ont évalué la qualité de la rétroaction narrative à l'aide d'un score d'utilité et d'un score QuAL. Nous avons utilisé le coefficient tau-b de Kendall pour comparer l'utilité perçue de la rétroaction écrite et sa qualité évaluée à l'aide du score QuAL. Les auteurs ont utilisé des études de généralisabilité et de décision pour estimer les coefficients de fiabilité et de généralisabilité. Résultats: Les scores d'utilité et les scores QuAL des enseignants (r = 0,646, p < 0,001) et ceux des étudiants (r = 0,667, p < 0,001) étaient modérément corrélés. Les résultats des études de généralisabilité ont montré qu'avec deux évaluateurs les scores d'utilité étaient fiables tant pour les enseignants (Epsilon=0,87, Phi=0,86) que pour les étudiants (Epsilon=0,88, Phi=0,88). Conclusions: Le score QuAL est en corrélation avec l'utilité de la rétroaction sur les APC en anesthésiologie évaluée par les enseignants et les étudiants. Les uns et les autres peuvent appliquer de manière fiable le score QuAL aux commentaires narratifs sur les APC en anesthésiologie. Cet outil pourrait être utilisé pour le perfectionnement professoral et l'évaluation des programmes dans le cadre d'une formation médicale fondée sur les compétences. D'autres programmes pourraient envisager de reproduire notre étude dans leur spécialité.

Growth of Coordinated Specialty Care in the United States With Changes in Federal Funding Policies: 2014-2018.

OBJECTIVE: In 2014, the number of coordinated specialty care (CSC) programs in the United States greatly expanded. The proliferation of CSC programs was likely due in part to the availability of Mental Health Block Grant (MHBG) set-aside funds for treatment of first-episode psychosis. This study aimed to explore the characteristics of CSC programs across 44 states, the District of Columbia, and three U.S. territories that received funding through the MHBG set-aside program in 2018. METHODS: Leadership at 88% (N=215) of the 244 MHBG-funded CSC programs identified through state mental health authorities participated in an online survey. RESULTS: Overall, 69% of the CSC programs were initiated after 2014. More than 90% of programs included services that were consistent with federal guidance. CSC programs showed variability in training received, program size, and enrollment criteria. CONCLUSIONS: The results of this study emphasize that clear federal guidance can help shape national CSC implementation efforts, although decisions at the state and local levels can influence how implementation occurs. The strategy of states administering federal funds for CSC may be adapted for the rollout of other behavioral health interventions. Future studies could investigate factors that may shape national dissemination efforts, such as leadership within the state, funding, availability of programs established before the influx of funding, and considerations about sustainability after the funding is no longer available.

Postmortem Assessment of Olfactory Tissue Degeneration and Microvasculopathy in Patients With COVID-19.

Importance: Loss of smell is an early and common presentation of COVID-19 infection. Although it has been speculated that viral infection of olfactory neurons may be the culprit, it is unclear whether viral infection causes injuries in the olfactory bulb region. Objective: To characterize the olfactory pathology associated with COVID-19 infection in a postmortem study. Design, Setting, and Participants: This multicenter postmortem cohort study was conducted from April 7, 2020, to September 11, 2021. Deceased patients with COVID-19 and control individuals were included in the cohort. One infant with congenital anomalies was excluded. Olfactory bulb and tract tissue was collected from deceased patients with COVID-19 and appropriate controls. Histopathology, electron microscopy, droplet digital polymerase chain reaction, and immunofluorescence/immunohistochemistry studies were performed. Data analysis was conducted from February 7 to October 19, 2021. Main Outcomes and Measures: (1) Severity of degeneration, (2) losses of olfactory axons, and (3) severity of microvasculopathy in olfactory tissue. Results: Olfactory tissue from 23 deceased patients with COVID-19 (median [IQR] age, 62 [49-69] years; 14 men [60.9%]) and 14 control individuals (median [IQR] age, 53.5 [33.25-65] years; 7 men [50%]) was included in the analysis. The mean (SD) axon pathology score (range, 1-3) was 1.921 (0.569) in patients with COVID-19 and 1.198 (0.208) in controls (P < .001), whereas axon density was 2.973 (0.963) × 104/mm2 in patients with COVID-19 and 3.867 (0.670) × 104/mm2 in controls (P = .002). Concomitant endothelial injury of the microvasculature was also noted in olfactory tissue. The mean (SD) microvasculopathy score (range, 1-3) was 1.907 (0.490) in patients with COVID-19 and 1.405 (0.233) in control individuals (P < .001). Both the axon and microvascular pathology was worse in patients with COVID-19 with smell alterations than those with intact smell (mean [SD] axon pathology score, 2.260 [0.457] vs 1.63 [0.426]; P = .002; mean [SD] microvasculopathy score, 2.154 [0.528] vs 1.694 [0.329]; P = .02) but was not associated with clinical severity, timing of infection, or presence of virus. Conclusions and Relevance: This study found that COVID-19 infection is associated with axon injuries and microvasculopathy in olfactory tissue. The striking axonal pathology in some cases indicates that olfactory dysfunction in COVID-19 infection may be severe and permanent.

Reporting Maltreatment to Child Protective Services in the Context of Intimate Partner Violence Research.

Given the overlap between intimate partner violence (IPV) and child maltreatment, IPV-exposed child participants in research might disclose instances of child maltreatment. Such disclosures might require researchers to report the maltreatment to child protective services (CPS). However, the literature provides minimal guidance on how to navigate the complex challenges and ethical dilemmas around reporting in the context of research. To help address this gap and stimulate discussion regarding protocols and policies for reporting child maltreatment, this article presents a CPS reporting protocol developed as part of a community-engaged research project evaluating a parenting intervention for system-involved mothers experiencing IPV.

Problem Internet Overuse Behaviors in College Students: Readiness-to-Change and Receptivity to Treatment.

This mixed methods study explores college students' readiness-to-change and receptivity to treatment for problem Internet overuse behaviors. Focus groups were conducted with 27 college students who self-identified as Internet over-users, and had experienced biopsychosocial problems related to Internet overuse. Participants completed standardized questionnaires assessing their Internet use and sociodemographic forms. Focus groups explored readiness to change problem Internet overuse behaviors and receptivity to treatment. Similar to college students with other addictive behaviors, students with problem Internet overuse fall along a continuum vis-à-vis readiness-to-change their behaviors. Over half of the participants were receptive to treatment for their problem Internet overuse behaviors.

Education, gender, and state-level disparities in the health of older Indians: Evidence from biomarker data.

Using new biomarker data from the 2010 pilot round of the Longitudinal Aging Study in India (LASI), we investigate education, gender, and state-level disparities in health. We find that hemoglobin level, a marker for anemia, is lower for respondents with no schooling (0.7g/dL less in the adjusted model) compared to those with some formal education and is also lower for females than for males (2.0g/dL less in the adjusted model). In addition, we find that about one third of respondents in our sample aged 45 or older have high C-reaction protein (CRP) levels (>3mg/L), an indicator of inflammation and a risk factor for cardiovascular disease. We find no evidence of educational or gender differences in CRP, but there are significant state-level disparities, with Kerala residents exhibiting the lowest CRP levels (a mean of 1.96mg/L compared to 3.28mg/L in Rajasthan, the state with the highest CRP). We use the Blinder-Oaxaca decomposition approach to explain group-level differences, and find that state-level disparities in CRP are mainly due to heterogeneity in the association of the observed characteristics of respondents with CRP, rather than differences in the distribution of endowments across the sampled state populations.

External quality control for dried blood spot-based C-reactive protein assay: experience from the indonesia family life survey and the longitudinal aging study in India.

Measurement of C-reactive protein (CRP), a marker of inflammation, in dried blood spots has been increasingly incorporated into community-based social surveys internationally. Although the dried blood spot-based CRP assay protocol has been validated in the United States, it remains unclear whether laboratories in other less-developed countries can generate CRP results of similar quality. We therefore conducted external quality monitoring for dried blood spot-based CRP measurement for the Indonesia Family Life Survey and the Longitudinal Aging Study in India. Our results show that dried blood spot-based CRP results in these two countries have excellent and consistent correlations with serum-based values and dried blood spot-based results from the reference laboratory in the United States. Even though the results from duplicate samples may have fluctuations in absolute values over time, the relative order of C-reactive protein levels remains similar, and the estimates are reasonably precise for population-based studies that investigate the association between socioeconomic factors and health.

Banking: shop and compare.

There are many reasons to take a critical look at the practice's banking relationship(s)--technology advancements, security measures, improvements in available services, recent banking enhancements designed specifically for medical practices, the impact of the financial crisis on bank ratings and stability, changing practice needs, opportunities for operational automation at the practice--and it is just simply smart to periodically evaluate and compare the features, pricing, and potential savings offered by vendors.

Valuing vaccination.

Vaccination has led to remarkable health gains over the last century. However, large coverage gaps remain, which will require significant financial resources and political will to address. In recent years, a compelling line of inquiry has established the economic benefits of health, at both the individual and aggregate levels. Most existing economic evaluations of particular health interventions fail to account for this new research, leading to potentially sizable undervaluation of those interventions. In line with this new research, we set forth a framework for conceptualizing the full benefits of vaccination, including avoided medical care costs, outcome-related productivity gains, behavior-related productivity gains, community health externalities, community economic externalities, and the value of risk reduction and pure health gains. We also review literature highlighting the magnitude of these sources of benefit for different vaccinations. Finally, we outline the steps that need to be taken to implement a broad-approach economic evaluation and discuss the implications of this work for research, policy, and resource allocation for vaccine development and delivery.

Valuing the broader benefits of dengue vaccination, with a preliminary application to Brazil.

The incidence of dengue has been on the rise since at least the 1960s, bringing greater urgency to the need for a vaccine to prevent the disease. Recent advances suggest that the scientific world is moving closer to an effective dengue vaccine. However, there are concerns that the price of a future vaccine could limit its uptake. High prices, in addition to other challenges, have already weighed negatively in government decisions to include other new vaccines in national immunization programs, e.g., the pneumococcal, rotavirus, and human papillomavirus vaccines. Recent research on the value of vaccination, however, suggests that vaccination confers benefits that are often neglected by traditional economic evaluations. In the case of dengue, commonly overlooked benefits are likely to include reduced spending on outbreak control, averted losses in tourism flows, and avoided productivity losses due to long-term dengue sequelae. Accounting for these and other broader benefits of dengue vaccination could reveal significantly greater economic value and strengthen the case for inclusion of dengue vaccination in national immunization programs. In this article we discuss a framework for the broader value of vaccination and review its application in the context of dengue vaccination for Brazil.

The social ecology of water in a Mumbai slum: failures in water quality, quantity, and reliability.

BACKGROUND: Urban slums in developing countries that are not recognized by the government often lack legal access to municipal water supplies. This results in the creation of insecure "informal" water distribution systems (i.e., community-run or private systems outside of the government's purview) that may increase water-borne disease risk. We evaluate an informal water distribution system in a slum in Mumbai, India using commonly accepted health and social equity indicators. We also identify predictors of bacterial contamination of drinking water using logistic regression analysis. METHODS: Data were collected through two studies: the 2008 Baseline Needs Assessment survey of 959 households and the 2011 Seasonal Water Assessment, in which 229 samples were collected for water quality testing over three seasons. Water samples were collected in each season from the following points along the distribution system: motors that directly tap the municipal supply (i.e., "point-of-source" water), hoses going to slum lanes, and storage and drinking water containers from 21 households. RESULTS: Depending on season, households spend an average of 52 to 206 times more than the standard municipal charge of Indian rupees 2.25 (US dollars 0.04) per 1000 liters for water, and, in some seasons, 95% use less than the WHO-recommended minimum of 50 liters per capita per day. During the monsoon season, 50% of point-of-source water samples were contaminated. Despite a lack of point-of-source water contamination in other seasons, stored drinking water was contaminated in all seasons, with rates as high as 43% for E. coli and 76% for coliform bacteria. In the multivariate logistic regression analysis, monsoon and summer seasons were associated with significantly increased odds of drinking water contamination. CONCLUSIONS: Our findings reveal severe deficiencies in water-related health and social equity indicators. All bacterial contamination of drinking water occurred due to post-source contamination during storage in the household, except during the monsoon season, when there was some point-of-source water contamination. This suggests that safe storage and household water treatment interventions may improve water quality in slums. Problems of exorbitant expense, inadequate quantity, and poor point-of-source quality can only be remedied by providing unrecognized slums with equitable access to municipal water supplies.

Assessment of inactivating stop codon mutations in forty Saccharomyces cerevisiae strains: implications for [PSI] prion- mediated phenotypes.

The yeast prion [PSI(+)] has been implicated in the generation of novel phenotypes by a mechanism involving a reduction in translation fidelity causing readthrough of naturally occurring stop codons. Some [PSI(+)] associated phenotypes may also be generated due to readthrough of inactivating stop codon mutations (ISCMs). Using next generation sequencing we have sequenced the genomes of two Saccharomyces cerevisiae strains that are commonly used for the study of the yeast [PSI(+)] prion. We have identified approximately 26,000 and 6,500 single nucleotide polymorphisms (SNPs) in strains 74-D694 and G600 respectively, compared to reference strain S288C. In addition to SNPs that produce non-synonymous amino acid changes we have also identified a number of SNPs that cause potential ISCMs in these strains, one of which we show is associated with a [PSI(+)]-dependent stress resistance phenotype in strain G600. We identified twenty-two potential ISCMs in strain 74-D694, present in genes involved in a variety of cellular processes including nitrogen metabolism, signal transduction and oxidative stress response. The presence of ISCMs in a subset of these genes provides possible explanations for previously identified [PSI(+)]-associated phenotypes in this strain. A comparison of ISCMs in strains G600 and 74-D694 with S. cerevisiae strains sequenced as part of the Saccharomyces Genome Resequencing Project (SGRP) shows much variation in the generation of strain-specific ISCMs and suggests this process is possible under complex genetic control. Additionally we have identified a major difference in the abilities of strains G600 and 74-D694 to grow at elevated temperatures. However, this difference appears unrelated to novel SNPs identified in strain 74-D694 present in proteins involved in the heat shock response, but may be attributed to other SNP differences in genes previously identified as playing a role in high temperature growth.

Rethinking the benefits and costs of childhood vaccination: the example of the Haemophilus influenzae type b vaccine.

Economic evaluations of health interventions, such as vaccinations, are important tools for informing health policy. Approaching the analysis from the appropriate perspective is critical to ensuring the validity of evaluation results for particular policy decisions. Using the example of cost-benefit analysis (CBA) of Haemophilus influenzae type b (Hib) vaccination, we demonstrate that past economic evaluations have mostly adopted narrow evaluation perspectives, focusing primarily on health gains, health-care cost savings, and reductions in the time costs of caring, while usually ignoring other important benefits including outcome-related productivity gains (improved economic productivity due to prevention of mental and physical disabilities), behavior-related productivity gains (economic growth due to fertility reductions as vaccination improves child survival), and community externalities (herd immunity and prevention of antibiotic resistance). We further show that potential cost reductions that could be attained through changes in the delivery of the Hib vaccine have also generally been ignored in economic evaluations. Future economic evaluations of childhood vaccinations should take full account of benefits and costs, so that policymakers have sufficient information to make well-informed decisions on vaccination implementation.

11th Annual Conference on Vaccine Research.

The 11th Annual Conference on Vaccine Research, hosted by the National Foundation for Infectious Disease, attracted approximately 450 leaders in the fields of epidemiology, health economics, immunology and vaccinology, making it the largest scientific meeting devoted exclusively to vaccine research and technology. The conference highlighted recent advancements in vaccine design, including the discovery of new adjuvants, cytokines and regulatory pathways. Other topics included a comprehensive overview of the development and uses of cutaneous vaccination and a discussion of recently licensed vaccines against the human papillomavirus, herpes zoster virus, meningococcal disease and rotavirus and a discussion on the importance of redesigning and increasing the coverage of the influenza vaccine. Keynote remarks were provided by the demographer and economist David E Bloom (Harvard School of Public Health, USA), who argued that traditional economic evaluations of vaccine interventions have failed to account for the full range of benefits that can accrue from vaccination. These benefits are substantial in size and potentially decisive with respect to the bottom-line results of benefit-cost calculations.

Clinical trials finance and operations.

The National Coverage Decision of 2000 was designed to enhance the participation in clinical trials for both patients and physicians by mandating the governmental coverage for services in a clinical trial that are considered "routine" regardless of the trial. Participation in clinical trials can be a practice builder as well as a contribution to the betterment of medical science. Without proper coverage analysis, study budgeting, accurate time estimates, and effective negotiation prior to signing the contract, participation in clinical trials can cost a practice rather than benefit it.

Netiquette: e-mail for group practices.

E-mail is a relatively new tool in business and communication, and it has unique nuances. Effective use of e-mail and its features can enhance performance, interaction, even morale. Misuse of e-mail can be a legal liability and damage relationships within your practice. This article provides a guide to optimizing the use of e-mail within your practice.