Using a Delphi Technique to Define a Feedback Culture in Graduate Medical Education.

BACKGROUND AND OBJECTIVES: Experts in medical education hypothesize that programs with a robust culture of feedback foster learning and growth for learners and educators, yet the literature shows no consensus for what defines a feedback culture in graduate medical education. METHODS: Using a two-round, modified Delphi technique in summer and fall of 2019, the authors asked a panel of experts to identify essential elements to a feedback culture. The research team compiled a list of experts and a list of 29 descriptors of a highly functioning feedback culture. Experts rated the items as an essential, compatible, or not important aspect of a highly functioning culture of feedback. Researchers set a minimum threshold of 80% agreement and used comments from panelists to revise elements that did not meet agreement during round one. Experts then rerated the elements using information on their initial ratings, aggregate panelist ratings, and comments from all panelists. RESULTS: The response rates from our panel of experts were 68% (17/25) for round one and 88% (15/17) for round two. Seventeen elements were rated as essential to a feedback culture. CONCLUSIONS: An expert panel endorsed essential elements that can be used to assess feedback culture in graduate medical education programs.

Fully Integrated Readiness for Service Training (FIRST): An Accelerated Medical Training Program for Rural and Underserved North Carolina.

PROBLEM: The U.S. primary care workforce remains inadequate to meet the health needs of the U.S. population. Effective programs are needed to provide workforce development for rural and other underserved areas. APPROACH: At the University of North Carolina (UNC) School of Medicine (SOM), between November 2014 and July 2015, the authors developed and implemented the Fully Integrated Readiness for Service Training (FIRST) Program, an accelerated curriculum focused on rural and underserved care that links 3 years of medical school with a conditional acceptance into UNC's 3-year family medicine residency, followed by 3 years of practice support post-graduation. Students are recruited to the FIRST Program during the fall of their first year of medical school. The FIRST Program promotes close faculty mentorship and familiarity with the health care system, includes a longitudinal quality improvement project with an assigned patient panel, includes early integration into the clinic, and fosters a close cohort of fellow students. OUTCOMES: As of March 2020, the FIRST Program had successfully recruited 5 classes of medical students, and 3 of those classes had matched into residency. In total, as of March 2020, 18 students had participated in the FIRST Program. NEXT STEPS: The FIRST Program will be expanded to additional clinical sites across North Carolina and to specialties beyond family medicine, including pediatrics, general surgery, and psychiatry.

Utilizing the F3App to Capture Learner Feedback About Faculty Teaching.

BACKGROUND AND OBJECTIVES: The Accreditation Council for Graduate Medical Education requires soliciting learner feedback on faculty teaching, although gathering meaningful feedback is challenging in the medical education environment. We developed the Faculty Feedback Facilitator (F3App), a mobile application that allows for real-time capture of narrative feedback by residents. The purpose of our study was to assess efficacy, usability, and acceptability of the F3App in family medicine residency programs. METHODS: Residents, faculty, and program directors (PDs) from eight residency programs participated in a beta test of the F3App from November 2017 to May 2018; participants completed pre- and postimplementation surveys about their evaluation process and the F3App. We interviewed PDs, and analyzed responses using a thematic analysis approach. RESULTS: Survey results showed significant postimplementation increases in faculty agreement that accessing evaluations is easy (42%), evaluations are an effective way to communicate feedback (34%), feedback is actionable and meaningful (24%), and the current system provides meaningful data for promotion (33%). Among residents, agreement that the current system allows meaningful information sharing and is easy to use increased significantly, by 17% each. The proportion of residents agreeing they were comfortable providing constructive criticism increased significantly (22%). PDs generally reported that residents were receptive to using the F3App, found it quick and easy to use, and that feedback provided was meaningful. CONCLUSIONS: Participating programs reviewed the F3App positively as a tool to gather narrative feedback from learners on faculty teaching.

Content Analysis of Family Medicine Resident Peer Observations.

BACKGROUND AND OBJECTIVES: Direct observation is a critical part of assessing learners' achievement of the Accreditation Council for Graduate Medical Education (ACGME) Milestones and subcompetencies. Little research exists identifying the content of peer feedback among residents; this study explored the content of residents' peer assessments as they relate to ACGME Milestone subcompetencies in a family medicine residency program. METHODS: Using content from a mobile app-based observation tool (M3App), we examined resident peer observations recorded between June 2014 and November 2017, tabulating frequency of observation for each ACGME subcompetency and calculating the proportion of observations categorized under each subcompetency, as well as for each postgraduate year (PGY) class. We also coded each observation on three separate dimensions: "positive," "constructive," and "actionable." We used the χ2 test for independence, and estimated odds ratios and 95% confidence intervals for two-by-two comparisons to compare numbers of observations within each category. RESULTS: Our data include 886 peer observations made by 54 individual residents. The most frequently observed competencies were in patient care, communication, and professionalism (56%, 47%, and 38% of observations, respectively). Practice-based learning and improvement was observed least frequently (16% of observations). On average, 97.25% of the observations were positive, 85% were actionable, and 6% were constructive. CONCLUSIONS: When asked to review their peers, residents provide comments that are primarily positive and actionable. In addition, residents tend to provide more feedback on certain subcompetencies compared to others, suggesting that programs may rely on peer feedback for specific subcompetencies. Peers can provide perspective on the behaviors and skills of fellow residents.

Impact of non-menthol flavours in e-cigarettes on perceptions and use: an updated systematic review.

OBJECTIVES: Given the exponential increase in the use of e-cigarettes among younger age groups and in the growth in research on e-cigarette flavours, we conducted a systematic review examining the impact of non-menthol flavoured e-cigarettes on e-cigarette perceptions and use among youth and adults. DESIGN: PubMed, Embase, PyscINFO and CINAHL were systematically searched for studies published and indexed through March 2018. ELIGIBILITY CRITERIA: Quantitative observational and experimental studies that assessed the effect of non-menthol flavours in e-cigarettes on perceptions and use behaviours were included. Specific outcome measures assessed are appeal, reasons for use, risk perceptions, susceptibility, intention to try, initiation, preference, current use, quit intentions and cessation. DATA EXTRACTION AND SYNTHESIS: Three authors independently extracted data related to the impact of flavours in tobacco products. Data from a previous review were then combined with those from the updated review for final analysis. Results were then grouped and analysed by outcome measure. RESULTS: The review included 51 articles for synthesis, including 17 published up to 2016 and an additional 34 published between 2016 and 2018. Results indicate that non-menthol flavours in e-cigarettes decrease harm perceptions (five studies) and increase willingness to try and initiation of e-cigarettes (six studies). Among adults, e-cigarette flavours increase product appeal (seven studies) and are a primary reason many adults use the product (five studies). The role of flavoured e-cigarettes on smoking cessation remains unclear (six studies). CONCLUSION: This review provides summary data on the role of non-menthol flavours in e-cigarette perceptions and use. Consistent evidence shows that flavours attract both youth and adults to use e-cigarettes. Given the clear findings that such flavours increase product appeal, willingness to try and initiation among youth, banning non-menthol flavours in e-cigarettes may reduce youth e-cigarette use. Longitudinal research is needed to examine any role flavours may play in quit behaviours among adults.

Residency Faculty Teaching Evaluation: What Do Faculty, Residents, and Program Directors Want?

BACKGROUND AND OBJECTIVES: The Accreditation Council for Graduate Medical Education Common Residency Program Requirements stipulate that each faculty member's performance be evaluated annually. Feedback is essential to this process, yet the culture of medicine poses challenges to developing effective feedback systems. The current study explores existing and ideal characteristics of faculty teaching evaluation systems from the perspectives of key stakeholders: faculty, residents, and residency program directors (PDs). METHODS: We utilized two qualitative approaches: (1) confidential semistructured telephone interviews with PDs from a convenience sample of eight family medicine residency programs, (2) qualitative responses from an anonymous online survey of faculty and residents in the same eight programs. We used inductive thematic analysis to analyze the interviews and survey responses. Data collection occurred in the fall of 2017. RESULTS: All eight (100%) of the PDs completed interviews. Survey response rates for faculty and residents were 79% (99/126) and 70% (152/216), respectively. Both PD and faculty responses identified a desire for actionable, real-time, frequent feedback used to foster continued professional development. Themes unique to faculty included easy accessibility and feedback from peers. Residents expressed an interest in in-person feedback and a process minimizing potential retribution. Residents indicated that feedback should be based on shared understanding of what skill(s) the faculty member is trying to address. CONCLUSIONS: PDs, faculty, and residents share a desire to provide faculty with meaningful, specific, and real-time feedback. Programs should strive to provide a culture in which feedback is an integral part of the learning process for both residents and faculty.

Youth source of acquisition for E-Cigarettes.

As rates of traditional cigarette smoking have decreased among youth over the past several years, rates of e-cigarette use have increased. Little evidence exists on how youth obtain e-cigarettes. We used data from middle and high school students under the age of 18 who reported using an e-cigarette in the past 30 days from the 2017 North Carolina Youth Tobacco Survey (n = 640). We used chi-square tests and multivariable logistic regressions to examine correlates of access and place of acquisition. Over half (51.5%) of youth report acquiring e-cigarettes from a friend. Youth in 12th grade had higher odds of acquiring e-cigarettes from a vape shop (aOR: 2.54, 95% CI: 1.25, 5.15) or retail outlet (aOR: 2.40, 95% CI: 1.18, 4.90) than youth in middle school. Compared to non-Hispanic white youth, Hispanic youth had lower odds of acquiring e-cigarettes from a vape shop (aOR: 0.42, 95% CI: 0.20, 0.87). Youth living with someone who uses e-cigarettes, compared to those who did not, had higher odds of acquiring e-cigarettes from a family member (aOR: 3.95, 95% CI: 1.94, 8.05). Finally, current smokers had higher odds of acquiring e-cigarettes from a retail outlet (aOR: 3.28, 95% CI: 1.88, 5.70) and lower odds of acquiring e-cigarettes from a friend (aOR: 0.53, 95% CI: 0.36, 0.77). Youth primarily reported obtaining e-cigarettes from a friend. Living with someone who uses e-cigarettes may be a risk factor for acquiring e-cigarettes from family members. Identifying sources of e-cigarette acquisition will help inform interventions preventing youth e-cigarette access.

Factors Influencing Trust in Agencies That Disseminate Tobacco Prevention Information.

Several health-related agencies administer national and targeted public education campaigns to provide health information and change health-related behaviors. The trust the public has in these agencies as the source of the message impacts the effectiveness of their communication campaigns. In this study, we explore the perceived trust of agencies that communicate health messages in the tobacco control field. As part of a larger tobacco regulatory science study, we conducted six 90-min focus groups comprising 41 participants. Five main themes emerged pertinent to the agency: (1) its integrity, (2) its competence, (3) its motives, (4) how it is portrayed in the media, and (5) skepticism and mistrust about it. Given the significant resources spent on health messaging to the public and potential benefits offered by this communication, an understanding of public trust in the agencies as the source of health messages is important. Findings suggest health information may be ignored or discounted when there is mistrust in the agency sending those messages.

Perceptions of the Food and Drug Administration as a Tobacco Regulator.

OBJECTIVES: The U. S. Food and Drug Administration (FDA) now has regulatory authority over all tobacco products. Little is known about public awareness and perceptions of FDA in their new role as a tobacco regulator. This research utilizes focus groups to examine perceptions of FDA as a tobacco regulator so that FDA can better communicate with the public about this role. METHODS: We conducted 6 focus groups in 2014 among a diverse sample of smokers and non-smokers. Participants were asked if they had heard of FDA, what they knew about FDA, if they associated FDA with tobacco, and their thoughts about this FDA role. RESULTS: A total of 41 individuals participated. Although nearly all participants had heard of FDA, most were not aware of FDA's regulatory authority over tobacco products, did not associate the role of FDA with tobacco, and some drew comparisons between FDA's work in tobacco and their work regulating food and drugs. CONCLUSION: Data suggest that although public awareness of FDA regulatory authority over tobacco is low, with proper public education, the public may find FDA to be a trustworthy source of tobacco regulation.

Perceptions and Experiences with Flavored Non-Menthol Tobacco Products: A Systematic Review of Qualitative Studies.

Although a few countries have banned flavored cigarettes (except menthol), flavors in most tobacco products remain unregulated across the globe. We conducted a systematic review of qualitative studies examining perceptions of and experiences with flavored non-menthol tobacco products. Of 20 studies on flavored tobacco products included in our qualitative systematic review, 10 examined hookah, six examined e-cigarettes, two examined little cigars and cigarillos (LCCs), and three examined other tobacco products, including cigarettes. The majority of studies, regardless of product type, reported positive perceptions of flavored tobacco products, particularly among young adults and adolescents. In six studies that assessed perceptions of harm (including hookah, LCCs, and other flavored tobacco products), participants believed flavored tobacco products to be less harmful than cigarettes. In studies that examined the role of flavors in experimentation and/or initiation (including three studies on e-cigarettes, one hookah study and one LCC study), participants mentioned flavors as specifically leading to their experimentation and/or initiation of flavored tobacco products. Given that many countries have not yet banned flavors in tobacco products, these findings add to existing research on why individuals use flavored tobacco products and how they perceive harm in flavored tobacco products, providing further support for banning non-menthol flavors in most tobacco products.

Impact of non-menthol flavours in tobacco products on perceptions and use among youth, young adults and adults: a systematic review.

OBJECTIVE: This systematic review examines the impact of non-menthol flavours in tobacco products on tobacco use perceptions and behaviours among youth, young adults and adults. DATA SOURCES: English-language peer-reviewed publications indexed in 4 databases were searched through April 2016. STUDY SELECTION: A search strategy was developed related to tobacco products and flavours. Of 1688 articles identified, we excluded articles that were not English-language, were not peer-reviewed, were qualitative, assessed menthol-flavoured tobacco products only and did not contain original data on outcomes that assessed the impact of flavours in tobacco products on perceptions and use behaviour. DATA EXTRACTION: Outcome measures were identified and tabulated. 2 researchers extracted the data independently and used a validated quality assessment tool to assess study quality. DATA SYNTHESIS: 40 studies met the inclusion criteria. Data showed that tobacco product packaging with flavour descriptors tended to be rated as more appealing and as less harmful by tobacco users and non-users. Many tobacco product users, especially adolescents, reported experimenting, initiating and continuing to use flavoured products because of the taste and variety of the flavours. Users of many flavoured tobacco products also showed decreased likelihood of intentions to quit compared with non-flavoured tobacco product users. CONCLUSIONS: Flavours in most tobacco products appear to play a key role in how users and non-users, especially youth, perceive, initiate, progress and continue using tobacco products. Banning non-menthol flavours from tobacco products may ultimately protect public health by reducing tobacco use, particularly among youth.

"May I Buy a Pack of Marlboros, Please?" A Systematic Review of Evidence to Improve the Validity and Impact of Youth Undercover Buy Inspections.

Most smokers become addicted to tobacco products before they are legally able to purchase these products. We systematically reviewed the literature on protocols to assess underage purchase and their ecological validity. We conducted a systematic search in May 2015 in PubMed and PsycINFO. We independently screened records for inclusion. We conducted a narrative review and examined implications of two types of legal authority for protocols that govern underage buy enforcement in the United States: criminal (state-level laws prohibiting sales to youth) and administrative (federal regulations prohibiting sales to youth). Ten studies experimentally assessed underage buy protocols and 44 studies assessed the association between youth characteristics and tobacco sales. Protocols that mimicked real-world youth behaviors were consistently associated with substantially greater likelihood of a sale to a youth. Many of the tested protocols appear to be designed for compliance with criminal law rather than administrative enforcement in ways that limited ecological validity. This may be due to concerns about entrapment. For administrative enforcement in particular, entrapment may be less of an issue than commonly thought. Commonly used underage buy protocols poorly represent the reality of youths' access to tobacco from retailers. Compliance check programs should allow youth to present themselves naturally and attempt to match the community's demographic makeup.

Single Cigarette Sales: State Differences in FDA Advertising and Labeling Violations, 2014, United States.

IMPORTANCE: Single cigarettes, which are sold without warning labels and often evade taxes, can serve as a gateway for youth smoking. The Family Smoking Prevention and Tobacco Control Act of 2009 gives the US Food and Drug Administration (FDA) authority to regulate the manufacture, distribution, and marketing of tobacco products, including prohibiting the sale of single cigarettes. To enforce these regulations, the FDA conducted over 335,661 inspections between 2010 and September 30, 2014, and allocated over $115 million toward state inspections contracts. OBJECTIVE: To examine differences in single cigarette violations across states and determine if likely correlates of single cigarette sales predict single cigarette violations at the state level. DESIGN: Cross-sectional study of publicly available FDA warning letters from January 1 to July 31, 2014. SETTING: All 50 states and the District of Columbia. PARTICIPANTS: Tobacco retailer inspections conducted by FDA (n = 33 543). EXPOSURES FOR OBSERVATIONAL STUDIES: State cigarette tax, youth smoking prevalence, poverty, and tobacco production. MAIN OUTCOMES AND MEASURES: State proportion of FDA warning letters issued for single cigarette violations. RESULTS: There are striking differences in the number of single cigarette violations found by state, with 38 states producing no warning letters for selling single cigarettes even as state policymakers developed legislation to address retailer sales of single cigarettes. The state proportion of warning letters issued for single cigarettes is not predicted by state cigarette tax, youth smoking, poverty, or tobacco production, P = .12. CONCLUSIONS AND RELEVANCE: Substantial, unexplained variation exists in violations of single cigarette sales among states. These data suggest the possibility of differences in implementation of FDA inspections and the need for stronger quality monitoring processes across states implementing FDA inspections.

Pilot Implementation of a Wellness and Tobacco Cessation Curriculum in North Carolina Group Homes.

Despite a steady decline in smoking rates in recent decades, individuals with mental illness continue to smoke at disproportionately higher rates than the general population. Adults with mental illness are motivated to quit and quit with rates similar to the general population when evidence-based cessation interventions are used. To build an evidence base for a wellness and cessation curriculum aimed at individuals with mental illness, the Breathe Easy Live Well (BELW) program was pilot tested in two group homes in North Carolina in the spring of 2014. Evaluators conducted pre- and post-implementation site visits and interviews with program instructors to assess outcomes as well as barriers and facilitators to implementation. Qualitative analysis of the data indicated that implementation was successful in both group homes, and the following themes emerged: (1) Training and technical assistance provided throughout implementation was sufficient; (2) Instructors used prior professional experiences and goal setting to facilitate program success and participant engagement; (3) Fostering positive coping strategies contributed to reports of reduced smoking; (4) Curriculum length may be a barrier to recruitment. Additional results included an increased interest among group home residents in more diligently managing mental illness symptoms and one group home moving the designated smoking area out of the direct path of the entrance/exit. Results of this pilot project suggest that BELW could be a potentially useful tool for group home staff to address health and wellness along with smoking cessation among individuals with mental illness.

Neighborhood Inequalities in Retailers' Compliance With the Family Smoking Prevention and Tobacco Control Act of 2009, January 2014-July 2014.

INTRODUCTION: Retailer noncompliance with limited US tobacco regulations on advertising and labeling was historically patterned by neighborhood in ways that promote health disparities. In 2010, the US Food and Drug Administration (FDA) began enforcing stronger tobacco retailer regulations under the Family Smoking Prevention and Tobacco Control Act of 2009. However, recent research has found no differences in compliance by neighborhood characteristics for FDA advertising and labeling inspections. We sought to investigate the neighborhood characteristics associated with retailer noncompliance with specific FDA advertising and labeling inspections (ie, violations of bans on self-service displays, selling single cigarettes, false or mislabeled products, vending machines, flavored cigarettes, and free samples). METHODS: We coded FDA advertising and labeling warning letters (n = 718) for type of violations and geocoded advertising and labeling inspections from January 1 through July 31, 2014 (N = 33,543). Using multilevel models, we examined cross-sectional associations between types of violations and neighborhood characteristics previously associated with disparities (ie, percentage black, Latino, under the poverty line, and younger than 18 years). RESULTS: Retailer advertising and labeling violations are patterned by who lives in the neighborhood; regulated tobacco products are more likely to be stored behind the counter as the percentage of black or Latino residents increases, and single cigarettes are more often available for purchase in neighborhoods as the percentage of black, poor, or young residents increases. CONCLUSION: Contrary to previous null findings, noncompliance with FDA advertising and labeling regulations is patterned by neighborhood characteristics, sometimes in opposite directions. Given the low likelihood of self-service violations in the same neighborhoods that have high likelihood of single cigarette sales, we suggest targeted approaches to FDA retailer inspections and education campaigns.

Electronic Cigarettes on Hospital Campuses.

Smoke and tobacco-free policies on hospital campuses have become more prevalent across the U.S. and Europe, de-normalizing smoking and reducing secondhand smoke exposure on hospital grounds. Concerns about the increasing use of electronic cigarettes (e-cigarettes) and the impact of such use on smoke and tobacco-free policies have arisen, but to date, no systematic data describes e-cigarette policies on hospital campuses. The study surveyed all hospitals in North Carolina (n = 121) to assess what proportion of hospitals have developed e-cigarette policies, how policies have been implemented and communicated, and what motivators and barriers have influenced the development of e-cigarette regulations. Seventy-five hospitals (62%) completed the survey. Over 80% of hospitals reported the existence of a policy regulating the use of e-cigarettes on campus and roughly half of the hospitals without a current e-cigarette policy are likely to develop one within the next year. Most e-cigarette policies have been incorporated into existing tobacco-free policies with few reported barriers, though effective communication of e-cigarette policies is lacking. The majority of hospitals strongly agree that e-cigarette use on campus should be prohibited for staff, patients, and visitors. Widespread incorporation of e-cigarette policies into existing hospital smoke and tobacco-free campus policies is feasible but needs communication to staff, patients, and visitors.

Pharmacist authority to provide HPV vaccine: novel partners in cervical cancer prevention.

OBJECTIVES: While the provision of cervical cancer prevention services in the United States has expanded to new settings beyond clinics that give Pap smears, prevention efforts are being hampered by relatively low human papillomavirus (HPV) vaccine coverage. Pharmacies are an underused setting to deliver HPV vaccine. To better understand this opportunity, we sought to classify pharmacists' authority to administer HPV vaccine in each US state. METHODS: For each US state and the District of Columbia (for simplicity, we refer to these 51 regions as states), we interviewed a member of the state's pharmacy association, member of the state board of pharmacy, or a faculty member at a school or college of pharmacy. RESULTS: Most states (80%) allowed pharmacists to provide HPV vaccine to adult women ages 19 and older, and 61% of states allowed provision to girls age 12. The mechanism for pharmacists to immunize was highly variable across states. For example, a 12 year-old girl seeking HPV vaccine could receive it from a pharmacist in 31% of states under a protocol between a specific physician and pharmacist, in 24% with an HPV vaccine prescription, and in 6% without prior physician approval. Pharmacists' authority was broadest on the west coast and limited on the east coast. Pharmacist authority to provide HPV, Tdap, and meningitis vaccines was very similar, but it was highly dependent on patient age. CONCLUSIONS: US states' laws governing pharmacists' ability to offer HPV vaccine varied widely. One consequence is that newly expanded cervical prevention efforts underuse pharmacists.