How is your feedback perceived? An experimental study of anticipated and delayed conversational feedback.

This article presents a different experiment examining the impact of feedback timing on its perception. Dialog sequences, featuring a main speaker's utterance followed by a listener's feedback, were extracted from spontaneous conversations. The original feedback instances were manipulated to be produced earlier, up to 1.5 s in advance, or to be delayed, up to 2 s later. Participants evaluated the feedback acceptability and engagement level of the listener. The findings reveal that 76% of the time feedback remains acceptable regardless of the delay. However, engagement decreases after a 1-s delay while no consistent effect is observed for feedback anticipation.

Feedback and Financial Incentives for Reducing Cell Phone Use While Driving: A Randomized Clinical Trial.

Importance: Handheld phone use while driving is a major factor in vehicle crashes. Scalable interventions are needed to encourage drivers not to use their phones. Objective: To test whether interventions involving social comparison feedback and/or financial incentives can reduce drivers' handheld phone use. Design, Setting, and Participants: In a randomized clinical trial, interventions were administered nationwide in the US via a mobile application in the context of a usage-based insurance program (Snapshot Mobile application). Customers were eligible to be invited to participate in the study if enrolled in the usage-based insurance program for 30 to 70 days. The study was conducted from May 13 to June 30, 2019. Analysis was completed December 22, 2023. Interventions: Participants were randomly assigned to 1 of 6 trial arms for a 7-week intervention period: (1) control; (2) feedback, with weekly push notification about their handheld phone use compared with that of similar others; (3) standard incentive, with a maximum $50 award at the end of the intervention based on how their handheld phone use compared with similar others; (4) standard incentive plus feedback, combining interventions of arms 2 and 3; (5) reframed incentive plus feedback, with a maximum $7.15 award each week, framed as participant's to lose; and (6) doubled reframed incentive plus feedback, a maximum $14.29 weekly loss-framed award. Main Outcome and Measure: Proportion of drive time engaged in handheld phone use in seconds per hour (s/h) of driving. Analyses were conducted with the intention-to-treat approach. Results: Of 17 663 customers invited by email to participate, 2109 opted in and were randomized. A total of 2020 drivers finished the intervention period (68.0% female; median age, 30 [IQR, 25-39] years). Median baseline handheld phone use was 216 (IQR, 72-480) s/h. Relative to control, feedback and standard incentive participants did not reduce their handheld phone use. Standard incentive plus feedback participants reduced their use by -38 (95% CI, -69 to -8) s/h (P = .045); reframed incentive plus feedback participants reduced their use by -56 (95% CI, -87 to -26) s/h (P < .001); and doubled reframed incentive plus feedback participants reduced their use by -42 s/h (95% CI, -72 to -13 s/h; P = .007). The 5 active treatment arms did not differ significantly from each other. Conclusions and Relevance: In this randomized clinical trial, providing social comparison feedback plus incentives reduced handheld phone use while individuals were driving. Trial Registration: ClinicalTrials.gov Identifier: NCT03833219.

Comparative study on the impact of 'Infographic versus video feedback' on enhancing students' clinical skills in basic life support.

BACKGROUND: Effective cardiopulmonary resuscitation (CPR) training for nursing students is crucial for improving patient outcomes in cardiac arrest scenarios. This study assesses the impact of infographic versus video feedback on enhancing nursing students' clinical skills in Basic Life Support (BLS). METHODS: In a randomized controlled setting, 76 nursing students at Torbat Heydariyeh University of Medical Sciences were divided into two groups: one received infographic-based education and the other video feedback training. Pre- and post-intervention assessments measured knowledge and skill retention using validated questionnaires. RESULTS: Post-training, the infographic group showed significantly higher knowledge scores, while the video feedback group exhibited greater improvement in CPR skill performance. No significant differences were noted in pre-training assessment scores between the groups. CONCLUSION: Infographic-based education enhances BLS knowledge retention, and video feedback improves practical CPR skills. This suggests potential benefits of a combined infographic and video feedback approach for optimizing CPR training outcomes, addressing a critical need in medical education.

Enhancing Laryngoscopy Mastery: The Impact of Autonomous Practice with Feedback-Providing Simulators.

Mastery learning with fixed end points and variable training time leads to more consistent expertise but is difficult to implement. Here we piloted mastery learning of laryngoscopy with independent practice. 35 learners participated in independent mastery learning on a manikin that provides automated performance feedback. A pre- and postpractice assessment of intubation skills was completed. After an average of 21 minutes of open practice, the percentage of subjects that met mastery criteria improved from 24% to 89% (P < .05). Independent intubation practice with manikin feedback facilitated mastery learning, enhanced procedural education, and may impact clinical care.

How to Design Effective Audit and Feedback Interventions With Nurses: A Set of Hypotheses Based on Qualitative and Quantitative Evidence.

OBJECTIVE: To propose practical hypotheses on audit and feedback that support the effectiveness with nurses. BACKGROUND: Audit and feedback interventions have been mainly studied with physicians; however, the processes have been practiced by nurses for years. Nurses' response may differ from that of physicians and other healthcare disciplines because of their roles, power, and the configuration of nursing activities. METHODS: A comparative analysis of the Clinical Performance Feedback Intervention Theory was conducted using nursing-specific empirical data from: 1) a mixed-methods systematic review and 2) a pilot study of audit and feedback with a team of primary care nurses. RESULTS: Researchers hypothesize that audit and feedback interventions are more effective when: 1) feedback emphasizes how it relates to the relational aspect of nursing; 2) indicators are measured and reported at team level; and 3) feedback is provided in a way that highlights benefits to nurses' practice, such as the potential to reduce workload. CONCLUSION: These proposed hypotheses provide concrete guidance to researchers and managers for an effective use of audit and feedback as a quality improvement strategy with nurses.

The efficacy of automated feedback after internet-based depression screening (DISCOVER): an observer-masked, three-armed, randomised controlled trial in Germany.

BACKGROUND: Despite the availability of effective treatments, most depressive disorders remain undetected and untreated. Internet-based depression screening combined with automated feedback of screening results could reach people with depression and lead to evidence-based care. We aimed to test the efficacy of two versions of automated feedback after internet-based screening on depression severity compared with no feedback. METHODS: DISCOVER was an observer-masked, three-armed, randomised controlled trial in Germany. We recruited individuals (aged ≥18 years) who were undiagnosed with depression and screened positive for depression on an internet-based self-report depression rating scale (Patient Health Questionnaire-9 [PHQ-9] ≥10 points). Participants were randomly assigned 1:1:1 to automatically receive no feedback, non-tailored feedback, or tailored feedback on the depression screening result. Randomisation was stratified by depression severity (moderate: PHQ-9 score 10-14 points; severe: PHQ-9 score ≥15 points). Participants could not be masked but were kept unaware of trial hypotheses to minimise expectancy bias. The non-tailored feedback included the depression screening result, a recommendation to seek professional diagnostic advice, and brief general information about depression and its treatment. The tailored feedback included the same basic information but individually framed according to the participants' symptom profiles, treatment preferences, causal symptom attributions, health insurance, and local residence. Research staff were masked to group allocation and outcome assessment as these were done using online questionnaires. The primary outcome was change in depression severity, defined as change in PHQ-9 score 6 months after random assignment. Analyses were conducted following the intention-to-treat principle for participants with at least one follow-up visit. This trial was registered at ClinicalTrials.gov, NCT04633096. FINDINGS: Between Jan 12, 2021, and Jan 31, 2022, 4878 individuals completed the internet-based screening. Of these, 1178 (24%) screened positive for depression (mean age 37·1 [SD 14·2] years; 824 [70%] woman, 344 [29%] men, and 10 [1%] other gender identity). 6 months after random assignment, depression severity decreased by 3·4 PHQ-9 points in the no feedback group (95% CI 2·9-4·0; within-group d 0·67; 325 participants), by 3·5 points in the non-tailored feedback group (3·0-4·0; within-group d 0·74; 319 participants), and by 3·7 points in the tailored feedback group (3·2-4·3; within-group d 0·71; 321 participants), with no significant differences among the three groups (p=0·72). The number of participants seeking help for depression or initiating psychotherapy or antidepressant treatment did not differ among study groups. The results remained consistent when adjusted for fulfilling the DSM-5-based criteria for major depressive disorder or subjective belief of having a depressive disorder. Negative effects were reported by less than 1% of the total sample 6 months after random assignment. INTERPRETATION: Automated feedback following internet-based depression screening did not reduce depression severity or prompt sufficient depression care in individuals previously undiagnosed with but affected by depression. FUNDING: German Research Foundation.

Impact of a prospective feedback loop aimed at reducing non-beneficial treatments in older people admitted to hospital and potentially nearing the end of life. A cluster stepped-wedge randomised controlled trial.

OBJECTIVES: To investigate if a prospective feedback loop that flags older patients at risk of death can reduce non-beneficial treatment at end of life. DESIGN: Prospective stepped-wedge cluster randomised trial with usual care and intervention phases. SETTING: Three large tertiary public hospitals in south-east Queensland, Australia. PARTICIPANTS: 14 clinical teams were recruited across the three hospitals. Teams were recruited based on a consistent history of admitting patients aged 75+ years, and needed a nominated lead specialist consultant. Under the care of these teams, there were 4,268 patients (median age 84 years) who were potentially near the end of life and flagged at risk of non-beneficial treatment. INTERVENTION: The intervention notified clinicians of patients under their care determined as at-risk of non-beneficial treatment. There were two notification flags: a real-time notification and an email sent to clinicians about the at-risk patients at the end of each screening day. The nudge intervention ran for 16-35 weeks across the three hospitals. MAIN OUTCOME MEASURES: The primary outcome was the proportion of patients with one or more intensive care unit (ICU) admissions. The secondary outcomes examined times from patients being flagged at-risk. RESULTS: There was no improvement in the primary outcome of reduced ICU admissions (mean probability difference [intervention minus usual care] = -0.01, 95% confidence interval -0.08 to 0.01). There were no differences for the times to death, discharge, or medical emergency call. There was a reduction in the probability of re-admission to hospital during the intervention phase (mean probability difference -0.08, 95% confidence interval -0.13 to -0.03). CONCLUSIONS: This nudge intervention was not sufficient to reduce the trial's non-beneficial treatment outcomes in older hospital patients. TRIAL REGISTRATION: Australia New Zealand Clinical Trial Registry, ACTRN12619000675123 (registered 6 May 2019).

Longitudinal evaluation of an electronic audit and feedback system for patient safety in a large tertiary hospital setting.

Objective: This study sought to assess the impact of a novel electronic audit and feedback (e-A&F) system on patient outcomes. Methods: The e-A&F intervention was implemented in a tertiary hospital and involved near real-time feedback via web-based dashboards. We used a segmented regression analysis of interrupted time series. We modelled the pre-post change in outcomes for the (1) announcement of this priority list, and (2) implementation of the e-A&F intervention to have affected patient outcomes. Results: Across the study period there were 222,792 episodes of inpatient care, of which 13,904 episodes were found to contain one or more HACs, a risk of 6.24%. From the point of the first intervention until the end of the study the overall risk of a HAC reduced from 8.57% to 4.12% - a 51.93% reduction. Of this reduction the proportion attributed to each of these interventions was found to be 29.99% for the announcement of the priority list and 21.93% for the implementation of the e-A&F intervention. Discussion: Our findings lend evidence to a mechanism that the announcement of a measurement framework, at a national level, can lead to local strategies, such as e-A&F, that lead to significant continued improvements over time.

Audit and feedback to change diagnostic image ordering practices: A systematic review and meta-analysis.

BACKGROUND: Up to 30% of diagnostic imaging (DI) tests may be unnecessary, leading to increased healthcare costs and the possibility of patient harm. The primary objective of this systematic review was to assess the effect of audit and feedback (AF) interventions directed at healthcare providers on reducing image ordering. The secondary objective was to examine the effect of AF on the appropriateness of DI ordering. METHODS: Studies were identified using MEDLINE, EMBASE, CINAHL, Cochrane Central Register of Controlled Trials and ClinicalTrials.gov registry on December 22nd, 2022. Studies were included if they were randomized control trials (RCTs), targeted healthcare professionals, and studied AF as the sole intervention or as the core component of a multi-faceted intervention. Risk of bias for each study was evaluated using the Cochrane risk of bias tool. Meta-analyses were completed using RevMan software and results were displayed in forest plots. RESULTS: Eleven RCTs enrolling 4311 clinicians or practices were included. AF interventions resulted in 1.5 fewer image test orders per 1000 patients seen than control interventions (95% confidence interval (CI) for the difference -2.6 to -0.4, p-value = 0.009). The effect of AF on appropriateness was not statistically significant, with a 3.2% (95% CI -1.5 to 7.7%, p-value = 0.18) greater likelihood of test orders being considered appropriate with AF vs control interventions. The strength of evidence was rated as moderate for the primary objective but was very low for the appropriateness outcome because of risk of bias, inconsistency in findings, indirectness, and imprecision. CONCLUSION: AF interventions are associated with a modest reduction in total DI ordering with moderate certainty, suggesting some benefit of AF. Individual studies document effects of AF on image order appropriateness ranging from a non-significant trend toward worsening to a highly significant improvement, but the weighted average effect size from the meta-analysis is not statistically significant with very low certainty.

Feedback in an Entrustment-Based Objective Structured Clinical Examination: Analysis of Content and Scoring Methods.

Background The integration of entrustable professional activities (EPAs) within objective structured clinical examinations (OSCEs) has yielded a valuable avenue for delivering timely feedback to residents. However, concerns about feedback quality persist. Objective This study aimed to assess the quality and content alignment of verbal feedback provided by examiners during an entrustment-based OSCE. Methods We conducted a progress test OSCE for internal medicine residents in 2022, assessing 7 EPAs. The immediate 2-minute feedback provided by examiners was recorded and analyzed using the Quality of Assessment of Learning (QuAL) score. We also analyzed the degree of alignment with EPA learning objectives: competency milestones and task-specific abilities. In a randomized crossover experiment, we compared the impact of 2 scoring methods used to assess residents' clinical performance (3-point entrustability scales vs task-specific checklists) on feedback quality and alignment. Results Twenty-one examiners provided feedback to 67 residents. The feedback demonstrated high quality (mean QuAL score 4.3 of 5) and significant alignment with the learning objectives of the EPAs. On average, examiners addressed in their feedback 2.5 milestones (61%) and 1.2 task-specific abilities (46%). The scoring methods used had no significant impact on QuAL scores (95% CI -0.3, 0.1, P=.28), alignment with competency milestones (95% CI -0.4, 0.1, P=.13), or alignment with task-specific abilities (95% CI -0.3, 0.1, P=.29). Conclusions In our entrustment-based OSCE, examiners consistently offered valuable feedback aligned with intended learning outcomes. Notably, we explored high-quality feedback and alignment as separate dimensions, finding no significant impact from our 2 scoring methods on either aspect.

Tunable linear feedback control of urban drainage systems using models defined purely from data.

Real-time and model-predictive control promises to make urban drainage systems (UDS) adaptive, coordinated, and dynamically optimal. Though early implementations are promising, existing control algorithms have drawbacks in computational expense, trust, system-level coordination, and labor cost. Linear feedback control has distinct advantages in computational expense, interpretation, and coordination. However, current methods for building linear feedback controllers require calibrated software models. Here we present an automated method for generating tunable linear feedback controllers that require only system response data. The controller design consists of three main steps: (1) estimating the network connectivity using tools for causal inference, (2) identifying a linear, time-invariant (LTI) dynamical system which approximates the network, and (3) designing and tuning a feedback controller based on the LTI urban drainage system approximation. The flooding safety, erosion prevention, and water treatment performance of the method are evaluated across 190 design storms on a separated sewer model. Strong results suggest that the system knowledge required for generating effective, safe, and tunable controllers for UDS is surprisingly basic. This method allows near-turnkey synthesis of controllers solely from sensor data or reduction of process-based models.

The UK VIRTUS helmet: User feedback from Operation TORAL in Afghanistan.

In 2015, the VIRTUS helmet was introduced to UK Armed Forces and will ultimately replace the Mark 7 combat helmet. The VIRTUS helmet has a reduced trimline compared to the Mark 7 helmet and can incorporate attachments such as a visor, mandible guard and nape protection. An anonymous questionnaire was provided to 200 UK Armed Forces personnel deployed to four locations on Operation TORAL in Afghanistan between September and October 2019. This is the first User feedback survey assessing the VIRTUS helmet in an operational environment. Users were measured to ascertain the fit of their helmet and asked to rate perceived helmet mass and comfort using a 5-point Likert scale. Users were also asked whether the VIRTUS helmet was better than previous helmets and about their use of the nape protection. The VIRTUS helmet was perceived to be an improvement over previously issued UK combat helmets in terms of both comfort and mass.

Perspectives of researchers, science policy makers and research ethics committee members on the feedback of individual genetic research findings in African genomics research.

BACKGROUND: Genetic research can yield information that is unrelated to the study's objectives but may be of clinical or personal interest to study participants. There is an emerging but controversial responsibility to return some genetic research results, however there is little evidence available about the views of genomic researchers and others on the African continent. METHODS: We conducted a continental survey to solicit perspectives of researchers, science policy makers and research ethics committee members on the feedback of individual genetic research findings in African genomics research. RESULTS: A total of 110 persons participated in the survey with 51 complete and 59 incomplete surveys received. Data was summarised using descriptive analysis. Overall, our respondents believed that individual genetic research results that are clinically actionable should be returned to study participants apparently because participants have a right to know things about their health, and it might also be a means for research participation to be recognized. Nonetheless, there is a need for development of precise guidance on how to return individual genetic research findings in African genomics research. DISCUSSION: Participants should receive information that could promote a healthier lifestyle; only clinically actionable findings should be returned, and participants should receive all important information that is directly relevant to their health. Nevertheless, detailed guidelines should inform what ought to be returned. H3Africa guidelines stipulate that it is generally considered good practice for researchers to feedback general study results, but there is no consensus about whether individual genomic study results should also be fed back. The decision on what individual results to feedback, if any, is very challenging and the specific context is important to make an appropriate determination.

Characterizing the aggregated encoding method utilizing bursts activated by a VCSEL-neuron with a feedback structure.

The rapid advancement of photonic technologies has facilitated the development of photonic neurons that emulate neuronal functionalities akin to those observed in the human brain. Neuronal bursts frequently occur in behaviors where information is encoded and transmitted. Here, we present the demonstration of the bursting response activated by an artificial photonic neuron. This neuron utilizes a single vertical-cavity surface-emitting laser (VCSEL) and encodes multiple stimuli effectively by varying the spike count during a burst based on the polarization competition in the VCSEL. By virtue of the modulated optical injection in the VCSEL employed to trigger the spiking response, we activate bursts output in the VCSEL with a feedback structure in this scheme. The bursting response activated by the VCSEL-neuron exhibits neural signal characteristics, promising an excitation threshold and the refractory period. Significantly, this marks the inaugural implementation of a controllable integrated encoding scheme predicated on bursts within photonic neurons. There are two remarkable merits; on the one hand, the interspike interval of bursts is distinctly diminished, amounting to merely one twenty-fourth compared to that observed in optoelectronic oscillators. Moreover, the interspike period of bursts is about 70.8% shorter than the period of spikes activated by a VCSEL neuron without optical feedback. Our results may shed light on the analogy between optical and biological neurons and open the door to fast burst encoding-based optical systems with a speed several orders of magnitude faster than their biological counterparts.

Evolutionary Game Dynamics with Environmental Feedback in a Network with Two Communities.

Recent developments of eco-evolutionary models have shown that evolving feedbacks between behavioral strategies and the environment of game interactions, leading to changes in the underlying payoff matrix, can impact the underlying population dynamics in various manners. We propose and analyze an eco-evolutionary game dynamics model on a network with two communities such that players interact with other players in the same community and those in the opposite community at different rates. In our model, we consider two-person matrix games with pairwise interactions occurring on individual edges and assume that the environmental state depends on edges rather than on nodes or being globally shared in the population. We analytically determine the equilibria and their stability under a symmetric population structure assumption, and we also numerically study the replicator dynamics of the general model. The model shows rich dynamical behavior, such as multiple transcritical bifurcations, multistability, and anti-synchronous oscillations. Our work offers insights into understanding how the presence of community structure impacts the eco-evolutionary dynamics within and between niches.

Exploring Anesthesia Provider Preferences for Precision Feedback: Preference Elicitation Study.

Background: Health care professionals must learn continuously as a core part of their work. As the rate of knowledge production in biomedicine increases, better support for health care professionals' continuous learning is needed. In health systems, feedback is pervasive and is widely considered to be essential for learning that drives improvement. Clinical quality dashboards are one widely deployed approach to delivering feedback, but engagement with these systems is commonly low, reflecting a limited understanding of how to improve the effectiveness of feedback about health care. When coaches and facilitators deliver feedback for improving performance, they aim to be responsive to the recipient's motivations, information needs, and preferences. However, such functionality is largely missing from dashboards and feedback reports. Precision feedback is the delivery of high-value, motivating performance information that is prioritized based on its motivational potential for a specific recipient, including their needs and preferences. Anesthesia care offers a clinical domain with high-quality performance data and an abundance of evidence-based quality metrics. Objective: The objective of this study is to explore anesthesia provider preferences for precision feedback. Methods: We developed a test set of precision feedback messages with balanced characteristics across 4 performance scenarios. We created an experimental design to expose participants to contrasting message versions. We recruited anesthesia providers and elicited their preferences through analysis of the content of preferred messages. Participants additionally rated their perceived benefit of preferred messages to clinical practice on a 5-point Likert scale. Results: We elicited preferences and feedback message benefit ratings from 35 participants. Preferences were diverse across participants but largely consistent within participants. Participants' preferences were consistent for message temporality (α=.85) and display format (α=.80). Ratings of participants' perceived benefit to clinical practice of preferred messages were high (mean rating 4.27, SD 0.77). Conclusions: Health care professionals exhibited diverse yet internally consistent preferences for precision feedback across a set of performance scenarios, while also giving messages high ratings of perceived benefit. A "one-size-fits-most approach" to performance feedback delivery would not appear to satisfy these preferences. Precision feedback systems may hold potential to improve support for health care professionals' continuous learning by accommodating feedback preferences.

Supporting the Nurse Preceptor Role: Implementing the R2C2 Feedback Model.

Nurse preceptors are key to the successful transition of graduate nurses to practice and experienced nurses to a new organization. Providing ongoing preceptor development is essential to support nurses in this vital role. The evidence-based R2C2 (relationship, reaction, content, coach) feedback and coaching model was implemented to facilitate the delivery of constructive feedback from nurse preceptors to their orientees. Post-intervention survey results suggest an overall positive response to the use of the feedback model in practice.

Near real-time patient experience feedback with data relay to providers: a systematic review of its effectiveness.

Near Real-Time Feedback (NRTF) on the patient's experience with care, coupled with data relay to providers, can inform quality-of-care improvements, including at the point of care. The objective is to systematically review contemporary literature on the impact of the use of NRTF and data relay to providers on standardized patient experience measures. Six scientific databases and five specialty journals were searched supplemented by snowballing search strategies, according to the registered study protocol. Eligibility included studies in English (2015-2023) assessing the impact of NRTF and data relay on standardized patient-reported experience measures as a primary outcome. Eligibility and quality appraisals were performed by two independent reviewers. An expert former patient (Patient and Family Advisory Council and communication sciences background) helped interpret the results. Eight papers met review eligibility criteria, including three randomized controlled trials (RCTs) and one non-randomized study. Three of these studies involved in-person NRTF prior to data relay (patient-level data for immediate corrective action or aggregated and peer-compared) and led to significantly better results in all or some of the experience measures. In turn, a kiosk-based NRTF achieved no better experience results. The remaining studies were pre-post designs with mixed or neutral results and greater risks of bias. In-person NRTF on the patient experience followed by rapid data relay to their providers, either patient-level or provider-level as peer-compared, can improve the patient experience of care. Reviewed kiosk-based or self-reported approaches combined with data relay were not effective. Further research should determine which approach (e.g. who conducts the in-person NRTF) will provide better, more efficient improvements and under which circumstances.