Impact of performance and information feedback on medical interns' confidence-accuracy calibration.

Diagnostic errors are a major, largely preventable, patient safety concern. Error interventions cannot feasibly be implemented for every patient that is seen. To identify cases at high risk of error, clinicians should have a good calibration between their perceived and actual accuracy. This experiment studied the impact of feedback on medical interns' calibration and diagnostic process. In a two-phase experiment, 125 medical interns from Dutch University Medical Centers were randomized to receive no feedback (control), feedback on their accuracy (performance feedback), or feedback with additional information on why a certain diagnosis was correct (information feedback) on 20 chest X-rays they diagnosed in a feedback phase. A test phase immediately followed this phase and had all interns diagnose an additional 10 X-rays without feedback. Outcome measures were confidence-accuracy calibration, diagnostic accuracy, confidence, and time to diagnose. Both feedback types improved overall confidence-accuracy calibration (R2No Feedback = 0.05, R2Performance Feedback = 0.12, R2Information Feedback = 0.19), in line with the individual improvements in diagnostic accuracy and confidence. We also report secondary analyses to examine how case difficulty affected calibration. Time to diagnose did not differ between conditions. Feedback improved interns' calibration. However, it is unclear whether this improvement reflects better confidence estimates or an improvement in accuracy. Future research should examine more experienced participants and non-visual specialties. Our results suggest that feedback is an effective intervention that could be beneficial as a tool to improve calibration, especially in cases that are not too difficult for learners.

Does formative assessment help students to acquire prescribing skills?

PURPOSE: Formative assessments can help motivate students and ease students' learning through feedback. There is a pressing need for improvement of clinical pharmacotherapy (CPT) education since junior doctors make many prescribing errors. The aim of this study was to determine whether a formative assessment with personalized narrative feedback helps medical students to increase their prescribing skills. METHODS: This retrospective cohort study was conducted among masters' medical students at Erasmus Medical Centre, The Netherlands. Students made a formative and a summative skill-based prescription assessment, both during clerkships as part of their regular curriculum. Errors in both assessments were categorized by type and possible consequence and compared with each other. RESULTS: A total of 388 students made 1964 errors in the formative assessment and 1016 in the summative assessment. Most improvements after the formative assessment were seen for mentioning the weight of a child on the prescription (n = 242, 19%). Most new and repeated errors in the summative assessment were missing usage instructions (n = 82, 16% and n = 121, 41%). CONCLUSIONS: This formative assessment with personalized and individual narrative feedback has helped students to increase the technical correctness of their prescriptions. However, errors repeated after the feedback were predominantly errors showing that only one formative assessment has not yet enhanced the clinical prescribing enough.

Selection tools and student diversity in health professions education: a multi-site study.

Student diversity in health professions education (HPE) can be affected by selection procedures. Little is known about how different selection tools impact student diversity across programs using different combinations of traditional and broadened selection criteria. The present multi-site study examined the chances in selection of subgroups of applicants to HPE undergraduate programs with distinctive selection procedures, and their performance on corresponding selection tools. Probability of selection of subgroups (based on gender, migration background, prior education, parental education) of applicants (N = 1935) to five selection procedures of corresponding Dutch HPE undergraduate programs was estimated using multilevel logistic regression. Multilevel linear regression was used to analyze performance on four tools: prior-education grade point average (pe-GPA), biomedical knowledge test, curriculum-sampling test, and curriculum vitae (CV). First-generation Western immigrants and applicants with a foreign education background were significantly less likely to be selected than applicants without a migration background and with pre-university education. These effects did not vary across programs. More variability in effects was found between different selection tools. Compared to women, men performed significantly poorer on CVs, while they had higher scores on biomedical knowledge tests. Applicants with a non-Western migration background scored lower on curriculum-sampling tests. First-generation Western immigrants had lower CV-scores. First-generation university applicants had significantly lower pe-GPAs. There was a variety in effects for applicants with different alternative forms of prior education. For curriculum-sampling tests and CVs, effects varied across programs. Our findings highlight the need for continuous evaluation, identifying best practices within existing tools, and applying alternative tools.

The added value of free preparatory activities for widening access to medical education: a multi-cohort study.

BACKGROUND: Medical schools are reported to be less accessible to students with non-traditional backgrounds. These students face barriers when applying for and transitioning to medical school, which may be reduced by offering free preparatory activities. By equalizing access to resources, these activities are expected to reduce disparities in selection outcomes and early academic performance. In the present study, four free institutionally-provided preparatory activities were evaluated by comparing the demographic composition of participating and non-participating applicants. Additionally, the association between participation and selection outcomes and early academic performance was investigated for subgroups (based on sex, migration background and parental education). METHODS: Participants were applicants to a Dutch medical school in 2016-2019 (N = 3592). Free preparatory activities included Summer School (N = 595), Coaching Day (N = 1794), Pre-Academic Program (N = 217), and Junior Med School (N = 81), supplemented with data on participation in commercial coaching (N = 65). Demographic compositions of participants and non-participants were compared using chi-squared tests. Regression analyses were performed to compare selection outcomes (curriculum vitae [CV], selection test score, probability of enrolment) and early academic performance (first-course grade) between participants and non-participants of demographic subgroups, controlling for pre-university grades and participation in other activities. RESULTS: Generally, no differences in sociodemographic compositions of participants and non-participants were found, but males participated less often in Summer School and Coaching Day. Applicants with a non-Western background participated less often in commercial coaching, but the overall participation rate was low and participation had negligible effects on selection outcomes. Participation in Summer School and Coaching Day were stronger related with selection outcomes. In some cases, this association was even stronger for males and candidates with a migration background. After controlling for pre-university grades, none of the preparatory activities were positively associated with early academic performance. CONCLUSIONS: Free institutionally-provided preparatory activities may contribute to student diversity in medical education, because usage was similar across sociodemographic subgroups, and participation was positively associated with selection outcomes of underrepresented and non-traditional students. However, since participation was not associated with early academic performance, adjustments to activities and/or curricula are needed to ensure inclusion and retention after selection.

The relationship between time to diagnose and diagnostic accuracy among internal medicine residents: a randomized experiment.

BACKGROUND: Diagnostic errors have been attributed to cognitive biases (reasoning shortcuts), which are thought to result from fast reasoning. Suggested solutions include slowing down the reasoning process. However, slower reasoning is not necessarily more accurate than faster reasoning. In this study, we studied the relationship between time to diagnose and diagnostic accuracy. METHODS: We conducted a multi-center within-subjects experiment where we prospectively induced availability bias (using Mamede et al.'s methodology) in 117 internal medicine residents. Subsequently, residents diagnosed cases that resembled those bias cases but had another correct diagnosis. We determined whether residents were correct, incorrect due to bias (i.e. they provided the diagnosis induced by availability bias) or due to other causes (i.e. they provided another incorrect diagnosis) and compared time to diagnose. RESULTS: We did not successfully induce bias: no significant effect of availability bias was found. Therefore, we compared correct diagnoses to all incorrect diagnoses. Residents reached correct diagnoses faster than incorrect diagnoses (115 s vs. 129 s, p < .001). Exploratory analyses of cases where bias was induced showed a trend of time to diagnose for bias diagnoses to be more similar to correct diagnoses (115 s vs 115 s, p = .971) than to other errors (115 s vs 136 s, p = .082). CONCLUSIONS: We showed that correct diagnoses were made faster than incorrect diagnoses, even within subjects. Errors due to availability bias may be different: exploratory analyses suggest a trend that biased cases were diagnosed faster than incorrect diagnoses. The hypothesis that fast reasoning leads to diagnostic errors should be revisited, but more research into the characteristics of cognitive biases is important because they may be different from other causes of diagnostic errors.

A randomized clinical trial comparing two two-phase treatment strategies for in-patients with severe depression.

OBJECTIVE: To compare the efficacy of two antidepressant treatment strategies in severely depressed in-patients, that is, imipramine vs. venlafaxine, both with subsequent lithium addition in non-responders. METHOD: In-patients (n = 88) with major depressive disorder were randomized to 7-week treatment with imipramine or venlafaxine (phase I). All non-responders (n = 44) received 4-week plasma level-targeted dose lithium addition (phase II). Efficacy was evaluated after 11 weeks of treatment. RESULTS: Analyzing phases I and II combined, non-inferiority was established and the difference in the proportion of responders (HAM-D score reduction ≥50%) by the end of phase II demonstrated the venlafaxine-lithium treatment strategy to be significantly superior to the imipramine-lithium treatment strategy (77% vs. 52%) (χ2 (1) = 6.03; P = 0.01). Regarding remission (HAM-D score ≤ 7), 15 of 44 (34%) patients in the imipramine-lithium treatment group were remitters compared to 22 of 44 (50%) patients in the venlafaxine-lithium treatment group, a non-significant difference. Patients in the venlafaxine-lithium treatment group had a non-significant larger mean HAM-D score reduction compared with patients in the imipramine-lithium treatment group (16.1 vs. 13.5 points, respectively; Cohen's d = 0.30). CONCLUSION: The venlafaxine-lithium treatment strategy can be considered a valuable alternative for the imipramine-lithium treatment strategy in the treatment of severely depressed in-patients.

Beta-blocking agents during electroconvulsive therapy: a review.

Electroconvulsive therapy (ECT) is associated with at least transient episodes of hypertension and tachycardia. Beta-blocking agents may be indicated to prevent cardiovascular complications and may shorten seizure duration. This review evaluates studies that used beta-blocking agents during ECT to determine which agent has the most favourable outcomes on cardiovascular variables and seizure duration. A Medline database search was made using the combined keywords 'adrenergic beta-antagonists' and 'electroconvulsive therapy'. The search was restricted to double-blind randomized controlled trials and yielded 29 original studies. With the use of esmolol, significant attenuating effects were found on cardiovascular parameters in the first 5 min after stimulation; its shortening effects on seizure duration may be dose-related. With the use of labetalol, findings on cardiovascular effects were inconsistent during the first minutes after stimulation but were significant after 5 min and thereafter; seizure duration was scarcely studied. Landiolol attenuates heart rate but with inconsistent findings regarding arterial pressure (AP); seizure duration was mostly unaffected. Esmolol appears to be effective in reducing the cardiovascular response, although seizure duration may be affected with higher dosages. Landiolol can be considered a suitable alternative, but effects on AP need further investigation. Labetalol has been studied to a lesser extent and may have prolonged cardiovascular effects. The included studies varied in design, methodology, and the amount of exact data provided in the publications. Further study of beta-blocking agents in ECT is clearly necessary.

The impact of patient-reported frailty on cardiovascular outcomes in elderly patients after non-ST-acute coronary syndrome.

BACKGROUND: As life expectancy increases, the population of older individuals with coronary artery disease and frailty is growing. We aimed to assess the impact of patient-reported frailty on the treatment and prognosis of elderly early survivors of non-ST-elevation acute coronary syndrome (NSTE-ACS). METHODS: Frailty data were obtained from two prospective trials, POPular Age and the POPular Age Registry, which both assessed elderly NSTE-ACS patients. Frailty was assessed one month after admission with the Groningen Frailty Indicator (GFI) and was defined as a GFI-score of 4 or higher. In these early survivors of NSTE-ACS, we assessed differences in treatment and 1-year outcomes between frail and non-frail patients, considering major adverse cardiovascular events (MACE, including cardiovascular mortality, myocardial infarction, and stroke) and major bleeding. RESULTS: The total study population consisted of 2192 NSTE-ACS patients, aged ≥70 years. The GFI-score was available in 1320 patients (79 ± 5 years, 37% women), of whom 712 (54%) were considered frail. Frail patients were at higher risk for MACE than non-frail patients (9.7% vs. 5.1%, adjusted hazard ratio [HR] 1.57, 95% confidence interval [CI] 1.01-2.43, p = 0.04), but not for major bleeding (3.7% vs. 2.8%, adjusted HR 1.23, 95% CI 0.65-2.32, p = 0.53). Cubic spline analysis showed a gradual increase of the risk for clinical outcomes with higher GFI-scores. CONCLUSIONS: In elderly NSTE-ACS patients who survived 1-month follow-up, patient-reported frailty was independently associated with a higher risk for 1-year MACE, but not with major bleeding. These findings emphasize the importance of frailty screening for risk stratification in elderly NSTE-ACS patients.

Treatment of unipolar psychotic depression: a randomized, double-blind study comparing imipramine, venlafaxine, and venlafaxine plus quetiapine.

OBJECTIVE: It remains unclear whether unipolar psychotic depression should be treated with an antidepressant and an antipsychotic or with an antidepressant alone. METHOD: In a multi-center RCT, 122 patients (18-65 years) with DSM-IV-TR psychotic major depression and HAM-D-17 > or = 18 were randomized to 7 weeks imipramine (plasma-levels 200-300 microg/l), venlafaxine (375 mg/day) or venlafaxine-quetiapine (375 mg/day, 600 mg/day). Primary outcome was response on HAM-D-17. Secondary outcomes were response on CGI and remission (HAM-D-17). RESULTS: Venlafaxine-quetiapine was more effective than venlafaxine with no significant differences between venlafaxine-quetiapine and imipramine, or between imipramine and venlafaxine. Secondary outcomes followed the same pattern. CONCLUSION: That unipolar psychotic depression should be treated with a combination of an antidepressant and an antipsychotic and not with an antidepressant alone, can be considered evidence based with regard to venlafaxine-quetiapine vs. venlafaxine monotherapy. Whether this is also the case for imipramine monotherapy is likely, but cannot be concluded from the data.

Efficacy of venlafaxine compared with tricyclic antidepressants in depressive disorder: a meta-analysis.

With respect to the pharmacological characteristic, venlafaxine is comparable with tricyclic antidepressants (TCAs), and venlafaxine might be comparable in efficacy. We performed a systematic review investigating the relative efficacy and tolerability of venlafaxine compared with TCAs (imipramine, clomipramine, amitriptyline, nortriptyline and desipramine). Relevant double-blind randomised trials were identified from systematic searches of electronic databases. An exact analysis of the estimated odds ratios of response of the TCA relative to venlafaxine showed no overall significance of treatment effect (P = 0.38). The odds ratios were not homogenous across studies (P = 0.0213). The average dose of venlafaxine was 103.5 mg/day and for the TCA 106.1 mg/day. An exact analysis of the estimated odds ratios of the withdrawals and side effects in the trials with a TCA relative to venlafaxine showed no overall significance of withdrawal. From our review, no significant difference in treatment effect between low dose of both venlafaxine and the TCAs could be found. In our opinion, because of the heterogeneity of the odds ratios, one cannot conclude that they are of equal efficacy.

[Symptoms of depression in strict Calvinist patients and in patients without religious affiliations: a comparison]. / Symptomen bij een depressie; bevindelijk gereformeerde versus niet-kerkelijke patiënten.

BACKGROUND: Culture can have a considerable influence on the way in which a depression is experienced, expressed or presented. Strict Calvinists or reformed pietists form an orthodox protestant cultural minority in the Netherlands. This orthodox wing of the Dutch Reformed Churches places a strong emphasis on personal religious experience of God's work of conversion. It is possible that symptoms of depression in this group differ somewhat from such symptoms in nonaffiliated depressed patients. AIM: To determine whether depressive symptoms in strict Calvinistic patients differ from those in non-affiliated patients. METHOD: Seventy depressed adult Dutch nationals receiving treatment as outpatients under the mental health service were asked to fill in a depression self-scoring list (Beck Depression Inventory II (bdi-ii)). A comparison was made between the total scores and scores of symptom clusters of strict Calvinists and the corresponding scores of non-affiliated patients. results The strict Calvinists had a lower total score than the non-affiliated patients on the bdi-ii and their scores were particularly lower for the symptom clusters suicidality and restrictions in functioning. CONCLUSION: Strict Calvinists differed from the non-affiliated patients in the way in which they presented on a depression self scoring list during depression. Perhaps strict Calvinists have less chance of being diagnosed and treated at an early stage because they conceal their depression and struggle on for a longer time. The study shows that insight into the religious background of Dutch national patients can be important for accurate psychiatric diagnostics.

[Beta-blockers and electroconvulsive therapy: a review]. / Prevention of post-discharge suicide: an inventory.

BACKGROUND: When patients with cardiovascular disorders undergo electroconvulsive therapy (ect) they sometimes have to be treated for tachycardia and high blood pressure. AIM: To describe the effects of beta-blockers on seizure duration and cardiovascular variables in patients undergoing ect. METHOD: Search for studies in Medline, with the keywords 'beta-adrenergic blocking agents' and 'electroconvulsive therapy'. Only articles based on randomised placebo-controlled investigations were included. results The search strategy produced 21 articles. These were assessed by all authors. Esmolol was the drug administered in most of the trials. Since seizure duration can influence the therapeutic effect of ect it is advisable to use bilateral electrode placement in patients with cardiovascular risk factors and to administer esmolol prior to seizure induction. CONCLUSION: The beta-blocker of choice for use during ect seems to be esmolol; it can shorten seizure duration, although the effect is probably dose-dependent. Esmolol is also the drug of choice in ect sessions for patients without cardiovascular risk factors but who develop prolonged hypertension or tachycardia. A possible alternative is labetalol, but its longer half-life is a disadvantage, particularly if it is administered in a high dose. So far, experience with landiolol is limited, but its short half-life, greater cardioselectivity and higher potency mean that it could be a promising alternative.

[Comparison of the effectiveness of two treatment strategies in inpatients with a depressive disorder. A double-blind study of imipramine followed by lithium addition versus fluvoxamine followed by lithium addition]. / De vergelijking van de effectiviteit van twee behandelingsstrategieën bij opgenomen patiënten met een depressieve stoornis. Een dubbelblind onderzoek met imipramine versusfluvoxamine, gevolgd door lithiumadditie.

BACKGROUND: There is still uncertainty regarding the best treatment optionfor depressed inpatients and the best strategy to follow if patient response is insufficient. AIM: To compare the efficacy of imipramine and fluvoxamine in depressed inpatients who subsequently received lithium supplement in case of poor response. METHOD: After a drug-free period and four days of placebo use, patients were randomised either to imipramine or to fluvoxamine (phase 1); the antidepressant dosage was fixed according to a predetermined plasma level. The efficacy of the antidepressant was evaluated four weeks after the predetermined plasma level had been attained. If patient response was inadequate, the antidepressant was augmented with lithium (phase 2). Patient response to the lithium addition was evaluated three weeks after an adequate lithium level had been attained. RESULTS: The study involved 138 inpatients. At the end of phase 1, imipramine was found to be superior tofluvoxamine according to the Clinical Global Impression of Improvement. Remission was achieved by 6 (23%) patients on imipramine and by 10 (15%) patients on fluvoxamine; this difference was not statistically significant. At the end of phase 2, 41 (9%) patients on imipramine and 27 (40%) patients on fluvoxamine achieved remission, this significant difference demonstrating the superiority of the imipramine strategy. CONCLUSION: Imipramine with subsequent lithium addition is superior to a similar strategy with fluvoxamine.

[The practice guideline 'Depressive disorder' (first revision) from the Dutch College of General Practitioners; a response from the perspective of psychiatry]. / De standaard 'Depressieve stoornis' (eerste herziening) van het Nederlands Huisartsen Genootschap; reactie vanuit de psychiatrie.

The first revision of the Dutch guidelines for the treatment of depressive disorders by general practitioners adapted the international psychiatric nomenclature for the diagnosis of depressive disorders. This enhances collaboration between general practitioners and psychiatrists. The use of selective serotonin reuptake inhibitors in this guideline is an advantage compared to the earlier version. The distinction between the indication for cognitive therapy and for antidepressant treatment is not very clear in this guideline. Overall the guideline represents a scientific and conservative stance in the treatment of depressed patients, which is commendable. The use of target plasma level concentrations with tricyclic antidepressants, better guidelines for the use of antidepressants or cognitive therapy, and the use of severity rating scales during treatment could further improve the next version of this guideline.

Comparison of 2 treatment strategies for depressed inpatients: imipramine and lithium addition or mirtazapine and lithium addition.

BACKGROUND: The purpose of this study was to compare the overall effectiveness of 2 treatment strategies for inpatients with severe major depressive episode (DSM-III-R): (1) mirtazapine (phase 1) and subsequent lithium addition (phase 2) or (2) imipramine (phase 1) and subsequent lithium addition (phase 2). We previously reported the results of phase 1. METHOD: In phase 1, patients were randomly assigned to treatment with either mirtazapine or imipramine, and doses were adjusted to obtain predefined blood drug levels. Nonresponders had lithium added to the double-blind mirtazapine or imipramine medication. The dose was adjusted to obtain a blood lithium level of 0.5-1.0 mmol/L. Treatment effects were evaluated weekly by the Montgomery-Asberg Depression Rating Scale for up to 2 weeks on this blood lithium level. RESULTS: Data for 100 patients were available for comparison of the 2 treatment strategies. 80 patients received no comedication. By the end of phase 2, 24 (48%) of 50 had responded to mirtazapine and 32 (64%) of 50 had responded to imipramine (intent-to-treat analysis). A survival analysis of the total patient group intent-to-treat showed a significant difference in favor of the treatment strategy with imipramine and subsequent lithium addition. CONCLUSION: Efficacy of imipramine and subsequent lithium addition for nonresponders is superior to the same treatment strategy with mirtazapine. This applies to the patient sample studied, which consisted of 100 severely depressed inpatients, 29 of whom were psychotically depressed. More serious side effects of imipramine, however, led to discontinuation of imipramine in 5 patients. No serious side effects were observed during the phase of lithium addition to either imipramine or mirtazapine. We, therefore, prefer to start treatment with imipramine and test for fixed blood drug levels, and, if necessary, add lithium. In the case of prohibitive side effects, patients are switched to a modern antidepressant such as mirtazapine, and, if necessary, lithium is added to this antidepressant.