A realist evaluation of how, why and when objective structured clinical exams (OSCEs) are experienced as an authentic assessment of clinical preparedness.

INTRODUCTION: Whilst rarely researched, the authenticity with which Objective Structured Clinical Exams (OSCEs) simulate practice is arguably critical to making valid judgements about candidates' preparedness to progress in their training. We studied how and why an OSCE gave rise to different experiences of authenticity for different participants under different circumstances. METHODS: We used Realist evaluation, collecting data through interviews/focus groups from participants across four UK medical schools who participated in an OSCE which aimed to enhance authenticity. RESULTS: Several features of OSCE stations (realistic, complex, complete cases, sufficient time, autonomy, props, guidelines, limited examiner interaction etc) combined to enable students to project into their future roles, judge and integrate information, consider their actions and act naturally. When this occurred, their performances felt like an authentic representation of their clinical practice. This didn't work all the time: focusing on unavoidable differences with practice, incongruous features, anxiety and preoccupation with examiners' expectations sometimes disrupted immersion, producing inauthenticity. CONCLUSIONS: The perception of authenticity in OSCEs appears to originate from an interaction of station design with individual preferences and contextual expectations. Whilst tentatively suggesting ways to promote authenticity, more understanding is needed of candidates' interaction with simulation and scenario immersion in summative assessment.

Inter-school variations in the standard of examiners' graduation-level OSCE judgements.

INTRODUCTION: Ensuring equivalence in high-stakes performance exams is important for patient safety and candidate fairness. We compared inter-school examiner differences within a shared OSCE and resulting impact on students' pass/fail categorisation. METHODS: The same 6 station formative OSCE ran asynchronously in 4 medical schools, with 2 parallel circuits/school. We compared examiners' judgements using Video-based Examiner Score Comparison and Adjustment (VESCA): examiners scored station-specific comparator videos in addition to 'live' student performances, enabling 1/controlled score comparisons by a/examiner-cohorts and b/schools and 2/data linkage to adjust for the influence of examiner-cohorts. We calculated score impact and change in pass/fail categorisation by school. RESULTS: On controlled video-based comparisons, inter-school variations in examiners' scoring (16.3%) were nearly double within-school variations (8.8%). Students' scores received a median adjustment of 5.26% (IQR 2.87-7.17%). The impact of adjusting for examiner differences on students' pass/fail categorisation varied by school, with adjustment reducing failure rate from 39.13% to 8.70% (school 2) whilst increasing failure from 0.00% to 21.74% (school 4). DISCUSSION: Whilst the formative context may partly account for differences, these findings query whether variations may exist between medical schools in examiners' judgements. This may benefit from systematic appraisal to safeguard equivalence. VESCA provided a viable method for comparisons.

Effect of major lifestyle risk factors, independent and jointly, on life expectancy with and without cardiovascular disease: results from the Consortium on Health and Ageing Network of Cohorts in Europe and the United States (CHANCES).

Seldom have studies taken account of changes in lifestyle habits in the elderly, or investigated their impact on disease-free life expectancy (LE) and LE with cardiovascular disease (CVD). Using data on subjects aged 50+ years from three European cohorts (RCPH, ESTHER and Tromsø), we used multi-state Markov models to calculate the independent and joint effects of smoking, physical activity, obesity and alcohol consumption on LE with and without CVD. Men and women aged 50 years who have a favourable lifestyle (overweight but not obese, light/moderate drinker, non-smoker and participates in vigorous physical activity) lived between 7.4 (in Tromsø men) and 15.7 (in ESTHER women) years longer than those with an unfavourable lifestyle (overweight but not obese, light/moderate drinker, smoker and does not participate in physical activity). The greater part of the extra life years was in terms of "disease-free" years, though a healthy lifestyle was also associated with extra years lived after a CVD event. There are sizeable benefits to LE without CVD and also for survival after CVD onset when people favour a lifestyle characterized by salutary behaviours. Remaining a non-smoker yielded the greatest extra years in overall LE, when compared to the effects of routinely taking physical activity, being overweight but not obese, and drinking in moderation. The majority of the overall LE benefit is in disease free years. Therefore, it is important for policy makers and the public to know that prevention through maintaining a favourable lifestyle is "never too late".

Adverse perception of cough in patients with severe asthma: a discrete choice experiment.

Background: Asthma symptoms adversely impact quality of life in particular in those with poor disease control. Commonly used patient-reported measures for asthma used to assess asthma control often inadequately capture the impact of cough, despite evidence that cough is one of the most bothersome symptoms for patients with asthma. This study aims to improve our understanding of how patients with asthma perceive cough to better understand its clinical impact. Methods: A discrete choice experiment (DCE) was performed in two distinct adult asthma populations; those with severe asthma as defined by Global Initiative for Asthma (GINA) step 4/5 classification and those with moderate asthma (a GINA steps 2 or 3 classification of asthma severity). Results: Choices were highly dominated by the cough attribute in the symptoms complexes; 48.4% of patients with severe asthma and 31.3% with moderate asthma consistently chose the alternative with the lowest level of cough. Furthermore, cough predominance was found to be significantly associated with severity of asthma (p=0.047). Patients with moderate asthma were not willing to accept any additional symptoms to reduce cough from severe to mild. However, these patients were willing to accept mild breathlessness, mild sleep disturbance, severe chest tightness and severe wheezing to remove coughing altogether. Conclusions: Patients with asthma prefer to have less cough and are willing to accept greater levels of other symptoms to achieve this. Additionally, asthma severity may influence an individual's perception of their symptoms; cough is a more important symptom for patients with severe asthma than those with a milder disease.

Reducing oral steroid intolerability and drug costs for acute wheezers: A retrospective evaluation of a clinical management algorithm in a Pediatric Emergency Department.

PROJECT AIM: To retrospectively evaluate a clinical management algorithm for acute wheezers in a UK Pediatric Emergency Department (PED). OVERVIEW AND RATIONALE: Acute wheezing attacks are a leading cause of PED attendances and inpatient admissions. Prednisolone, a routine treatment, is intolerable in almost one-third of children, requiring repeated dosing, which may prolong length of stay (LOS). To address this problem, we: (1) developed an acute management algorithm (concise, single-sided flow-chart, instructing immediate management); (2) modified the OCS regime from prednisolone (1 mg/kg, 3-day course) to dexamethasone (600 then 300 mcg/kg); (3) and disseminated guidance regionally. Written information-handouts, e-mails, and posters-were followed-up with verbal reinforcement. We implemented the algorithm in 2017 and revised it further in 2018. EVALUATION: In 2019, we retrospectively collected data on 100 acute wheeze attendances (those requiring OCS, aged 2-14), between October and December in 2016, 2017, and 2018 (n = 300), and assessed outcomes. RESULTS: Over a 48-month period, we reduced OCS intolerability by 67.2% and OCS drug costs by 85.8% (saving £41,470.14), while not significantly influencing the other outcomes. CONCLUSIONS: Reduced intolerability and substantial cost savings can be achieved by implementing a structured acute pediatric wheeze algorithm and modifying the OCS to single-dose dexamethasone (300 mcg/kg).

Enhancing authenticity, diagnosticity and equivalence (AD-Equiv) in multicentre OSCE exams in health professionals education: protocol for a complex intervention study.

INTRODUCTION: Objective structured clinical exams (OSCEs) are a cornerstone of assessing the competence of trainee healthcare professionals, but have been criticised for (1) lacking authenticity, (2) variability in examiners' judgements which can challenge assessment equivalence and (3) for limited diagnosticity of trainees' focal strengths and weaknesses. In response, this study aims to investigate whether (1) sharing integrated-task OSCE stations across institutions can increase perceived authenticity, while (2) enhancing assessment equivalence by enabling comparison of the standard of examiners' judgements between institutions using a novel methodology (video-based score comparison and adjustment (VESCA)) and (3) exploring the potential to develop more diagnostic signals from data on students' performances. METHODS AND ANALYSIS: The study will use a complex intervention design, developing, implementing and sharing an integrated-task (research) OSCE across four UK medical schools. It will use VESCA to compare examiner scoring differences between groups of examiners and different sites, while studying how, why and for whom the shared OSCE and VESCA operate across participating schools. Quantitative analysis will use Many Facet Rasch Modelling to compare the influence of different examiners groups and sites on students' scores, while the operation of the two interventions (shared integrated task OSCEs; VESCA) will be studied through the theory-driven method of Realist evaluation. Further exploratory analyses will examine diagnostic performance signals within data. ETHICS AND DISSEMINATION: The study will be extra to usual course requirements and all participation will be voluntary. We will uphold principles of informed consent, the right to withdraw, confidentiality with pseudonymity and strict data security. The study has received ethical approval from Keele University Research Ethics Committee. Findings will be academically published and will contribute to good practice guidance on (1) the use of VESCA and (2) sharing and use of integrated-task OSCE stations.

The path towards herd immunity: Predicting COVID-19 vaccination uptake through results from a stated choice study across six continents.

Despite unprecedented progress in developing COVID-19 vaccines, global vaccination levels needed to reach herd immunity remain a distant target, while new variants keep emerging. Obtaining near universal vaccine uptake relies on understanding and addressing vaccine resistance. Simple questions about vaccine acceptance however ignore that the vaccines being offered vary across countries and even population subgroups, and differ in terms of efficacy and side effects. By using advanced discrete choice models estimated on stated choice data collected in 18 countries/territories across six continents, we show a substantial influence of vaccine characteristics. Uptake increases if more efficacious vaccines (95% vs 60%) are offered (mean across study areas = 3.9%, range of 0.6%-8.1%) or if vaccines offer at least 12 months of protection (mean across study areas = 2.4%, range of 0.2%-5.8%), while an increase in severe side effects (from 0.001% to 0.01%) leads to reduced uptake (mean = -1.3%, range of -0.2% to -3.9%). Additionally, a large share of individuals (mean = 55.2%, range of 28%-75.8%) would delay vaccination by 3 months to obtain a more efficacious (95% vs 60%) vaccine, where this increases further if the low efficacy vaccine has a higher risk (0.01% instead of 0.001%) of severe side effects (mean = 65.9%, range of 41.4%-86.5%). Our work highlights that careful consideration of which vaccines to offer can be beneficial. In support of this, we provide an interactive tool to predict uptake in a country as a function of the vaccines being deployed, and also depending on the levels of infectiousness and severity of circulating variants of COVID-19.

FKBPL is associated with metabolic parameters and is a novel determinant of cardiovascular disease.

Type 2 diabetes (T2D) is associated with increased risk of cardiovascular disease (CVD). As disturbed angiogenesis and endothelial dysfunction are strongly implicated in T2D and CVD, we aimed to investigate the association between a novel anti-angiogenic protein, FK506-binding protein like (FKBPL), and these diseases. Plasma FKBPL was quantified by ELISA cross-sectionally in 353 adults, consisting of 234 T2D and 119 non-diabetic subjects with/without CVD, matched for age, BMI and gender. FKBPL levels were higher in T2D (adjusted mean: 2.03 ng/ml ± 0.90 SD) vs. non-diabetic subjects (adjusted mean: 1.79 ng/ml ± 0.89 SD, p = 0.02), but only after adjustment for CVD status. In T2D, FKBPL was negatively correlated with fasting blood glucose, HbA1c and diastolic blood pressure (DBP), and positively correlated with age, known diabetes duration, waist/hip ratio, urinary albumin/creatinine ratio (ACR) and fasting C-peptide. FKBPL plasma concentrations were increased in the presence of CVD, but only in the non-diabetic group (CVD: 2.02 ng/ml ± 0.75 SD vs. no CVD: 1.68 ng/ml ± 0.79 SD, p = 0.02). In non-diabetic subjects, FKBPL was positively correlated with an established biomarker for CVD, B-type Natriuretic Peptide (BNP), and echocardiographic parameters of diastolic dysfunction. FKBPL was a determinant of CVD in the non-diabetic group in addition to age, gender, total-cholesterol and systolic blood pressure (SBP). FKBPL may be a useful anti-angiogenic biomarker in CVD in the absence of diabetes and could represent a novel CVD mechanism.

Drivers of inequality in disability-free expectancy at birth and age 85 across space and time in Great Britain.

BACKGROUND: Although mortality and health inequalities at birth have increased both geographically and in socioeconomic terms, little is known about inequalities at age 85, the fastest growing sector of the population in Great Britain (GB). AIM: To determine whether trends and drivers of inequalities in life expectancy (LE) and disability-free life expectancy (DFLE) at age 85 between 1991 and 2001 are the same as those at birth. METHODS: DFLE at birth and age 85 for 1991 and 2001 by gender were calculated for each local authority in GB using the Sullivan method. Regression modelling was used to identify area characteristics (rurality, deprivation, social class composition, ethnicity, unemployment, retirement migration) that could explain inequalities in LE and DFLE. RESULTS: Similar to values at birth, LE and DFLE at age 85 both increased between 1991 and 2001 (though DFLE increased less than LE) and gaps across local areas widened (and more for DFLE than LE). The significantly greater increases in LE and DFLE at birth for less-deprived compared with more-deprived areas were still partly present at age 85. Considering all factors, inequalities in DFLE at birth were largely driven by social class composition and unemployment rate, but these associations appear to be less influential at age 85. CONCLUSIONS: Inequalities between areas in LE and DFLE at birth and age 85 have increased over time though factors explaining inequalities at birth (mainly social class and unemployment rates) appear less important for inequalities at age 85.