Exploring how differently patients and clinical tutors see the same consultation: building evidence for inclusion of real patient feedback in medical education.

BACKGROUND: Undergraduate medical education recognises that patient feedback is potentially valuable for student learning and development as a component of multi-source feedback. However greater exploration of how patient feedback perspectives differ to clinical educators is required for curriculum development and improving student feedback literacy. This study aimed to determine how two sources of feedback, patients and clinical tutors, compare on the same patient-centred, interpersonal criteria. METHODS: A patient feedback instrument designed for the undergraduate medical education setting was used to compare patients' feedback with clinical tutors' feedback following a student-patient consultation in the learning context. Assessments from 222 learning consultations involving 40 medical students were collected. Descriptive statistics for tutors and patients for each question were calculated and correlations between patient and tutor were explored using Spearman's rank-order correlation. Mixed effects ordered logistic regression was used to compare each question with an overall rating for tutor and patients in addition to comparing patient with tutor ratings. RESULTS: Clinical tutor and patient assessments had a weak but significant positive correlation in all areas except questions related to respect and concern. When making judgements compared with overall assessment, patients' ratings of respect, concern, communication and being understood in the consultation have a greater effect. After eliminating the effect of generally higher ratings by patients compared with tutors using comparative ordered logistic regression, patients rated students relatively less competent in areas of personal interaction. CONCLUSION: This study provides insight about patient feedback, which is required to continue improving the use and acceptability of this multisource feedback to students as a valuable component of their social learning environment. We have revealed the different perspective-specific judgement that patients bring to feedback. This finding contributes to building respect for patient feedback through greater understanding of the elements of consultations for which patients can discriminate performance.

A randomised controlled trial of feedback to improve patient satisfaction and consultation skills in medical students.

BACKGROUND: The use of feedback has been integral to medical student learning, but rigorous evidence to evaluate its education effect is limited, especially in the role of patient feedback in clinical teaching and practice improvement. The aim of the Patient Teaching Associate (PTA) Feedback Study was to evaluate whether additional written consumer feedback on patient satisfaction improved consultation skills among medical students and whether multisource feedback (MSF) improved student performance. METHODS: In this single site, double-blinded randomised controlled trial, 71 eligible medical students from two universities in their first clinical year were allocated to intervention or control and followed up for one semester. They participated in five simulated student-led consultations in a teaching clinic with patient volunteers living with chronic illness. Students in the intervention group received additional written feedback on patient satisfaction combined with guided self-reflection. The control group received usual immediate formative multisource feedback from tutors, patients and peers. Student characteristics, baseline patient-rated satisfaction scores and tutor-rated consultation skills were measured. RESULTS: Follow-up assessments were complete in 70 students attending the MSF program. At the final consultation episodes, both groups improved patient-rated rapport (P = 0.002), tutor-rated patient-centeredness and tutor-rated overall consultation skills (P = 0.01). The intervention group showed significantly better tutor-rated patient-centeredness (P = 0.003) comparing with the control group. Distress relief, communication comfort, rapport reported by patients and tutor-rated clinical skills did not differ significantly between the two groups. CONCLUSIONS: The innovative multisource feedback program effectively improved consultation skills in medical students. Structured written consumer feedback combined with guided student reflection further improved patient-centred practice and effectively enhanced the benefit of an MSF model. This strategy might provide a valuable adjunct to communication skills education for medical students. TRIAL REGISTRATION: Australian New Zealand Clinical Trials Registry Number ACTRN12613001055796 .

From opening the 'black box' to looking behind the curtain: cognition and context in assessor-based judgements.

The increasing use of direct observation tools to assess routine performance has resulted in the growing reliance on assessor-based judgements in the workplace. However, we have a limited understanding of how assessors make judgements and formulate ratings in real world contexts. The current research on assessor cognition has largely focused on the cognitive domain but the contextual factors are equally important, and both are closely interconnected. This study aimed to explore the perceived cognitive and contextual factors influencing Mini-CEX assessor judgements in the Emergency Department setting. We used a conceptual framework of assessor-based judgement to develop a sequential mixed methods study. We analysed and integrated survey and focus group results to illustrate self-reported cognitive and contextual factors influencing assessor judgements. We used situated cognition theory as a sensitizing lens to explore the interactions between people and their environment. The major factors highlighted through our mixed methods study were: clarity of the assessment, reliance on and variable approach to overall impression (gestalt), role tension especially when giving constructive feedback, prior knowledge of the trainee and case complexity. We identified prevailing tensions between participants (assessors and trainees), interactions (assessment and feedback) and setting. The two practical implications of our research are the need to broaden assessor training to incorporate both cognitive and contextual domains, and the need to develop a more holistic understanding of assessor-based judgements in real world contexts to better inform future research and development in workplace-based assessments.

Consensus statement: support for supervisors of surgical training in Australia and Aotearoa New Zealand.

The Supervisor Support Consensus Statement has been developed after consultation with supervisors of surgical training for the Royal Australasian College of Surgeons (RACS) programmes in Australia and Aotearoa New Zealand and other key stakeholders. Six key areas have been recognized with specific recommendations crafted to improve the support and recognition of Supervisors: 1. Clarity of role, 2. Education and Training, 3. Local support, 4. RACS support, 5. Recognition and valuing of the Supervisor role, 6. Risk Management. The purpose of this consensus statement is to clearly articulate supervisor opinions on the support they require to undertake this important role. It has been produced by an independent writing group of experienced surgical supervisors and educators, with support from RACS education department. The consensus statement is a response to a needs assessment of supervisors of surgical training. The statements in this consensus document have been generated from comments and feedback from supervisors that have been refined through process of extensive consultation using a Delphi methodology. We advise specialty training Committees consider these statements and mandate them as part of their accreditation of terms. The role of the supervisor of training requires greater recognition, and incorporation in the Enterprise Bargaining Agreement (EBA) in Australia and the ASMS Te Whatu Ora SECA in Aotearoa New Zealand would ensure the provisions in this document are enacted. The six areas identified have transferability to other specialities and countries and are valuable when considering how to support supervisors involved in training our next generation of specialist doctors.

Factors Influencing Mini-CEX Rater Judgments and Their Practical Implications: A Systematic Literature Review.

PURPOSE: At present, little is known about how mini-clinical evaluation exercise (mini-CEX) raters translate their observations into judgments and ratings. The authors of this systematic literature review aim both to identify the factors influencing mini-CEX rater judgments in the medical education setting and to translate these findings into practical implications for clinician assessors. METHOD: The authors searched for internal and external factors influencing mini-CEX rater judgments in the medical education setting from 1980 to 2015 using the Ovid MEDLINE, PsycINFO, ERIC, PubMed, and Scopus databases. They extracted the following information from each study: country of origin, educational level, study design and setting, type of observation, occurrence of rater training, provision of feedback to the trainee, research question, and identified factors influencing rater judgments. The authors also conducted a quality assessment for each study. RESULTS: Seventeen articles met the inclusion criteria. The authors identified both internal and external factors that influence mini-CEX rater judgments. They subcategorized the internal factors into intrinsic rater factors, judgment-making factors (conceptualization, interpretation, attention, and impressions), and scoring factors (scoring integration and domain differentiation). CONCLUSIONS: The current theories of rater-based judgment have not helped clinicians resolve the issues of rater idiosyncrasy, bias, gestalt, and conflicting contextual factors; therefore, the authors believe the most important solution is to increase the justification of rater judgments through the use of specific narrative and contextual comments, which are more informative for trainees. Finally, more real-world research is required to bridge the gap between the theory and practice of rater cognition.

Searching for a written patient feedback instrument for patient-medical student consultations.

OBJECTIVE: The Patient Teaching Associate (PTA) program at Eastern Health Clinical School uses volunteer patients with chronic illnesses in consultation-based medical student education. The PTA program aims to develop students' patient-centeredness and associated skills. Our study aims, 1) to identify key desirable characteristics of written patient feedback to doctors and/or students that focuses on patient-centeredness in consultations, and 2) to critically evaluate existing instruments to identify any suitable instrument for use for medical student teaching. METHODS: We reviewed our experience with the PTA program and explored the literature on patient-centeredness and patient feedback to identify desirable characteristics of written feedback for our program. A systematic search was conducted to identify existing patient feedback instruments. These were then evaluated in light of criteria based on desirable characteristics. RESULTS: Eight instruments met the inclusion criteria. While all were designed for patient use, none were ideal for the PTA program. The Doctors' Interpersonal Skills Questionnaire (DISQ), while not used with medical students, is the closest fit to criteria. CONCLUSION: The lack of instruments specifically designed for written patient feedback to medical students highlights a gap in the current literature. PRACTICE IMPLICATIONS: The DISQ provides a good basis for developing a new feedback instrument focused on patient-centeredness in medical students.

Determining normal values for intra-abdominal pressure.

BACKGROUND: Intra-abdominal pressure (IAP) measurements can be used for the early detection and management of the abdominal compartment syndrome. IAP values are widely thought to be atmospheric or subatmospheric. However, there are no reports that describe normal IAP values using urinary bladder pressure measurements in patients not suspected of having a raised IAP level. This study sought to determine these normal values to aid our interpretation of IAP measurements in post-surgical patients or patients with suspected increased IAP. METHODS: Urinary bladder pressure measurements were carried out in 40 men and 18 women awake medical or non-abdominal surgery inpatients with existing indwelling catheters. Measurements were made in the supine, 30 degrees and 45 degrees sitting positions. Comparisons were carried out to determine the effects on urinary bladder pressure of body position, sex and a suspected diagnosis of benign prostatic hypertrophy. RESULTS: Median values for IAP were higher if measured in a more upright position (P < 0.0001). Median values were supine, 9.5 cmH2O (range, 1-18 cmH2O); 30 degrees upright, 11.5 cmH2O (range, 3-19 cmH2O); and at 45 degrees upright, 14.0 cmH2O (range, 4-22 cmH2O). Measurements recorded were neither atmospheric nor subatmospheric. IAP was higher in men compared with women in the supine and 30 degrees positions (P < 0.05) but not in the 45 degrees position (P = 0.083). There was no significant difference between patients with and without suspected benign prostatic hypertrophy. CONCLUSIONS: Normal IAP using urinary bladder pressure in awake patients are above atmospheric pressure. As a patient is moved from the supine into the upright position, IAP measurements increase.

Bridging the gap: from simulation to clinical practice.

BACKGROUND: There has been a shift from the initial learning of skills on patients in the clinical setting to initial learning in a simulated environment, using part-task models, with the risk of a task focus to the learning. We contend that quality learning in both the simulated and the clinical environment is crucial to enhance the transferability of skills to the clinical setting. CONTEXT: We describe teaching strategies, with the sequencing of events and increasing complexity, for the simulated training of basic procedural skills. These teaching strategies can be readily implemented into basic skills training to 'bridge' the gap between the simulated environment and the clinical setting. IMPLICATIONS: We suggest that our approach takes basic skills training beyond a task-focused approach to exemplify clinical scenarios encountered in real life. We argue that there is a need to broaden the focus of medical student training in basic procedural skills, and that the use of a preceptor model of supervision in the clinical setting better enables the transferability of the skills. Although our strategies are based on learning theory, well-designed research is required to test the efficacy in improving medical student learning.

Effectiveness of patient feedback as an educational intervention to improve medical student consultation (PTA Feedback Study): study protocol for a randomized controlled trial.

BACKGROUND: Oral feedback from clinical educators is the traditional teaching method for improving clinical consultation skills in medical students. New approaches are needed to enhance this teaching model. Multisource feedback is a commonly used assessment method for learning among practising clinicians, but this assessment has not been explored rigorously in medical student education. This study seeks to evaluate if additional feedback on patient satisfaction improves medical student performance. METHODS: The Patient Teaching Associate (PTA) Feedback Study is a single site randomized controlled, double-blinded trial with two parallel groups.An after-hours general practitioner clinic in Victoria, Australia, is adapted as a teaching clinic during the day. Medical students from two universities in their first clinical year participate in six simulated clinical consultations with ambulatory patient volunteers living with chronic illness. Eligible students will be randomized in equal proportions to receive patient satisfaction score feedback with the usual multisource feedback and the usual multisource feedback alone as control. Block randomization will be performed. We will assess patient satisfaction and consultation performance outcomes at baseline and after one semester and will compare any change in mean scores at the last session from that at baseline. We will model data using regression analysis to determine any differences between intervention and control groups. Full ethical approval has been obtained for the study. This trial will comply with CONSORT guidelines and we will disseminate data at conferences and in peer-reviewed journals. DISCUSSION: This is the first proposed trial to determine whether consumer feedback enhances the use of multisource feedback in medical student education, and to assess the value of multisource feedback in teaching and learning about the management of ambulatory patients living with chronic conditions. TRIAL REGISTRATION: Australian New Zealand Clinical Trials Registry (ANZCTR): ACTRN12613001055796.

Examining potential barriers to early intervention access in Australian hearing impaired children.

OBJECTIVES: Early intervention for children with hearing loss involves assistance in oral speech development, optimal use of hearing devices and fostering a holistic partnership between allied health and the children's families. Adequate access to early intervention has been shown to be vital in the positive development of long term language and social outcomes. However, there has been limited research to identify the factors which may influence access. This study aimed to explore whether access to early intervention by children with hearing loss is affected by: geographical location, socio-economic status and ethnic-minority family status. METHODS: A cross-sectional research design was used in this study incorporating a survey of early intervention coordinators and an audit of an organization database. All (N=11) early intervention coordinators at an "Oral Language Centre for Deaf Children" in the state of Victoria, Australia were surveyed on whether child clients (N=133) were accessing an appropriate level of early intervention corresponding to their level of hearing loss. The length of time for each child to enroll for early intervention following diagnosis was obtained from the database of the organization. Potential differences in access between geographical groups, between socio-economic status groups and between ethnic-minority and non-minority groups were analyzed using inferential statistics. RESULTS: Closer geographical proximity to early intervention services was associated with more appropriate (P=.000) and more prompt (P=.005) access. No difference in access to early intervention was detected for different socio-economic status groups. Although, ethnic-minority family status was not shown to influence the level of access, it took a significantly longer time for ethnic-minority families to enroll for early intervention compared to non-minority families (P=.04). CONCLUSIONS: Findings suggest that geographical proximity and ethnic-minority family status, instead of socio-economic status, are more likely to be potential barriers to early intervention access in children with hearing loss. From the health promotion perspective, attention should be directed towards these potential barriers.

Development of the surgical science examination of the Royal Australasian College of Surgeons surgical education and training programme: putting the chicken before the egg.

Basic science knowledge is a foundational element of surgical practice. Increasing surgical specialization may merit a reconsideration of the 'whole-body' approach to basic science curriculum in favour of specialty specific depth. The conundrum of depth or breadth of basic science curriculum is currently being addressed by the Royal Australasian College of Surgeons, which introduced a new surgical education and training programme for nine surgical specialties in 2008. This paper describes an innovative solution to the design of a basic science curriculum in the nine different surgical specialty streams of this programme. The task was to develop a curriculum and rigorous assessment in basic sciences to meet the needs of the training programme, for implementation within the first year. A number of political/cultural and technical issues were identified as critical to success. To achieve a robust assessment within the required time frame attention was paid to engagement, governance, curriculum definition, assessment development, and implementation. The pragmatic solution to curriculum and assessment was to use the existing assessment items and blueprint to determine a new curriculum definition and assessment. The resulting curriculum comprises a generic component, undertaken by all trainees, and specialty specific components. In a time critical environment, a pragmatic solution to curriculum, applied with predetermined, structured and meticulous methodology, allowed explicit definition of breadth for the generic basic science curriculum for surgical training in Australia and New Zealand. Implicit definition of specialty specific-basic science curricula was through the creation of a blueprinted assessment.

Paramedic identification of stroke: community validation of the melbourne ambulance stroke screen.

BACKGROUND: Paramedics require an effective prehospital tool to eliminate stroke mimics and to assist in the identification of suitable candidates for thrombolytic therapy. The Faster Access to Stroke Therapies study combined two validated stroke assessment tools (the Los Angeles Prehospital Stroke Screen, LAPSS, and the Cincinnati Prehospital Stroke Scale, CPSS) to form the Melbourne Ambulance Stroke Screen (MASS), and performed an in-field validation by Australian paramedics. METHODS: Over a 12-month period, 18 paramedics participated in the Faster Access to Stroke Therapies study and prospectively collected data contained in the MASS on all stroke dispatches, and for other patients with a focal neurological deficit. Sensitivity and specificity analysis of the LAPSS, CPSS and MASS was calculated and equivalence analysis performed. RESULTS: Paramedics completed 100 MASS assessments for 73 (73%) stroke/transient ischemic attack patients and 27 (27%) stroke mimics. The sensitivity of the MASS (90%, 95% CI: 81-96%) showed statistical equivalence to the sensitivity of the CPSS (95%, p = 0.45) and superiority to the LAPSS (78%, p = 0.008). The specificity of the MASS (74%, 95% CI: 53-88%) was equivalent to that of the LAPSS (85%, p = 0.25) and superior to the CPSS (54%, p = 0.007). All patients misidentified by the MASS (7 strokes, 7 mimics) were ineligible for thrombolytic therapy. CONCLUSION: The MASS is simple to use, with accurate prehospital identification of stroke. It distinguishes stroke mimics, with good recognition of suitable patients for thrombolytic therapy.

An interventional study to improve paramedic diagnosis of stroke.

OBJECTIVE: The aim of the Faster Access to Stroke Therapy (FAST) study was to determine the effect of educational intervention and the use of a prehospital stroke tool on the paramedic diagnosis of stroke. METHODS: Paramedics in emergency medical service units servicing a university teaching hospital were divided into two groups: FAST study paramedics (n = 18) and non-FAST study paramedics (n = 43). The FAST study paramedics received stroke education and instruction in the use of a prehospital stroke assessment tool [Melbourne Ambulance Stroke Screen (MASS)] to assist in stroke diagnosis. Based on final hospital diagnosis, the sensitivities of paramedic stroke diagnosis in the two groups were compared for a 12-month period before and after the intervention. RESULTS: The sensitivity for the FAST study paramedics in identifying stroke improved from 78% (95% confidence interval [CI]: 63% to 88%) to 94% (95% CI: 86% to 98%) (p = 0.006) after receiving the stroke education session and with use of the MASS tool. There was no change in stroke diagnosis for the non-study paramedics 78% (95% CI: 71% to 84%) to 80% (95% CI: 72% to 87%) (p = 0.695). Pre-notification of impending arrival to the emergency department was associated with higher-priority triage in the emergency department, and subsequent shorter times for door to medical review (15 min vs. 31 min, p < 0.001) and door to computed tomography (CT) scanning (94 min vs. 144 min, p < 0.001). CONCLUSIONS: Targeted stroke education and the use of a simple clinical tool can significantly improve the diagnostic sensitivity of stroke by paramedics in the prehospital setting. Accurate diagnosis combined with pre-notification of the pending arrival of stroke patients will allow for the focused and timely application of resources for the management of acute stroke.