Medical students' learning processes the first time they role-play in psychiatry: A grounded theory study.

BACKGROUND: Recent changes in psychiatric care and teaching that limit patient contact for medical students can be overcome in part by simulation-based education. Understanding the learning processes of medical students involved in psychiatric simulation-based programmes could usefully inform efforts to improve this teaching. This study explored the learning processes of medical students the first time they role-play in psychiatry. METHODS: We used constructivist grounded theory to analyse semi-structured interviews of 13 purposively sampled medical students and the six psychiatrists who trained them. To improve the triangulation process, the results of this analysis were compared with those of the analyses of the role-play video and the debriefing audio-tapes. RESULTS: Five organising themes emerged: improving the students' immediate perception of patients with mental disorders; cultivating clinical reasoning; managing affect; enhancing skills and attitudes and fostering involvement in learning psychiatry. CONCLUSION: Results suggest that psychiatric role-playing can improve students' progressive understanding of psychiatry through the development of intuition and by allaying affects. Emotional elaboration and student involvement appear to be key features.

A review of educational strategies to improve nurses' roles in recognizing and responding to deteriorating patients.

BACKGROUND: Physiological instability leading to clinical deterioration often precedes cardiopulmonary arrest. Nurses, who have the most frequent patient contact and responsibility for ongoing monitoring of patients, play a crucial role in recognizing and responding to clinical deterioration. The importance of education in supporting such a role has been addressed in numerous studies. AIM: This study aimed to identify nurses' educational needs and explore educational strategies to enhance their ability in recognizing and managing wards with deteriorating patients. METHODS: A literature search from databases (2000-2010) was undertaken to include papers that identified the educational needs of ward nurses and existing educational programmes related to the care of deteriorating patients. FINDINGS: Twenty-six papers were included in this review. Findings identified the educational need to empower nurses with the appropriate knowledge and skills in recognizing, reporting and responding to patient deterioration. The review of existing educational programmes and their outcomes identified valuable teaching information and strategies, and areas that could be improved in meeting nurses' educational needs. CONCLUSION: The review has highlighted important aspects of patient safety in clinical deterioration that could be further addressed by educational strategies targeting the role of ward nurses. These strategies include: utilizing clinical decision-making models to develop nurses' decision making skills; developing a standardized tool for systematic nursing assessment and management of clinical deterioration; incorporating training in clinical deterioration as a core competence of pre-registered nursing education; providing vital signs training to nursing assistants; and conducting more rigorous studies to evaluate the effectiveness of the educational programmes.

Assessment of practicing family physicians: comparison of observation in a multiple-station examination using standardized patients with observation of consultations in daily practice.

PURPOSE: Looking for a valid, reliable, and feasible method to collect data on the performances of practicing family physicians, the authors compare the measurement characteristics of a multiple-station examination (MSE) using standardized patients with those of a video assessment of regular consultations in daily practice (practice video assessment, PVA). METHOD: In a cross-sectional study, consultations of 90 family physicians were videotaped both in an MSE and in their daily practices. Peer-observers used a validated instrument (MAAS-Global) to assess the physicians' communication with patients and their medical performances. The physicians were randomly divided into two groups, comparable for demographic characteristics, and half underwent the assessments in reverse order to test for time-order effects. Content validity, criterion validity, reliability, and feasibility of the two methods were compared. RESULTS: Content validity of the PVA was superior to that of the MSE, since the domain of general family practice care was better covered. Observed participants judged the videotaped practice consultations to be "natural," whereas hardly any family physician, after reviewing the videotaped consultations of the MSE, recognized his or her usual working style. Specific criteria made it possible to standardize real practice. Concerning criterion validity, only the medical-performance components of the two methods correlated. No correlation was found for the communication components. Real-practice performance proved to be less influenced by observation than was performance during the MSE. The reliabilities of the two methods, expected to be better in the controlled MSE, were comparable. The administration of the PVA was more flexible, less costly, and better accepted by the family physicians than was that of the MSE. CONCLUSION: Assessment for quality improvement of family physicians' practices by video observation in daily practice is superior to video assessment in a simulated setting using standardized patients.

Developing case-specific checklists for standardized-patient-based assessments in internal medicine: A review of the literature.

PURPOSE: To review the literature on the methods used in writing case-specific checklists for studies of internal medicine physicians' performances that were assessed by standardized patients. METHOD: The authors searched Medline, Embase, Psychlit, and ERIC for articles in English published between 1966 and February 1998. The following search string was used: "[(standardi(*) or simulat(*) or programm(*)) near (patient(*) or client(*) or consultati(*))] and internal medicine." The authors then searched the reference lists of papers retrieved from the database searches, as well as those from seven proceedings of the International Ottawa Conference on Medical Education and Assessment. RESULTS: The procedure yielded 29 relevant articles: database searches yielded 14 published reports dealing with case-specific checklists, 11 articles were culled from the reference lists of these papers, and the Ottawa Conference proceedings yielded four articles. Only 12 articles reported specifically on the development of checklists. In general, there were three sources used for developing checklists: panels of experts, the investigators themselves, and responses from expert physicians to written protocols. No article indicated that researchers had relied exclusively on data from the literature to compose their checklists. Only three articles indicated that literature sources had informed their checklist development. All articles except one relied on explicit criteria for the inclusion of items on the checklists. In 21 of the 29 articles, the checklists had been scored by SPs, but the scoring of specific items on the checklists varied according to the purpose of the SP-physician encounter. Only four of the articles made the checklists available or indicated that the checklists could be obtained from the authors. CONCLUSION: The development of case-specific checklists for SP examinations of physicians' performance has received little attention. To judge the validity of studies of physicians' performances that use SPs, the development processes for the checklists need to be more fully described to enable readers to evaluate the validity and reliability of the studies.

The NECTAR-study: development of nutrition modules for general practice vocational training; determinants of nutrition guidance practices of GP-trainees. Nutrition Education by Computerized Training And Research.

OBJECTIVE: To identify determinants of nutrition guidance practices of general practitioner-trainees (GP-trainees), to investigate whether these determinants differ from those found by experienced general practitioners; to reveal educational directions towards the development of computer-based instruction on nutrition. DESIGN: Cross-sectional study by means of validated questionnaires. SUBJECTS: All GP-trainees in training at the eight university departments for vocational training in the Netherlands in September, 1998 (n = 985). MAIN OUTCOME MEASURES: Reliability of determinants of nutrition guidance practices was calculated by means of Crohnbach's alpha. The mechanism of action of determinants was identified by means of linear structural relationship analysis (LISREL) using a model developed for GPs. RESULTS: Crohnbach's alphas for factors ranged from 0.58-0.90. The empirical GP-trainee-data fitted with the corresponding GP-model on the mechanism of action. CONCLUSIONS: The same predisposing factors, driving forces and barriers as found with GPs were identified with GP-trainees. Comparing the GP-and GP-trainee-models, only minor differences were found in the path coefficients between factors. Lack of nutrition training and education proved to be of great influence on the extent of nutrition information given. The GP-trainee-model will be of use in developing computer-based instruction on nutrition. It is expected that GPs may also benefit from this instruction.

To what extent do clinical notes by general practitioners reflect actual medical performance? A study using simulated patients.

BACKGROUND: Review of clinical notes is used extensively as an indirect method of assessing doctors' performance. However, to be acceptable it must be valid. AIM: This study set out to examine the extent to which clinical notes in medical records of general practice consultations reflected doctors' actual performance during consultations. METHOD: Thirty nine general practitioners in the Netherlands were consulted by four simulated patients who were indistinguishable from real patients and who reported on the consultations. The complaints presented by the simulated patients were tension headache, acute diarrhoea and pain in the shoulder, and one presented for a check up for non-insulin dependent diabetes. Later, the doctors forwarded their medical records of these patients to the researchers. Content of consultations was measured against accepted standards for general practice and then compared with content of clinical notes. An index, or content score, was calculated as the measure of agreement between actions which had actually been recorded and actions which could have been recorded in the clinical notes. A high content score reflected a consultation which had been recorded well in the medical record. The correlation between number of actions across the four complaints recorded in the clinical notes and number of actions taken during the consultations was also calculated. RESULTS: The mean content score (interquartile range) for the four types of complaint was 0.32 (0.27-0.37), indicating that of all actions undertaken, only 32% had been recorded. However, mean content scores for the categories 'medication and therapy' and 'laboratory examination' were much higher than for the categories 'history' and 'guidance and advice' (0.68 and 0.64, respectively versus 0.29 and 0.22, respectively). The correlation between number of actions across the four complaints recorded in the clinical notes and number of actions taken during the consultations was 0.54 (P < 0.05). CONCLUSION: The use of clinical notes to audit doctors' performance in Dutch general practice is invalid. However, the use of clinical notes to rank doctors according to those who perform many or a few actions in a consultation may be justified.

A method for introducing standardized (simulated) patients into general practice consultations.

A study has been undertaken to determine whether it is possible for a set of standardized (simulated) patients to visit general practitioners, without being detected, in a health care system where doctors have fixed patient lists. Since sending standardized patients into doctors' offices is a new way to assess the performance of general practitioners; this paper describes in detail the methodology that has been used for visits. The paper looks first at the general preparation for visits and secondly at the specific preparation concerning the fine detail of the individual visit. The method was tested in 156 consultations with 39 general practitioners and in no cases were the standardized patients detected. None of the doctors visited felt offended and all were prepared to cooperate in future studies with standardized patients. It is concluded that the standardized patient method, following the step-by-step procedure described, is feasible in actual practice.

Assessment of the performance of general practitioners by the use of standardized (simulated) patients.

A study was undertaken whereby a set of standardized (simulated) patients visited general practitioners without being detected, in a health care system where doctors had fixed patient lists. Thirty nine general practitioners were each visited during normal surgery hours by four standardized patients who were designed to be indistinguishable from real patients. The objective of the study was to see whether the actual performance of general practitioners, as assessed by standardized patients, met predetermined consensus standards of care for actual practice. The patients presented standardized accounts of headache, diarrhoea, shoulder pain and diabetes. The mean group scores of the doctors on the predefined standards of care for the different complaints ranged from 33 to 68%. The results show that standardized patients may be the method of choice in the assessment of the quality of actual care of doctors. It is hypothesized that the substandard scores of the doctors do not reflect inadequate competence, but are a result of the difference between competence and performance.

Teaching and assessing communication skills in Maastricht: the first twenty years.

In order to share the issues involved in setting up a communication skills training programme in a medical school, the development of such a programme at the Skillslab of Maastricht Medical School, the Netherlands, is described and the problems encountered are addressed. A multidisciplinary working group developed teaching goals for communication skills, focused on observable behaviour to be displayed by students. These teaching goals were incorporated in a generic model for doctor-patient communication. A longitudinal training programme was created, throughout the four years of the preclinical curriculum. Students meet in small groups of 10, once every 2 weeks. In between group sessions they practise consultation skills in simulated patient contacts. Communication skills are assessed in the annual multiple station examination. In the development of this programme the following consecutive actions were taken: teaching material was produced, and an assessment tool was developed, as were instruments for programme evaluation. The programme evaluation allowed student feedback to teachers, the teachers' departments, and the administration of the medical school. Finally, teacher training was professionalized.

Do general practitioners act consistently in real practice when they meet the same patient twice? Examination of intradoctor variation using standardised (simulated) patients.

OBJECTIVE: To assess the variation within individual general practitioners facing the same problem twice in actual practice under unbiased conditions. DESIGN: General practitioners were consulted during normal surgery hours by a standardised patient portraying a patient with angina pectoris. Six weeks later the same general practitioners were consulted again by a similar standardised patient portraying a similar case. The patients reported on the consultations. SETTING: Trondheim, Norway. SUBJECTS: Of 87 general practitioners invited by letter, 28 (32%) agreed to participate without hesitation; nine others (10%) wanted more information before consenting. From these 24 were selected and visited. MAIN OUTCOME MEASURES: Number of actions undertaken from a guideline in both rounds of consultations. Duration of consultations. RESULTS: The mean (range, interquartile range) guideline score, total score, and duration of consultation were not significantly different between the first and second patient encounters for the group as a whole. For individual doctors the mean (SD) difference was -0.09 (3.36) for the guideline score, 0.30 (8.1) for the total score, and -0.87 (9.01) for consultation time. CONCLUSIONS: The study shows that assessment of performance in real practice for a group of general practitioners is consistent from the first round of consultations to the second round. However, significant variation occurs in performance of individual physicians.

Does competence of general practitioners predict their performance? Comparison between examination setting and actual practice.

OBJECTIVE: To study the differences and the relation between what a doctor actually does in daily practice (performance) and what he or she is capable of doing (competence) by using national standards for general practice. DESIGN: General practitioners were consulted by four standardised (simulated) patients portraying four different cases during normal surgery hours. Later the doctors participated in a controlled practice test, for which they were asked to perform to the best of their ability. In the test they saw exactly the same standardised cases but in different patients. The patients reported on the consultations. SETTING: Province of Limburg, the Netherlands. SUBJECTS: 442 general practitioners invited by a letter. 137 (31%) agreed to participate, of whom 36 were selected and visited. MAIN OUTCOME MEASURES: Number of actions taken during the consultations across complaints and for each category of complaint: the competence and performance total scores. Combination of scores with duration of consultations (efficiency-time score). Correlation between scores in the competence and performance part. RESULTS: Mean (SD) total score across complaints for competence was 49% higher than in the performance test (81.8 (11) compared with 54.7 (10.1), p less than 0.0001). The Pearson correlation across complaints between the competence total score and the performance total score of the participating physicians was -0.04 (not significant). When efficiency and consultation time of the consultations were taken into account, the correlation was 0.45 (p less than 0.01). CONCLUSIONS: Assessment of competence under examination circumstances can have predictive value for performance in actual practice only when factors such as efficiency and consultation time are taken into account. Below standard performance of physicians does not necessarily reflect a lack of competence. Performance and competence should be considered as distinct constructs.

[Various opinions of family physicians and rheumatologists about the management of patients with rheumatoid arthritis]. / Verschillende visies van huisartsen en reumatologen op de zorg voor patiënten met reumatoïde artritis.

OBJECTIVE: To make an inventory of the opinions about professional duties and of the cooperation of general practitioners (GPs) and rheumatologists in the care of patients with rheumatoid arthritis (RA), after the publication of the standard 'Rheumatoid arthritis' issued by the Dutch College of General Practitioners in 1994. DESIGN: Descriptive. SETTING: Maastricht University, the Netherlands. METHOD: Information was collected by means of a written questionnaire submitted to a random sample of 500 GPs and all 148 (assistant) rheumatologists in the Netherlands, and by means of focus group interviews with GPs, rheumatologists and RA patients. This information focused on the opinion of both groups of professionals on their professional duties in diagnosis and management of RA, existing models of cooperation, the satisfaction with mutual consultations, experienced problems and possibilities to improve cooperation. RESULTS: Substantial differences existed between both groups of professionals in their views on the duties of the GP and the rheumatologist respectively, in the care of RA patients. GPs tended to an expectative policy in cases of suspected or even diagnosed RA, whereas rheumatologists preferred early referral. Hardly any cooperation model was found with agreements committed to paper on the mutual duties regarding RA patients. CONCLUSION: Inadequate mutual contacts and inadequate insight of both parties into each other's abilities appeared to be major problems impeding improvement of the mutual communication. Both groups recognized the need to improve the mutual cooperation.

The role of a computerised case-based testing procedure in practice performance assessment.

INTRODUCTION: For postgraduate training of doctors there is a need for valid and reliable instruments to assess their daily performance. Various instruments have been suggested, some of which use incognito simulated patients (SPs). These methods are resource intensive. Computerised Case-based testing (CCT) is logistically simpler and may still predict performance well. The research question was to evaluate the predictive validity of CCT for performance. METHODS: Seventeen rheumatologists were each visited by eight incognito SPs presenting various rheumatological complaints, and scoring the performance of the rheumatologists using a predefined checklist. From this checklist a panel of experts identified essential items. In addition the rheumatologists sat a CCT test containing 55 cases with a total of 121 items. RESULTS: Negative correlations were found between the SP scores and the CCT scores. This was unexpected. Therefore, background variables on experience were used to compare both methods. The correlation between these and CCT were high and positive and with the SP scores high and negative. This pattern did not differ when using the essential items of the checklist. Reliabilities of the SP scores were markedly high. DISCUSSION: Although CCT was not predictive of SP scores, it was related to working experience. There are good reasons to assume that although SP-scores were more authentic, they were less valid than CCT scores, mainly because they focussed more on thoroughness than on efficiency in data gathering. The results underpin the assumption that for valid performance assessment the most important issue is what information about the candidate is collected and now how authentic the method is.

Management of patients with angina pectoris by GPs: a study with standardized (simulated) patients in actual practice.

BACKGROUND: Little is known about the management of patients with angina pectoris by GPs. OBJECTIVE: The purpose of this study was to assess how a group of GPs managed a patient with angina pectoris complaints in a real-life practice setting during unbiased consultations with standardized patients. METHODS: GPs were consulted during normal surgery hours by a standardized patient portraying a patient with angina pectoris. The setting was Trondheim, Norway. All 87 GPs in the city of Trondheim (Norway) were informed by letter about a study with standardized patients and invited to take part. They were asked to give consent to be visited during actual surgery hours by standardized patients. The date, number and content of the visits planned were not mentioned. They were not told that the study focused on angina pectoris. For budgetary reasons it was decided to ask 24 physicians to participate. The GPs were consulted during normal surgery hours by a standardized patient portraying a patient with angina pectoris. The patients reported on the consultations using a checklist based on guidelines for management of angina pectoris. Outcome measures were the content and number of actions undertaken from the guidelines. RESULTS: Twenty-eight GPs (32%) agreed to participate. Of these, 24 were selected and visited. One doctor detected the standardized patient. The results showed that the participating physicians met 76% of the guidelines used. However, the GPs ordered 31 different types of laboratory test (mean = 7.9, range = 1-18 per physician). In addition, the 23 consultations resulted in seven referrals (two for chest X-rays, four for an exercise test and one referral to a specialist in cardiology). Twenty-two of the 23 doctors made the correct diagnosis and informed the patient accordingly. CONCLUSIONS: When assessed in an unbiased situation in real practice, GPs performed well against a pre-set standard for management of angina pectoris patients. Much variation was found in the request for laboratory tests. These real-life practice data suggest that there is a need for discussing guidelines for effective ordering of laboratory tests in general practice.

On the relationship between the efficiency and the quality of the consultation. A validity study.

OBJECTIVES: The aim of this study was to determine how the medical performance of physicians during consultations is related to doctor-patient communication and satisfaction of patients, taking into account the actual length of the consultations. In addition, we studied the validity of the 'efficiency-per-time score' as a measure of competence. METHODS: General practice trainees participated in a test situation in which they were confronted with six consultations with standardized (simulated) patients (SPs). All consultations were videotaped and evaluated by multiple observers, using national guidelines on medical content and on communication. The SPs scored satisfaction with the consultation using a satisfaction checklist. Forty GP-trainees were invited, of whom 34 participated. The main outcome measures were the number of obligatory actions undertaken by the GP-trainees, total number of actions undertaken, consultation time, efficiency-per-time score, patient satisfaction and quality of communication score, and the Pearson correlations between these measures. RESULTS: There was a negative correlation between the 'efficiency-per-time score' of the GP-trainees and the satisfaction of the SPs in five of the six consultations [Pearson r from -0.29 (P < 0.05) to -0.58 (P < 0.001)] and between the 'efficiency-per-time score' and the quality of the communication in three of the six consultations [Pearson r from -0.34 (P <.05) to -0.51 (P < 0.001)]. CONCLUSIONS: Short consultations with high technical medical efficiency seem to be related to bad communication and dissatisfied patients, thus questioning the validity of the 'efficiency-per-time score' as a measure of competence.

[Standardized patients in general practice--a new method for quality assurance in Noway]. / Standardiserte pasienter i allmennpraksis--en ny metode for kvalitetssikring i Norge.

Standardized patients were sent to general practitioners who use the patient list system in Trondheim in order to register daily clinical practice without the patient being unmasked. The authors explain what a standardized patient is, how they are taught to present a disease, and how they report on the consultation in a valid and reliable way. They also describe how the standardized patients were introduced into the doctors' patient list system. The doctors were informed about the project in advance. Twenty-three doctors were visited twice and one doctor was visited once by a standardized patient. At two of the visits the patient was unmasked. The conclusion is that the use of standardized patients is a valid, reliable and practical method for quality assurance in general practice in Norway.

Methods for quality assessment in general practice.

BACKGROUND AND OBJECTIVES: There is now a wide variety of methods available to general practitioners who want to engage in quality assessment, quality assurance, or quality improvement activities in their practices. These methods require some kind of performance review, or at least the collection of some performance-related data. As in traditional research, the choice of methods depends on what research questions one wants to address. This paper elaborates on some key concepts related to the choice of methods, making a distinction between whether any method actually covers performance (what a doctor does in daily practice) or competence (what a doctor is capable of doing) as well as a distinction between whether a method is direct (patient-doctor contact is observable) or is indirect. METHOD: An overview frame will be presented of the methods most commonly used for data collection within quality assessment. These methods are discussed on their validity, reliability, feasibility and acceptability. Direct methods aimed at recording performance are assumed to hold the highest validity, but practical, economic and logistic factors may favour less ambitious methods for audit or quality improvement activities. CONCLUSIONS: One crucial element in all methods is creating a set of empirical data, as a basis for comparisons, reflection, dialogue and discussions among colleagues.