Perceptions of scheduled vs. unscheduled directly observed visits in an internal medicine residency outpatient clinic.

INTRODUCTION: Learners may subconsciously change their behavior once they know they are being observed, and this Hawthorne effect should be considered when designing assessments of learner behavior. While there is a growing body of literature to suggest direct observation is the ideal standard for formative assessment, the best method to directly observe learners is unknown. We explored scheduled and unscheduled methods of direct observation among internal medicine residents in the outpatient continuity clinic to advance the understanding of both observation methods. METHODS: We conducted a thematic analysis of faculty and internal medicine residents in an outpatient clinic setting. A semi-structured interview guide for focus group sessions was created. Focus groups were used to explore the internal medicine resident and core teaching faculty perceptions of the scheduled and unscheduled direct observation methods in the outpatient clinc. An experienced qualitative research interviewer external to the internal medicine residency was moderating the sessions. Eight peer focus groups were held. Abstraction of themes from focus group transcripts identified resident and faculty perceptions of the different observation methods. RESULTS: Focus groups had 14 resident participants and 14 faculty participants. Unscheduled observations were felt to be more authentic than scheduled observations since residents perceived their behavior to be unmodified. Unscheduled observations allowed for increased numbers of observations per resident, which permitted more frequent formative assessments. Residents and faculty preferred remote video observation compared to in-room observation. Participants found direct observation a useful learning tool for high-yield, specific feedback. CONCLUSIONS: Unscheduled remote direct observation captures authentic clinical encounters while minimizing learner behavior modification. An unscheduled observation approach results in more frequent formative assessment and therefore in more instances of valuable feedback compared to scheduled observations. These findings can help guide the best practice approaches to direct clinical observation in order to enhance residents learning and experience.

A prospective study of faecal immunochemical testing following polypectomy in a colorectal cancer screening population.

INTRODUCTION: 52% of faecal immunohistochemistry test (FIT)-positive clients in the Irish National Colorectal Cancer Screening Programme (BowelScreen) have adenomatous polyps identified at colonoscopy in round 1. Although it is known that advanced adenomas and cancers cause an elevated FIT, it is not known if small (<5 mm) adenomas cause a positive FIT. AIMS: Determine if removal of small polyps in an FIT-based colorectal cancer (CRC) screening programme is associated with a negative FIT on follow-up. METHODS: A single-centre prospective observational study of consecutive participants attending for first round screening colonoscopy who had a positive FIT (>45 µg Hb/g) as part of the Irish Colorectal Cancer Screening Programme. Subjects were consented at the time of colonoscopy and were sent a repeat FIT 4-6 weeks later. Precolonoscopy and postcolonoscopy FITs were compared and correlated with clinical findings and endoscopic intervention. RESULTS: 112 consecutive first round participants were recruited. Eight (7%) had cancer, 75 (67%) adenomatous polyps, 17 (15%) a normal colonoscopy and 12 (11%) other pathology. There was a clear difference in median FIT levels between the four groups (P=0.006). Advanced pathology (tumour or adenomatous polyp >1 cm) was associated with higher FIT than non-advanced pathology (median FIT 346 vs 89 P=0.0003). 83% (86/104) of subjects completed a follow-up FIT. Follow-up FIT remained positive in 20% (17/86). Polypectomy was associated with a reduction in FIT from a median of 100 to 5 µg Hb/g (P<0.0001). Removal of polyps >5 mm was the only factor independently associated with a negative follow-up FIT on multivariate analysis (OR 3.9 (1.3-11.9, P=0.04)). CONCLUSION: FIT is a sensitive test and levels increase with advanced colonic pathology. Polypectomy of advanced adenomas is associated with a negative follow-up FIT. However, alternative causes for a positive FIT should be considered in patients who have adenomas less than 5 mm detected or a normal colonoscopy.

The validity of peer review in a general medicine journal.

UNLABELLED: All the opinions in this article are those of the authors and should not be construed to reflect, in any way, those of the Department of Veterans Affairs. BACKGROUND: Our study purpose was to assess the predictive validity of reviewer quality ratings and editorial decisions in a general medicine journal. METHODS: Submissions to the Journal of General Internal Medicine (JGIM) between July 2004 and June 2005 were included. We abstracted JGIM peer review quality ratings, verified the publication status of all articles and calculated an impact factor for published articles (Rw) by dividing the 3-year citation rate by the average for this group of papers; an Rw>1 indicates a greater than average impact. RESULTS: Of 507 submissions, 128 (25%) were published in JGIM, 331 rejected (128 with review) and 48 were either not resubmitted after revision was requested or were withdrawn by the author. Of 331 rejections, 243 were published elsewhere. Articles published in JGIM had a higher citation rate than those published elsewhere (Rw: 1.6 vs. 1.1, p = 0.002). Reviewer quality ratings of article quality had good internal consistency and reviewer recommendations markedly influenced publication decisions. There was no quality rating cutpoint that accurately distinguished high from low impact articles. There was a stepwise increase in Rw for articles rejected without review, rejected after review or accepted by JGIM (Rw 0.60 vs. 0.87 vs. 1.56, p<0.0005). However, there was low agreement between reviewers for quality ratings and publication recommendations. The editorial publication decision accurately discriminated high and low impact articles in 68% of submissions. We found evidence of better accuracy with a greater number of reviewers. CONCLUSIONS: The peer review process largely succeeds in selecting high impact articles and dispatching lower impact ones, but the process is far from perfect. While the inter-rater reliability between individual reviewers is low, the accuracy of sorting is improved with a greater number of reviewers.

Endoscopic retrograde cholangiopancreatography-induced severe acute pancreatitis.

BACKGROUND/AIMS: There is scant information in the literature about the outcomes of endoscopic retrograde cholangiopancreatography (ERCP)-induced severe acute pancreatitis (ESAP). Compared to other causes, higher morbidity and mortality have been reported in ERCP-induced acute pancreatitis. We undertook this study to determine the differences between ESAP and SAP due to other causes (OSAP). METHODS: We retrospectively identified all cases of SAP admitted to our institution during the years 1992-2001. We reviewed the medical records of all SAP patients to obtain information on demographics, interventions, local and systemic complications and outcomes. RESULTS: We identified 207 patients with SAP, of whom 16 (7.7%) had ESAP and 191 OSAP. There was no difference between ESAP and OSAP with regard to demographics, clinical interventions, local and systemic complications and outcomes. Both groups had a similar mortality (25 vs. 18%). CONCLUSION: ESAP has a similar morbidity and mortality compared to OSAP.