The effects of gaze-display feedback on medical students' self-monitoring and learning in radiology.

Self-monitoring is essential for effectively regulating learning, but difficult in visual diagnostic tasks such as radiograph interpretation. Eye-tracking technology can visualize viewing behavior in gaze displays, thereby providing information about visual search and decision-making. We hypothesized that individually adaptive gaze-display feedback improves posttest performance and self-monitoring of medical students who learn to detect nodules in radiographs. We investigated the effects of: (1) Search displays, showing which part of the image was searched by the participant; and (2) Decision displays, showing which parts of the image received prolonged attention in 78 medical students. After a pretest and instruction, participants practiced identifying nodules in 16 cases under search-display, decision-display, or no feedback conditions (n = 26 per condition). A 10-case posttest, without feedback, was administered to assess learning outcomes. After each case, participants provided self-monitoring and confidence judgments. Afterward, participants reported on self-efficacy, perceived competence, feedback use, and perceived usefulness of the feedback. Bayesian analyses showed no benefits of gaze displays for post-test performance, monitoring accuracy (absolute difference between participants' estimated and their actual test performance), completeness of viewing behavior, self-efficacy, and perceived competence. Participants receiving search-displays reported greater feedback utilization than participants receiving decision-displays, and also found the feedback more useful when the gaze data displayed was precise and accurate. As the completeness of search was not related to posttest performance, search displays might not have been sufficiently informative to improve self-monitoring. Information from decision displays was rarely used to inform self-monitoring. Further research should address if and when gaze displays can support learning.

Predictors of Knowledge and Image Interpretation Skill Development in Radiology Residents.

Purpose To investigate knowledge and image interpretation skill development in residency by studying scores on knowledge and image questions on radiology tests, mediated by the training environment. Materials and Methods Ethical approval for the study was obtained from the ethical review board of the Netherlands Association for Medical Education. Longitudinal test data of 577 of 2884 radiology residents who took semiannual progress tests during 5 years were retrospectively analyzed by using a nonlinear mixed-effects model taking training length as input variable. Tests included nonimage and image questions that assessed knowledge and image interpretation skill. Hypothesized predictors were hospital type (academic or nonacademic), training hospital, enrollment age, sex, and test date. Results Scores showed a curvilinear growth during residency. Image scores increased faster during the first 3 years of residency and reached a higher maximum than knowledge scores (55.8% vs 45.1%). The slope of image score development versus knowledge question scores of 1st-year residents was 16.8% versus 12.4%, respectively. Training hospital environment appeared to be an important predictor in both knowledge and image interpretation skill development (maximum score difference between training hospitals was 23.2%; P < .001). Conclusion Expertise developed rapidly in the initial years of radiology residency and leveled off in the 3rd and 4th training year. The shape of the curve was mainly influenced by the specific training hospital. © RSNA, 2017 Online supplemental material is available for this article.

Determinants of Difficulty and Discriminating Power of Image-based Test Items in Postgraduate Radiological Examinations.

RATIONALE AND OBJECTIVES: The psychometric characteristics of image-based test items in radiological written examinations are not well known. In this study, we explored difficulty and discriminating power of these test items in postgraduate radiological digital examinations. MATERIALS AND METHODS: We reviewed test items of seven Dutch Radiology Progress Tests (DRPTs) that were taken from October 2013 to April 2017. The DRPT is a semiannual formative examination, required for all Dutch radiology residents. We assessed several stimulus and response characteristics of test items. The response format of test items included true or false, single right multiple choice with 2, 3, 4, or ≥5 answer options, pick-N multiple-choice, drag-and-drop, and long-list-menu formats. We calculated item P values and item-rest-correlation (Rir) values to assess difficulty and discriminating power. We performed linear regression analysis in image-based test items to investigate whether P and Rir values were significantly related to stimulus and response characteristics. Also, we compared psychometric indices between image-based test items and text-alone items. RESULTS: P and Rir values of image-based items (n = 369) were significantly related to the type of response format (P < .001), and not to which of the seven DRPTs the item was obtained from, radiological subspecialty domain, nonvolumetric or volumetric character of images, or context-rich or context-free character of the stimulus. When accounted for type of response format, difficulty and discriminating power of image-based items did not differ significantly from text-alone items (n = 881). Test items with a relatively large number of answer options were generally more difficult, and discriminated better among high- and low-performing candidates. CONCLUSION: In postgraduate radiological written examinations, difficulty and discriminating power of image-based test items are related to the type of response format and are comparable to those of text-alone items. We recommend a response format with a relatively large number of answer options to optimize psychometric indices of radiological image-based test items.

Effect of carotid endarterectomy on primary collateral blood flow in patients with severe carotid artery lesions.

BACKGROUND AND PURPOSE: In patients with severe obstruction of the internal carotid artery (ICA), it is recognized that the preoperative failure to visualize collaterals of the circle of Willis increases the risk of hemispheric ischemia before, during, and after carotid endarterectomy (CEA). The purpose of the present study was to assess the effect of CEA on the anatomy and function of the circle of Willis. METHODS: Time-of-flight and phase-contrast MR angiography were used to study changes in vessel diameter and collateral flow of the circle of Willis in 48 patients with 70% to 99% ICA stenosis before and after CEA. RESULTS: In patients with unilateral ICA stenosis, all preoperative vessel diameters on both sides of the circle of Willis were larger than in control subjects. All demonstrated a significant diameter decrease to reach normal values after CEA. Furthermore, preoperative collateral flow patterns normalized after CEA (P=0.03). In patients with stenosis and contralateral ICA occlusion, CEA resulted in a significant increase in the prevalence of collateral flow via the anterior communicating artery (33% to 83%, P<0.01) and a significant increase in diameter of both A1 segments (P<0.05) in patients in whom collateral flow developed after CEA. CONCLUSIONS: CEA reduces the caliber of compensatory collateral channels to normal levels by MR angiography measurements in the presence of severe unilateral stenosis; when the opposite side is occluded and the stenosis is removed ipsilaterally, a greater amount of compensatory collateral circulation can be measured on both the occluded side and the fully opened side.

Proximal and distal hyperattenuating middle cerebral artery signs at CT: different prognostic implications.

PURPOSE: To determine whether a proximal (M1-segment) or distal (M2- and/or M3-segment) hyperattenuating middle cerebral artery (MCA) sign in patients with ischemic infarction in the territory of the MCA indicates a worse short-term prognosis than that in patients without a hyperattenuating MCA sign. MATERIALS AND METHODS: We retrospectively reviewed the records of 352 patients who were diagnosed with ischemic brain infarction in the territory of the MCA. Of these patients, 186 patients met our final criteria and were included in this study. Nonenhanced computed tomography (CT) was performed for the entire brain, with a 5-mm section thickness in all patients, within 24 hours after symptom onset. The presence and location of a hyperattenuating MCA sign was correlated with neurologic deficit at discharge from the hospital (ie, short-term prognosis) by using the chi(2) test to detect differences between patient groups. RESULTS: Patients with a hyperattenuating MCA sign at CT have a worse short-term prognosis than do patients without a hyperattenuating MCA sign (P <.05). Patients with a proximal hyperattenuating MCA sign have a significantly (P <.01) worse short-term prognosis than do patients with a distal hyperattenuating MCA sign. CONCLUSION: A proximal hyperattenuating MCA sign is a reliable predictor of poor short-term prognosis in patients who experience acute stroke.

Internal carotid artery occlusion assessed at pulsed arterial spin-labeling perfusion MR imaging at multiple delay times.

Magnetic resonance (MR) imaging with pulsed arterial spin labeling (ASL) was performed at six different inversion times in nine patients with internal carotid artery (ICA) occlusion and in 11 control subjects. The hospital's commission on scientific research on human subjects approved the study protocol, and all study subjects gave informed consent. Cerebral blood flow (CBF) in the middle cerebral artery territories was calculated from the combined signal intensities measured with ASL at the multiple inversion times. In the patients with ICA occlusion, mean CBF values were decreased in the gray matter of the hemisphere ipsilateral to the occlusion, as compared with values in the gray matter of the contralateral hemisphere (P < .05) and with values in the gray matter of the control subjects (P < .05). Quantification of CBF with ASL at multiple inversion times can compensate for the blood transit delays in patients with ICA occlusion.