Inter-and intrarater agreement of Computed Tomographic brain calcification scoring in Primary Familial Brain Calcification.

BACKGROUND AND PURPOSE: The Total Calcification Score (TCS) is a visual rating scale to measure Primary Familial Brain Calcification (PFBC) related calcification severity on Computed Tomography (CT). We investigated the inter-and intrarater agreement of a modified TCS. MATERIALS AND METHODS: Patients aged ≥18 years with PFBC or Fahr's syndrome who visited the outpatient clinic of a Dutch academic hospital were included. The TCS was modified, for example by adding hippocampal calcification, and ranged from 0 to 95 points. Fifteen raters evaluated all CTs, of whom three evaluated the CTs twice. Their Entrustable Professional Activity (EPA) level ranged from II (medical student) to V (neuroradiologist). Agreement was assessed using the intraclass correlation coefficient (ICC) for the total score. Kendall's W and weighted Cohen's Kappa were used to determine the inter- and intrarater agreement for individual locations, respectively. RESULTS: Forty patients were included (mean age 60 years, 53% female). The median modified TCS was 34 (range 4-76). For all EPA levels, the interrater agreement of the modified TCS was excellent (ICC=0.97 (95% CI 0.95-0.98)). Kendall's W's were good to excellent for commonly affected locations, but poor to moderate for less commonly affected locations for raters with lower levels of expertise. The intrarater agreement of the modified TCS was excellent. Kappa's of most locations were substantial to almost perfect. CONCLUSIONS: The modified TCS can be used with excellent reproducibility of the overall amount of brain calcifications and with limited training, although for some individual calcification locations more expertise is needed. ABBREVIATIONS: CI, Confidence Interval; CT, Computed Tomography; EPA, Entrustable Professional Activity; IBGC, Idiopathic Basal Ganglia Calcification; ICC, Intraclass Correlation Coefficient; IQR, Interquartile Range; PFBC, Primary Familial Brain Calcification; SD, Standard Deviation, TCS, Total Calcification Score; UMCU, University Medical Center Utrecht.

The effects of gaze-display feedback on medical students' self-monitoring and learning in radiology.

Self-monitoring is essential for effectively regulating learning, but difficult in visual diagnostic tasks such as radiograph interpretation. Eye-tracking technology can visualize viewing behavior in gaze displays, thereby providing information about visual search and decision-making. We hypothesized that individually adaptive gaze-display feedback improves posttest performance and self-monitoring of medical students who learn to detect nodules in radiographs. We investigated the effects of: (1) Search displays, showing which part of the image was searched by the participant; and (2) Decision displays, showing which parts of the image received prolonged attention in 78 medical students. After a pretest and instruction, participants practiced identifying nodules in 16 cases under search-display, decision-display, or no feedback conditions (n = 26 per condition). A 10-case posttest, without feedback, was administered to assess learning outcomes. After each case, participants provided self-monitoring and confidence judgments. Afterward, participants reported on self-efficacy, perceived competence, feedback use, and perceived usefulness of the feedback. Bayesian analyses showed no benefits of gaze displays for post-test performance, monitoring accuracy (absolute difference between participants' estimated and their actual test performance), completeness of viewing behavior, self-efficacy, and perceived competence. Participants receiving search-displays reported greater feedback utilization than participants receiving decision-displays, and also found the feedback more useful when the gaze data displayed was precise and accurate. As the completeness of search was not related to posttest performance, search displays might not have been sufficiently informative to improve self-monitoring. Information from decision displays was rarely used to inform self-monitoring. Further research should address if and when gaze displays can support learning.

Expertise development in volumetric image interpretation of radiology residents: what do longitudinal scroll data reveal?

The current study used theories on expertise development (the holistic model of image perception and the information reduction hypothesis) as a starting point to identify and explore potentially relevant process measures to monitor and evaluate expertise development in radiology residency training. It is the first to examine expertise development in volumetric image interpretation (i.e., CT scans) within radiology residents using scroll data collected longitudinally over five years of residency training. Consistent with the holistic model of image perception, the percentage of time spent on full runs, i.e. scrolling through more than 50% of the CT-scan slices (global search), decreased within residents over residency training years. Furthermore, the percentage of time spent on question-relevant areas in the CT scans increased within residents over residency training years, consistent with the information reduction hypothesis. Second, we examined if scroll patterns can predict diagnostic accuracy. The percentage of time spent on full runs and the percentage of time spent on question-relevant areas did not predict diagnostic accuracy. Thus, although scroll patterns over training years are consistent with visual expertise theories, they could not be used as predictors of diagnostic accuracy in the current study. Therefore, the relation between scroll patterns and performance needs to be further examined, before process measures can be used to monitor and evaluate expertise development in radiology residency training.

Determinants of Difficulty and Discriminating Power of Image-based Test Items in Postgraduate Radiological Examinations.

RATIONALE AND OBJECTIVES: The psychometric characteristics of image-based test items in radiological written examinations are not well known. In this study, we explored difficulty and discriminating power of these test items in postgraduate radiological digital examinations. MATERIALS AND METHODS: We reviewed test items of seven Dutch Radiology Progress Tests (DRPTs) that were taken from October 2013 to April 2017. The DRPT is a semiannual formative examination, required for all Dutch radiology residents. We assessed several stimulus and response characteristics of test items. The response format of test items included true or false, single right multiple choice with 2, 3, 4, or ≥5 answer options, pick-N multiple-choice, drag-and-drop, and long-list-menu formats. We calculated item P values and item-rest-correlation (Rir) values to assess difficulty and discriminating power. We performed linear regression analysis in image-based test items to investigate whether P and Rir values were significantly related to stimulus and response characteristics. Also, we compared psychometric indices between image-based test items and text-alone items. RESULTS: P and Rir values of image-based items (n = 369) were significantly related to the type of response format (P < .001), and not to which of the seven DRPTs the item was obtained from, radiological subspecialty domain, nonvolumetric or volumetric character of images, or context-rich or context-free character of the stimulus. When accounted for type of response format, difficulty and discriminating power of image-based items did not differ significantly from text-alone items (n = 881). Test items with a relatively large number of answer options were generally more difficult, and discriminated better among high- and low-performing candidates. CONCLUSION: In postgraduate radiological written examinations, difficulty and discriminating power of image-based test items are related to the type of response format and are comparable to those of text-alone items. We recommend a response format with a relatively large number of answer options to optimize psychometric indices of radiological image-based test items.

Brachial plexus magnetic resonance imaging differentiates between inflammatory neuropathies and does not predict disease course.

OBJECTIVE: The main objective of this study was to evaluate the correlation between the distribution of brachial plexus magnetic resonance imaging (MRI) abnormalities and clinical weakness, and to evaluate the value of brachial plexus MRI in predicting disease course and response to treatment in multifocal motor neuropathy (MMN), Lewis-Sumner syndrome (LSS) and chronic inflammatory demyelinating polyradiculoneuropathy (CIDP). METHODS: Sixty-seven patients with an inflammatory neuropathy diagnosed at our tertiary referral center for neuromuscular diseases had undergone bilateral T2-weighted short tau inversion recovery (STIR) MRI of the brachial plexus. We obtained clinical follow-up data and scored all MRIs for abnormalities and the symmetry of their distribution. RESULTS: Brachial plexus MRI abnormalities were detected in 45% of the patients. An abnormal MRI did not predict disease course in terms of patterns of weakness, sensory disturbances or response to treatment. Within the spectrum of radiological abnormalities, asymmetrical clinical syndromes, MMN and LSS were significantly associated with asymmetrical radiological abnormalities, whereas symmetrical abnormalities predominated in CIDP (p < .001, phi 0.791). CONCLUSION: T2 STIR brachial plexus MRI abnormalities correspond with the distribution of neurological deficits in inflammatory neuropathies, but do not correlate with specific clinical characteristics, response to treatment or disease course.

Predictors of Knowledge and Image Interpretation Skill Development in Radiology Residents.

Purpose To investigate knowledge and image interpretation skill development in residency by studying scores on knowledge and image questions on radiology tests, mediated by the training environment. Materials and Methods Ethical approval for the study was obtained from the ethical review board of the Netherlands Association for Medical Education. Longitudinal test data of 577 of 2884 radiology residents who took semiannual progress tests during 5 years were retrospectively analyzed by using a nonlinear mixed-effects model taking training length as input variable. Tests included nonimage and image questions that assessed knowledge and image interpretation skill. Hypothesized predictors were hospital type (academic or nonacademic), training hospital, enrollment age, sex, and test date. Results Scores showed a curvilinear growth during residency. Image scores increased faster during the first 3 years of residency and reached a higher maximum than knowledge scores (55.8% vs 45.1%). The slope of image score development versus knowledge question scores of 1st-year residents was 16.8% versus 12.4%, respectively. Training hospital environment appeared to be an important predictor in both knowledge and image interpretation skill development (maximum score difference between training hospitals was 23.2%; P < .001). Conclusion Expertise developed rapidly in the initial years of radiology residency and leveled off in the 3rd and 4th training year. The shape of the curve was mainly influenced by the specific training hospital. © RSNA, 2017 Online supplemental material is available for this article.

Internal carotid artery occlusion assessed at pulsed arterial spin-labeling perfusion MR imaging at multiple delay times.

Magnetic resonance (MR) imaging with pulsed arterial spin labeling (ASL) was performed at six different inversion times in nine patients with internal carotid artery (ICA) occlusion and in 11 control subjects. The hospital's commission on scientific research on human subjects approved the study protocol, and all study subjects gave informed consent. Cerebral blood flow (CBF) in the middle cerebral artery territories was calculated from the combined signal intensities measured with ASL at the multiple inversion times. In the patients with ICA occlusion, mean CBF values were decreased in the gray matter of the hemisphere ipsilateral to the occlusion, as compared with values in the gray matter of the contralateral hemisphere (P < .05) and with values in the gray matter of the control subjects (P < .05). Quantification of CBF with ASL at multiple inversion times can compensate for the blood transit delays in patients with ICA occlusion.

Effect of carotid endarterectomy on primary collateral blood flow in patients with severe carotid artery lesions.

BACKGROUND AND PURPOSE: In patients with severe obstruction of the internal carotid artery (ICA), it is recognized that the preoperative failure to visualize collaterals of the circle of Willis increases the risk of hemispheric ischemia before, during, and after carotid endarterectomy (CEA). The purpose of the present study was to assess the effect of CEA on the anatomy and function of the circle of Willis. METHODS: Time-of-flight and phase-contrast MR angiography were used to study changes in vessel diameter and collateral flow of the circle of Willis in 48 patients with 70% to 99% ICA stenosis before and after CEA. RESULTS: In patients with unilateral ICA stenosis, all preoperative vessel diameters on both sides of the circle of Willis were larger than in control subjects. All demonstrated a significant diameter decrease to reach normal values after CEA. Furthermore, preoperative collateral flow patterns normalized after CEA (P=0.03). In patients with stenosis and contralateral ICA occlusion, CEA resulted in a significant increase in the prevalence of collateral flow via the anterior communicating artery (33% to 83%, P<0.01) and a significant increase in diameter of both A1 segments (P<0.05) in patients in whom collateral flow developed after CEA. CONCLUSIONS: CEA reduces the caliber of compensatory collateral channels to normal levels by MR angiography measurements in the presence of severe unilateral stenosis; when the opposite side is occluded and the stenosis is removed ipsilaterally, a greater amount of compensatory collateral circulation can be measured on both the occluded side and the fully opened side.

Proximal and distal hyperattenuating middle cerebral artery signs at CT: different prognostic implications.

PURPOSE: To determine whether a proximal (M1-segment) or distal (M2- and/or M3-segment) hyperattenuating middle cerebral artery (MCA) sign in patients with ischemic infarction in the territory of the MCA indicates a worse short-term prognosis than that in patients without a hyperattenuating MCA sign. MATERIALS AND METHODS: We retrospectively reviewed the records of 352 patients who were diagnosed with ischemic brain infarction in the territory of the MCA. Of these patients, 186 patients met our final criteria and were included in this study. Nonenhanced computed tomography (CT) was performed for the entire brain, with a 5-mm section thickness in all patients, within 24 hours after symptom onset. The presence and location of a hyperattenuating MCA sign was correlated with neurologic deficit at discharge from the hospital (ie, short-term prognosis) by using the chi(2) test to detect differences between patient groups. RESULTS: Patients with a hyperattenuating MCA sign at CT have a worse short-term prognosis than do patients without a hyperattenuating MCA sign (P <.05). Patients with a proximal hyperattenuating MCA sign have a significantly (P <.01) worse short-term prognosis than do patients with a distal hyperattenuating MCA sign. CONCLUSION: A proximal hyperattenuating MCA sign is a reliable predictor of poor short-term prognosis in patients who experience acute stroke.