Effect of Training on Visual Identification of High Frequency Oscillations-A Delphi-Style Intervention.

OBJECTIVE: We examined the effect of a simple Delphi-method feedback on visual identification of high frequency oscillations (HFOs) in the ripple (80-250 Hz) band, and assessed the impact of this training intervention on the interrater reliability and generalizability of HFO evaluations. METHODS: We employed a morphology detector to identify potential HFOs at two thresholds and presented them to visual reviewers to assess the probability of each epoch containing an HFO. We recruited 19 board-certified epileptologists with various levels of experience to complete a series of HFO evaluations during three sessions. A Delphi-style intervention was used to provide feedback on the performance of each reviewer relative to their peers. A delayed-intervention paradigm was used, in which reviewers received feedback either before or after the second session. ANOVAs were used to assess the effect of the intervention on the reviewers' evaluations. Generalizability theory was used to assess the interrater reliability before and after the intervention. RESULTS: The intervention, regardless of when it occurred, resulted in a significant reduction in the variability between reviewers in both groups (p GroupDI = 0.037, p GroupEI = 0.003). Prior to the delayed-intervention, the group receiving the early intervention showed a significant reduction in variability (p GroupEI = 0.041), but the delayed-intervention group did not (p GroupDI = 0.414). Following the intervention, the projected number of reviewers required to achieve strong generalizability decreased from 35 to 16. SIGNIFICANCE: This study shows a robust effect of a Delphi-style intervention on the interrater variability, reliability, and generalizability of HFO evaluations. The observed decreases in HFO marking discrepancies across 14 of the 15 reviewers are encouraging: they are necessarily associated with an increase in interrater reliability, and therefore with a corresponding decrease in the number of reviewers required to achieve strong generalizability. Indeed, the reliability of all reviewers following the intervention was similar to that of experienced reviewers prior to intervention. Therefore, a Delphi-style intervention could be implemented either to sufficiently train any reviewer, or to further refine the interrater reliability of experienced reviewers. In either case, a Delphi-style intervention would help facilitate the standardization of HFO evaluations and its implementation in clinical care.

Disseminated intravascular coagulation from disseminated histoplasmosis in uncontrolled HIV - Case report.

This case report describes an atypical presentation of a relatively common opportunistic infection, without documented exposure to areas known at the time to be endemic, resulting in catastrophic complications. The patient presented with a two month progressive history of vomiting, diarrhea, productive cough, and shortness of breath, on the background of poorly-controlled HIV. There was a low index of suspicion for infection with histoplasmosis, particularly given the large differential diagnosis and the lack of travel or endemic precedence. The case was complicated by the development of disseminated intravascular coagulation (DIC) prior to identification of the pathogen. Ultimately, the patient's goals of care transitioned to palliation, and treatments were discontinued. It is our hope that in the future, such outcomes might be prevented by considering disseminated histoplasmosis in systemically unwell patients with HIV, regardless of endemic exposure or specific presentation.

Graph index complexity as a novel surrogate marker of high frequency oscillations in delineating the seizure onset zone.

OBJECTIVE: To investigate the Graph Index Complexity (uGIC) as a marker of high frequency oscillatory (HFO) activity, the seizure onset zone (SOZ), and surgical outcome. METHODS: The SOZ, rates of HFOs at two thresholds (broad, strict), and uGIC were determined using EEG data from 41 patients. The correlation between HFOs and uGIC were calculated. HFOs and uGIC were compared within and outside the SOZ. Postsurgical outcome was compared to the colocalization of HFOs and resected SOZ. RESULTS: There was significant correlation between uGIC and both broad (r = 0.69, p < 0.0005) and strict HFOs (r = 0.48, p < 0.0005). All were significantly greater within the SOZ overall, but only in 17/41 (strict, uGIC) or 18/41 (broad) patients. HFO markers were significantly greater within the SOZ for 8/15 patients with positive postsurgical outcomes, but not for any patients with negative outcomes (0/5). CONCLUSION: The uGIC is a marker of HFO activity, while HFOs and uGIC are markers of the SOZ overall. Colocalization of HFOs and the SOZ has strong positive predictive value for postsurgical outcome, but poor negative predictive value. SIGNIFICANCE: The uGIC is an objective surrogate marker of HFO activity independent of identifying discrete HFO events.

Generalizability of High Frequency Oscillation Evaluations in the Ripple Band.

Objective: We examined the interrater reliability and generalizability of high-frequency oscillation (HFO) visual evaluations in the ripple (80-250 Hz) band, and established a framework for the transition of HFO analysis to routine clinical care. We were interested in the interrater reliability or epoch generalizability to describe how similar the evaluations were between reviewers, and in the reviewer generalizability to represent the consistency of the internal threshold each individual reviewer. Methods: We studied 41 adult epilepsy patients (mean age: 35.6 years) who underwent intracranial electroencephalography. A morphology detector was designed and used to detect candidate HFO events, lower-threshold events, and distractor events. These events were subsequently presented to six expert reviewers, who visually evaluated events for the presence of HFOs. Generalizability theory was used to characterize the epoch generalizability (interrater reliability) and reviewer generalizability (internal threshold consistency) of visual evaluations, as well as to project the numbers of epochs, reviewers, and datasets required to achieve strong generalizability (threshold of 0.8). Results: The reviewer generalizability was almost perfect (0.983), indicating there were sufficient evaluations to determine the internal threshold of each reviewer. However, the interrater reliability for 6 reviewers (0.588) and pairwise interrater reliability (0.322) were both poor, indicating that the agreement of 6 reviewers is insufficient to reliably establish the presence or absence of individual HFOs. Strong interrater reliability (≥0.8) was projected as requiring a minimum of 17 reviewers, while strong reviewer generalizability could be achieved with <30 epoch evaluations per reviewer. Significance: This study reaffirms the poor reliability of using small numbers of reviewers to identify HFOs, and projects the number of reviewers required to overcome this limitation. It also provides a set of tools which may be used for training reviewers, tracking changes to interrater reliability, and for constructing a benchmark set of epochs that can serve as a generalizable gold standard, against which other HFO detection algorithms may be compared. This study represents an important step toward the reconciliation of important but discordant findings from HFO studies undertaken with different sets of HFOs, and ultimately toward transitioning HFO analysis into a meaningful part of the clinical epilepsy workup.

Interrater reliability of visually evaluated high frequency oscillations.

OBJECTIVE: High frequency oscillations (HFOs) and interictal epileptiform discharges (IEDs) have been shown to be markers of epileptogenic regions. However, there is currently no 'gold standard' for identifying HFOs. Accordingly, we aimed to formally characterize the interrater reliability of HFO markings to validate the current practices. METHODS: A morphology detector was implemented to detect events (candidate HFOs, lower-threshold events, and distractors) from the intracranial EEG (iEEG) of ten patients. Six electroencephalographers visually evaluated these events for the presence of HFOs and IEDs. Interrater reliability was calculated using pairwise Cohen's Kappa (κ) and intraclass correlation coefficients (ICC). RESULTS: The HFO evaluation distributions were significantly different for most pairs of reviewers (p<0.05; 11/15 pairs). Interrater reliability was poor for HFOs alone (κmean=0.403; ICC=0.401) and HFO+IEDs (κmean=0.568; ICC=0.570). CONCLUSIONS: The current practice of using two visual reviewers to identify HFOs is prone to bias arising from the poor agreement between reviewers, limiting the extrinsic validity of studies using these markers. SIGNIFICANCE: The poor interrater reliability underlines the need for a framework to reconcile the important findings of existing studies. The present epoched design is an ideal candidate for the implementation of such a framework.