Your browser doesn't support javascript.
loading
Interrater Reliability of Expert Electroencephalographers Identifying Seizures and Rhythmic and Periodic Patterns in EEGs.
Jing, Jin; Ge, Wendong; Struck, Aaron F; Fernandes, Marta Bento; Hong, Shenda; An, Sungtae; Fatima, Safoora; Herlopian, Aline; Karakis, Ioannis; Halford, Jonathan J; Ng, Marcus C; Johnson, Emily L; Appavu, Brian L; Sarkis, Rani A; Osman, Gamaleldin; Kaplan, Peter W; Dhakar, Monica B; Jayagopal, Lakshman Arcot; Sheikh, Zubeda; Taraschenko, Olga; Schmitt, Sarah; Haider, Hiba A; Kim, Jennifer A; Swisher, Christa B; Gaspard, Nicolas; Cervenka, Mackenzie C; Rodriguez Ruiz, Andres A; Lee, Jong Woo; Tabaeizadeh, Mohammad; Gilmore, Emily J; Nordstrom, Kristy; Yoo, Ji Yeoun; Holmes, Manisha G; Herman, Susan T; Williams, Jennifer A; Pathmanathan, Jay; Nascimento, Fábio A; Fan, Ziwei; Nasiri, Samaneh; Shafi, Mouhsin M; Cash, Sydney S; Hoch, Daniel B; Cole, Andrew J; Rosenthal, Eric S; Zafar, Sahar F; Sun, Jimeng; Westover, M Brandon.
Afiliação
  • Jing J; From the Massachusetts General Hospital/Harvard Medical School Department of Neurology (J.J., W.G., M.B.F., S.S.C., A.J.C., D.B.H., E.S.R., S.F.Z., M.B.W.), MA; Massachusetts General Hospital Clinical Data Animation Center (CDAC) (J.J., W.G., M.B.F., S.S.C., D.B.H., A.J.C., E.S.R., S.F.Z., M.B.W.),
  • Ge W; From the Massachusetts General Hospital/Harvard Medical School Department of Neurology (J.J., W.G., M.B.F., S.S.C., A.J.C., D.B.H., E.S.R., S.F.Z., M.B.W.), MA; Massachusetts General Hospital Clinical Data Animation Center (CDAC) (J.J., W.G., M.B.F., S.S.C., D.B.H., A.J.C., E.S.R., S.F.Z., M.B.W.),
  • Struck AF; From the Massachusetts General Hospital/Harvard Medical School Department of Neurology (J.J., W.G., M.B.F., S.S.C., A.J.C., D.B.H., E.S.R., S.F.Z., M.B.W.), MA; Massachusetts General Hospital Clinical Data Animation Center (CDAC) (J.J., W.G., M.B.F., S.S.C., D.B.H., A.J.C., E.S.R., S.F.Z., M.B.W.),
  • Fernandes MB; From the Massachusetts General Hospital/Harvard Medical School Department of Neurology (J.J., W.G., M.B.F., S.S.C., A.J.C., D.B.H., E.S.R., S.F.Z., M.B.W.), MA; Massachusetts General Hospital Clinical Data Animation Center (CDAC) (J.J., W.G., M.B.F., S.S.C., D.B.H., A.J.C., E.S.R., S.F.Z., M.B.W.),
  • Hong S; From the Massachusetts General Hospital/Harvard Medical School Department of Neurology (J.J., W.G., M.B.F., S.S.C., A.J.C., D.B.H., E.S.R., S.F.Z., M.B.W.), MA; Massachusetts General Hospital Clinical Data Animation Center (CDAC) (J.J., W.G., M.B.F., S.S.C., D.B.H., A.J.C., E.S.R., S.F.Z., M.B.W.),
  • An S; From the Massachusetts General Hospital/Harvard Medical School Department of Neurology (J.J., W.G., M.B.F., S.S.C., A.J.C., D.B.H., E.S.R., S.F.Z., M.B.W.), MA; Massachusetts General Hospital Clinical Data Animation Center (CDAC) (J.J., W.G., M.B.F., S.S.C., D.B.H., A.J.C., E.S.R., S.F.Z., M.B.W.),
  • Fatima S; From the Massachusetts General Hospital/Harvard Medical School Department of Neurology (J.J., W.G., M.B.F., S.S.C., A.J.C., D.B.H., E.S.R., S.F.Z., M.B.W.), MA; Massachusetts General Hospital Clinical Data Animation Center (CDAC) (J.J., W.G., M.B.F., S.S.C., D.B.H., A.J.C., E.S.R., S.F.Z., M.B.W.),
  • Herlopian A; From the Massachusetts General Hospital/Harvard Medical School Department of Neurology (J.J., W.G., M.B.F., S.S.C., A.J.C., D.B.H., E.S.R., S.F.Z., M.B.W.), MA; Massachusetts General Hospital Clinical Data Animation Center (CDAC) (J.J., W.G., M.B.F., S.S.C., D.B.H., A.J.C., E.S.R., S.F.Z., M.B.W.),
  • Karakis I; From the Massachusetts General Hospital/Harvard Medical School Department of Neurology (J.J., W.G., M.B.F., S.S.C., A.J.C., D.B.H., E.S.R., S.F.Z., M.B.W.), MA; Massachusetts General Hospital Clinical Data Animation Center (CDAC) (J.J., W.G., M.B.F., S.S.C., D.B.H., A.J.C., E.S.R., S.F.Z., M.B.W.),
  • Halford JJ; From the Massachusetts General Hospital/Harvard Medical School Department of Neurology (J.J., W.G., M.B.F., S.S.C., A.J.C., D.B.H., E.S.R., S.F.Z., M.B.W.), MA; Massachusetts General Hospital Clinical Data Animation Center (CDAC) (J.J., W.G., M.B.F., S.S.C., D.B.H., A.J.C., E.S.R., S.F.Z., M.B.W.),
  • Ng MC; From the Massachusetts General Hospital/Harvard Medical School Department of Neurology (J.J., W.G., M.B.F., S.S.C., A.J.C., D.B.H., E.S.R., S.F.Z., M.B.W.), MA; Massachusetts General Hospital Clinical Data Animation Center (CDAC) (J.J., W.G., M.B.F., S.S.C., D.B.H., A.J.C., E.S.R., S.F.Z., M.B.W.),
  • Johnson EL; From the Massachusetts General Hospital/Harvard Medical School Department of Neurology (J.J., W.G., M.B.F., S.S.C., A.J.C., D.B.H., E.S.R., S.F.Z., M.B.W.), MA; Massachusetts General Hospital Clinical Data Animation Center (CDAC) (J.J., W.G., M.B.F., S.S.C., D.B.H., A.J.C., E.S.R., S.F.Z., M.B.W.),
  • Appavu BL; From the Massachusetts General Hospital/Harvard Medical School Department of Neurology (J.J., W.G., M.B.F., S.S.C., A.J.C., D.B.H., E.S.R., S.F.Z., M.B.W.), MA; Massachusetts General Hospital Clinical Data Animation Center (CDAC) (J.J., W.G., M.B.F., S.S.C., D.B.H., A.J.C., E.S.R., S.F.Z., M.B.W.),
  • Sarkis RA; From the Massachusetts General Hospital/Harvard Medical School Department of Neurology (J.J., W.G., M.B.F., S.S.C., A.J.C., D.B.H., E.S.R., S.F.Z., M.B.W.), MA; Massachusetts General Hospital Clinical Data Animation Center (CDAC) (J.J., W.G., M.B.F., S.S.C., D.B.H., A.J.C., E.S.R., S.F.Z., M.B.W.),
  • Osman G; From the Massachusetts General Hospital/Harvard Medical School Department of Neurology (J.J., W.G., M.B.F., S.S.C., A.J.C., D.B.H., E.S.R., S.F.Z., M.B.W.), MA; Massachusetts General Hospital Clinical Data Animation Center (CDAC) (J.J., W.G., M.B.F., S.S.C., D.B.H., A.J.C., E.S.R., S.F.Z., M.B.W.),
  • Kaplan PW; From the Massachusetts General Hospital/Harvard Medical School Department of Neurology (J.J., W.G., M.B.F., S.S.C., A.J.C., D.B.H., E.S.R., S.F.Z., M.B.W.), MA; Massachusetts General Hospital Clinical Data Animation Center (CDAC) (J.J., W.G., M.B.F., S.S.C., D.B.H., A.J.C., E.S.R., S.F.Z., M.B.W.),
  • Dhakar MB; From the Massachusetts General Hospital/Harvard Medical School Department of Neurology (J.J., W.G., M.B.F., S.S.C., A.J.C., D.B.H., E.S.R., S.F.Z., M.B.W.), MA; Massachusetts General Hospital Clinical Data Animation Center (CDAC) (J.J., W.G., M.B.F., S.S.C., D.B.H., A.J.C., E.S.R., S.F.Z., M.B.W.),
  • Jayagopal LA; From the Massachusetts General Hospital/Harvard Medical School Department of Neurology (J.J., W.G., M.B.F., S.S.C., A.J.C., D.B.H., E.S.R., S.F.Z., M.B.W.), MA; Massachusetts General Hospital Clinical Data Animation Center (CDAC) (J.J., W.G., M.B.F., S.S.C., D.B.H., A.J.C., E.S.R., S.F.Z., M.B.W.),
  • Sheikh Z; From the Massachusetts General Hospital/Harvard Medical School Department of Neurology (J.J., W.G., M.B.F., S.S.C., A.J.C., D.B.H., E.S.R., S.F.Z., M.B.W.), MA; Massachusetts General Hospital Clinical Data Animation Center (CDAC) (J.J., W.G., M.B.F., S.S.C., D.B.H., A.J.C., E.S.R., S.F.Z., M.B.W.),
  • Taraschenko O; From the Massachusetts General Hospital/Harvard Medical School Department of Neurology (J.J., W.G., M.B.F., S.S.C., A.J.C., D.B.H., E.S.R., S.F.Z., M.B.W.), MA; Massachusetts General Hospital Clinical Data Animation Center (CDAC) (J.J., W.G., M.B.F., S.S.C., D.B.H., A.J.C., E.S.R., S.F.Z., M.B.W.),
  • Schmitt S; From the Massachusetts General Hospital/Harvard Medical School Department of Neurology (J.J., W.G., M.B.F., S.S.C., A.J.C., D.B.H., E.S.R., S.F.Z., M.B.W.), MA; Massachusetts General Hospital Clinical Data Animation Center (CDAC) (J.J., W.G., M.B.F., S.S.C., D.B.H., A.J.C., E.S.R., S.F.Z., M.B.W.),
  • Haider HA; From the Massachusetts General Hospital/Harvard Medical School Department of Neurology (J.J., W.G., M.B.F., S.S.C., A.J.C., D.B.H., E.S.R., S.F.Z., M.B.W.), MA; Massachusetts General Hospital Clinical Data Animation Center (CDAC) (J.J., W.G., M.B.F., S.S.C., D.B.H., A.J.C., E.S.R., S.F.Z., M.B.W.),
  • Kim JA; From the Massachusetts General Hospital/Harvard Medical School Department of Neurology (J.J., W.G., M.B.F., S.S.C., A.J.C., D.B.H., E.S.R., S.F.Z., M.B.W.), MA; Massachusetts General Hospital Clinical Data Animation Center (CDAC) (J.J., W.G., M.B.F., S.S.C., D.B.H., A.J.C., E.S.R., S.F.Z., M.B.W.),
  • Swisher CB; From the Massachusetts General Hospital/Harvard Medical School Department of Neurology (J.J., W.G., M.B.F., S.S.C., A.J.C., D.B.H., E.S.R., S.F.Z., M.B.W.), MA; Massachusetts General Hospital Clinical Data Animation Center (CDAC) (J.J., W.G., M.B.F., S.S.C., D.B.H., A.J.C., E.S.R., S.F.Z., M.B.W.),
  • Gaspard N; From the Massachusetts General Hospital/Harvard Medical School Department of Neurology (J.J., W.G., M.B.F., S.S.C., A.J.C., D.B.H., E.S.R., S.F.Z., M.B.W.), MA; Massachusetts General Hospital Clinical Data Animation Center (CDAC) (J.J., W.G., M.B.F., S.S.C., D.B.H., A.J.C., E.S.R., S.F.Z., M.B.W.),
  • Cervenka MC; From the Massachusetts General Hospital/Harvard Medical School Department of Neurology (J.J., W.G., M.B.F., S.S.C., A.J.C., D.B.H., E.S.R., S.F.Z., M.B.W.), MA; Massachusetts General Hospital Clinical Data Animation Center (CDAC) (J.J., W.G., M.B.F., S.S.C., D.B.H., A.J.C., E.S.R., S.F.Z., M.B.W.),
  • Rodriguez Ruiz AA; From the Massachusetts General Hospital/Harvard Medical School Department of Neurology (J.J., W.G., M.B.F., S.S.C., A.J.C., D.B.H., E.S.R., S.F.Z., M.B.W.), MA; Massachusetts General Hospital Clinical Data Animation Center (CDAC) (J.J., W.G., M.B.F., S.S.C., D.B.H., A.J.C., E.S.R., S.F.Z., M.B.W.),
  • Lee JW; From the Massachusetts General Hospital/Harvard Medical School Department of Neurology (J.J., W.G., M.B.F., S.S.C., A.J.C., D.B.H., E.S.R., S.F.Z., M.B.W.), MA; Massachusetts General Hospital Clinical Data Animation Center (CDAC) (J.J., W.G., M.B.F., S.S.C., D.B.H., A.J.C., E.S.R., S.F.Z., M.B.W.),
  • Tabaeizadeh M; From the Massachusetts General Hospital/Harvard Medical School Department of Neurology (J.J., W.G., M.B.F., S.S.C., A.J.C., D.B.H., E.S.R., S.F.Z., M.B.W.), MA; Massachusetts General Hospital Clinical Data Animation Center (CDAC) (J.J., W.G., M.B.F., S.S.C., D.B.H., A.J.C., E.S.R., S.F.Z., M.B.W.),
  • Gilmore EJ; From the Massachusetts General Hospital/Harvard Medical School Department of Neurology (J.J., W.G., M.B.F., S.S.C., A.J.C., D.B.H., E.S.R., S.F.Z., M.B.W.), MA; Massachusetts General Hospital Clinical Data Animation Center (CDAC) (J.J., W.G., M.B.F., S.S.C., D.B.H., A.J.C., E.S.R., S.F.Z., M.B.W.),
  • Nordstrom K; From the Massachusetts General Hospital/Harvard Medical School Department of Neurology (J.J., W.G., M.B.F., S.S.C., A.J.C., D.B.H., E.S.R., S.F.Z., M.B.W.), MA; Massachusetts General Hospital Clinical Data Animation Center (CDAC) (J.J., W.G., M.B.F., S.S.C., D.B.H., A.J.C., E.S.R., S.F.Z., M.B.W.),
  • Yoo JY; From the Massachusetts General Hospital/Harvard Medical School Department of Neurology (J.J., W.G., M.B.F., S.S.C., A.J.C., D.B.H., E.S.R., S.F.Z., M.B.W.), MA; Massachusetts General Hospital Clinical Data Animation Center (CDAC) (J.J., W.G., M.B.F., S.S.C., D.B.H., A.J.C., E.S.R., S.F.Z., M.B.W.),
  • Holmes MG; From the Massachusetts General Hospital/Harvard Medical School Department of Neurology (J.J., W.G., M.B.F., S.S.C., A.J.C., D.B.H., E.S.R., S.F.Z., M.B.W.), MA; Massachusetts General Hospital Clinical Data Animation Center (CDAC) (J.J., W.G., M.B.F., S.S.C., D.B.H., A.J.C., E.S.R., S.F.Z., M.B.W.),
  • Herman ST; From the Massachusetts General Hospital/Harvard Medical School Department of Neurology (J.J., W.G., M.B.F., S.S.C., A.J.C., D.B.H., E.S.R., S.F.Z., M.B.W.), MA; Massachusetts General Hospital Clinical Data Animation Center (CDAC) (J.J., W.G., M.B.F., S.S.C., D.B.H., A.J.C., E.S.R., S.F.Z., M.B.W.),
  • Williams JA; From the Massachusetts General Hospital/Harvard Medical School Department of Neurology (J.J., W.G., M.B.F., S.S.C., A.J.C., D.B.H., E.S.R., S.F.Z., M.B.W.), MA; Massachusetts General Hospital Clinical Data Animation Center (CDAC) (J.J., W.G., M.B.F., S.S.C., D.B.H., A.J.C., E.S.R., S.F.Z., M.B.W.),
  • Pathmanathan J; From the Massachusetts General Hospital/Harvard Medical School Department of Neurology (J.J., W.G., M.B.F., S.S.C., A.J.C., D.B.H., E.S.R., S.F.Z., M.B.W.), MA; Massachusetts General Hospital Clinical Data Animation Center (CDAC) (J.J., W.G., M.B.F., S.S.C., D.B.H., A.J.C., E.S.R., S.F.Z., M.B.W.),
  • Nascimento FA; From the Massachusetts General Hospital/Harvard Medical School Department of Neurology (J.J., W.G., M.B.F., S.S.C., A.J.C., D.B.H., E.S.R., S.F.Z., M.B.W.), MA; Massachusetts General Hospital Clinical Data Animation Center (CDAC) (J.J., W.G., M.B.F., S.S.C., D.B.H., A.J.C., E.S.R., S.F.Z., M.B.W.),
  • Fan Z; From the Massachusetts General Hospital/Harvard Medical School Department of Neurology (J.J., W.G., M.B.F., S.S.C., A.J.C., D.B.H., E.S.R., S.F.Z., M.B.W.), MA; Massachusetts General Hospital Clinical Data Animation Center (CDAC) (J.J., W.G., M.B.F., S.S.C., D.B.H., A.J.C., E.S.R., S.F.Z., M.B.W.),
  • Nasiri S; From the Massachusetts General Hospital/Harvard Medical School Department of Neurology (J.J., W.G., M.B.F., S.S.C., A.J.C., D.B.H., E.S.R., S.F.Z., M.B.W.), MA; Massachusetts General Hospital Clinical Data Animation Center (CDAC) (J.J., W.G., M.B.F., S.S.C., D.B.H., A.J.C., E.S.R., S.F.Z., M.B.W.),
  • Shafi MM; From the Massachusetts General Hospital/Harvard Medical School Department of Neurology (J.J., W.G., M.B.F., S.S.C., A.J.C., D.B.H., E.S.R., S.F.Z., M.B.W.), MA; Massachusetts General Hospital Clinical Data Animation Center (CDAC) (J.J., W.G., M.B.F., S.S.C., D.B.H., A.J.C., E.S.R., S.F.Z., M.B.W.),
  • Cash SS; From the Massachusetts General Hospital/Harvard Medical School Department of Neurology (J.J., W.G., M.B.F., S.S.C., A.J.C., D.B.H., E.S.R., S.F.Z., M.B.W.), MA; Massachusetts General Hospital Clinical Data Animation Center (CDAC) (J.J., W.G., M.B.F., S.S.C., D.B.H., A.J.C., E.S.R., S.F.Z., M.B.W.),
  • Hoch DB; From the Massachusetts General Hospital/Harvard Medical School Department of Neurology (J.J., W.G., M.B.F., S.S.C., A.J.C., D.B.H., E.S.R., S.F.Z., M.B.W.), MA; Massachusetts General Hospital Clinical Data Animation Center (CDAC) (J.J., W.G., M.B.F., S.S.C., D.B.H., A.J.C., E.S.R., S.F.Z., M.B.W.),
  • Cole AJ; From the Massachusetts General Hospital/Harvard Medical School Department of Neurology (J.J., W.G., M.B.F., S.S.C., A.J.C., D.B.H., E.S.R., S.F.Z., M.B.W.), MA; Massachusetts General Hospital Clinical Data Animation Center (CDAC) (J.J., W.G., M.B.F., S.S.C., D.B.H., A.J.C., E.S.R., S.F.Z., M.B.W.),
  • Rosenthal ES; From the Massachusetts General Hospital/Harvard Medical School Department of Neurology (J.J., W.G., M.B.F., S.S.C., A.J.C., D.B.H., E.S.R., S.F.Z., M.B.W.), MA; Massachusetts General Hospital Clinical Data Animation Center (CDAC) (J.J., W.G., M.B.F., S.S.C., D.B.H., A.J.C., E.S.R., S.F.Z., M.B.W.),
  • Zafar SF; From the Massachusetts General Hospital/Harvard Medical School Department of Neurology (J.J., W.G., M.B.F., S.S.C., A.J.C., D.B.H., E.S.R., S.F.Z., M.B.W.), MA; Massachusetts General Hospital Clinical Data Animation Center (CDAC) (J.J., W.G., M.B.F., S.S.C., D.B.H., A.J.C., E.S.R., S.F.Z., M.B.W.),
  • Sun J; From the Massachusetts General Hospital/Harvard Medical School Department of Neurology (J.J., W.G., M.B.F., S.S.C., A.J.C., D.B.H., E.S.R., S.F.Z., M.B.W.), MA; Massachusetts General Hospital Clinical Data Animation Center (CDAC) (J.J., W.G., M.B.F., S.S.C., D.B.H., A.J.C., E.S.R., S.F.Z., M.B.W.),
  • Westover MB; From the Massachusetts General Hospital/Harvard Medical School Department of Neurology (J.J., W.G., M.B.F., S.S.C., A.J.C., D.B.H., E.S.R., S.F.Z., M.B.W.), MA; Massachusetts General Hospital Clinical Data Animation Center (CDAC) (J.J., W.G., M.B.F., S.S.C., D.B.H., A.J.C., E.S.R., S.F.Z., M.B.W.),
Neurology ; 100(17): e1737-e1749, 2023 04 25.
Article em En | MEDLINE | ID: mdl-36460472
ABSTRACT
BACKGROUND AND

OBJECTIVES:

The validity of brain monitoring using electroencephalography (EEG), particularly to guide care in patients with acute or critical illness, requires that experts can reliably identify seizures and other potentially harmful rhythmic and periodic brain activity, collectively referred to as "ictal-interictal-injury continuum" (IIIC). Previous interrater reliability (IRR) studies are limited by small samples and selection bias. This study was conducted to assess the reliability of experts in identifying IIIC.

METHODS:

This prospective analysis included 30 experts with subspecialty clinical neurophysiology training from 18 institutions. Experts independently scored varying numbers of ten-second EEG segments as "seizure (SZ)," "lateralized periodic discharges (LPDs)," "generalized periodic discharges (GPDs)," "lateralized rhythmic delta activity (LRDA)," "generalized rhythmic delta activity (GRDA)," or "other." EEGs were performed for clinical indications at Massachusetts General Hospital between 2006 and 2020. Primary outcome measures were pairwise IRR (average percent agreement [PA] between pairs of experts) and majority IRR (average PA with group consensus) for each class and beyond chance agreement (κ). Secondary outcomes were calibration of expert scoring to group consensus, and latent trait analysis to investigate contributions of bias and noise to scoring variability.

RESULTS:

Among 2,711 EEGs, 49% were from women, and the median (IQR) age was 55 (41) years. In total, experts scored 50,697 EEG segments; the median [range] number scored by each expert was 6,287.5 [1,002, 45,267]. Overall pairwise IRR was moderate (PA 52%, κ 42%), and majority IRR was substantial (PA 65%, κ 61%). Noise-bias analysis demonstrated that a single underlying receiver operating curve can account for most variation in experts' false-positive vs true-positive characteristics (median [range] of variance explained ([Formula see text]) 95 [93, 98]%) and for most variation in experts' precision vs sensitivity characteristics ([Formula see text] 75 [59, 89]%). Thus, variation between experts is mostly attributable not to differences in expertise but rather to variation in decision thresholds.

DISCUSSION:

Our results provide precise estimates of expert reliability from a large and diverse sample and a parsimonious theory to explain the origin of disagreements between experts. The results also establish a standard for how well an automated IIIC classifier must perform to match experts. CLASSIFICATION OF EVIDENCE This study provides Class II evidence that an independent expert review reliably identifies ictal-interictal injury continuum patterns on EEG compared with expert consensus.
Assuntos
Texto completo
Imprimir
XML
PubMed Links
Buscar no Google

Texto completo: 1 Base de dados: MEDLINE Assunto principal: Convulsões / Eletroencefalografia Tipo de estudo: Prognostic_studies / Qualitative_research Limite: Female / Humans / Middle aged Idioma: En Revista: Neurology Ano de publicação: 2023 Tipo de documento: Article
Texto completo
Imprimir
XML
PubMed Links
Buscar no Google

Texto completo: 1 Base de dados: MEDLINE Assunto principal: Convulsões / Eletroencefalografia Tipo de estudo: Prognostic_studies / Qualitative_research Limite: Female / Humans / Middle aged Idioma: En Revista: Neurology Ano de publicação: 2023 Tipo de documento: Article