Diagnostic Identification of Acute Brain Dysfunction in Pediatric Sepsis and Septic Shock in the Electronic Health Record: A Comparison of Four Definitions in a Reference Dataset.

OBJECTIVES: Acute brain dysfunction (ABD) in pediatric sepsis has a prevalence of 20%, but can be difficult to identify. Our previously validated ABD computational phenotype (CP ABD ) used variables obtained from the electronic health record indicative of clinician concern for acute neurologic or behavioral change. We tested whether the CP ABD has better diagnostic performance to identify confirmed ABD than other definitions using the Glasgow Coma Scale or delirium scores. DESIGN: Diagnostic testing in a curated cohort of pediatric sepsis/septic shock patients. SETTING: Quaternary freestanding children's hospital. SUBJECTS: The test dataset comprised 527 children with sepsis/septic shock managed between 2011 and 2021 with a prevalence (pretest probability) of confirmed ABD of 30% (159/527). MEASUREMENTS AND MAIN RESULTS: CP ABD was based on use of neuroimaging, electroencephalogram, and/or administration of new antipsychotic medication. We compared the performance of the CP ABD with three GCS/delirium-based definitions of ABD-Proulx et al, International Pediatric Sepsis Consensus Conference, and Pediatric Organ Dysfunction Information Update Mandate. The posttest probability of identifying ABD was highest in CP ABD (0.84) compared with other definitions. CP ABD also had the highest sensitivity (83%; 95% CI, 76-89%) and specificity (93%; 95% CI, 90-96%). The false discovery rate was lowest in CP ABD (1-in-6) as was the false omission rate (1-in-14). Finally, the prevalence threshold for the definitions varied, with the CP ABD being the definition closest to 20%. CONCLUSIONS: In our curated dataset of pediatric sepsis/septic shock, CP ABD had favorable characteristics to identify confirmed ABD compared with GCS/delirium-based definitions. The CP ABD can be used to further study the impact of ABD in studies using large electronic health datasets.

Validation of a Computational Phenotype to Identify Acute Brain Dysfunction in Pediatric Sepsis.

OBJECTIVES: To validate a computational phenotype that identifies acute brain dysfunction (ABD) based on clinician concern for neurologic or behavioral changes in pediatric sepsis. DESIGN: Retrospective observational study. SETTING: Single academic children's hospital. PATIENTS: Four thousand two hundred eighty-nine index sepsis episodes. INTERVENTIONS: None. MEASUREMENTS AND MAIN RESULTS: An existing computational phenotype of ABD was optimized to include routinely collected variables indicative of clinician concern for acute neurologic or behavioral change (completion of CT or MRI, electroencephalogram, or new antipsychotic administration). First, the computational phenotype was compared with an ABD reference standard established from chart review of 527 random sepsis episodes to determine criterion validity. Next, the computational phenotype was compared with a separate validation cohort of 3,762 index sepsis episodes to determine content and construct validity. Criterion validity for the final phenotype had sensitivity 83% (95% CI, 76-89%), specificity 93% (90-95%), positive predictive value 84% (77-89%), and negative predictive value 93% (90-96%). In the validation cohort, the computational phenotype identified ABD in 35% (95% CI 33-36%). Content validity was demonstrated as those with the ABD computational phenotype were more likely to have characteristics of neurologic dysfunction and severe illness than those without the ABD phenotype, including nonreactive pupils (15% vs 1%; p < 0.001), Glasgow Coma Scale less than 5 (44% vs 12%; p < 0.001), greater than or equal to two nonneurologic organ dysfunctions (50% vs 25%; p < 0.001), and need for intensive care (81% vs 65%; p < 0.001). Construct validity was demonstrated by higher odds for mortality (odds ratio [OR], 6.9; 95% CI, 5.3-9.1) and discharge to rehabilitation (OR, 11.4; 95% CI 7.4-17.5) in patients with, versus without, the ABD computational phenotype. CONCLUSIONS: A computational phenotype of ABD indicative of clinician concern for new neurologic or behavioral change offers a valid retrospective measure to identify episodes of sepsis that involved ABD. This computational phenotype provides a feasible and efficient way to study risk factors for and outcomes from ABD using routinely collected clinical data.

Sensitivity and Specificity of Empiric Treatment for Sexually Transmitted Infections in a Pediatric Emergency Department.

OBJECTIVE: To determine test characteristics of provider judgment for empiric antibiotic provision to patients undergoing testing for a sexually transmitted infection. STUDY DESIGN: We conducted a retrospective cross-sectional electronic health record review of all patients aged 13-19 years who had Neisseria gonorrhoeae (GC) and Chlamydia trachomatis (CT) testing sent from an urban, academic pediatric emergency department in 2012. We abstracted data, including patient demographics, chief complaint, sexually transmitted infection test results, and treatment. We calculated test characteristics comparing clinician judgment for presumptive treatment for a sexually transmitted infection with the reference standard of the actual results of testing for a sexually transmitted infection. RESULTS: Of 1223 patient visits meeting inclusion criteria, 284 (23.2%) had a positive GC and/or CT test result. Empiric treatment was provided in 615 encounters (50.3%). Provider judgment for presumptive treatment had an overall sensitivity of 67.6% (95% CI, 61.8-73.0) and a specificity of 55% (95% CI, 51.7-58.2) for accurate GC and/or CT detection. CONCLUSIONS: Many adolescents tested for GC and CT receive empiric treatment at the initial emergency department visit. Provider judgment may lack sufficient sensitivity and specificity for identifying infected patients, resulting in the potential for undertreatment of true disease, overtreatment of uninfected patients, or both.

Comparison of Two Sepsis Recognition Methods in a Pediatric Emergency Department.

OBJECTIVES: The objective was to compare the effectiveness of physician judgment and an electronic algorithmic alert to identify pediatric patients with severe sepsis/septic shock in a pediatric emergency department (ED). METHODS: This was an observational cohort study of patients older than 56 days with fever or hypothermia. All patients were evaluated for potential sepsis in real time by the ED clinical team. An electronic algorithmic alert was retrospectively applied to identify patients with potential sepsis independent of physician judgment. The primary outcome was the proportion of patients correctly identified with severe sepsis/septic shock defined by consensus criteria. Test characteristics were determined and receiver operating characteristic (ROC) curves were compared. RESULTS: Of 19,524 eligible patient visits, 88 patients developed consensus-confirmed severe sepsis or septic shock. Physician judgment identified 159 and the algorithmic alert identified 3,301 patients with potential sepsis. Physician judgment had sensitivity of 72.7% (95% confidence interval [CI] = 72.1% to 73.4%) and specificity of 99.5% (95% CI = 99.4% to 99.6%); the algorithmic alert had sensitivity of 92.1% (95% CI = 91.7% to 92.4%) and specificity of 83.4% (95% CI = 82.9% to 83.9%) for severe sepsis/septic shock. There was no significant difference in the area under the ROC curve for physician judgment (0.86, 95% CI = 0.81 to 0.91) or the algorithm (0.88, 95% CI = 0.85 to 0.91; p = 0.54). A combination method using either positive physician judgment or an algorithmic alert improved sensitivity to 96.6% and specificity to 83.3%. A sequential approach, in which positive identification by the algorithmic alert was then confirmed by physician judgment, achieved 68.2% sensitivity and 99.6% specificity. Positive and negative predictive values for physician judgment versus algorithmic alert were 40.3% versus 2.5% and 99.88% versus 99.96%, respectively. CONCLUSIONS: The electronic algorithmic alert was more sensitive but less specific than physician judgment for recognition of pediatric severe sepsis and septic shock. These findings can help to guide institutions in selecting pediatric sepsis recognition methods based on institutional needs and priorities.

Identifying Pediatric Severe Sepsis and Septic Shock: Accuracy of Diagnosis Codes.

OBJECTIVES: To evaluate accuracy of 2 established administrative methods of identifying children with sepsis using a medical record review reference standard. STUDY DESIGN: Multicenter retrospective study at 6 US children's hospitals. Subjects were children >60 days to <19 years of age and identified in 4 groups based on International Classification of Diseases, Ninth Revision, Clinical Modification codes: (1) severe sepsis/septic shock (sepsis codes); (2) infection plus organ dysfunction (combination codes); (3) subjects without codes for infection, organ dysfunction, or severe sepsis; and (4) infection but not severe sepsis or organ dysfunction. Combination codes were allowed, but not required within the sepsis codes group. We determined the presence of reference standard severe sepsis according to consensus criteria. Logistic regression was performed to determine whether addition of codes for sepsis therapies improved case identification. RESULTS: A total of 130 out of 432 subjects met reference SD of severe sepsis. Sepsis codes had sensitivity 73% (95% CI 70-86), specificity 92% (95% CI 87-95), and positive predictive value 79% (95% CI 70-86). Combination codes had sensitivity 15% (95% CI 9-22), specificity 71% (95% CI 65-76), and positive predictive value 18% (95% CI 11-27). Slight improvements in model characteristics were observed when codes for vasoactive medications and endotracheal intubation were added to sepsis codes (c-statistic 0.83 vs 0.87, P = .008). CONCLUSIONS: Sepsis specific International Classification of Diseases, Ninth Revision, Clinical Modification codes identify pediatric patients with severe sepsis in administrative data more accurately than a combination of codes for infection plus organ dysfunction.

RNA Biosignatures in Adolescent Patients in a Pediatric Emergency Department With Pelvic Inflammatory Disease.

BACKGROUND: Adolescents are at high risk for pelvic inflammatory disease (PID). Because accurate diagnosis of PID is difficult, and complications of untreated PID are significant, novel methods to improve diagnosis are essential. OBJECTIVES: To determine if patients with PID have unique RNA expression patterns compared to controls. METHODS: Peripheral blood was collected from adolescent females with PID in the emergency department, and from control patients in the operating room. RNA was isolated, and microarray analysis was performed. Initial analysis involved a training set of 18 patients (9 PID patients with either Neisseria gonorrhoeae or Chlamydia trachomatis infection and 9 control patients). Supervised and unsupervised cluster analyses were performed, followed by network analysis. The training set was used to classify a set of 15 additional PID patients and 2 controls. RESULTS: Supervised cluster analysis of the training set revealed 170 genes which were differentially expressed in PID patients versus controls. Network analysis indicated that several differentially expressed genes are involved in immune activation. Analysis of additional PID patients based on the training set findings revealed that patients with positive testing for Trichomonas vaginalis partitioned with the PID group, whereas patients with no organism identified partitioned with both groups. CONCLUSIONS: RNA sample collection from adolescents in the emergency department is feasible. Genes were identified which were differentially expressed in PID patients versus controls, many of which are involved in inflammation. Future studies should confirm the training set findings on a larger sample and may lead to improved accuracy of PID diagnosis.

Clinician adherence to recommendations for screening of adolescents for sexual activity and sexually transmitted infection/human immunodeficiency virus.

OBJECTIVES: To evaluate clinician adherence to guidelines for documentation of sexual history and screening for sexually transmitted infection (STI)/HIV infection during routine adolescent well visits. Secondary objectives were to determine patient and clinician factors associated with sexual history documentation and STI/HIV testing. STUDY DESIGN: Retrospective, cross-sectional study of 1000 randomly selected 13- to 19-year-old routine well visits at all 29 pediatric primary care practices affiliated with a children's hospital. We evaluated frequency of documentation of sexual history and testing for gonorrhea (GC)/chlamydia (CT) and HIV testing. Multivariable logistic regression was performed to identify factors associated with documentation and testing. RESULTS: Of the 1000 patient visits reviewed, 212 (21.2%; 95% CI, 18.7-23.7) had a documented sexual history, of which 45 adolescents' (21.2%; 95% CI, 15.7-26.8) encounters were documented as being sexually active. Overall, 26 (2.6%; 95% CI, 1.6-3.6) patients were tested for GC/CT and 16 (1.6%; 95% CI, 0.8-2.4) were tested for HIV infection. In multivariable analyses, factors associated with sexual history documentation included older patient age, non-Hispanic black race/ethnicity, nonprivate insurance status, and care by female clinician. Factors associated with GC/CT testing included male gender, non-Hispanic black race/ethnicity, and nonprivate insurance. HIV testing was more likely to be performed on older adolescents, those of non-Hispanic black race/ethnicity, and those with nonprivate insurance. CONCLUSIONS: Pediatric primary care clinicians infrequently document sexual histories and perform STI and HIV testing on adolescent patients. Future studies should investigate provider beliefs, clinical decision-making principles, and perceived barriers to improve the sexual health care of adolescents and evaluate interventions to increase rates of adolescent sexual health screening.

Developing emergency department-based education about emergency contraception: adolescent preferences.

OBJECTIVES: The objective was to identify adolescent preferences for emergency department (ED)-based education about emergency contraception. METHODS: This was a cross-sectional computerized survey, using adaptive conjoint analysis (ACA). Patients were eligible if they were females ages 14 through 19 years old and were seeking care in one of two urban EDs. Patients were excluded if they were too ill to participate in the survey or if they were non-English speaking. Participants completed a computerized survey that used ACA, a technique that can be used to assess patients' relative preferences for services. ACA uses the individual's answers to update and refine questions through trade-off comparisons, so that each respondent answers a customized set of questions. The survey assessed preferences for the following attributes of emergency contraception education: who should deliver the education, if anyone (e.g., nurse, doctor); how the education should be delivered (e.g., by a person or via video); how often the education should be offered if patients were to frequent the ED (e.g., every time or only when asking for it); length (e.g., 5 minutes, 10 minutes); and chief complaint that would trigger the education (e.g., headache or stomach pain). RESULTS: A total of 223 patients were enrolled (37.2% at Hospital 1 and 62.8% at Hospital 2). The mean (±SD) age of the participants was 16.1 (±1.3) years. Just over half (55%) reported a history of sexual activity; 8% reported a history of pregnancy. Overall, the participants preferred education that was delivered by a person, specifically a doctor or nurse. They preferred a slightly longer education session and preferred education directed at patients seeking care in the ED for complaints potentially related to sexual activity. CONCLUSIONS: Adolescents have specific preferences for how education about emergency contraception would best serve their needs. This information can inform clinicians as they work to improve adolescents' knowledge about pregnancy prevention and emergency contraception in particular.

Pediatric primary care provider practices, knowledge, and attitudes of human immunodeficiency virus screening among adolescents.

OBJECTIVES: To evaluate pediatric primary care provider (PCP) HIV screening practices, knowledge, and attitudes. STUDY DESIGN: Anonymous cross-sectional, internet-based survey of pediatric PCPs from 29 primary care practices. Survey items assessed current HIV screening practices and knowledge, attitudes, and perceived barriers towards screening. Provider demographics and practice characteristics were analyzed for associations with screening through logistic regression. RESULTS: Of 190 PCPs, there were 101 evaluable responses (response rate: 53.2%). PCPs reported a screening rate for HIV of 39.6% ("most" or "all of the time") during routine adolescent visits compared with violence (60.4%), substance abuse (92.1%), and depression (94.1%) (P < .001). Less than 10% of PCPs correctly answered questions related to Centers for Disease Control and Prevention and state HIV screening recommendations. Of 20 potential HIV screening barriers assessed, mean number of reported barriers was 4.8 (SD ± 2.9); with most concerns related to confidentiality, time for counseling, and follow-up. In a multivariable model, the only factor significantly associated with HIV screening "most" or "all of the time" during routine adolescent visits was urban practice site (aOR 9.8, 95% CI 2.9, 32.9). Provider type, sex, years since training, HIV screening guideline knowledge, and endorsing ≤5 barriers were not associated with HIV screening. CONCLUSIONS: Although providers practicing in urban areas were more likely to report screening adolescents for HIV than those in suburban areas, overall self-reported screening rates were low, and several barriers were identified commonly. Future interventions should target increasing providers' knowledge and addressing concerns about confidentiality, requirements and counseling time, and follow-up of results.

Enhancing the emergency department approach to pediatric sexual assault care: implementation of a pediatric sexual assault response team program.

OBJECTIVES: The objectives of this study were to describe the experience of a novel pediatric sexual assault response team (SART) program in the first 3 years of implementation and compare patient characteristics, evaluation, and treatment among subpopulations of patients. METHODS: This was a retrospective chart review of a consecutive sample of patients evaluated at a pediatric emergency department (ED) who met institutional criteria for a SART evaluation. Associations of evaluation and treatment with sex, menarchal status, and presence of injuries were measured using logistic regression. RESULTS: One hundred eighty-four patients met criteria for SART evaluation, of whom 87.5% were female; mean age was 10.1 (SD, 4.6) years. The majority of patients underwent forensic evidence collection (89.1%), which varied by menarchal status among girls (P < 0.01), but not by sex. Evidence of acute anogenital injury on physical examination was found in 20.6% of patients. As per the Centers for Disease Control and Prevention guidelines for acute sexual assault evaluations in pediatric patients, menarchal girls were more likely to undergo testing for sexually transmitted infections and pregnancy (P < 0.01) and to be offered pregnancy, sexually transmitted infection, and HIV prophylaxis (P < 0.01). CONCLUSIONS: In an effort to improve quality and consistency of acute sexual assault examinations in a pediatric ED, development of a SART program supported the majority of eligible patients undergoing forensic evidence collection. Furthermore, a substantial number of patients had evidence of injury on examination. These findings underscore the importance of having properly trained personnel to support ED care for pediatric victims of acute sexual assault.