Development and evaluation of a novel knowledge assessment tool for pediatric emergency medicine clerkships.

Objectives: This study seeks to determine validity evidence for a newly developed multiple-choice examination (MCE) tool to assess retention and application of medical knowledge of students enrolled in a pediatric emergency medicine (PEM) clerkship. Methods: A team of PEM physicians created a 110-item MCE covering the range of clinical topics in PEM relevant for medical students. The researchers determined examination content using the report of Clerkship Directors in Emergency Medicine and PEM Interest Group of the Society for Academic Emergency Medicine (SAEM). The authors administered the MCE to fourth-year medical students at the end of their PEM rotation from May 2020 to April 2023 at four institutions and then analyzed the examination using four of Messick's five sources of validity evidence: content, response process, internal structure, and relation to other variables. Results: A total of 158 students took the test. In academic year (AY)20-21, 47 students took the test and scored, on average, 81%. After revision of poor and indeterminate questions, the 111 medical students who took the revised version of the test in AY21-AY23 scored on average 77.3% with a standard deviation of 5.7% with a normal distribution in scores. The revised questions were rated as excellent (10.0%), good (26.4%), fair (34.5%), poor (24.5%), or indeterminate (4.5%) based on test item discrimination. There was a positive correlation between MCE scores and students' clinical evaluations but no correlation between MCE scores and scores that students received on their clinical notes or patient presentations during case conference. Conclusions: This novel PEM clerkship examination is a reliable test of medical knowledge. Future directions involve evaluating consequences of the MCE and offering the test to medical students in a dedicated PEM rotation at the national level.

Utility of common bile duct measurement in the diagnosis of cholecystitis and choledocholithiasis in children.

BACKGROUND: Ultrasound is an integral part of evaluating for acute cholecystitis and choledocholithiasis in pediatric patients. Finding the common bile duct (CBD), a structure which is normally <4 mm in children, can be very challenging. OBJECTIVE: The primary objective of this study was to determine the prevalence of isolated sonographic CBD dilation in pediatric patients with acute cholecystitis and/or choledocholithiasis without laboratory abnormalities or pathologic findings on radiology based biliary ultrasound, apart from cholelithiasis. METHODS: We conducted a retrospective chart review of patients ≤21-years-old, at a single free-standing tertiary care children's hospital, who received a biliary ultrasound in the radiology department (RADUS) from September 2005 to February 2020. We identified patients who had a diagnosis of acute cholecystitis and/or choledocholithiasis on RADUS. Based on prior studies, a positive ultrasound was defined as having gallbladder wall thickening (GWT), pericholecystic fluid (PCF), or sonographic Murphy's sign (SMS). The final diagnosis was confirmed using the gold standard, cholecystectomy pathology diagnosis for patients with cholecystitis and endoscopic retrograde cholangiopancreatography (ERCP) diagnosis for patients with choledocholithiasis. Ultrasound data and contemporaneous laboratory values were collected. RESULTS: 180 patients met inclusion criteria. For the study population, 97 (53.9%) had a positive ultrasound, 127 patients (70.6%) had a dilated CBD, and 170 (94.4%) had at least one abnormal laboratory finding. Within the study population there were 76 patients (42.3%) with acute cholecystitis, 55 patients (30.5%) with choledocholithiasis, and 49 patients (27.2%) with acute cholecystitis and choledocholithiasis. Of the 127 patients with a dilated CBD, 80 (62.9%) had a normal ultrasound, apart from cholelithiasis. In this group of 80, 78 patients (97.5%) had at least one abnormal laboratory finding. Thus, for the entire study population, isolated CBD dilation without a positive ultrasound or laboratory abnormalities occurred in 2 patients (1.1%). Of note, these 2 patients had an ultrasound diagnosis of choledocholithiasis. CONCLUSION: The prevalence of isolated sonographic CBD dilation in pediatric patients with cholecystitis and/or choledocholithiasis was 1.1%. Thus, biliary ultrasound without CBD measurement is unlikely to result in missed cholecystitis and/or choledocholithiasis if the biliary ultrasound does not demonstrate GWT, PCF, SMS, or choledocholithiasis, and the patient has normal laboratory values.

Factors Associated With Point-of-Care Ultrasound Use by Recent Pediatric Emergency Medicine Fellowship Graduates.

OBJECTIVE: The aims of this study were to describe point-of-care ultrasound (POCUS) use by recent pediatric emergency medicine (PEM) fellowship graduates and identify associations between frequency and breadth of POCUS use with variations in POCUS training and current clinical practice environment. METHODS: This was a cross-sectional online survey of recent PEM fellowship graduates. Chi-square and nonparametric tests were used to compare POCUS use among physicians with varying types of POCUS training and varying clinical practice environments. RESULTS: Eighty-two percent of 143 respondents reported using POCUS in their past 10 shifts. There was no association between the methods of POCUS education and frequency or breadth of POCUS use. Pediatric emergency medicine fellowship graduates with additional POCUS fellowship training performed more scans and used more applications than those who completed a pediatrics or medicine-pediatrics residency before PEM fellowship only [median 15 (9, 20) vs 2 (1, 5) (P < 0.01) and median 11 (6.5, 13) vs 2 (1, 3) (P < 0.01), respectively]. Participants who worked in academic emergency departments performed more ultrasounds than those who did not [3.5 (1, 8) vs 1 (0, 2), P < 0.01] and used a greater breadth of applications [3 (1, 5) vs 1 (0, 3), P < 0.01]. Physicians who billed for POCUS studies were more likely to use POCUS (odds ratio, 2.8; 95% confidence interval, 1.1-7.3) with greater frequency [5 (2.3, 10) vs 2 (0.8, 5), P < 0.01] and use a broader range of applications [3 (2,6) vs 2 (0.8, 3.3), P < 0.01]. CONCLUSION: Most respondents report recent POCUS use in practice. Point-of-care ultrasound fellowship training, working in an academic emergency department, and having the ability to bill were associated with increased POCUS use.

Accuracy and Interrater Reliability of Point-of-Care Ultrasonography Image Interpretation for Intussusception.

OBJECTIVES: The aim of this study was to determine the accuracy and interrater reliability of (1) point-of-care ultrasound (POCUS) image interpretation for identification of intussusception and (2) reliability of secondary signs associated with intussusception among experts compared with novice POCUS reviewers. METHODS: We conducted a planned secondary analysis of a prospective, convenience sample of children aged 3 months to 6 years who were evaluated with POCUS for intussusception across 17 international pediatric emergency departments between October 2018 and December 2020. A random sample of 100 POCUS examinations was reviewed by novice and expert POCUS reviewers. The primary outcome was identification of the presence or absence of intussusception. Secondary outcomes included intussusception size and the presence of trapped free fluid or echogenic foci. Accuracy was summarized using sensitivity and specificity, which were estimated via generalized mixed effects logistic regression. Interrater reliability was summarized via Light's κ statistics with bootstrapped standard errors (SEs). Accuracy and reliability of expert and novice POCUS reviewers were compared. RESULTS: Eighteen expert and 16 novice POCUS reviewers completed the reviews. The average expert sensitivity was 94.5% (95% confidence interval [CI], 88.6-97.5), and the specificity was 94.3% (95% CI, 90.3-96.7), significantly higher than the average novice sensitivity of 84.7% (95% CI, 74.3-91.4) and specificity of 80.4% (95% CI, 72.4, 86.7). κ was significantly greater for expert (0.679, SE 0.039) compared with novice POCUS reviewers (0.424, SE 0.044; difference 0.256, SE 0.033). For our secondary outcome measure of intussusception size, κ was significantly greater for experts (0.661, SE 0.038) compared with novices (0.397, SE 0.041; difference 0.264, SE 0.029). Interrater reliability was weak for expert and minimal for novice reviewers regarding the detection of trapped free fluid and echogenic foci. CONCLUSIONS: Expert POCUS reviewers demonstrate high accuracy and moderate interrater reliability when identifying intussusception via image interpretation and perform better than novice reviewers.

Diagnostic Accuracy of Point-of-Care Ultrasound for Intussusception: A Multicenter, Noninferiority Study of Paired Diagnostic Tests.

STUDY OBJECTIVE: To determine the diagnostic accuracy of point-of-care ultrasound (POCUS) performed by experienced clinician sonologists compared to radiology-performed ultrasound (RADUS) for detection of clinically important intussusception, defined as intussusception requiring radiographic or surgical reduction. METHODS: We conducted a multicenter, noninferiority, observational study among a convenience sample of children aged 3 months to 6 years treated in tertiary care emergency departments across North and Central America, Europe, and Australia. The primary outcome was diagnostic accuracy of POCUS and RADUS with respect to clinically important intussusception. Sample size was determined using a 4-percentage-point noninferiority margin for the absolute difference in accuracy. Secondary outcomes included agreement between POCUS and RADUS for identification of secondary sonographic findings. RESULTS: The analysis included 256 children across 17 sites (35 sonologists). Of the 256 children, 58 (22.7%) had clinically important intussusception. POCUS identified 60 (23.4%) children with clinically important intussusception. The diagnostic accuracy of POCUS was 97.7% (95% confidence interval [CI] 94.9% to 99.0%), compared to 99.3% (95% CI 96.8% to 99.9%) for RADUS. The absolute difference between the accuracy of RADUS and that of POCUS was 1.5 percentage points (95% CI -0.6 to 3.6). Sensitivity for POCUS was 96.6% (95% CI 87.2% to 99.1%), and specificity was 98.0% (95% CI 94.7% to 99.2%). Agreement was high between POCUS and RADUS for identification of trapped free fluid (83.3%, n=40/48) and decreased color Doppler signal (95.7%, n=22/23). CONCLUSION: Our findings suggest that the diagnostic accuracy of POCUS performed by experienced clinician sonologists may be noninferior to that of RADUS for detection of clinically important intussusception. Given the limitations of convenience sampling and spectrum bias, a larger randomized controlled trial is warranted.

The effect of point-of-care ultrasound on length of stay in the emergency department in children with neck swelling.

BACKGROUND: Ultrasound is the imaging modality of choice in children presenting to the emergency department (ED) with soft tissue neck swelling. Point of care ultrasound (POCUS) has good accuracy when compared to comprehensive radiology department ultrasound (RADUS). POCUS could potentially improve ED length of stay (LOS) by improving efficiency. We aimed to evaluate the LOS of pediatric patients seen in ED with soft tissue neck swelling who received POCUS compared to RADUS. We determined unscheduled 30-day return visit rates in both groups as a balancing measure. METHODS: We performed a retrospective review of the electronic medical record for our cross-sectional study of discharged patients ≤21 years of age who had a neck ultrasound performed by a credentialed POCUS physician or by the radiology department between July 2014 and January 2020. We included patients who had both POCUS and RADUS in the POCUS group. We compared median ED LOS in both groups using the Mann Whitney U test and proportion of unscheduled return visits to the ED in both groups using odds ratio and 95% CI. RESULTS: There were 925 patients: 76 with only POCUS, 6 with POCUS and RADUS, and 843 with only RADUS performed. Median LOS in the POCUS group was 68.5 min (IQR 38.3120.3) versus 154.0 min (IQR 111.0, 211.0) in the RADUS group (p < 0.001). Return visit overall was 7.6%: 13.2% in the POCUS group versus 7.1% in the RADUS group (p = 0.07). CONCLUSION: Pediatric patients evaluated in the ED for soft tissue neck swelling had a shorter LOS with POCUS than with RADUS without a statistically significant increase in 30-day return visits. We suggest a "POCUS First" approach to the care of these patients.

Quality Assurance for Point-of-Care Ultrasound in North American Pediatric Emergency Medicine Fellowships.

OBJECTIVES: The American Academy of Pediatrics, the Society for Academic Emergency Medicine, and the American College of Emergency Physicians released a policy statement endorsing the use of point-of-care ultrasound (POCUS) by pediatric emergency medicine (PEM) providers. This statement specifically recommends that emergency departments have a credentialing and quality assurance (QA) program for POCUS. There is limited knowledge of how QA for POCUS is currently carried out in pediatric emergency departments with PEM training programs. METHODS: We sent a cross-sectional web-based survey to all 81 PEM fellowship-training programs in the United States and Canada between June 2016 and June 2017. RESULTS: Sixty-six of 81 programs (81.2%) responded. Sixty-five percent of responding PEM training programs had POCUS-trained faculty or a POCUS champion at their institution. Forty-six percent had a POCUS fellowship in their institution, with 10 programs having PEM-specific POCUS fellowships. Programs with POCUS fellowships were more likely to save all images, review all scans, review scans more frequently, provide feedback, and bill compared with programs without POCUS fellowships. CONCLUSIONS: Point-of-care ultrasound is growing in PEM fellowship-training programs, with a majority of programs now having faculty members trained or interested specifically in POCUS. Most programs prefer more frequent and thorough QA processes, and programs with POCUS fellowships are more likely to have more frequent and thorough QA processes.

Improving Point-of-Care Ultrasound Documentation and Billing Accuracy in a Pediatric Emergency Department.

OBJECTIVE: The performance and interpretation of point-of-care ultrasound (POCUS) should be documented appropriately in the electronic medical record (EMR) with correct billing codes assigned. We aimed to improve complete POCUS documentation from 62% to 80% and improve correct POCUS billing codes to 95% or higher through the implementation of a quality improvement initiative. METHODS: We collected POCUS documentation and billing data from the EMR. Interventions included: (1) staff education and feedback, (2) standardization of documentation and billing, and (3) changes to the EMR to support standardization. We used P charts to analyze our outcome measures between January 2017 and June 2018. RESULTS: Six hundred medical records of billed POCUS examinations were included. Complete POCUS documentation rate rose from 62% to 91%, and correct CPT code selection for billing increased from 92% to 95% after our interventions. CONCLUSIONS: The creation of a standardized documentation template incorporated into the EMR improved complete documentation compliance.

Carotid Artery Flow Time Measured by Point-of-Care Ultrasound Correlates with Volume Changes in Pediatric Hemodialysis Patients.

Carotid artery flow time corrected for heart rate (CFTc) correlates with intravascular volume changes in adults but has not been studied adequately in the pediatric population. We studied how fluid status changes correlate with CFTc in pediatric patients undergoing hemodialysis. This prospective observational study involved pediatric patients aged 5-18 y undergoing chronic hemodialysis at a tertiary care children's hospital in the United States. We measured CFTc by point-of-care ultrasound before and after each hemodialysis session, including passive leg raise. One hundred sixty-eight CFTc measurements were obtained from a total of 21 patient encounters. Post-dialysis CFTc decreased by 21.7 ms (95% confidence interval: 12.3-31.0) (p < 0.001). Pre- and post-dialysis ∆CFTc measurements were proportionally correlated with volume removed in dialysis adjusted for weight (mL/kg) (R2 = 0.224, p = 0.03). There was no significant change in mean CFTc with passive leg raise before or after hemodialysis. In children on hemodialysis, changes in CFTc were moderately correlated with decrease in intravascular volume after hemodialysis.

Parotitis on Ultrasound: The Pomegranate Sign.

The differential diagnosis for facial swelling is broad and can be a diagnostic challenge in the pediatric emergency department. We describe the first pediatric case of acute parotitis with sialolithiasis where the diagnosis was facilitated by point-of-care ultrasound.

Interpretation errors in focused cardiac ultrasound by novice pediatric emergency medicine fellow sonologists.

BACKGROUND: Focused cardiac ultrasound (FOCUS) is a core competency for pediatric emergency medicine (PEM) fellows. The objectives of this study were (1) to evaluate test characteristics of PEM-fellow-performed FOCUS for pericardial effusion and diminished cardiac function and (2) to assess image interpretation independent of image acquisition. METHODS: PEM fellows performed and interpreted FOCUS on patients who also received cardiology service echocardiograms, the reference standard. Subsequently, eight different PEM fellows remotely interpreted a subset of the PEM-acquired and cardiology-acquired echocardiograms. RESULTS: Eight PEM fellows performed 54 FOCUS exams, of which two had pericardial effusion and four had diminished function. PEM fellow FOCUS had a sensitivity of 50.0% (95% CI 9.19-90.8) and specificity of 100.0% (95% CI 91.1-100.0) for detecting diminished function, and sensitivity of 50.0% (95% CI 2.67-97.33) and specificity of 98.1% (95% CI 88.42-99.9) for detecting pericardial effusions. When PEM fellows remotely interpreted 15 echocardiograms, the sensitivity was 81.3% (95% CI 70.7-88.8) and specificity 75% (95% CI 67.0-81.0) for detecting diminished function, and sensitivity of 76.3% (95% CI 65.0-85.0) and specificity 94.4% (95% CI 89.0-97.0) for detecting pericardial effusion. There were no differences in sensitivity and specificity of PEM fellows' interpretation of FOCUS studies compared to their interpretation of cardiology echocardiograms. Interrater reliability for interpretation of remote images (kappa) was 0.66 (95% CI 0.59-0.73) for effusion and 0.31 (95% CI 0.24-0.38) for function among the fellows. CONCLUSION: Novice PEM fellow sonologists (a physician who performs and interprets ultrasound) in the majority of instances were able to acquire and remotely interpret FOCUS images with limited training. However, they made real-time interpretation errors and likely need further training to incorporate real-time image acquisition and interpretation into their practice.