Interrater Reliability in Interpretation of Neuropathic Pediatric Urodynamic Tracings: An Expanded Multicenter Study.

PURPOSE: Urodynamic findings often guide treatment for neuropathic bladder and are reported as objective data points in multi-institutional trials. However, urodynamic interpretation can be variable. In a pilot study pediatric urologists interpreting videourodynamics exhibited only moderate agreement despite similar training and practice patterns. We hypothesized the pilot study variability would be replicated in a multi-institutional study. MATERIALS AND METHODS: We developed an anonymous electronic survey that contained 20 scenarios, each with a brief patient history, 1 urodynamic tracing and fluoroscopic imagery. All videourodynamics were completed during routine care of patients with neuropathic bladder at a single institution. Pediatric urologists from Centers for Disease Control and Prevention Urologic Protocol sites were invited to complete an interpretation instrument for each scenario. Fleiss kappa and 95% confidence limits were reported, with Fleiss kappa 1.00 corresponding to perfect agreement. RESULTS: The survey was completed by 14 pediatric urologists at 7 institutions. Substantial agreement was seen for assessment of fluoroscopic bladder shape (Fleiss kappa 0.73), while moderate agreement was observed for assessment of bladder safety, end filling detrusor pressure and bladder capacity (Fleiss kappa 0.50, 0.56 and 0.54, respectively). Fair agreement was seen for electromyographic synergy and presence of detrusor overactivity (Fleiss kappa 0.21 and 0.35, respectively). CONCLUSIONS: Experienced pediatric urologists demonstrate variability during interpretation of videourodynamic tracings. Subjectivity of assessment of electromyographic activity and detrusor overactivity was confirmed in this expanded study. Future work to improve the reliability of videourodynamic interpretation would improve the quality of clinical care and the quality of multi-institutional studies that use urodynamic data points as outcomes.

Interrater Reliability in Pediatric Urodynamic Tracings: A Pilot Study.

PURPOSE: Urodynamic studies are crucial to neuropathic bladder management and they often determine surgical intervention. However, current evidence indicates that interpretations show poor agreement across physicians. We sought to determine the interrater reliability of urodynamic interpretation in our practice. We hypothesized that there would be strong correlation among pediatric urologists of similar training in a single academic practice. MATERIALS AND METHODS: We retrospectively identified patients with neuropathic bladder who underwent urodynamics at our institution between 2014 and 2015. An anonymous electronic survey (phase I) was developed with 20 clinical scenarios, each containing a brief history, a single urodynamic tracing and an accompanying fluoroscopic image. Faculty members assessed each tracing by an online instrument developed using urodynamic reports and published literature. The primary outcome was statistical correlation across raters as measured by the Spearman correlation coefficient. In a followup study (phase II) we investigated the sources of variability in urodynamic interpretations. RESULTS: Six faculty members completed the study with a response rate of 100%. In comparing urodynamic interpretation across raters, the faculty demonstrated a weak to strong correlation (rs 0.39-0.61, p <0.001). A strong correlation was found for fluoroscopic and clinical decision making variables, while electromyography synergy and detrusor overactivity demonstrated weaker correlation across physicians. CONCLUSIONS: Faculty interpretations of urodynamic tracings showed only moderate agreement despite a close working relationship and similar training at a single institution. Variability in interpretation can strongly impact patient treatment. Therefore, further work is needed to standardize the reporting and interpretation of urodynamic studies to optimize patient care.

Hidden consequences of patient satisfaction: A survey of pediatric surgeons.

BACKGROUND: Patient satisfaction surveys are increasingly utilized to assess patients' perceptions of their health care. Recently, these scores have been linked to payment, potentially incentivizing practices to meet certain metrics. We hypothesize that increasing pressures to receive positive reviews have led physicians to alter the delivery of their care to accommodate patient expectations over standards of care. METHODS: An 11-question REDCap™ survey was developed and emailed anonymously to all sixty-two surgeons across all surgical subspecialties at our children's hospital. Multiple-choice and open-ended questions were included. A modified Delphi method was used to acquire general consensus. RESULTS: Survey response rate for analysis was 41/62 (66%). 23 (56%) stated that they have changed their clinical practice patterns due to concerns regarding patient dissatisfaction. Examples of such changes included: requesting imaging tests or laboratory studies, performing invasive procedures, referring for second opinions, and prescribing medications. Only 2% felt that these interventions led to any significant change in outcome of a patient's condition. Several respondents expressed concerns that factors outside their control (scheduling, parking, wait times) contributed to patient dissatisfaction and affected providers' ratings, while others expressed concerns about inherent biases driving survey participants. CONCLUSIONS: As a result of patient satisfaction surveys, a significant number of surgeons reported altering their clinical practice beyond standard care to meet patient expectations. Some of these modifications included performing unnecessary interventions. Reliance on these surveys may be at odds with reducing health care costs and avoiding physician burnout. These and other unintended consequences of patient satisfaction surveys warrant further study before they are widely accepted as appropriate quality metrics. LEVEL OF EVIDENCE: Level IV, questionnaire.

Clinical Implications of Second and Third Trimester Surveillance Ultrasounds of Growth-Restricted Fetuses.

Objective We sought to investigate the positive predictive value of ultrasound-diagnosed fetal growth restriction (FGR) for estimating small for gestational age (SGA) at birth. Secondary objectives were to describe clinical interventions performed as a result of FGR diagnosis. Study Design This was a retrospective cohort of pregnancies diagnosed with FGR over 3 years at a single institution. Maternal demographics, antenatal and delivery data, and neonatal data were collected. Descriptive statistics and linear regression were conducted. Results We included 406 pregnancies with diagnosis of FGR in second or third trimester. Median birth weight percentile was 17 (interquartile range: 5-50) and only 35.0% of these fetuses were SGA at birth. The positive predictive value of a final growth ultrasound below the 10th percentile for SGA at birth was 56.9%. Patients averaged eight additional growth ultrasounds following FGR diagnosis. One hundred and fourteen (28.1%) received antenatal steroids prior to delivery, and 100% of those delivered after more than 7 days following administration. There were 6 fetal deaths and 14 neonatal deaths. Conclusion In the majority of cases, pregnancies diagnosed with FGR during screening ultrasounds resulted in normally grown neonates and term deliveries. These patients may be receiving unnecessary ultrasounds and premature courses of corticosteroids.