Validation of a Novel Statistical Method to Identify Aberrant Patient Logging: A Multi-Institutional Study.

INTRODUCTION: Student patient encounter logging informs the quality of supervised clinical practice experiences (SCPEs). Yet, it is unknown whether logs accurately reflect patient encounters, and the faculty resources necessary to review for potential aberrant logging are significant. The purpose of this study was to identify a statistical method to identify aberrant logging. METHODS: A multi-institutional (n = 6) study examined a statistical method for identifying potentially aberrant logging behavior. An automated statistical Mahalanobis Distance (MD) measurement was used to categorize student logs as aberrant if they were identified as probable multivariate outliers. This approach was validated using a gold standard for aberrant logging behavior with manual review by 4 experienced faculty ("faculty consensus") and then comparing interrater agreement between faculty and MD-based categorization. In secondary analyses, we compared the relative accuracy of MD-based categorization to individual faculty categorizing data from their own program ("own program" categorization). RESULTS: 323 student logging records from 6 physician assistant (PA) programs were included. Compared to "faculty consensus" (the gold standard), MD-based categorization was highly sensitive (0.846, 95% CI: 0.650, 1.000) and specific (0.766, 95% CI: 0.645, 0.887). Additionally, there was no significant difference in sensitivity, specificity, positive predictive value, or negative predictive value between MD-based categorization and "own program" categorization. DISCUSSION: The MD-based method of identifying aberrant and nonaberrant student logging compared favorably to the more traditional, faculty-intensive approach of reviewing individual student logging records. This supports MD-based screening as a less labor-intensive alternative to individual faculty review to identify aberrant logging. Identification of aberrant logging may facilitate early intervention with students to improve clinical exposure logging during their SCPEs.

Addressing the Opioid Crisis: Medication-Assisted Therapy Waiver Training for Students.

PURPOSE: Physician assistant (PA) graduates should be prepared to care for patients with substance use disorders. Medication-assisted therapy (MAT) allows PA graduates to provide that care by becoming licensed to prescribe buprenorphine. However, it is unclear how feasible and effective it is to implement online MAT waiver training during PA school. This study examined student knowledge and attitudes after training to assess its impact and perceived value. METHODS: We conducted a 15-question survey after one class of students completed training during clinical rotations. Students self-reported pre/post change in awareness, knowledge, interest, comfort and confidence, perceived usefulness to practice, and assessed quality using 5-point Likert scale (higher scores = more positive) and narrative responses. Data analysis was performed using the Wilcoxon signed rank test and descriptive statistics. Free text comments were analyzed for themes using constant comparison. RESULTS: Fifty-five (100%) students completed training within 6 weeks. The survey response rate was 49/55 (89%). Pre-to-post score changes were significant (p < .05) from +0.39 to +1.35 with the greatest changes seen in knowledge (+1.35), comfort (+1.14), awareness (+1.06), and confidence (+1.08); the lowest change was in interest (score change +0.39). Students reported being satisfied with content organization and quality (mean 3.82) and recommended training to colleagues (3.98); 82% reported they would have preferred 3 months to complete training; 46% would have preferred training prior to the start of clinical rotations. Major themes indicated a desire for better preparation and flexibility of platform, with ambivalence about relevance to practice. CONCLUSION: Online MAT waiver training is feasible and effective. However, students may not be convinced of its relevance to future practice. Faculty should offer adequate preparation and optimize integration into existing curricula.