A human centered design approach to define and measure documentation quality using an EHR virtual simulation.

Electronic health record (EHR) documentation serves multiple functions, including recording patient health status, enabling interprofessional communication, supporting billing, and providing data to support the quality infrastructure of a Learning Healthcare System. There is no definition and standardized method to assess documentation quality in EHRs. Using a human-centered design (HCD) approach, we define and describe a method to measure documentation quality. Documentation quality was defined as timely, accurate, user-centered, and efficient. Measurement of quality used a virtual simulated standardized patient visit via an EHR vendor platform. By observing and recording documentation efforts, nurse practitioners (NPs) (N = 12) documented the delivery of an Age-Friendly Health System (AFHS) 4Ms (what Matters, Medication, Mentation, and Mobility) clinic visit using a standardized case. Results for timely documentation indicated considerable variability in completion times of documenting the 4Ms. Accuracy varied, as there were many types of episodes of erroneous documentation and extra time in seconds in documenting the 4Ms. The type and frequency of erroneous documentation efforts were related to navigation burden when navigating to different documentation tabs. The evaluated system demonstrated poor usability, with most participants scoring between 60 and 70 on the System Usability Scale (SUS). Efficiency, measured as click burden (the number of clicks used to navigate through a software system), revealed significant variability in the number of clicks required, with the NPs averaging approximately 13 clicks above the minimum requirement. The HCD methodology used in this study to assess the documentation quality proved feasible and provided valuable information on the quality of documentation. By assessing the quality of documentation, the gathered data can be leveraged to enhance documentation, optimize user experience, and elevate the quality of data within a Learning Healthcare System.

Evaluation of education initiatives to increase delivery of age-friendly care in retail clinics.

BACKGROUND: The Age-Friendly Health Systems model, encompassing four key elements (4Ms)-What Matters, Medication, Mentation, Mobility-is integral to delivering high-quality care to older adult patients. In May 2020, the MinuteClinic at CVS implemented the 4Ms model in all 1100+ store locations nationwide. To prepare healthcare providers to deliver 4Ms care, educational modules were developed to provide an understanding of the gerontology principles that support the 4Ms model of care. Our goal was to evaluate the effectiveness of these education modules on improving reliable 4Ms delivery during retail clinic visits. METHODS: Educational modules were provided to nurse practitioners and physician associates to complete in a self-directed manner. These included an orientation module with scenarios comparing usual care and 4Ms care, 12 monthly grand rounds focusing on 4Ms case studies, and 10 video vignettes on 4Ms integration. We examined the association between number of education modules completed with the average number of Ms delivered per visit (M-Score) using descriptive statistics and a generalized linear mixed-effects model. RESULTS: Over 70% of 2783 providers completed at least one education module. Rates of 4Ms care delivery were 1.37 (1.36-1.39, p < 0.001) times higher among those that completed an orientation course compared to those that did not. Higher uptake of education exhibited a dose-response relationship with rate ratios between 1.77 (1.74-1.80, p < 0.001) for 1-2 modules beyond orientation, up to 2.94 (2.90-2.99, p < 0.001) for eight or more modules. CONCLUSIONS: The self-directed learning environment (e.g., providers self-select the number and type of courses) reflects real-world variation in engagement. Despite this variation, significant improvements in 4Ms delivery were observed at any level of educational exposure, underscoring the value of prioritizing education time with quality improvement initiatives.