Comparison of Full-Time Equivalent and Clinic Time Labor Input Measures in Productivity Metrics.

GOAL: A lack of improvement in productivity in recent years may be the result of suboptimal measurement of productivity. Hospitals and clinics benefit from external benchmarks that allow assessment of clinical productivity. Work relative value units have long served as a common currency for this purpose. Productivity is determined by comparing work relative value units to full-time equivalents (FTEs), but FTEs do not have a universal or standardized definition, which could cause problems. We propose a new clinical labor input measure-"clinic time"-as a substitute for using the reported measure of FTEs. METHODS: In this observational validation study, we used data from a cluster randomized trial to compare FTE with clinic time. We compared these two productivity measures graphically. For validation, we estimated two separate ordinary least squares (OLS) regression models. To validate and simultaneously adjust for endogeneity, we used instrumental variables (IV) regression with the proportion of days in a pay period that were federal holidays as an instrument. We used productivity data collected between 2018 and 2020 from Veterans Health Administration (VA) cardiology and orthopedics providers as part of a 2-year cluster randomized trial of medical scribes mandated by the VA Maintaining Internal Systems and Strengthening Integrated Outside Networks (MISSION) Act of 2018. PRINCIPAL FINDINGS: Our cohort included 654 unique providers. For both productivity variables, the values for patients per clinic day were consistently higher than those for patients per day per FTE. To validate these measures, we estimated separate OLS and IV regression models, predicting wait times from the two productivity measures. The slopes from the two productivity measures were positive and small in magnitude with OLS, but negative and large in magnitude with IV regression. The magnitude of the slope for patients per clinic day was much larger than the slope for patients per day per FTE. Current metrics that rely on FTE data may suffer from self-report bias and low reporting frequency. Using clinic time as an alternative is an effective way to mitigate these biases. PRACTICAL APPLICATIONS: Measuring productivity accurately is essential because provider productivity plays an important role in facilitating clinic operations outcomes. Most importantly, tracking a more valid productivity metric is a concrete, cost-effective management tactic to improve the provision of care in the long term.

Costs and Productivity Benefits of the Department of Veterans Affairs Maintaining Internal Systems and Strengthening Integrated Outside Networks Act Scribes Trial.

OBJECTIVES: To improve access, the VA Maintaining Internal Systems and Strengthening Integrated Outside Networks (MISSION) Act of 2018 mandated a 2-year study of medical scribes in Veterans Health Administration specialty clinics and emergency departments. Medical scribes are employed in clinical settings with the goals of increasing provider productivity and satisfaction by minimizing physicians' documentation burden. Our objective is to quantify the economic outcomes of the MISSION Act scribes trial. METHODS: A cluster-randomized trial was designed with 12 Department of Veterans Affairs (VA) medical centers randomized into the intervention. We estimated the total cost of the trial, cost per scribe-year, and projected cost of hiring additional physicians to achieve the observed scribe productivity benefits in relative value units and visits per full-time-equivalent over the 2-year intervention period (June 30, 2020 to July 1, 2022). RESULTS: The estimated cost of the trial was $4.6 million, below the Congressional Budget Office estimate of $5 million. A full-time scribe-year cost approximately $74 600 through contracting and $62 900 through VA hiring. Randomization into the trial led to an approximate 30% increase in productivity in cardiology and 20% in orthopedics. The projected incremental cost of using additional physicians instead of scribes to achieve the same productivity benefits was nearly $1.7 million more, or 75% higher, than the observed cost of scribes in cardiology and orthopedics. CONCLUSIONS: As the largest randomized trial of scribes to date, the MISSION Act scribes trial provides important evidence on the costs and benefits of scribes. Improving productivity enhances access and scribes may give VA a new tool to improve productivity in specialty care at a lower cost than hiring additional providers.