Automatic speech recognition performance for digital scribes: a performance comparison between general-purpose and specialized models tuned for patient-clinician conversations.
AMIA Annu Symp Proc
; 2022: 1072-1080, 2022.
Article
en En
| MEDLINE
| ID: mdl-37128439
ABSTRACT
One promising solution to address physician data entry needs is through the development of so-called "digital scribes," or tools which aim to automate clinical documentation via automatic speech recognition (ASR) of patient-clinician conversations. Evaluation of specialized ASR models in this domain, useful for understanding feasibility and development opportunities, has been difficult because most models have been under development. Following the commercial release of such models, we report an independent evaluation of four models, two general-purpose, and two for medical conversation with a corpus of 36 primary care conversations. We identify word error rates (WER) of 8.8%-10.5% and word-level diarization error rates (WDER) ranging from 1.8%-13.9%, which are generally lower than previous reports. The findings indicate that, while there is room for improvement, the performance of these specialized models, at least under ideal recording conditions, may be amenable to the development of downstream applications which rely on ASR of patient-clinician conversations.
Texto completo:
1
Colección:
01-internacional
Base de datos:
MEDLINE
Asunto principal:
Percepción del Habla
/
Software de Reconocimiento del Habla
Tipo de estudio:
Prognostic_studies
Límite:
Humans
Idioma:
En
Revista:
AMIA Annu Symp Proc
Asunto de la revista:
INFORMATICA MEDICA
Año:
2022
Tipo del documento:
Article
País de afiliación:
Estados Unidos