Developing Machine Learning Models for Behavioral Coding.
J Pediatr Psychol
; 44(3): 289-299, 2019 04 01.
Article
em En
| MEDLINE
| ID: mdl-30698755
ABSTRACT
OBJECTIVE:
The goal of this research is to develop a machine learning supervised classification model to automatically code clinical encounter transcripts using a behavioral code scheme.METHODS:
We first evaluated the efficacy of eight state-of-the-art machine learning classification models to recognize patient-provider communication behaviors operationalized by the motivational interviewing framework. Data were collected during the course of a single weight loss intervention session with 37 African American adolescents and their caregivers. We then tested the transferability of the model to a novel treatment context, 80 patient-provider interactions during routine human immunodeficiency virus (HIV) clinic visits.RESULTS:
Of the eight models tested, the support vector machine model demonstrated the best performance, achieving a .680 F1-score (a function of model precision and recall) in adolescent and .639 in caregiver sessions. Adding semantic and contextual features improved accuracy with 75.1% of utterances in adolescent and 73.8% in caregiver sessions correctly coded. With no modification, the model correctly classified 72.0% of patient-provider utterances in HIV clinical encounters with reliability comparable to human coders (k = .639).CONCLUSIONS:
The development of a validated approach for automatic behavioral coding offers an efficient alternative to traditional, resource-intensive methods with the potential to dramatically accelerate the pace of outcomes-oriented behavioral research. The knowledge gained from computer-driven behavioral research can inform clinical practice by providing clinicians with empirically supported communication strategies to tailor their conversations with patients. Lastly, automatic behavioral coding is a critical first step toward fully automated eHealth/mHealth (electronic/mobile Health) behavioral interventions.Palavras-chave
Texto completo:
1
Base de dados:
MEDLINE
Assunto principal:
Relações Profissional-Paciente
/
Comunicação
/
Pesquisa Comportamental
/
Entrevista Motivacional
/
Aprendizado de Máquina
Tipo de estudo:
Prognostic_studies
/
Qualitative_research
Limite:
Adolescent
/
Female
/
Humans
/
Male
Idioma:
En
Ano de publicação:
2019
Tipo de documento:
Article