Application of Topic Modeling on Artificial Intelligence Studies as a Foundation to Develop Ethical Guidelines in African American Dementia Caregiving.

We applied natural language processing and topic modeling to publicly available abstracts and titles of 263 papers in the scientific literature mentioning AI and demographics (corpus 1 before Covid-19, corpus 2 after Covid-19) extracted from the MEDLINE database. We found exponential growth of AI studies mentioning demographics since the pandemic (Before Covid-19: N= 40 vs. After Covid-19: N= 223) [forecast model equation: ln(Number of Records) = 250.543*ln(Year) + -1904.38, p = 0.0005229]. Topics related to diagnostic imaging, quality of life, Covid, psychology, and smartphone increased during the pandemic, while cancer-related topics decreased. The application of topic modeling to the scientific literature on AI and demographics provides a foundation for the next steps regarding developing guidelines for the ethical use of AI for African American dementia caregivers.

Comparing Themes Extracted via Topic Modeling and Manual Content Analysis: Korean-Language Discussions of Dementia on Twitter.

We randomly examined Korean-language Tweets mentioning dementia/Alzheimer's disease (n= 12,413) posted from November 28 to December 9, 2020, without limiting geographical locations. We independently applied Latent Dirichlet Allocation (LDA) topic modeling and qualitative content analysis to the texts of the Tweets. We compared the themes extracted by LDA topic modeling to those identified via manual coding methods. A total of 16 themes were detected from manual coding, with inter-rater reliability (Cohen's kappa) of 0.842. The proportions of the most prominent themes were: burdens of family caregiving (48.50%), reports of wandering/missing family members with dementia (18.12%), stigma (13.64%), prevention strategies (5.07%), risk factors (4.91%), healthcare policy (3.26%), and elder abuse/safety issues (1.75%). Seven themes whose contents were similar to themes derived from manual coding were extracted from the LDA topic modeling results (perplexity: -6.39, coherence score: 0.45). Our findings suggest that applying LDA topic modeling can be fairly effective at extracting themes from Korean Twitter discussions, in a manner analogous to qualitative coding, to gain insights regarding caregiving for family members with dementia, and our approach can be applied to other languages.

Comparing Emotional Valence Scores of Twitter Posts from Manual Coding and Machine Learning Algorithms to Gain Insights to Refine Interventions for Family Caregivers of Persons with Dementia.

We randomly extracted Korean-language Tweets mentioning dementia/Alzheimer's disease (n= 12,413) from November 28 to December 9, 2020. We independently applied three machine learning algorithms (Afinn, Syuzhet, and Bing) using natural language processing (NLP) techniques and qualitative manual scoring to assign emotional valence scores to Tweets. We then compared the means and distributions of the four emotional valence scores. Visual examination of the graphs produced indicated that each method exhibited unique patterns. The aggregated mean emotional valence scores from the NLP methods were mostly neutral, vs. slightly negative for manual coding (Afinn 0.029, 95% CI [-0.019, 0.077]; Syuzhet 0.266, [0.236, 0.295]; Bing -0.271, [-0.289, -0.252]; manual coding -1.601, [-1.632, -1.569]). One-way analysis of variance (ANOVA) showed no statistically significant differences among the four means after normalization. These findings suggest that the application of NLP can be fairly effective in extracting emotional valence scores from Korean-language Twitter content to gain insights regarding family caregiving for a person with dementia.

Applying Participatory Design Mixed-Methods Approaches to Refine Twitter-Based Social Support Interventions for African Americans and Hispanic Family Caregivers of Persons with Dementia.

We applied mixed-methods to refine our first version of the Twitter message library (English 400, translated into Spanish 400) for African Americans and Hispanic family caregivers for a person with dementia. We conducted a series of expert panels to collect quantitative and qualitative data using surveys and in-depth interviews. Using mixed methods to ensure unbiased results, the panelists first independently scored them (1 message/5 panelist) on a scale of 1 to 4 (1: lowest, 4: highest), followed by in-depth interviews and group discussions. Survey results showed that the average score was 3.47, indicating good to excellent (SD 0.35, ranges from 1.8 to 4). Quantitative surveys and qualitative interviews showed different results in emotional support messages.