RESUMEN
BACKGROUND: The rising global elderly population increases the demand for caregiving, yet traditional methods may not fully assess the challenges faced by vital informal caregivers. OBJECTIVE: To investigate the efficacy of Large Language Model (LLM) in detecting overburdened informal caregivers, benchmarking against rule-based and machine learning methods. METHODS: 1,791 eligible informal caregivers from Southern Taiwan and utilized their textual case summary reports for the LLM. We also employed structured questionnaire results for machine learning models. Furthermore, we leveraged the visualization of the LLM's attention mechanisms to enhance our understanding of the model's interpretative capabilities. RESULTS: The LLM achieved an Area Under the Receiver Operating Characteristic (AUROC) curve of 0.84 and an Area Under the Precision-Recall Curve (AUPRC) of 0.70, marking an 8% and 14% improvement over traditional methods. The visualization of the attention mechanism accurately reflected the evaluations of human experts, concentrating on descriptions of high-burden descriptions and the relationships between caregivers and recipients. CONCLUSION: This research demonstrates the notable capability of LLM to accurately identify high-burden caregivers in Long-term Care (LTC) settings. Compared to traditional approaches, LLM offers an opportunity for the future of LTC research and policymaking.
RESUMEN
BACKGROUND: Quantifying the informal caregiver burden is important for understanding the risk factors associated with caregiver overload and for evaluating the effectiveness of services provided in Long-term Care (LTC). OBJECTIVE: This study aimed to develop and validate a Caregiver Strain Index (CSI)-based score for quantifying the informal caregiver burden, while the original dataset did not fully cover evaluation items commonly included in international assessments. Subsequently, we utilized the CSI-based score to pinpoint key caregiver burden risk factors, examine the initial timing of LTC services adoption, and assess the impact of LTC services on reducing caregiver burden. METHODS: The study analyzed over 28,000 LTC cases in Southern Taiwan from August 2019 to December 2022. Through multiple regression analysis, we identified significant risk factors associated with caregiver burden and examined changes in this burden after utilizing various services. Survival analysis was employed to explore the relationship between adopting the first LTC services and varying levels of caregiver burden. RESULTS: We identified 126 significant risk factors for caregiver burden. The most critical factors included caregiving for other disabled family members or children under the age of three (ß = 0.74, p < 0.001), the employment status of the caregiver (ß = 0.30-0.53, p < 0.001), the frailty of the care recipient (ß = 0.28-0.31, p < 0.001), and the behavioral symptoms of dementia in care recipients (ß = 0.28-2.60, p < 0.05). Generally, caregivers facing higher burdens sought LTC services earlier, and providing home care services alleviated the caregiver's burden. CONCLUSION: This comprehensive study suggests policy refinements to recognize high-risk caregivers better early and provide timely support to improve the overall well-being of both informal caregivers and care recipients.