Back to the drawing board-The relationship between self-report and neuropsychological tests of cognitive flexibility in clinical cohorts: A systematic review and meta-analysis.

OBJECTIVE: Cognitive flexibility has been previously described as the ability to adjust cognitive and behavioral strategies in response to changing contextual demands. Cognitive flexibility is typically assessed via self-report questionnaires and performance on neuropsychological tests in research and clinical practice. A common assumption among researchers and clinicians is that self-report and neuropsychological tests of cognitive flexibility assess the same or similar constructs, but the extent of the relationship between these two assessment approaches in clinical cohorts remains unknown. We undertook a systematic review and meta-analysis to determine the relationship between self-report and neuropsychological tests of cognitive flexibility in clinical samples. METHOD: We searched 10 databases and relevant gray literature (e.g., other databases and pearling) from inception to October 2020 and used the Preferred Reporting Items for Systematic Reviews and Meta-Analyses reporting guidelines. Eleven articles including 405 participants satisfied our eligibility criteria. RESULTS: A multilevel random-effects meta-analysis revealed no relationship between self-report and neuropsychological tests of cognitive flexibility (0.01, 95% CI [-0.16 to 0.18]). Individual random-effects meta-analyses between 12 different tests pairs also found no relationship. CONCLUSION: Based on our results, it is clear that the two assessment approaches of cognitive flexibility provide independent information-they do not assess the same construct. These findings have important ramifications for future research and clinical practice-there is a need to reconsider what constructs self-report and neuropsychological tests of "cognitive flexibility" actually assess, and avoid the interchangeable use of these assessments in clinical samples. (PsycInfo Database Record (c) 2022 APA, all rights reserved).

Same room - different windows? A systematic review and meta-analysis of the relationship between self-report and neuropsychological tests of cognitive flexibility in healthy adults.

Cognitive flexibility can be thought of as the ability to effectively adapt one's cognitive and behavioural strategies in response to changing task or environmental demands. To substantiate the common inference that self-report and neuropsychological tests of cognitive flexibility provide 'different windows into the same room', we undertook a systematic review and meta-analysis to determine whether self-report and neuropsychological tests of cognitive flexibility are related in healthy adults. Ten databases and relevant grey literature were searched from inception. The Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines were adhered to. Twenty-one articles satisfied our inclusion criteria. A multi-level random-effects meta-analysis revealed no relationship (0.05, 95% CI = -0.00 to 0.10). Random-effects meta-analyses raised the possibility that the Cognitive Flexibility Scale and the Trail Making Test - part B (time) may be related (0.19, 95% CI = 0.06 to 0.31). We conclude that the relationship between self-report and neuropsychological tests of cognitive flexibility is not large enough to be considered convincing evidence for the two assessment approaches sharing construct validity. These results have clear implications for assessing and interpreting cognitive flexibility research and clinical practice.