Model fit is a fallible indicator of model quality in quantitative psychopathology research: A reply to Bader and Moshagen.

ABSTRACT

As evidenced by our exchange with Bader and Moshagen (2022), the degree to which model fit indices can and should be used for the purpose of model selection remains a contentious topic. Here, we make three core points. First, we discuss the common misconception about fit statistics' abilities to identify the "best model," arguing that mechanical application of model fit indices contributes to faulty inferences in the field of quantitative psychopathology. We illustrate the consequences of this practice through examples in the literature. Second, we highlight the parsimony-adjacent concept of fitting propensity, which is not accounted for by commonly used fit statistics. Finally, we present specific strategies to overcome interpretative bias and increase generalizability of study results and stress the importance of carefully balancing substantive and statistical criteria in model selection scenarios. (PsycInfo Database Record (c) 2022 APA, all rights reserved).