Your browser doesn't support javascript.
loading
Efficiency in sequential testing: Comparing the sequential probability ratio test and the sequential Bayes factor test.
Stefan, Angelika M; Schönbrodt, Felix D; Evans, Nathan J; Wagenmakers, Eric-Jan.
Afiliação
  • Stefan AM; Department of Psychology, University of Amsterdam, Amsterdam, The Netherlands. a.m.stefan@uva.nl.
  • Schönbrodt FD; Department of Psychology, Ludwig-Maximilians-Universität München, München, Germany.
  • Evans NJ; School of Psychology, University of Queensland, St Lucia, Australia.
  • Wagenmakers EJ; Department of Psychology, University of Amsterdam, Amsterdam, The Netherlands.
Behav Res Methods ; 54(6): 3100-3117, 2022 12.
Article em En | MEDLINE | ID: mdl-35233752
In a sequential hypothesis test, the analyst checks at multiple steps during data collection whether sufficient evidence has accrued to make a decision about the tested hypotheses. As soon as sufficient information has been obtained, data collection is terminated. Here, we compare two sequential hypothesis testing procedures that have recently been proposed for use in psychological research: Sequential Probability Ratio Test (SPRT; Psychological Methods, 25(2), 206-226, 2020) and the Sequential Bayes Factor Test (SBFT; Psychological Methods, 22(2), 322-339, 2017). We show that although the two methods have different philosophical roots, they share many similarities and can even be mathematically regarded as two instances of an overarching hypothesis testing framework. We demonstrate that the two methods use the same mechanisms for evidence monitoring and error control, and that differences in efficiency between the methods depend on the exact specification of the statistical models involved, as well as on the population truth. Our simulations indicate that when deciding on a sequential design within a unified sequential testing framework, researchers need to balance the needs of test efficiency, robustness against model misspecification, and appropriate uncertainty quantification. We provide guidance for navigating these design decisions based on individual preferences and simulation-based design analyses.
Assuntos
Palavras-chave

Texto completo: 1 Coleções: 01-internacional Base de dados: MEDLINE Assunto principal: Projetos de Pesquisa Tipo de estudo: Prognostic_studies / Risk_factors_studies Limite: Humans Idioma: En Ano de publicação: 2022 Tipo de documento: Article

Texto completo: 1 Coleções: 01-internacional Base de dados: MEDLINE Assunto principal: Projetos de Pesquisa Tipo de estudo: Prognostic_studies / Risk_factors_studies Limite: Humans Idioma: En Ano de publicação: 2022 Tipo de documento: Article