Pitfalls in post hoc analyses of population receptive field data.
Neuroimage
; 263: 119557, 2022 11.
Article
em En
| MEDLINE
| ID: mdl-35970472
ABSTRACT
Data binning involves grouping observations into bins and calculating bin-wise summary statistics. It can cope with overplotting and noise, making it a versatile tool for comparing many observations. However, data binning goes awry if the same observations are used for binning (selection) and contrasting (selective analysis). This creates circularity, biasing noise components and resulting in artifactual changes in the form of regression towards the mean. Importantly, these artifactual changes are a statistical necessity. Here, we use (null) simulations and empirical repeat data to expose this flaw in the scope of post hoc analyses of population receptive field data. In doing so, we reveal that the type of data analysis, data properties, and circular data cleaning are factors shaping the appearance of such artifactual changes. We furthermore highlight that circular data cleaning and circular sorting of change scores are selection practices that result in artifactual changes even without circular data binning. These pitfalls might have led to erroneous claims about changes in population receptive fields in previous work and can be mitigated by using independent data for selection purposes. Our evaluations highlight the urgency for us researchers to make the validation of analysis pipelines standard practice.
Palavras-chave
Texto completo:
1
Base de dados:
MEDLINE
Assunto principal:
Análise de Dados
Idioma:
En
Revista:
Neuroimage
Assunto da revista:
DIAGNOSTICO POR IMAGEM
Ano de publicação:
2022
Tipo de documento:
Article