Reimagining peer review as an expert elicitation process.
BMC Res Notes
; 15(1): 127, 2022 Apr 05.
Article
en En
| MEDLINE
| ID: mdl-35382867
ABSTRACT
Journal peer review regulates the flow of ideas through an academic discipline and thus has the power to shape what a research community knows, actively investigates, and recommends to policymakers and the wider public. We might assume that editors can identify the 'best' experts and rely on them for peer review. But decades of research on both expert decision-making and peer review suggests they cannot. In the absence of a clear criterion for demarcating reliable, insightful, and accurate expert assessors of research quality, the best safeguard against unwanted biases and uneven power distributions is to introduce greater transparency and structure into the process. This paper argues that peer review would therefore benefit from applying a series of evidence-based recommendations from the empirical literature on structured expert elicitation. We highlight individual and group characteristics that contribute to higher quality judgements, and elements of elicitation protocols that reduce bias, promote constructive discussion, and enable opinions to be objectively and transparently aggregated.
Palabras clave
Texto completo:
1
Colección:
01-internacional
Base de datos:
MEDLINE
Asunto principal:
Revisión por Pares
Tipo de estudio:
Prognostic_studies
/
Qualitative_research
Idioma:
En
Revista:
BMC Res Notes
Año:
2022
Tipo del documento:
Article
País de afiliación:
Reino Unido