Incorporating public values into evaluative criteria: Using crowdsourcing to identify criteria and standards.
Eval Program Plann
; 71: 68-82, 2018 12.
Article
en En
| MEDLINE
| ID: mdl-30165260
At its core, evaluation involves the generation of value judgments. These evaluative judgments are based on comparing an evaluand's performance to what the evaluand is supposed to do (criteria) and how well it is supposed to do it (standards). The aim of this four-phase study was to test whether criteria and standards can be set via crowdsourcing, a potentially cost- and time-effective approach to collecting public opinion data. In the first three phases, participants were presented with a program description, then asked to complete a task to either identify criteria (phase one), weigh criteria (phase two), or set standards (phase three). Phase four found that the crowd-generated criteria were high quality; more specifically, that they were clear and concise, complete, non-overlapping, and realistic. Overall, the study concludes that crowdsourcing has the potential to be used in evaluation for setting stable, high-quality criteria and standards.
Palabras clave
Texto completo:
1
Colección:
01-internacional
Base de datos:
MEDLINE
Asunto principal:
Opinión Pública
/
Evaluación de Programas y Proyectos de Salud
/
Colaboración de las Masas
Tipo de estudio:
Evaluation_studies
/
Prognostic_studies
Límite:
Humans
Idioma:
En
Revista:
Eval Program Plann
Año:
2018
Tipo del documento:
Article
País de afiliación:
Estados Unidos
Pais de publicación:
Reino Unido