Optimally generate policy-based evidence before scaling.

Social scientists have increasingly turned to the experimental method to understand human behaviour. One critical issue that makes solving social problems difficult is scaling up the idea from a small group to a larger group in more diverse situations. The urgency of scaling policies impacts us every day, whether it is protecting the health and safety of a community or enhancing the opportunities of future generations. Yet, a common result is that, when we scale up ideas, most experience a 'voltage drop'-that is, on scaling, the cost-benefit profile depreciates considerably. Here I argue that, to reduce voltage drops, we must optimally generate policy-based evidence. Optimality requires answering two crucial questions: what information should be generated and in what sequence. The economics underlying the science of scaling provides insights into these questions, which are in some cases at odds with conventional approaches. For example, there are important situations in which I advocate flipping the traditional social science research model to an approach that, from the beginning, produces the type of policy-based evidence that the science of scaling demands. To do so, I propose augmenting efficacy trials by including relevant tests of scale in the original discovery process, which forces the scientist to naturally start with a recognition of the big picture: what information do I need to have scaling confidence?

Health Sciences cultural safety education in Australia, Canada, New Zealand, and the United States: a literature review.

OBJECTIVES: To review the research literature on cultural safety education within post-secondary health science programs. METHODS: We conducted health and social science database searches from 1996-2016, using combined keywords: cultural competence or safety; teaching or curriculum; universities, polytechnics or professional programs; and Aboriginal or Indigenous. In dyads, authors selected, and reviewed studies independently followed by discussion and consensus to identify thematic linkages of major findings. RESULTS: A total of 1583 abstracts and 122 full-text articles were reviewed with 40 selected for final inclusion. Publications from Australia, Canada, New Zealand and the United States described curriculum development and delivery. A variety of evaluation approaches were used including anecdotal reports, focus groups, interviews, course evaluations, reflective journals, pre-post surveys, critical reflective papers, and exam questions. Duration and depth of curricular exposure ranged from one day to integration across a six-year program.  Changes in student knowledge, attitude, self-confidence, and behaviour when working with Indigenous populations were reported. Cultural safety education and application to practice were shown to be linked to improved relationships, healthier outcomes, and increased number of Indigenous people entering health education programs and graduates interested in working in diverse communities. CONCLUSIONS: This review provides a summary of multidisciplinary didactic and experiential instructional approaches to cultural safety education and the impact on students, educators and Indigenous people.  Institutional support, strategic planning and cultural safety curriculum policy within post-secondary settings and community engagement are imperative for positive student experiences, advocacy, and actions toward health equity and improved health for Indigenous people and communities.

Improving public health by respecting autonomy: using social science research to enfranchise vulnerable prison populations.

It is widely recognised that prisoners constitute a vulnerable population that is subject to numerous health inequalities and merits special protection. Improving prisoners' access to healthcare by ensuring adherence to the principle of equivalence has been the main focus of efforts to ensure that their health is not jeopardised. However, another means of respecting prisoners' autonomy and improving their health is to involve them (and prison staff) in social science research within prisons. Such research not only produces valuable data which can be used to assess whether the principle of equivalence is being respected; it also enfranchises prisoners by allowing them to air concerns about perceived ill-treatment and influence their environment. If prison authorities enable such research and adjust policy accordingly, both they and prisoners will benefit from the increased level of respect for prisoners' autonomy, and the improvements in individual and public health that flow from this. Conducting social science research in prisons enables the creation of a virtuous cycle of respect that makes prisons safer and healthier places.

The relationship between motivation, monetary compensation, and data quality among US- and India-based workers on Mechanical Turk.

In this study, we examined data quality among Amazon Mechanical Turk (MTurk) workers based in India, and the effect of monetary compensation on their data quality. Recent studies have shown that work quality is independent of compensation rates, and that compensation primarily affects the quantity but not the quality of work. However, the results of these studies were generally based on compensation rates below the minimum wage, and far below a level that was likely to play a practical role in the lives of workers. In this study, compensation rates were set around the minimum wage in India. To examine data quality, we developed the squared discrepancy procedure, which is a task-based quality assurance approach for survey tasks whose goal is to identify inattentive participants. We showed that data quality is directly affected by compensation rates for India-based participants. We also found that data were of a lesser quality among India-based than among US participants, even when optimal payment strategies were utilized. We additionally showed that the motivation of MTurk users has shifted, and that monetary compensation is now reported to be the primary reason for working on MTurk, among both US- and India-based workers. Overall, MTurk is a constantly evolving marketplace where multiple factors can contribute to data quality. High-quality survey data can be acquired on MTurk among India-based participants when an appropriate pay rate is provided and task-specific quality assurance procedures are utilized.

From randomized controlled trials to evidence grading schemes: current state of evidence-based practice in social sciences.

With the advance of web search and navigation technology, enormous amount of information, non-information, and misinformation may be obtained in milliseconds in response to questions about 'what works' in social sciences. Today, policy makers in non-medical public service arenas are under increasing pressure to make sound decisions based on scientific evidence. Some of these decisions are a matter of legal requirement. This paper shows how such movements are closely aligned with the evolution of organizations that develop and apply evidence standards and evidence grading schemes within the social science communities. The current state of evidence-based practice in social sciences is examined by reviewing the latest development of randomized trials and evidence grading schemes in the fields of education, criminal justice, and social welfare. Studies conducted under the auspices of the Campbell Collaboration and What Works Clearinghouse are used to illustrate ingredients of evidence grading schemes, graphic display of results of systematic reviews, and discrepancies of evidence derived from randomized trials and non-experimental trials. Furthermore, it is argued that the use of evidence on 'what works' depends on the potential users' awareness, understanding of the evidence, as well as their capacity and willingness to use it. Awareness and understanding depends on the world wide web and its augmentations, while capacity and willingness depends more on incentives to use good evidence and on political and ethical values. Implications for the future development of evidence grading organizations are discussed.

Qualitative science policy.

Qualitative research struggles against a tide of quantitative methods. To assist in this struggle, it is useful to consider the historical and philosophical origins of quantitative methods as well as criticisms that have been raised against them. Although these criticisms have often been restricted to discussions in the philosophy of science, they have become increasingly prominent in debates regarding science policy. This article thus reviews current science policy debates concerning scientific autonomy and the linear model of science-society relationships. Then, having considered the multiple meanings of quality, it argues for a science policy reassessment of quantitative research, for deeper engagements between science policy and the social sciences, and finally, for a more explicit alliance between science policy and qualitative methods.

Quality-of-life measurements: origin and pathogenesis.

Despite extensive growth in recent years, the field of "quality-of-life" appraisal still evokes debate about basic perception of the concept and is accompanied by a plethora of indexes for measurement. One prime reason for the problems is that the measurements have been transferred from two separate sources - medical health status indexes and social-science population indexes - neither of which was designed for appraising the particular personal distinctions of the way people feel about their own quality of life. When regulatory and commercial incentives were offered for measuring patients' quality of life, it became appraised with the indexes available from the medical and psychosocial sources, even though neither set of indexes was specifically intended for that purpose. They are not developed from the basic principle that a person's "quality of life" is a state of mind, not a state of health, which is uniquely perceived by that person, and which will not be appropriately appraised unless the most cogent personal components are allowed suitable expressions. An approach that lets patients state their own opinions directly can offer the "face validity" or "common sense" that now seems absent from the generally applied measurements.