Crowdsourcing in health and medical research: a systematic review.

BACKGROUND: Crowdsourcing is used increasingly in health and medical research. Crowdsourcing is the process of aggregating crowd wisdom to solve a problem. The purpose of this systematic review is to summarize quantitative evidence on crowdsourcing to improve health. METHODS: We followed Cochrane systematic review guidance and systematically searched seven databases up to September 4th 2019. Studies were included if they reported on crowdsourcing and related to health or medicine. Studies were excluded if recruitment was the only use of crowdsourcing. We determined the level of evidence associated with review findings using the GRADE approach. RESULTS: We screened 3508 citations, accessed 362 articles, and included 188 studies. Ninety-six studies examined effectiveness, 127 examined feasibility, and 37 examined cost. The most common purposes were to evaluate surgical skills (17 studies), to create sexual health messages (seven studies), and to provide layperson cardio-pulmonary resuscitation (CPR) out-of-hospital (six studies). Seventeen observational studies used crowdsourcing to evaluate surgical skills, finding that crowdsourcing evaluation was as effective as expert evaluation (low quality). Four studies used a challenge contest to solicit human immunodeficiency virus (HIV) testing promotion materials and increase HIV testing rates (moderate quality), and two of the four studies found this approach saved money. Three studies suggested that an interactive technology system increased rates of layperson initiated CPR out-of-hospital (moderate quality). However, studies analyzing crowdsourcing to evaluate surgical skills and layperson-initiated CPR were only from high-income countries. Five studies examined crowdsourcing to inform artificial intelligence projects, most often related to annotation of medical data. Crowdsourcing was evaluated using different outcomes, limiting the extent to which studies could be pooled. CONCLUSIONS: Crowdsourcing has been used to improve health in many settings. Although crowdsourcing is effective at improving behavioral outcomes, more research is needed to understand effects on clinical outcomes and costs. More research is needed on crowdsourcing as a tool to develop artificial intelligence systems in medicine. TRIAL REGISTRATION: PROSPERO: CRD42017052835. December 27, 2016.

Identifying high risk subgroups of MSM: a latent class analysis using two samples.

BACKGROUND: Latent class analyses (LCA) are increasingly being used to target specialized HIV interventions, but generalizability of emergent population structures across settings has yet to be considered. We compare LCA performed on two online samples of HIV negative Chinese men who have sex with men (MSM) to detect more generalizable latent class structures and to assess the extent to which sampling considerations impact the validity of LCA results. METHODS: LCAs were performed on an 1) nationwide online survey which involved no in-person contact with study staff and a 2) sentinel surveillance survey in which participants underwent HIV and syphilis testing in the city of Guangzhou, both conducted in 2014. Models for each sample were informed by risk factors for HIV acquisition in MSM that were common to both datasets. RESULTS: An LCA of the Guangzhou sentinel surveillance data indicated the presence of two relatively similar classes, differing only by the greater tendency of one to report group sex. In contrast an LCA of the nationwide survey identified three classes, two of which shared many of the same features as those identified in the Guangzhou survey, including the fact that they were mainly distinguished by group sex behaviors. The final latent class in the nationwide survey was composed of members with notably few risk behaviors. CONCLUSIONS: Comparisons of the latent class structures of each sample lead us to conclude that the nationwide online sample captured a larger, possibly more representative group of Chinese MSM comprised of a larger, higher risk group and a small yet distinct lower group with few reported behaviors. The absence of a lower risk group in the Guangzhou sentinel surveillance dataset suggests that MSM recruited into studies involving free HIV/STI testing may oversample MSM with higher risk behaviors and therefore greater risk perception. Lastly, two types of higher risk MSM were emergent across both samples distinguished largely by their recent group sex behaviors. Higher odds not only of self-reported HIV infection but also of closeted tendencies and gender fluid identities in this highest risk group suggest that interacting factors drive individual and structural facets of HIV risk.

Correction to: Identifying high risk subgroups of MSM: a latent class analysis using two samples.

Following publication of the original article [1], the author reported his family name has been marked as the first name. His given name is M. Kumi and his family name is Smith.

Ethical Concerns of and Risk Mitigation Strategies for Crowdsourcing Contests and Innovation Challenges: Scoping Review.

BACKGROUND: Crowdsourcing contests (also called innovation challenges, innovation contests, and inducement prize contests) can be used to solicit multisectoral feedback on health programs and design public health campaigns. They consist of organizing a steering committee, soliciting contributions, engaging the community, judging contributions, recognizing a subset of contributors, and sharing with the community. OBJECTIVE: This scoping review describes crowdsourcing contests by stage, examines ethical problems at each stage, and proposes potential ways of mitigating risk. METHODS: Our analysis was anchored in the specific example of a crowdsourcing contest that our team organized to solicit videos promoting condom use in China. The purpose of this contest was to create compelling 1-min videos to promote condom use. We used a scoping review to examine the existing ethical literature on crowdsourcing to help identify and frame ethical concerns at each stage. RESULTS: Crowdsourcing has a group of individuals solve a problem and then share the solution with the public. Crowdsourcing contests provide an opportunity for community engagement at each stage: organizing, soliciting, promoting, judging, recognizing, and sharing. Crowdsourcing poses several ethical concerns: organizing-potential for excluding community voices; soliciting-potential for overly narrow participation; promoting-potential for divulging confidential information; judging-potential for biased evaluation; recognizing-potential for insufficient recognition of the finalist; and sharing-potential for the solution to not be implemented or widely disseminated. CONCLUSIONS: Crowdsourcing contests can be effective and engaging public health tools but also introduce potential ethical problems. We present methods for the responsible conduct of crowdsourcing contests.

Faster and Riskier? Online Context of Sex Seeking Among Men Who Have Sex With Men in China.

BACKGROUND: Many men who have sex with men (MSM) seek sex partners online, creating barriers and opportunities for human immunodeficiency virus prevention. The purpose of this study was to examine the characteristics of MSM and the risks associated with seeking sex through websites, gay apps, and both platforms in China. METHODS: Data were collected through a cross-sectional online survey from September through October 2014 from 3 large gay Web portals. Sociodemographic information, sexual behaviors, and online sex seeking behaviors were measured. Multinomial logistic regression was performed to compare sexual risk behaviors among website users, gay app users, and men who used both platforms. RESULTS: Of the 1201 participants, 377 (31.4%) were website-only users, 487 (40.5%) were gay app-only users, and 337 (28.0%) were men who used both platforms. These 3 MSM subgroups have distinct sociodemographic characteristics. Overall, 57.6% of participants reported having engaged in condomless anal sex with their last male partner in the past 6 months, but there was no significant difference in condomless sex between the 3 groups. Men who used both platforms viewed more sexually transmitted disease-related messages than website-only users (adjusted odds ratio, 2.19; 95% confidence interval, 1.57-3.05). CONCLUSIONS: Condom usage behaviors were unaffected by the medium through which sexual partners were found. However, the high frequency of condomless sex suggests that websites and gay apps are both risk environments. This study suggests using multiple platforms for human immunodeficiency virus/sexually transmitted disease social media interventions may be useful.

Systematic review of innovation design contests for health: spurring innovation and mass engagement.

We undertook a systematic review evaluating the effectiveness and cost of health-focused innovation design contests. We followed Cochrane guidance and systematically searched eight databases. Articles were included if they reported an open contest focused on improving health, required participants submit finished design solutions and contained a prize structure. We searched 3579 citations, identifying 29 health-focused innovation design contests which collectively received 15494 contest submissions. Contests solicited submissions worldwide (7) and exclusively from North America (13), Asia (4), Africa (2), Australia (2) and Europe (1). Submissions per contest ranged from 3 to 11354 (median of 73). Contest entrants were tasked with helping develop health promotion messages (HPM) (25) and improve predictive clinical models, protocols and/or algorithms (4). Two types of contests emerged-those focused on high-quality, innovative outcomes and those focused on the process of mass community engagement. All outcome-oriented contests had innovation design contest solutions equivalent or superior to the comparator (100%; 7/7). Two of two studies found that innovation design contests saved money (100%; 2/2). Five of seven process-oriented contests concluded the contest improved at least one health indicator (71%; 5/7). Innovation design contests are an effective way to solicit innovative solutions to health problems and spur mass community engagement.

The association between pathological gambling and suicidality in treatment-seeking pathological gamblers in South Africa.

BACKGROUND: A number of studies have noted a significant association between suicidality and pathological gambling (PG), but the exact relationship has not been extensively characterized. It is unclear whether gambling precipitates suicidality, or whether underlying psychiatric problems, such as mood disturbances, lead to both gambling and suicidality. Furthermore, all published data on the association between suicidality and gambling is from high-income countries, and the nature of this relationship in low- and middle-income countries, such as South Africa, has not been explored. METHODS: The relationship between gambling and suicidality was investigated in individuals who had called the South African National Responsible Gambling Programme's helpline. Associations between sociodemographic factors, severity of gambling symptoms, comorbid psychiatric disorders, family history of psychiatric disorders, and suicidality were assessed. RESULTS: Data indicated that suicidality in PG is associated with sociodemographic factors (female sex, being unmarried, and unemployment), clinical factors (severity of gambling, personal history of comorbid psychiatric disorders, particularly depression), and a family history of psychiatric disorders. CONCLUSIONS: A knowledge of risk factors for suicidality is important when assessing and counseling individuals who have PG, and may be a useful tool in preventing suicidal behaviors. This study provides additional evidence that treatment of PG should include a focus on comorbid psychiatric illnesses.