Linguistic effects on news headline success: Evidence from thousands of online field experiments (Registered Report).

What makes written text appealing? In this registered report, we study the linguistic characteristics of news headline success using a large-scale dataset of field experiments (A/B tests) conducted on the popular website Upworthy.com comparing multiple headline variants for the same news articles. This unique setup allows us to control for factors that could otherwise have important confounding effects on headline success. Based on the prior literature and an exploratory portion of the data, we formulated hypotheses about the linguistic features associated with statistically superior headlines, previously published as a registered report protocol. Here, we report the findings based on a much larger portion of the data that became available after the publication of our registered report protocol. Our registered findings contribute to resolving competing hypotheses about the linguistic features that affect the success of text and provide avenues for research into the psychological mechanisms that are activated by those features.

Quantifying social organization and political polarization in online platforms.

Mass selection into groups of like-minded individuals may be fragmenting and polarizing online society, particularly with respect to partisan differences1-4. However, our ability to measure the social makeup of online communities and in turn, to understand the social organization of online platforms, is limited by the pseudonymous, unstructured and large-scale nature of digital discussion. Here we develop a neural-embedding methodology to quantify the positioning of online communities along social dimensions by leveraging large-scale patterns of aggregate behaviour. Applying our methodology to 5.1 billion comments made in 10,000 communities over 14 years on Reddit, we measure how the macroscale community structure is organized with respect to age, gender and US political partisanship. Examining political content, we find that Reddit underwent a significant polarization event around the 2016 US presidential election. Contrary to conventional wisdom, however, individual-level polarization is rare; the system-level shift in 2016 was disproportionately driven by the arrival of new users. Political polarization on Reddit is unrelated to previous activity on the platform and is instead temporally aligned with external events. We also observe a stark ideological asymmetry, with the sharp increase in polarization in 2016 being entirely attributable to changes in right-wing activity. This methodology is broadly applicable to the study of online interaction, and our findings have implications for the design of online platforms, understanding the social contexts of online behaviour, and quantifying the dynamics and mechanisms of online polarization.

Linguistic effects on news headline success: Evidence from thousands of online field experiments (Registered Report Protocol).

What makes written text appealing? In this registered report protocol, we propose to study the linguistic characteristics of news headline success using a large-scale dataset of field experiments (A/B tests) conducted on the popular website Upworthy comparing multiple headline variants for the same news articles. This unique setup allows us to control for factors that can have crucial confounding effects on headline success. Based on prior literature and a pilot partition of the data, we formulate hypotheses about the linguistic features that are associated with statistically superior headlines. We will test our hypotheses on a much larger partition of the data that will become available after the publication of this registered report protocol. Our results will contribute to resolving competing hypotheses about the linguistic features that affect the success of text and will provide avenues for research into the psychological mechanisms that are activated by those features.

Personal bests as reference points.

Personal bests act as reference points. Examining 133 million chess games, we find that players exert effort to set new personal best ratings and quit once they have done so. Although specific and difficult goals have been shown to inspire greater motivation than vague pronouncements to "do your best," doing one's best can be a specific and difficult goal-and, as we show, motivates in a manner predicted by loss aversion.

Characterization of the Medical Symptom Validity Test in evaluation of clinically referred memory disorders clinic patients.

We prospectively evaluated performance of 63 referrals to a memory disorders clinic who received the Medical Symptom Validity Test (MSVT) as part of their standard neuropsychological evaluation. The patients were grouped based on independent medical diagnoses and presence or absence of a potential financial incentive to under-perform. Twenty-seven patients (42.9%) scored below cutoffs on the MSVT symptom validity indices. Two individuals in the potential financial incentive group showed clear signs of invalid responding (18.2%). Twenty-two of the remaining 25 patients who failed the symptom validity indices corresponded to the dementia profile. Three individuals did not correspond to the dementia profile but are thought to have performed validly representing a 4.8% false positive rate. When considering all MSVT indices, the base rate of invalid responding in the potential financial incentive to under-perform group increased to 27.3%. Combining all groups our base rate of invalid responding was 4.8%. Specific performances are presented.