The Problem of Limited Inter-rater Agreement in Modelling Music Similarity.

One of the central goals of Music Information Retrieval (MIR) is the quantification of similarity between or within pieces of music. These quantitative relations should mirror the human perception of music similarity, which is however highly subjective with low inter-rater agreement. Unfortunately this principal problem has been given little attention in MIR so far. Since it is not meaningful to have computational models that go beyond the level of human agreement, these levels of inter-rater agreement present a natural upper bound for any algorithmic approach. We will illustrate this fundamental problem in the evaluation of MIR systems using results from two typical application scenarios: (i) modelling of music similarity between pieces of music; (ii) music structure analysis within pieces of music. For both applications, we derive upper bounds of performance which are due to the limited inter-rater agreement. We compare these upper bounds to the performance of state-of-the-art MIR systems and show how the upper bounds prevent further progress in developing better MIR systems.

Internal validation of STRmix™ - A multi laboratory response to PCAST.

We report a large compilation of the internal validations of the probabilistic genotyping software STRmix™. Thirty one laboratories contributed data resulting in 2825 mixtures comprising three to six donors and a wide range of multiplex, equipment, mixture proportions and templates. Previously reported trends in the LR were confirmed including less discriminatory LRs occurring both for donors and non-donors at low template (for the donor in question) and at high contributor number. We were unable to isolate an effect of allelic sharing. Any apparent effect appears to be largely confounded with increased contributor number.

Viewing experience of 3DTV: An exploration of the feeling of sickness and presence in a shopping mall.

The adoption and deployment of 3DTV can be seen as a major step in the history of television, comparable to the transition from analogue to digital and standard to high definition TV. Although 3D is expected to emerge from the cinema to peoples' home, there is still a lack of knowledge on how people (future end users) perceive 3DTV and how this influences their viewing experience as well as their acceptance of 3DTV. Within this paper, findings from a three-day field evaluation study on people's 3DTV experiences, focusing on the feeling of sickness and presence, are presented. Contrary to the traditional controlled laboratory setting, the study was conducted in the public setting of a shopping center and involved 700 participants. The study revealed initial insights on users' feeling of presence and sickness when watching 3DTV content. Results from this explorative study show that most of the participants reported symptoms of sickness after watching 3DTV with an effect of gender and age on the reported feeling of sickness. Our results further suggest that the users' previous experience with 3D content has an influence on how realistic people rate the viewing experience and how involved they feel. The particularities of the study environment, a shopping mall, are reflected in our findings and future research directions and action points for investigating people's viewing experiences of 3DTV are summarized.