Assessment of human expertise and movement kinematics in first-person shooter games.

In contrast to traditional professional sports, there are few standardized metrics in professional esports (competitive multiplayer video games) for assessing a player's skill and ability. We assessed the performance of professional-level players in Aim LabTM, a first-person shooter training and assessment game, with two target-shooting tasks. These tasks differed primarily in target size: the task with large targets provided an incentive to be fast but imprecise and the task with large targets provided an incentive to be precise but slow. Each player's motor acuity was measured by characterizing the speed-accuracy trade-off in shot behavior: shot time (elapsed time for a player to shoot at a target) and shot spatial error (distance from center of a target). We also characterized the fine-grained kinematics of players' mouse movements. Our findings demonstrate that: 1) movement kinematics depended on task demands; 2) individual differences in motor acuity were significantly correlated with kinematics; and 3) performance, combined across the two target sizes, was poorly characterized by Fitts Law. Our approach to measuring motor acuity has widespread applications not only in esports assessment and training, but also in basic (motor psychophysics) and clinical (gamified rehabilitation) research.

Spatially Specific Working Memory Activity in the Human Superior Colliculus.

Theoretically, working memory (WM) representations are encoded by population activity of neurons with distributed tuning across the stored feature. Here, we leverage computational neuroimaging approaches to map the topographic organization of human superior colliculus (SC) and model how population activity in SC encodes WM representations. We first modeled receptive field properties of voxels in SC, deriving a detailed topographic organization resembling that of the primate SC. Neural activity within human (5 male and 1 female) SC persisted throughout a retention interval of several types of modified memory-guided saccade tasks. Assuming an underlying neural architecture of the SC based on its retinotopic organization, we used an encoding model to show that the pattern of activity in human SC represents locations stored in WM. Our tasks and models allowed us to dissociate the locations of visual targets and the motor metrics of memory-guided saccades from the spatial locations stored in WM, thus confirming that human SC represents true WM information. These data have several important implications. They add the SC to a growing number of cortical and subcortical brain areas that form distributed networks supporting WM functions. Moreover, they specify a clear neural mechanism by which topographically organized SC encodes WM representations.SIGNIFICANCE STATEMENT Using computational neuroimaging approaches, we mapped the topographic organization of human superior colliculus (SC) and modeled how population activity in SC encodes working memory (WM) representations, rather than simpler visual or motor properties that have been traditionally associated with the laminar maps in the primate SC. Together, these data both position the human SC into a distributed network of brain areas supporting WM and elucidate the neural mechanisms by which the SC supports WM.

Number Adaptation Can Be Dissociated From Density Adaptation.

Rapidly judging the number of objects in a scene is an important perceptual ability. Recent debates have centered on whether number perception is accomplished by dedicated mechanisms and, in particular, on whether number-adaptation aftereffects reflect adaptation of number per se or adaptation of related stimulus properties, such as density. Here, we report an adaptation experiment (N = 8) for which the predictions of number and density theories are diametrically opposed. We found that when a reference stimulus has higher density than an adaptation stimulus but contains fewer elements, adaptation reduces the perceived number of elements in the reference stimulus. This is consistent with number adaptation and inconsistent with density adaptation. Thus, number-adaptation aftereffects are more than a by-product of density adaptation: When density and number are dissociated, adaptation effects are in the direction predicted by adaptation to number, not density.

Distinguishing Hemodynamics from Function in the Human LGN Using a Temporal Response Model.

We developed a temporal population receptive field model to differentiate the neural and hemodynamic response functions (HRF) in the human lateral geniculate nucleus (LGN). The HRF in the human LGN is dominated by the richly vascularized hilum, a structure that serves as a point of entry for blood vessels entering the LGN and supplying the substrates of central vision. The location of the hilum along the ventral surface of the LGN and the resulting gradient in the amplitude of the HRF across the extent of the LGN have made it difficult to segment the human LGN into its more interesting magnocellular and parvocellular regions that represent two distinct visual processing streams. Here, we show that an intrinsic clustering of the LGN responses to a variety of visual inputs reveals the hilum, and further, that this clustering is dominated by the amplitude of the HRF. We introduced a temporal population receptive field model that includes separate sustained and transient temporal impulse response functions that vary on a much short timescale than the HRF. When we account for the HRF amplitude, we demonstrate that this temporal response model is able to functionally segregate the residual responses according to their temporal properties.

Larger Auditory Cortical Area and Broader Frequency Tuning Underlie Absolute Pitch.

Absolute pitch (AP), the ability of some musicians to precisely identify and name musical tones in isolation, is associated with a number of gross morphological changes in the brain, but the fundamental neural mechanisms underlying this ability have not been clear. We presented a series of logarithmic frequency sweeps to age- and sex-matched groups of musicians with or without AP and controls without musical training. We used fMRI and population receptive field (pRF) modeling to measure the responses in the auditory cortex in 61 human subjects. The tuning response of each fMRI voxel was characterized as Gaussian, with independent center frequency and bandwidth parameters. We identified three distinct tonotopic maps, corresponding to primary (A1), rostral (R), and rostral-temporal (RT) regions of auditory cortex. We initially hypothesized that AP abilities might manifest in sharper tuning in the auditory cortex. However, we observed that AP subjects had larger cortical area, with the increased area primarily devoted to broader frequency tuning. We observed anatomically that A1, R and RT were significantly larger in AP musicians than in non-AP musicians or control subjects, which did not differ significantly from each other. The increased cortical area in AP in areas A1 and R were primarily low frequency and broadly tuned, whereas the distribution of responses in area RT did not differ significantly. We conclude that AP abilities are associated with increased early auditory cortical area devoted to broad-frequency tuning and likely exploit increased ensemble encoding.SIGNIFICANCE STATEMENT Absolute pitch (AP), the ability of some musicians to precisely identify and name musical tones in isolation, is associated with a number of gross morphological changes in the brain, but the fundamental neural mechanisms have not been clear. Our study shows that AP musicians have significantly larger volume in early auditory cortex than non-AP musicians and non-musician controls and that this increased volume is primarily devoted to broad-frequency tuning. We conclude that AP musicians are likely able to exploit increased ensemble representations to encode and identify frequency.

Population Receptive Field Estimation Reveals New Retinotopic Maps in Human Subcortex.

The human subcortex contains multiple nuclei that govern the transmission of information to and among cortical areas. In the visual domain, these nuclei are organized into retinotopic maps. Because of their small size, these maps have been difficult to precisely measure using phase-encoded functional magnetic resonance imaging, particularly in the eccentricity dimension. Using instead the population receptive field model to estimate the response properties of individual voxels, we were able to resolve two previously unreported retinotopic maps in the thalamic reticular nucleus and the substantia nigra. We measured both the polar angle and eccentricity components, receptive field size and hemodynamic response function delay, in the these nuclei and in the lateral geniculate nucleus, the superior colliculus, and the lateral and intergeniculate pulvinars. The anatomical boundaries of these nuclei were delineated using multiple averaged proton density-weighted images and were used to constrain and confirm the functional activations. Deriving the retinotopic organization of these small, subcortical nuclei is the first step in exploring their response properties and their roles in neural dynamics.

Increased cortical surface area and gyrification following long-term survival from early monocular enucleation.

PURPOSE: Retinoblastoma is typically diagnosed before 5 years of age and is often treated by enucleation (surgical removal) of the cancerous eye. Here, we sought to characterize morphological changes of the cortex following long-term survival from early monocular enucleation. METHODS: Nine adults with early right-eye enucleation (≤48 months of age) due to retinoblastoma were compared to 18 binocularly intact controls. Surface area, cortical thickness, and gyrification estimates were obtained from T1 weighted images and group differences were examined. RESULTS: Early monocular enucleation was associated with increased surface area and/or gyrification in visual (i.e., V1, inferior temporal), auditory (i.e., supramarginal), and multisensory (i.e., superior temporal, inferior parietal, superior parietal) cortices compared with controls. Visual cortex increases were restricted to the right hemisphere contralateral to the remaining eye, consistent with previous subcortical data showing asymmetrical lateral geniculate nucleus volume following early monocular enucleation. CONCLUSIONS: Altered morphological development of visual, auditory, and multisensory regions occurs subsequent to long-time survival from early eye loss.

Topographic maps in human frontal cortex revealed in memory-guided saccade and spatial working-memory tasks.

We used fMRI at 3 Tesla and improved spatial resolution (2 x 2 x 2 mm(3)) to investigate topographic organization in human frontal cortex using memory-guided response tasks performed at 8 or 12 peripheral locations arranged clockwise around a central fixation point. The tasks required the location of a peripheral target to be remembered for several seconds after which the subjects either made a saccade to the remembered location (memory-guided saccade task) or judged whether a test stimulus appeared in the same or a slightly different location by button press (spatial working-memory task). With these tasks, we found two topographic maps in each hemisphere, one in the superior branch of precentral cortex and caudalmost part of the superior frontal sulcus, in the region of the human frontal eye field, and a second in the inferior branch of precentral cortex and caudalmost part of the inferior frontal sulcus, both of which greatly overlapped with activations evoked by visually guided saccades. In each map, activated voxels coded for saccade directions and memorized locations predominantly in the contralateral hemifield with neighboring saccade directions and memorized locations represented in adjacent locations of the map. Particular saccade directions or memorized locations were often represented in multiple locations of the map. The topographic activation patterns showed individual variability from subject to subject but were reproducible within subjects. Notably, only saccade-related activation, but no topographic organization, was found in the region of the human supplementary eye field in dorsomedial prefrontal cortex. Together these results show that topographic organization can be revealed outside sensory cortical areas using more complex behavioral tasks.

Representations of faces and body parts in macaque temporal cortex: a functional MRI study.

Human neuroimaging studies suggest that areas in temporal cortex respond preferentially to certain biologically relevant stimulus categories such as faces and bodies. Single-cell studies in monkeys have reported cells in inferior temporal cortex that respond selectively to faces, hands, and bodies but provide little evidence of large clusters of category-specific cells that would form "areas." We probed the category selectivity of macaque temporal cortex for representations of monkey faces and monkey body parts relative to man-made objects using functional MRI in animals trained to fixate. Two face-selective areas were activated bilaterally in the posterior and anterior superior temporal sulcus exhibiting different degrees of category selectivity. The posterior face area was more extensively activated in the right hemisphere than in the left hemisphere. Immediately adjacent to the face areas, regions were activated bilaterally responding preferentially to body parts. Our findings suggest a category-selective organization for faces and body parts in macaque temporal cortex.