Spatiotemporal dynamics of perisaccadic remapping in humans revealed by classification images,J Vis, 4 (12), 11.

We actively scan our environment with fast ballistic movements called saccades, which create large and rapid displacements of the image on the retina. At the time of saccades, vision becomes transiently distorted in many ways: Briefly flashed stimuli are displaced in space and in time, and spatial and temporal intervals appear compressed. Here we apply the psychophysical technique of classification images to study the spatiotemporal dynamics of visual mechanisms during saccades. We show that saccades cause gross distortions of the classification images. Before the onset of saccadic eye movements, the positive lobes of the images become enlarged in both space and in time and also shifted in a systematic manner toward the pre-saccadic fixation (in space) and anticipated in time by about 50 ms. The transient reorganization creates a spatiotemporal organization oriented in the direction of saccadic-induced motion at the time of saccades, providing a potential mechanism for integrating stimuli across saccades, facilitating stable and continuous vision in the face of constant eye movements.

Visual motion distorts visual and motor space, J Vis, 2 (12),

Mapping of number onto space is fundamental to mathematics and measurement. Previous research suggests that while typical adults with mathematical schooling map numbers veridically onto a linear scale, pre-school children and adults without formal mathematics training, as well as individuals with dyscalculia, show strong compressive, logarithmic-like non-linearities when mapping both symbolic and non-symbolic numbers onto the numberline. Here we show that the use of the linear scale is dependent on attentional resources. We asked typical adults to position clouds of dots on a numberline of various lengths. In agreement with previous research, they did so veridically under normal conditions, but when asked to perform a concurrent attentionally-demanding conjunction task, the mapping followed a compressive, non-linear function. We model the non-linearity both by the commonly assumed logarithmic transform, and also with a Bayesian model of central tendency. These results suggest that veridical representation numerosity requires attentional mechanisms.

A comparative study of face processing using scrambled faces,Perception, 4 (41), 460-473.

It is a widespread assumption that all primate species process faces in the same way because the species are closely related and they engage in similar social interactions. However, this approach ignores potentially interesting and informative differences that may exist between species. This paper describes a comparative study of holistic face processing. Twelve subjects (six chimpanzees Pan troglodytes and six rhesus monkeys Macaca mulatta) were trained to discriminate whole faces (faces with features in their canonical position) and feature-scrambled faces in two separate conditions. We found that both species tended to match the global configuration of features over local features, providing strong evidence of global precedence. In addition, we show that both species were better able to generalize from a learned configuration to an entirely novel configuration when they were first trained to match feature-scrambled faces compared to when they were trained with whole faces. This result implies that the subjects were able to access local information easier when facial features were presented in a scrambled configuration and is consistent with a holistic processing hypothesis. Interestingly, these data also suggest that, while holistic processing in chimpanzees is tuned to own-species faces, monkeys have a more general approach towards all faces. Thus, while these data confirm that both chimpanzees and rhesus monkeys process faces holistically, they also indicate that there are differences between the species that warrant further investigation.

Spatiotopic perceptual maps in humans: evidence from motion adaptation,Proc Biol Sci, 1740 (279), 3091-3097.

How our perceptual experience of the world remains stable and continuous despite the frequent repositioning eye movements remains very much a mystery. One possibility is that our brain actively constructs a spatiotopic representation of the world, which is anchored in external-or at least head-centred-coordinates. In this study, we show that the positional motion aftereffect (the change in apparent position after adaptation to motion) is spatially selective in external rather than retinal coordinates, whereas the classic motion aftereffect (the illusion of motion after prolonged inspection of a moving source) is selective in retinotopic coordinates. The results provide clear evidence for a spatiotopic map in humans: one which can be influenced by image motion.

Impaired visual size-discrimination in children with movement disorders,Neuropsychologia, 8 (50), 1838-1843.

Multisensory integration of spatial information occurs late in childhood, at around eight years (Gori, Del Viva, Sandini, & Burr, 2008). For younger children, the haptic system dominates size discrimination and vision dominates orientation discrimination: the dominance may reflect sensory calibration, and could have direct consequences on children born with specific sensory disabilities. Here we measure thresholds for visual discrimination of orientation and size in children with movement disorders of upper limbs. Visual orientation discrimination was very similar to the age-matched typical children, but visual size discrimination thresholds were far worse, in all eight individuals with early-onset movement disorder. This surprising and counterintuitive result is readily explained by the cross-sensory calibration hypothesis: when the haptic sense is unavailable for manipulation, it cannot be readily used to estimate size, and hence to calibrate the visual experience of size: visual discrimination is subsequently impaired. This complements a previous study showing that non-sighted children have reduced acuity for haptic orientation, but not haptic size, discriminations (Gori, Sandini, Martinoli, & Burr, 2010). Together these studies show that when either vision or haptic manipulation is impaired, the impairment also impacts on complementary sensory systems that are calibrated by that one.

When the world becomes ‘too real’: a Bayesian explanation of autistic perception,Trends Cogn Sci, 10 (16), 504-510.

Perceptual experience is influenced both by incoming sensory information and prior knowledge about the world, a concept recently formalised within Bayesian decision theory. We propose that Bayesian models can be applied to autism – a neurodevelopmental condition with atypicalities in sensation and perception – to pinpoint fundamental differences in perceptual mechanisms. We suggest specifically that attenuated Bayesian priors – ‘hypo-priors’ – may be responsible for the unique perceptual experience of autistic people, leading to a tendency to perceive the world more accurately rather than modulated by prior experience. In this account, we consider how hypo-priors might explain key features of autism – the broad range of sensory and other non-social atypicalities–in addition to the phenomenological differences in autistic perception.

Active movement restores veridical event-timing after tactile adaptation,J Neurophysiol, 8 (108), 2092-2100.

Growing evidence suggests that time in the subsecond range is tightly linked to sensory processing. Event-time can be distorted by sensory adaptation, and many temporal illusions can accompany action execution. In this study, we show that adaptation to tactile motion causes a strong contraction of the apparent duration of tactile stimuli. However, when subjects make a voluntary motor act before judging the duration, it annuls the adaptation-induced temporal distortion, reestablishing veridical event-time. The movement needs to be performed actively by the subject: passive movement of similar magnitude and dynamics has no effect on adaptation, showing that it is the motor commands themselves, rather than reafferent signals from body movement, which reset the adaptation for tactile duration. No other concomitant perceptual changes were reported (such as apparent speed or enhanced temporal discrimination), ruling out a generalized effect of body movement on somatosensory processing. We suggest that active movement resets timing mechanisms in preparation for the new scenario that the movement will cause, eliminating inappropriate biases in perceived time. Our brain seems to utilize the intention-to-move signals to retune its perceptual machinery appropriately, to prepare to extract new temporal information.

The development of speed discrimination abilities,Vision Res, (70), 27-33.

The processing of speed is a critical part of a child’s visual development, allowing children to track and interact with moving objects. Despite such importance, no study has investigated the developmental trajectory of speed discrimination abilities or precisely when these abilities become adult-like. Here, we measured speed discrimination thresholds in 5-, 7-, 9-, 11-year-olds and adults using random dot stimuli with two different reference speeds (slow: 1.5 deg/s; fast: 6 deg/s). Sensitivity for both reference speeds improved exponentially with age and, at all ages, participants were more sensitive to the faster reference speed. However, sensitivity to slow speeds followed a more protracted developmental trajectory than that for faster speeds. Furthermore, sensitivity to the faster reference speed reached adult-like levels by 11 years, whereas sensitivity to the slower reference speed was not yet adult-like by this age. Different developmental trajectories may reflect distinct systems for processing fast and slow speeds. The reasonably late development of speed processing abilities may be due to inherent limits in the integration of neuronal responses in motion-sensitive areas in early childhood.

Plasticità ed adattabilità della visione,Giornale Italiano di Psicologia, (3), 517-522.

Constructing stable spatial maps of the world,Perception, 11 (41), 1355-1372.

To interact rapidly and effectively with our environment, our brain needs access to a neural representation—or map—of the spatial layout of the external world. However, the construction of such a map poses major challenges to the visual system, given that the images on our retinae depend on where the eyes are looking, and shift each time we move our eyes, head, and body to explore the world. Much research has been devoted to how the stability is achieved, with the debate often polarized between the utility of spatiotopic maps (that remain solid in external coordinates), as opposed to transiently updated retinotopic maps. Our research suggests that the visual system uses both strategies to maintain stability. f MRI, motion-adaptation, and saccade-adaptation studies demonstrate and characterize spatiotopic neural maps within the dorsal visual stream that remain solid in external rather than retinal coordinates. However, the construction of these maps takes time (up to 500 ms) and attentional resources. To solve the immediate problems created by individual saccades, we postulate the existence of a separate system to bridge each saccade with neural units that are ‘transiently craniotopic’. These units prepare for the effects of saccades with a shift of their receptive fields before the saccade starts, then relaxing back into their standard position during the saccade, compensating for its action. Psychophysical studies investigating localization of stimuli flashed briefly around the time of saccades provide strong support for these neural mechanisms, and show quantitatively how they integrate information across saccades. This transient system cooperates with the spatiotopic mechanism to provide a useful map to guide interactions with our environment: one rapid and transitory, bringing into play the high-resolution visual areas; the other slow, long-lasting, and low-resolution, useful for interacting with the world.