PisaVisionLab

Pooresmaeili, A., Cicchini, G. M., Morrone, M. C. & Burr, D. (2012). "Non-retinotopic processing" in Ternus motion displays modeled by spatiotemporal filters,J Vis, 1 (12), PDF

Recently, M. Boi, H. Ogmen, J. Krummenacher, T. U. Otto, & M. H. Herzog (2009) reported a fascinating visual effect, where the direction of apparent motion was disambiguated by cues along the path of apparent motion, the Ternus-Pikler group motion, even though no actual movement occurs in this stimulus. They referred to their study as a "litmus test" to distinguish "non-retinotopic" (motion-based) from "retinotopic" (retina-based) image processing. We adapted the test to one with simple grating stimuli that could be more readily modeled and replicated their psychophysical results quantitatively with this stimulus. We then modeled our experiments in 3D (x, y, t) Fourier space and demonstrated that the observed perceptual effects are readily accounted for by integration of information within a detector that is oriented in space and time, in a similar way to previous explanations of other motion illusions. This demonstration brings the study of Boi et al. into the more general context of perception of moving objects.

Burr, D. C., Cicchini, G. M., Arrighi, R. & Morrone, M. C. (2011). Spatiotopic selectivity of adaptation-based compression of event duration, J Vis, 2 (11), 21; author reply 21a. PDF

A. Bruno, I. Ayhan, and A. Johnston (2010) have recently challenged our report of spatiotopic selectivity for adaptation of event time (D. Burr, A. Tozzi, & M. C. Morrone, 2007) and also our claim that retinotopic adaptation of event time depends on perceived speed. To assist the reader judge this issue, we present here a mass of data accumulated in our laboratories over the last few years, all confirming our original conclusions. We also point out that where Bruno et al. made experimental measurements (rather than relying on theoretical reasoning), they too find clearly significant spatiotopically tuned adaptation-based compression of event time but of lower magnitude to ours. We speculate on the reasons for the differences in magnitude.

Lunghi C, Burr DC, Morrone C. (2011). Brief periods of monocular deprivation disrupt ocular balance in human adult visual cortex, Curr Biol. 2011 Jul 26;21(14):R538-9. PDF

Neuroplasticity is a fundamental property of the developing mammalian visual system, with residual potential in adult human cortex [1]. A short period of abnormal visual experience (such as occlusion of one eye) before closure of the critical period has dramatic and permanent neural consequences, reshaping visual cortical organization in favour of the non-deprived eye [2,3]. We used binocular rivalry [4] - a sensitive probe of neural competition - to demonstrate that adult human visual cortex retains a surprisingly high degree of neural plasticity, with important perceptual consequences. We report that 150 minutes of monocular deprivation strongly affects the dynamics of binocular rivalry, unexpectedly causing the deprived eye to prevail in conscious perception twice as much as the non-deprived eye, with significant effects for up to 90 minutes. Apparent contrast of stimuli presented to the deprived eye was also increased, suggesting that the deprivation acts by up-regulation of cortical gain-control mechanisms of the deprived eye. The results suggest that adult visual cortex retains a good deal of plasticity that could be important in reaction to sensory loss.

Burr, D. C. & Morrone, M. C. (2011). Spatiotopic coding and remapping in humans,Philos Trans R Soc Lond B Biol Sci, 1564 (366), 504-515. PDF

How our perceptual experience of the world remains stable and continuous in the face of continuous rapid eye movements still remains a mystery. This review discusses some recent progress towards understanding the neural and psychophysical processes that accompany these eye movements. We firstly report recent evidence from imaging studies in humans showing that many brain regions are tuned in spatiotopic coordinates, but only for items that are actively attended. We then describe a series of experiments measuring the spatial and temporal phenomena that occur around the time of saccades, and discuss how these could be related to visual stability. Finally, we introduce the concept of the spatio-temporal receptive field to describe the local spatiotopicity exhibited by many neurons when the eyes move.

Crespi, S., Biagi, L., d'Avossa, G., Burr, D. C., Tosetti, M. & Morrone, M. C. (2011). Spatiotopic Coding of BOLD Signal in Human Visual Cortex Depends on Spatial Attention,PLoS One, 7 (6), e21661. PDF

The neural substrate of the phenomenological experience of a stable visual world remains obscure. One possible mechanism would be to construct spatiotopic neural maps where the response is selective to the position of the stimulus in external space, rather than to retinal eccentricities, but evidence for these maps has been inconsistent. Here we show, with fMRI, that when human subjects perform concomitantly a demanding attentive task on stimuli displayed at the fovea, BOLD responses evoked by moving stimuli irrelevant to the task were mostly tuned in retinotopic coordinates. However, under more unconstrained conditions, where subjects could attend easily to the motion stimuli, BOLD responses were tuned not in retinal but in external coordinates (spatiotopic selectivity) in many visual areas, including MT, MST, LO and V6, agreeing with our previous fMRI study. These results indicate that spatial attention may play an important role in mediating spatiotopic selectivity.

Binda, P., Morrone, M. C., Ross, J. & Burr, D. C. (2011). Underestimation of perceived number at the time of saccades,Vision Res, 1 (51), 34-42. PDF

Saccadic eye movements produce transient distortions in both space and time. Mounting evidence suggests that space and time perception are linked, and associated with the perception of another important perceptual attribute, numerosity. Here we investigate the effect of saccades on the perceived numerosity of briefly presented arrays of visual elements. We report a systematic underestimation of numerosity for stimuli flashed just before or during saccades, of about 35% of the reference numerosity. The bias is observed only for relatively large arrays of visual elements, in line with the notion that a distinct perceptual mechanism is involved with enumeration of small numerosities in the 'subitizing' range. This study provides further evidence for the notion that space, time and number share common neural representations, all affected by saccades.

Knoll, J., Binda, P., Morrone, M. C. & Bremmer, F. (2011). Spatiotemporal profile of peri-saccadic contrast sensitivity,J Vis, 14 (11), PDF

Sensitivity to luminance contrast is reduced just before and during saccades (saccadic suppression), whereas sensitivity to color contrast is unimpaired peri-saccadically and enhanced post-saccadically. The exact spatiotemporal map of these perceptual effects is as yet unknown. Here, we measured detection thresholds for briefly flashed Gaussian blobs modulated in either luminance or chromatic contrast, displayed at a range of eccentricities. Sensitivity to luminance contrast was reduced peri-saccadically by a scaling factor, which was almost constant across retinal space. Saccadic suppression followed a similar time course across all tested eccentricities and was maximal shortly after the saccade onset. Sensitivity to chromatic contrast was enhanced post-saccadically at all tested locations. The enhancement was not specifically linked to the execution of saccades, as it was also observed following a displacement of retinal images comparable to that caused by a saccade. We conclude that luminance and chromatic contrast sensitivities are subject to distinct modulations at the time of saccades, resulting from independent neural processes.

Tomassini A, Gori M, Burr D, Sandini G and Morrone MC (2011) Perceived duration of visual and tactile stimuli depends on perceived speed. Front. Integr. Neurosci. 5:51 PDF

It is known that the perceived duration of visual stimuli is strongly influenced by speed: faster moving stimuli appear to last longer. To test whether this is a general property of sensory systems we asked participants to reproduce the duration of visual and tactile gratings, and visuo-tactile gratings moving at a variable speed (3.5–15 cm/s) for three different durations (400, 600, and 800 ms). For both modalities, the apparent duration of the stimulus increased strongly with stimulus speed, more so for tactile than for visual stimuli. In addition, visual stimuli were perceived to last approximately 200 ms longer than tactile stimuli. The apparent duration of visuo-tactile stimuli lay between the unimodal estimates, as the Bayesian account predicts, but the bimodal precision of the reproduction did not show the theoretical improvement. A cross-modal speed-matching task revealed that visual stimuli were perceived to move faster than tactile stimuli. To test whether the large difference in the perceived duration of visual and tactile stimuli resulted from the difference in their perceived speed, we repeated the time reproduction task with visual and tactile stimuli matched in apparent speed. This reduced, but did not completely eliminate the difference in apparent duration. These results show that for both vision and touch, perceived duration depends on speed, pointing to common strategies of time perception.

Zimmerman, E., Burr D.C., and Morrone, M.C. (2011) Spatiotopic Visual Maps Revealed by Saccadic Adaptation in Humans, Curr Biol. 2011 Aug 23;21(16):1380-4 PDF

Saccadic adaptation is a powerful experimental paradigm to probe the mechanisms of eye movement control and spatial vision, in which saccadic amplitudes change in response to false visual feedback. The adaptation occurs primarily in the motor system, but there is also evidence for visual adaptation, depending on the size and the permanence of the postsaccadic error. Here we confirm that adaptation has a strong visual component and show that the visual component of the adaptation is spatially selective in external, not retinal coordinates. Subjects performed a memory-guided, double-saccade, outward-adaptation task designed to maximize visual adaptation and to dissociate the visual and motor corrections. When the memorized saccadic target was in the same position (in external space) as that used in the adaptation training, saccade targeting was strongly influenced by adaptation (even if not matched in retinal or cranial position), but when in the same retinal or cranial but different external spatial position, targeting was unaffected by adaptation, demonstrating unequivocal spatiotopic selectivity. These results point to the existence of a spatiotopic neural representation for eye movement control that adapts in response to saccade error signals.

Morrone, M. C., Cicchini, M. & Burr, D. C. (2010). Spatial maps for time and motion,Exp Brain Res, 2 (206), 121-128. PDF

In this article, we review recent research studying the mechanisms for transforming coordinate systems to encode space, time and motion. A range of studies using functional imaging and psychophysical techniques reveals mechanisms in the human brain for encoding information in external rather than retinal coordinates. This reinforces the idea of a tight relationship between space and time, in the parietal cortex of primates.

Morrone, M. C. (2010). Brain development: critical periods for cross-sensory plasticity,Curr Biol, 21 (20), R934-936. PDF

Recent work has shown that visual deprivation of humans during a critical period leads to motion area MT+ responding to auditory motion. This cross-sensory plasticity, an important form of brain reorganization, may be mediated by top-down brain circuits from pre-frontal cortex.

Schutz, A. C. & Morrone, M. C. (2010). Compression of time during smooth pursuit eye movements,Vision Res, 24 (50), 2702-2713. PDF

Humans have a clear sense for the passage of time, but while implicit motor timing is quite accurate, explicit timing is prone to distortions particularly during action (Wenke & Haggard, 2009) and saccadic eye movements (Morrone, Ross, & Burr, 2005). Here, we investigated whether perceived duration is also affected by the execution of smooth pursuit eye movements, showing a compression of apparent duration similar to that observed during saccades. To this end, we presented two brief bars that marked intervals between 100 and 300 ms and asked subjects to judge their duration during fixation and pursuit. We found a compression of perceived duration for bars modulated in luminance contrast of about 32% and for bars modulated in chromatic contrast of 14% during pursuit compared to fixation. Interestingly, Weber ratios were similar for fixation and pursuit, if they are expressed as ratio between JND and perceived duration. This compression was constant for pursuit speeds from 7 to 14 deg/s and did not occur for intervals marked by auditory events. These results argue for a modality-specific component in the processing of temporal information.

Campanella, F., Sandini, G. & Morrone, M. C. (2010). Visual information gleaned by observing grasping movement in allocentric and egocentric perspectives,Proc Biol Sci, 1715 (278), 2142-2149. PDF

One of the major functions of vision is to allow for an efficient and active interaction with the environment. In this study, we investigate the capacity of human observers to extract visual information from observation of their own actions, and those of others, from different viewpoints. Subjects discriminated the size of objects by observing a point-light movie of a hand reaching for an invisible object. We recorded real reach-and-grasp actions in three-dimensional space towards objects of different shape and size, to produce two-dimensional 'point-light display' movies, which were used to measure size discrimination for reach-and-grasp motion sequences, release-and-withdraw sequences and still frames, all in egocentric and allocentric perspectives. Visual size discrimination from action was significantly better in egocentric than in allocentric view, but only for reach-and-grasp motion sequences: release-and-withdraw sequences or still frames derived no advantage from egocentric viewing. The results suggest that the system may have access to an internal model of action that contributes to calibrate visual sense of size for an accurate grasp.

Lunghi, C., Binda, P. & Morrone, M. C. (2010). Touch disambiguates rivalrous perception at early stages of visual analysis,Curr Biol, 4 (20), R143-144. PDF

Binocular rivalry is a powerful tool to study human consciousness: two equally salient stimuli are imaged on the retinae, but at any given instant only one is consciously perceived, the other suppressed.The suppression takes place early, probably in V1. However, a trace of the suppressed signal has been detected along the dorsal visual pathway (BOLD responses) and demonstrated with psychophysical experiments. The suppressed image of a rotating sphere during rivalry is restored to consciousness when the observer actively controls the rotation and a similar effect on the suppressed signal has been shown for motion perception and reflexive eye movements (see Supplemental References). Here, we asked whether cross-modal sensory signals could selectively interact with rivalrous visual signals that are analyzed at a very early stage, probably V1. An auditory stimulus, when attended, can influence binocular rivalry, extending dominance times for a congruent visual stimulus. Tactile information can  also disambiguate unstable visual motion and can fuse with vision to improve discrimination (e.g. slant). Our results indicate that a haptic oriented stimulus can disambiguate visual perception during binocular rivalry of gratings of orthogonal orientation, not only by prolonging dominance but also by curtailing suppression of the visual stimulus of matched orientation. The effect is selective for the spatial frequency of the stimuli, suggesting that haptic signals interact with early visual representations to enhance access to conscious perception.

Burr, D. C., Ross, J., Binda, P. & Morrone, M. C. (2010). Saccades compress space, time and number,Trends Cogn Sci, 12 (14), 528-533. PDF

It has been suggested that space, time and number are represented on a common subjective scale. Saccadic eye movements provide a fascinating test. Saccades compress the perceived magnitude of spatial separations and temporal intervals to approximately half of their true value. The question arises as to whether saccades also compress number. They do, and compression follows a very similar time course for all three attributes: it is maximal at saccadic onset and decreases to veridicality within a window of approximately 50ms. These results reinforce the suggestion of a common perceptual metric, which is probably mediated by the intraparietal cortex; they further suggest that before each saccade the common metric for all three is reset, possibly to pave the way for a fresh analysis of the post-saccadic situation.

Burr, D. C. & Morrone, M. C. (2010). Vision: keeping the world still when the eyes move,Curr Biol, 10 (20), R442-444. PDF

A long-standing problem for visual science is how the world remains so apparently stable in the face of continual rapid eye movements. New experimental evidence, and computational models are helping to solve this mystery.

Binda, P., Morrone, M. C. & Burr, D. C. (2010). Temporal auditory capture does not affect the time course of saccadic mislocalization of visual stimuli,J Vis, 2 (10), 7 1-13. PDF

Irrelevant sounds can "capture" visual stimuli to change their apparent timing, a phenomenon sometimes termed "temporal ventriloquism". Here we ask whether this auditory capture can alter the time course of spatial mislocalization of visual stimuli during saccades. We first show that during saccades, sounds affect the apparent timing of visual flashes, even more strongly than during fixation. However, this capture does not affect the dynamics of perisaccadic visual distortions. Sounds presented 50 ms before or after a visual bar (that change perceived timing of the bars by more than 40 ms) had no measurable effect on the time courses of spatial mislocalization of the bars, in four subjects. Control studies showed that with barely visible, low-contrast stimuli, leading, but not trailing, sounds can have a small effect on mislocalization, most likely attributable to attentional effects rather than auditory capture. These findings support previous studies showing that integration of multisensory information occurs at a relatively late stage of sensory processing, after visual representations have undergone the distortions induced by saccades.

Cicchini, G. M. & Morrone, M. C. (2009). Shifts in spatial attention affect the perceived duration of events,J Vis, 1 (9), 9 1-13. PDF

We investigated the relationship between attention and perceived duration of visual events with a double-task paradigm. The primary task was to discriminate the size change of a 2 degree circle presented 10 degrees left, right, above, or below fixation; the secondary task was to judge the temporal separation (from 133 ms to 633 ms) of two equiluminant horizontal bars (10 deg x 2 deg) briefly flashed 12 degrees above or below fixation. The stimulus onset asynchrony (SOA) between primary and secondary task ranged from -1300 ms to +1000 ms. Temporal intervals in proximity of the onset of the primary task stimuli were perceived strongly compressed by up to 40%. The effect was proportional to the size of the interval with a maximum effect at 100 ms SOA. Control experiments show that neither primary-task difficulty, nor the type of primary task discrimination (form or motion, or equiluminant or luminance contrast) nor spatial congruence between primary and secondary task alter the effect. Interestingly, the compression occurred only when the intervals are marked by bars presented in separated spatial locations: when the interval is marked by two bars flashed in the same spatial position no temporal distortion was found. These data indicate that attention can alter perceived duration when the brain has to compare the passage of time at two different spatial positions, corroborating earlier findings that mechanisms of time perception may monitor separately the various spatial locations possibly at high level of analysis.

Burr, D., Silva, O., Cicchini, G. M., Banks, M. S. & Morrone, M. C. (2009). Temporal mechanisms of multimodal binding,Proc Biol Sci, 1663 (276), 1761-1769. PDF

The simultaneity of signals from different senses-such as vision and audition-is a useful cue for determining whether those signals arose from one environmental source or from more than one. To understand better the sensory mechanisms for assessing simultaneity, we measured the discrimination thresholds for time intervals marked by auditory, visual or auditory-visual stimuli, as a function of the base interval. For all conditions, both unimodal and cross-modal, the thresholds followed a characteristic 'dipper function' in which the lowest thresholds occurred when discriminating against a non-zero interval. The base interval yielding the lowest threshold was roughly equal to the threshold for discriminating asynchronous from synchronous presentations. Those lowest thresholds occurred at approximately 5, 15 and 75 ms for auditory, visual and auditory-visual stimuli, respectively. Thus, the mechanisms mediating performance with cross-modal stimuli are considerably slower than the mechanisms mediating performance within a particular sense. We developed a simple model with temporal filters of different time constants and showed that the model produces discrimination functions similar to the ones we observed in humans. Both for processing within a single sense, and for processing across senses, temporal perception is affected by the properties of temporal filters, the outputs of which are used to estimate time offsets, correlations between signals, and more.

Binda, P., Cicchini, G. M., Burr, D. C. & Morrone, M. C. (2009). Spatiotemporal distortions of visual perception at the time of saccades,J Neurosci, 42 (29), 13147-13157. PDF

Both space and time are grossly distorted during saccades. Here we show that the two distortions are strongly linked, and that both could be a consequence of the transient remapping mechanisms that affect visual neurons perisaccadically. We measured perisaccadic spatial and temporal distortions simultaneously by asking subjects to report both the perceived spatial location of a perisaccadic vertical bar (relative to a remembered ruler), and its perceived timing (relative to two sounds straddling the bar). During fixation and well before or after saccades, bars were localized veridically in space and in time. In different epochs of the perisaccadic interval, temporal perception was subject to different biases. At about the time of the saccadic onset, bars were temporally mislocalized 50-100 ms later than their actual presentation and spatially mislocalized toward the saccadic target. Importantly, the magnitude of the temporal distortions co-varied with the spatial localization bias and the two phenomena had similar dynamics. Within a brief period about 50 ms before saccadic onset, stimuli were perceived with shorter latencies than at other delays relative to saccadic onset, suggesting that the perceived passage of time transiently inverted its direction. Based on this result we could predict the inversion of perceived temporal order for two briefly flashed visual stimuli. We developed a model that simulates the perisaccadic transient change of neuronal receptive fields predicting well the reported temporal distortions. The key aspects of the model are the dynamics of the "remapped" activity and the use of decoder operators that are optimal during fixation, but are not updated perisaccadically.

Burr, D. C., Baldassi, S., Morrone, M. C. & Verghese, P. (2009). Pooling and segmenting motion signals,Vision Res, 10 (49), 1065-1072. PDF

Humans are extremely sensitive to visual motion, largely because local motion signals can be integrated over a large spatial region. On the other hand, summation is often not advantageous, for example when segmenting a moving stimulus against a stationary or oppositely moving background. In this study we show that the spatial extent of motion integration is not compulsory, but is subject to voluntary attentional control. Measurements of motion coherence sensitivity with summation and search paradigms showed that human observers can combine motion signals from cued regions or patches in an optimal manner, even when the regions are quite distinct and remote from each other. Further measurements of contrast sensitivity reinforce previous studies showing that motion integration is preceded by a local analysis akin to contrast thresholding (or intrinsic uncertainty). The results were well modelled by two standard signal-detection-theory models.

Burr, D., Banks, M. S. & Morrone, M. C. (2009). Auditory dominance over vision in the perception of interval duration,Exp Brain Res, 1 (198), 49-57. PDF

The "ventriloquist effect" refers to the fact that vision usually dominates hearing in spatial localization, and this has been shown to be consistent with optimal integration of visual and auditory signals (Alais and Burr in Curr Biol 14(3):257-262, 2004). For temporal localization, however, auditory stimuli often "capture" visual stimuli, in what has become known as "temporal ventriloquism". We examined this quantitatively using a bisection task, confirming that sound does tend to dominate the perceived timing of audio-visual stimuli. The dominance was predicted qualitatively by considering the better temporal localization of audition, but the quantitative fit was less than perfect, with more weight being given to audition than predicted from thresholds. As predicted by optimal cue combination, the temporal localization of audio-visual stimuli was better than for either sense alone.

2008 (back to top)

Bruno, A. & Morrone, M. C. (2007). Influence of saccadic adaptation on spatial localization: comparison of verbal and pointing reports,J Vis, 5 (7), 16 11-13. PDF

Under conditions of short-term saccadic adaptation, stimuli presented long before saccadic onset are perceptually mislocalized in space. Here we study whether saccadic adaptation can also affect localization of objects by pointing. We measured localization performance during fixation and after normal saccades and adapted saccades, for a bar presented well before a saccadic eye movement, for both pointing and verbal localization, under open-loop conditions generated by a transient dark period about 300 ms after the presentation of the bar. During fixation and normal saccade, localization performance for verbal report was veridical, while for pointing there was an overestimation of the target eccentricity respect to gaze, in agreement with the idea of separate representations of space for action and perception. During saccadic adaptation, there was a significant shift of both pointing and verbal report localization in the direction of adaptation with similar spatial selectivity for both tasks. These results indicate that saccadic adaptation induces a similar re-calibration of the action map as well as of the perceptual map, suggesting a common site of operation in the transformation from eye-centered to gaze-centered coordinates.

Tozzi, A., Morrone, M. C. & Burr, D. C. (2007). The effect of optokinetic nystagmus on the perceived position of briefly flashed targets,Vision Res, 6 (47), 861-868. PDF

Stimuli flashed briefly around the time of an impending saccade are mislocalized in the direction of the saccade and also compressed towards the saccadic target. Similarly, targets flashed during pursuit eye movements are mislocalized in the direction of pursuit. Here, we investigate the effects of optokinetic nystagmus (OKN) on visual localization. Subjects passively viewed a wide-field drifting grating that elicited strong OKN, comprising the characteristic slow-phase tracking movement interspersed with corrected "saccade-like" fast-phase movements. Subjects reported the apparent position of salient bars flashed briefly at various positions on the screen. In general, bars were misperceived in the direction of the slow-phase tracking movement. Bars flashed around the onset of the fast-phase movements were subject to much less mislocalization, pointing to a competing shift in the direction of the fast-phase, as occurs with saccades. However, as distinct from saccades, there was no evidence for spatial compression around the time of the corrective fast-phase OKN. The results suggest that OKN cause perceptual mislocalizations similar to those of smooth pursuit and saccades, but there are some differences in the nature of the mislocalizations, pointing to different perceptual mechanisms associated with the different types of eye movements.

Perna, A. & Morrone, M. C. (2007). The lowest spatial frequency channel determines brightness perception,Vision Res, 10 (47), 1282-1291. PDF

This study investigates the role played by individual spatial scales in determining the apparent brightness of greyscale patterns. We measured the perceived difference in brightness across an edge in the presence of notch filtering and high-pass filtering for two stimulus configurations, one that elicits the perception of transparency and one that appears opaque. For both stimulus configurations, the apparent brightness of the surfaces delimited by the border decreased monotonically with progressive (ideal) high-pass filtering, with a critical cut-off at 1 c/deg. Using two octave ideal notch filtering, the maximum detrimental effect on apparent brightness was observed at about 1c/deg. Critical frequencies for apparent brightness did not vary with contrast, viewing distance, or surface size, suggesting that apparent brightness is determined by the channel tuned at 1 c/deg. Modelling the data with the local energy model [Morrone, M. C., & Burr, D. C. (1988). Feature detection in human vision: a phase dependent energy model. Proceedings of the Royal Society (London), B235, 221-245] at 1c/deg confirmed the suggestion that this channel mediates apparent brightness for both opaque and transparent borders, with no need for pooling or integration across spatial channels.

Burr, D., Tozzi, A. & Morrone, M. C. (2007). Neural mechanisms for timing visual events are spatially selective in real-world coordinates,Nat Neurosci, 4 (10), 423-425. PDF

It is generally assumed that perceptual events are timed by a centralized supramodal clock. This study challenges this notion in humans by providing clear evidence that visual events of subsecond duration are timed by visual neural mechanisms with spatially circumscribed receptive fields, localized in real-world, rather than retinal, coordinates.

d'Avossa, G., Tosetti, M., Crespi, S., Biagi, L., Burr, D. C. & Morrone, M. C. (2007). Spatiotopic selectivity of BOLD responses to visual motion in human area MT,Nat Neurosci, 2 (10), 249-255. PDF

Many neurons in the monkey visual extrastriate cortex have receptive fields that are affected by gaze direction. In humans, psychophysical studies suggest that motion signals may be encoded in a spatiotopic fashion. Here we use functional magnetic resonance imaging to study spatial selectivity in the human middle temporal cortex (area MT or V5), an area that is clearly implicated in motion perception. The results show that the response of MT is modulated by gaze direction, generating a spatial selectivity based on screen rather than retinal coordinates. This area could be the neurophysiological substrate of the spatiotopic representation of motion signals.

Chirimuuta, M., Burr, D. & Morrone, M. C. (2007). The role of perceptual learning on modality-specific visual attentional effects,Vision Res, 1 (47), 60-70. PDF

Morrone et al. [Morrone, M. C., Denti, V., & Spinelli, D. (2002). Color and luminance contrasts attract independent attention. Current Biology, 12, 1134-1137] reported that the detrimental effect on contrast discrimination thresholds of performing a concomitant task is modality specific: performing a secondary luminance task has no effect on colour contrast thresholds, and vice versa. Here we confirm this result with a novel task involving learning of spatial position, and go on to show that it is not specific to the cardinal colour axes: secondary tasks with red-green stimuli impede performance on a blue-yellow task and vice versa. We further show that the attentional effect can be abolished with continued training over 2-4 training days (2-20 training sessions), and that the effect of learning is transferable to new target positions. Given the finding of transference, we discuss the possibility that V4 is a site of plasticity for both stimulus types, and that the separation is due to a luminance-colour separation within this cortical area.

Binda, P., Bruno, A., Burr, D. C. & Morrone, M. C. (2007). Fusion of visual and auditory stimuli during saccades: a Bayesian explanation for perisaccadic distortions,J Neurosci, 32 (27), 8525-8532. PDF

Brief stimuli presented near the onset of saccades are grossly mislocalized in space. In this study, we investigated whether the Bayesian hypothesis of optimal sensory fusion could account for the mislocalization. We required subjects to localize visual, auditory, and audiovisual stimuli at the time of saccades (compared with an earlier presented target). During fixation, vision dominates and spatially "captures" the auditory stimulus (the ventriloquist effect). But for perisaccadic presentations, auditory localization becomes more important, so the mislocalized visual stimulus is seen closer to its veridical position. The precision of the bimodal localization (as measured by localization thresholds or just-noticeable difference) was better than either the visual or acoustic stimulus presented in isolation. Both the perceived position of the bimodal stimuli and the improved precision were well predicted by assuming statistically optimal Bayesian-like combination of visual and auditory signals. Furthermore, the time course of localization was well predicted by the Bayesian approach. We present a detailed model that simulates the time-course data, assuming that perceived position is given by the sum of retinal position and a sluggish noisy eye-position signal, obtained by integrating optimally the output of two populations of neural activity: one centered at the current point of gaze, the other centered at the future point of gaze.

2006 (back to top)