When Sound Affects Vision: Effects of Auditory Grouping on Visual Motion Perception

Katsumi Watanabe*, Shinsuke Shimojo

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

170 Citations (Scopus)


Two identical visual targets moving across each other can be perceived either to bounce off or to stream through each other. A brief sound at the moment the targets coincide biases perception toward bouncing. We found that this bounce-inducing effect was attenuated when other identical sounds (auditory flankers) were presented 300 ms before and after the simultaneous sound. The attenuation occurred only when the simultaneous sound and auditory flankers had similar acoustic characteristics and the simultaneous sound was not salient. These results suggest that there is an aspect of auditory-grouping (saliency-assigning) processes that is context-sensitive and can be utilized by the visual system for solving ambiguity. Furthermore, control experiments revealed that such auditory context did not affect the perceptual qualities of the simultaneous sound. Because the attenuation effect is not manifest in the perception of acoustic characteristics of individual sound elements, we conclude that it is a genuine cross-modal effect.

Original languageEnglish
Pages (from-to)109-116
Number of pages8
JournalPsychological Science
Issue number2
Publication statusPublished - 2001 Mar
Externally publishedYes

ASJC Scopus subject areas

  • General Psychology


Dive into the research topics of 'When Sound Affects Vision: Effects of Auditory Grouping on Visual Motion Perception'. Together they form a unique fingerprint.

Cite this