The McGurk effect is a perceptual phenomenon which indicates an interaction between hearing and vision in speech perception . It suggests that speech perception is multimodal; it involves information from more than one sensory modality.
The McGurk effect may be experienced when a video of one phoneme's production is dubbed with a sound-recording of a different phoneme. Often, the perceived phoneme is a third, intermediate phoneme. For example, a visual /ga/ combined with a heard /ba/ is often heard as /da/.
The McGurk effect is robust: that is, knowledge about it seems to have little effect on one's perception of it. This is different from certain optical illusions, which break down once one 'sees through' them.
The McGurk effect is named after its discoverer, Harry McGurk , and was first described in McGurk & MacDonald (1976).
The McGurk effect is being leveraged to produce more accurate speech recognition programs by making use of a video camera and lip reading software.
References
McGurk, H & MacDonald, J (1976) "Hearing lips and seeing voices", in Nature,
Vol.264, No.5588, 746-748
External links
Last updated: 10-10-2005 10:18:16
