Abstract：
:The interaction between auditory and visual speech streams is a seamless and surprisingly effective process. An intriguing example is the "McGurk effect": The acoustic syllable /ba/ presented simultaneously with a mouth articulating /ga/ is typically heard as /da/ [McGurk, H., & MacDonald, J. Hearing lips and seeing voices. Nature, 264, 746-748, 1976]. Previous studies have demonstrated the interaction of auditory and visual streams at the auditory cortex level, but the importance of these interactions for the qualitative perception change remained unclear because the change could result from interactions at higher processing levels as well. In our electroencephalogram experiment, we combined the McGurk effect with mismatch negativity (MMN), a response that is elicited in the auditory cortex at a latency of 100-250 msec by any above-threshold change in a sequence of repetitive sounds. An "odd-ball" sequence of acoustic stimuli consisting of frequent /va/ syllables (standards) and infrequent /ba/ syllables (deviants) was presented to 11 participants. Deviant stimuli in the unisensory acoustic stimulus sequence elicited a typical MMN, reflecting discrimination of acoustic features in the auditory cortex. When the acoustic stimuli were dubbed onto a video of a mouth constantly articulating /va/, the deviant acoustic /ba/ was heard as /va/ due to the McGurk effect and was indistinguishable from the standards. Importantly, such deviants did not elicit MMN, indicating that the auditory cortex failed to discriminate between the acoustic stimuli. Our findings show that visual stream can qualitatively change the auditory percept at the auditory cortex level, profoundly influencing the auditory cortex mechanisms underlying early sound discrimination.
journal_name
J Cogn Neuroscijournal_title
Journal of cognitive neuroscienceauthors
Kislyuk DS,Möttönen R,Sams Mdoi
10.1162/jocn.2008.20152subject
Has Abstractpub_date
2008-12-01 00:00:00pages
2175-84issue
12eissn
0898-929Xissn
1530-8898journal_volume
20pub_type
杂志文章abstract：:Although the amygdala's role in processing facial expressions of fear has been well established, its role in the processing of other emotions is unclear. In particular, evidence for the amygdala's involvement in processing expressions of happiness and sadness remains controversial. To clarify this issue, we constructe...
journal_title：Journal of cognitive neuroscience
pub_type： 杂志文章
doi：10.1162/089892904322926782
更新日期：2004-04-01 00:00:00
abstract：:We studied the brain activation patterns in two visual image processing tasks requiring judgements on object construction (FIT task) or object sameness (SAME task). Eight right-handed healthy human subjects (four women and four men) performed the two tasks in a randomized block design while 5-mm, multislice functional...
journal_title：Journal of cognitive neuroscience
pub_type： 杂志文章
doi：10.1162/089892901564180
更新日期：2001-01-01 00:00:00
abstract：:The occipito-temporal cortex is strongly implicated in carrying out the high-level computations associated with vision. In human neuroimaging studies, focal regions are consistently found within this broad region that respond strongly and selectively to faces, bodies, or objects. A notable feature of these selective r...
journal_title：Journal of cognitive neuroscience
pub_type： 杂志文章,评审
doi：10.1162/jocn_a_00091
更新日期：2011-12-01 00:00:00
abstract：:Extant research has examined the process of decision making under uncertainty, specifically in situations of ambiguity. However, much of this work has been conducted in the context of semantic and low-level visual processing. An open question is whether ambiguity in social signals (e.g., emotional facial expressions) ...
journal_title：Journal of cognitive neuroscience
pub_type： 杂志文章
doi：10.1162/jocn_a_00363
更新日期：2013-04-01 00:00:00
abstract：:Abstract Parapsychology is the scientific investigation of apparently paranormal mental phenomena (such as telepathy, i.e., "mind reading"), also known as psi. Despite widespread public belief in such phenomena and over 75 years of experimentation, there is no compelling evidence that psi exists. In the present study,...
journal_title：Journal of cognitive neuroscience
pub_type： 杂志文章
doi：10.1162/jocn.2008.20.1.182
更新日期：2008-01-01 00:00:00
abstract：:Many aspects of perception and cognition are supported by activity in neural populations that are tuned to different stimulus features (e.g., orientation, spatial location, color). Goal-directed behavior, such as sustained attention, requires a mechanism for the selective prioritization of contextually appropriate rep...
journal_title：Journal of cognitive neuroscience
pub_type： 杂志文章
doi：10.1162/jocn_a_00955
更新日期：2016-08-01 00:00:00
abstract：:The processing of auditory spatial information in cortical areas of the human brain outside of the primary auditory cortex remains poorly understood. Here we investigated the role of the superior temporal gyrus (STG) and the occipital cortex (OC) in spatial hearing using repetitive transcranial magnetic stimulation (r...
journal_title：Journal of cognitive neuroscience
pub_type： 杂志文章
doi：10.1162/089892904970834
更新日期：2004-06-01 00:00:00
abstract：:Studies of cognition often use an "oddball" paradigm to study effects of stimulus novelty and significance on information processing. However, an oddball tends to be perceptually more novel than the standard, repeated stimulus as well as more relevant to the ongoing task, making it difficult to disentangle effects due...
journal_title：Journal of cognitive neuroscience
pub_type： 杂志文章
doi：10.1162/jocn.2009.21244
更新日期：2010-02-01 00:00:00
abstract：:Although it is well documented that children undergo a productive vocabulary spurt late in the second year, it is unclear whether this development is accompanied by equally significant advances in receptive word processing. In the present study, we tested an electrophysiological procedure for assessing receptive word ...
journal_title：Journal of cognitive neuroscience
pub_type： 杂志文章
doi：10.1162/jocn.2008.20087
更新日期：2008-07-01 00:00:00
abstract：:The formation of an object's cortical representation seems to rely on synchronized neuronal activity within the gamma band frequency range (gamma band activity [GBA]). In this study, we investigated whether electroencephalogram (EEG) GBA, and its phase synchronization between electrodes, is necessary for the formation...
journal_title：Journal of cognitive neuroscience
pub_type： 杂志文章
doi：10.1162/jocn.2008.20136
更新日期：2008-11-01 00:00:00
abstract：:Although much evidence indicates that RT increases as a function of computational load in many cognitive tasks, quantification of changes in neural activity related to increasing demand of cognitive control has rarely been attempted. In this fMRI study, we used a majority function task to quantify the effect of comput...
journal_title：Journal of cognitive neuroscience
pub_type： 杂志文章
doi：10.1162/jocn_a_00554
更新日期：2014-07-01 00:00:00
abstract：:Human alpha-band activity (8-12 Hz) has been proposed to index a variety of mechanisms during visual processing. Here, we distinguished between an account in which alpha suppression indexes selective attention versus an account in which it indexes subsequent working memory storage. We manipulated two aspects of the vi...
journal_title：Journal of cognitive neuroscience
pub_type： 杂志文章
doi：10.1162/jocn_a_01637
更新日期：2020-10-15 00:00:00
abstract：:The neural mechanisms that mediate metacognitive ability (the capacity to accurately reflect on one's own cognition and experience) remain poorly understood. An important question is whether metacognitive capacity is a domain-general skill supported by a core neuroanatomical substrate or whether regionally specific ne...
journal_title：Journal of cognitive neuroscience
pub_type： 杂志文章
doi：10.1162/jocn_a_00741
更新日期：2015-03-01 00:00:00
abstract：:Neural systems involved in the processing of written language have been identified by a number of functional imaging studies. Structural changes in cortical anatomy that occur in the course of literacy acquisition, however, remain largely unknown. Here, we follow elementary school children over their first 2 years of ...
journal_title：Journal of cognitive neuroscience
pub_type： 杂志文章
doi：10.1162/jocn_a_00710
更新日期：2015-02-01 00:00:00
abstract：:Action execution-perception links (mirror mechanism) have been repeatedly suggested to play crucial roles in social cognition. Remarkably, the designs of most studies exploring this topic so far excluded even the simplest traces of social interaction, such as a movement of the observer toward another individual. This ...
journal_title：Journal of cognitive neuroscience
pub_type： 杂志文章
doi：10.1162/jocn_a_00602
更新日期：2014-09-01 00:00:00
abstract：:The solution of a problem left unresolved in the evening can sometimes pop into mind as a sudden insight after a night of sleep in the following morning. Although favorable effects of sleep on insightful behavior have been experimentally confirmed, the neural mechanisms determining this delayed insight remain unknown....
journal_title：Journal of cognitive neuroscience
pub_type： 杂志文章
doi：10.1162/jocn.2010.21550
更新日期：2011-08-01 00:00:00
abstract：:Currently, there is considerable controversy regarding the degree to which top-down control can affect attentional capture by salient events. According to the contingent capture hypothesis, attentional capture by a salient stimulus is contingent on a match between the properties of the stimulus and top-down attentiona...
journal_title：Journal of cognitive neuroscience
pub_type： 杂志文章
doi：10.1162/jocn.2008.20051
更新日期：2008-04-01 00:00:00
abstract：:Ventral occipito-temporal cortex is known to play a major role in visual object recognition. Still unknown is whether object familiarity and semantic domain are critical factors in its functional organization. Most models assume a functional locus where exemplars of familiar categories are represented: the structural ...
journal_title：Journal of cognitive neuroscience
pub_type： 杂志文章
doi：10.1162/jocn.2011.21629
更新日期：2011-10-01 00:00:00
abstract：:The posterior STS (pSTS) is an important brain region for perceptual analysis of social cognitive cues. This study seeks to characterize the pattern of network connectivity emerging from the pSTS in three core social perception localizers: biological motion perception, gaze recognition, and the interpretation of movin...
journal_title：Journal of cognitive neuroscience
pub_type： 杂志文章
doi：10.1162/jocn_a_01054
更新日期：2017-02-01 00:00:00
abstract：:In vision, perceptual features are processed in several regions distributed across the brain. Yet, the brain achieves a coherent perception of visual scenes and objects through integration of these features, which are encoded in spatially segregated brain areas. How the brain seamlessly achieves this accurate integrat...
journal_title：Journal of cognitive neuroscience
pub_type： 杂志文章
doi：10.1162/jocn_a_01158
更新日期：2017-11-01 00:00:00
abstract：:Cortical stimulation mapping (CSM) has provided important insights into the neuroanatomy of language because of its high spatial and temporal resolution, and the causal relationships that can be inferred from transient disruption of specific functions. Almost all CSM studies to date have focused on word-level processe...
journal_title：Journal of cognitive neuroscience
pub_type： 杂志文章
doi：10.1162/jocn_a_01215
更新日期：2018-03-01 00:00:00
abstract：:We investigated neural correlates of human visual orienting using event-related functional magnetic resonance imaging (fMRI). When subjects voluntarily directed attention to a peripheral location, we recorded robust and sustained signals uniquely from the intraparietal sulcus (IPs) and superior frontal cortex (near th...
journal_title：Journal of cognitive neuroscience
pub_type： 杂志文章
doi：10.1162/089892902317362029
更新日期：2002-04-01 00:00:00
abstract：:Interhemispheric inhibition (IHI) between motor cortical areas is thought to play a critical role in motor control and could influence manual dexterity. The purpose of this study was to investigate IHI preceding movements of the dominant and nondominant hands of healthy volunteers. Movement-related IHI was studied by ...
journal_title：Journal of cognitive neuroscience
pub_type： 杂志文章
doi：10.1162/jocn.2007.19.2.204
更新日期：2007-02-01 00:00:00
abstract：:Attention-related sensory gain control in human extrastriate cortex is believed to improve the acuity of visual perception. Yet given wide variance in the spatial resolution of vision across the retina, it remains unclear whether sensory gain operates homogenously between foveal and nonfoveal retinotopic locations. To...
journal_title：Journal of cognitive neuroscience
pub_type： 临床试验,杂志文章
doi：10.1162/089892905775008715
更新日期：2005-12-01 00:00:00
abstract：:We conducted two fMRI studies to investigate the sensitivity of delay-period activity to changes in memory load during a delayed-recognition task for faces. In Experiment 1, each trial began with the presentation of a memory array consisting of one, two, or three faces that lasted for 3 sec. A 15-sec delay period foll...
journal_title：Journal of cognitive neuroscience
pub_type： 杂志文章
doi：10.1162/089892900564091
更新日期：2000-01-01 00:00:00
abstract：:This investigation combined behavioral and functional neuroimaging measures to explore whether perception of pain is modulated by the target's stigmatized status and whether the target bore responsibility for that stigma. During fMRI scanning, participants were exposed to a series of short video clips featuring age-ma...
journal_title：Journal of cognitive neuroscience
pub_type： 杂志文章
doi：10.1162/jocn.2009.21266
更新日期：2010-05-01 00:00:00
abstract：:Contrasts between implicit and explicit knowledge in the serial reaction time (SJRT) paradigm have been challenged because they have depended on a single dissociation; intact implicit knowledge in the absence of corresponding explicit knowledge. In the SRT task, subjects respond with a corresponding keypress to a cue ...
journal_title：Journal of cognitive neuroscience
pub_type： 临床试验,杂志文章
doi：10.1162/089892998562681
更新日期：1998-03-01 00:00:00
abstract：:The fusion of rhythm, beat perception, and movement is often summarized under the term "entrainment" and becomes obvious when we effortlessly tap our feet or snap our fingers to the pulse of music. Entrainment to music involves a large network of brain structures, and neural oscillations at beat-related frequencies ca...
journal_title：Journal of cognitive neuroscience
pub_type： 杂志文章
doi：10.1162/jocn_a_01013
更新日期：2016-12-01 00:00:00
abstract：:Many features can describe a concept, but only some features define a concept in that they enable discrimination of items that are instances of a concept from (similar) items that are not. We refer to this property of some features as feature diagnosticity. Previous work has described the behavioral effects of feature...
journal_title：Journal of cognitive neuroscience
pub_type： 杂志文章
doi：10.1162/jocn_a_00661
更新日期：2014-12-01 00:00:00
abstract：:Despite decades of research, there is still disagreement regarding the nature of the information that is maintained in linguistic short-term memory (STM). Some authors argue for abstract phonological codes, whereas others argue for more general sensory traces. We assess these possibilities by investigating linguistic ...
journal_title：Journal of cognitive neuroscience
pub_type： 杂志文章
doi：10.1162/jocn.2008.20154
更新日期：2008-12-01 00:00:00
