Time course of early audiovisual interactions during speech and nonspeech central auditory processing: a magnetoencephalography study.

Abstract:

:Cross-modal fusion phenomena suggest specific interactions of auditory and visual sensory information both within the speech and nonspeech domains. Using whole-head magnetoencephalography, this study recorded M50 and M100 fields evoked by ambiguous acoustic stimuli that were visually disambiguated to perceived /ta/ or /pa/ syllables. As in natural speech, visual motion onset preceded the acoustic signal by 150 msec. Control conditions included visual and acoustic nonspeech signals as well as visual-only and acoustic-only stimuli. (a) Both speech and nonspeech motion yielded a consistent attenuation of the auditory M50 field, suggesting a visually induced "preparatory baseline shift" at the level of the auditory cortex. (b) Within the temporal domain of the auditory M100 field, visual speech and nonspeech motion gave rise to different response patterns (nonspeech: M100 attenuation; visual /pa/: left-hemisphere M100 enhancement; /ta/: no effect). (c) These interactions could be further decomposed using a six-dipole model. One of these three pairs of dipoles (V270) was fitted to motion-induced activity at a latency of 270 msec after motion onset, that is, the time domain of the auditory M100 field, and could be attributed to the posterior insula. This dipole source responded to nonspeech motion and visual /pa/, but was found suppressed in the case of visual /ta/. Such a nonlinear interaction might reflect the operation of a binary distinction between the marked phonological feature "labial" versus its underspecified competitor "coronal." Thus, visual processing seems to be shaped by linguistic data structures even prior to its fusion with auditory information channel.

journal_name

J Cogn Neurosci

authors

Hertrich I,Mathiak K,Lutzenberger W,Ackermann H

doi

10.1162/jocn.2008.21019

subject

Has Abstract

pub_date

2009-02-01 00:00:00

pages

259-74

issue

2

eissn

0898-929X

issn

1530-8898

journal_volume

21

pub_type

杂志文章
  • Rules rule! Brain activity dissociates the representations of stimulus contingencies with varying levels of complexity.

    abstract::The significance of stimuli is linked not only to their nature but also to the sequential structure in which they are embedded, which gives rise to contingency rules. Humans have an extraordinary ability to extract and exploit these rules, as exemplified by the role of grammar and syntax in language. To study the brai...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/jocn_a_00229

    authors: Tse CY,Low KA,Fabiani M,Gratton G

    更新日期:2012-09-01 00:00:00

  • From prestimulus alpha oscillation to visual-evoked response: an inverted-U function and its attentional modulation.

    abstract::Understanding the relation between prestimulus neural activity and subsequent stimulus processing has become an area of active investigation. Computational modeling, as well as in vitro and in vivo single-unit recordings in animal preparations, have explored mechanisms by which background synaptic activity can influen...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/jocn.2010.21478

    authors: Rajagovindan R,Ding M

    更新日期:2011-06-01 00:00:00

  • ERP evidence for rapid hedonic evaluation of logos.

    abstract::We know that human neurocognitive systems rapidly and implicitly evaluate emotionally charged stimuli. But what about more everyday, frequently encountered kinds of objects, such as computer desktop icons and business logos? Do we rapidly and implicitly evaluate these more prosaic visual images, attitude objects that ...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/jocn.2008.21180

    authors: Handy TC,Smilek D,Geiger L,Liu C,Schooler JW

    更新日期:2010-01-01 00:00:00

  • Neural Representations for Sensorimotor Control. III. Learning a Body-Centered Representation of a Three-Dimensional Target Position.

    abstract::Abstract A neural model is described of how the brain may autonomously learn a body-centered representation of a three-dimensional (3-D) target position by combining information about retinal target position, eye position, and head position in real time. Such a body-centered spatial representation enables accurate mov...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/jocn.1994.6.4.341

    authors: Guenther FH,Bullock D,Greve D,Grossberg S

    更新日期:1994-10-01 00:00:00

  • Reflexive, symbolic, and affective contributions to eye movements during task switching: response selection.

    abstract::Active vision is a dynamic process involving the flexible coordination of different gaze strategies to achieve behavioral goals. Although many complex behaviors rely on an ability to efficiently switch between gaze-control strategies, few studies to date have examined mechanisms of task level oculomotor control in det...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/089892904322984599

    authors: Hodgson TL,Golding C,Molyva D,Rosenthal CR,Kennard C

    更新日期:2004-03-01 00:00:00

  • Comparisons between Active Properties of Distal Dendritic Branches and Spines: Implications for Neuronal Computations.

    abstract::The specific contributions of distal dendrites to the computational properties of cortical neurons are little understood and are completely ignored in most network simulations of higher brain functions. Compartmental models, based on realistic estimates of morphology and physiology, provide a means for exploring these...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/jocn.1989.1.3.273

    authors: Shepherd GM,Woolf TB,Carnevale NT

    更新日期:1989-07-01 00:00:00

  • Anodal Occipital Transcranial Direct Current Stimulation Enhances Perceived Visual Size Illusions.

    abstract::Human early visual cortex has long been suggested to play a crucial role in context-dependent visual size perception through either lateral interaction or feedback projections from higher to lower visual areas. We investigated the causal contribution of early visual cortex to context-dependent visual size perception u...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/jocn_a_01664

    authors: Wang A,Chen L,Jiang Y

    更新日期:2020-12-16 00:00:00

  • Multisensory spatial attention deficits are predictive of phonological decoding skills in developmental dyslexia.

    abstract::Although the dominant approach posits that developmental dyslexia arises from deficits in systems that are exclusively linguistic in nature (i.e., phonological deficit theory), dyslexics show a variety of lower level deficits in sensory and attentional processing. Although their link to the reading disorder remains co...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/jocn.2009.21232

    authors: Facoetti A,Trussardi AN,Ruffino M,Lorusso ML,Cattaneo C,Galli R,Molteni M,Zorzi M

    更新日期:2010-05-01 00:00:00

  • Verbal labels modulate perceptual object processing in 1-year-old children.

    abstract::Whether verbal labels help infants visually process and categorize objects is a contentious issue. Using electroencephalography, we investigated whether possessing familiar or novel labels for objects directly enhances 1-year-old children's neural processes underlying the perception of those objects. We found enhanced...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/jocn.2010.21427

    authors: Gliga T,Volein A,Csibra G

    更新日期:2010-12-01 00:00:00

  • FM-selective networks in human auditory cortex revealed using fMRI and multivariate pattern classification.

    abstract::Frequency modulation (FM) is an acoustic feature of nearly all complex sounds. Directional FM sweeps are especially pervasive in speech, music, animal vocalizations, and other natural sounds. Although the existence of FM-selective cells in the auditory cortex of animals has been documented, evidence in humans remains ...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/jocn_a_00254

    authors: Hsieh IH,Fillmore P,Rong F,Hickok G,Saberi K

    更新日期:2012-09-01 00:00:00

  • Neural activity in the hippocampus and perirhinal cortex during encoding is associated with the durability of episodic memory.

    abstract::Studies examining medial temporal lobe (MTL) involvement in memory formation typically assess memory performance after a single, short delay. Thus, the relationship between MTL encoding activity and memory durability over time remains poorly characterized. To explore this relationship, we scanned participants using hi...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/jocn.2009.21381

    authors: Carr VA,Viskontas IV,Engel SA,Knowlton BJ

    更新日期:2010-11-01 00:00:00

  • Moving mirrors: a high-density EEG study investigating the effect of camera movements on motor cortex activation during action observation.

    abstract::Action execution-perception links (mirror mechanism) have been repeatedly suggested to play crucial roles in social cognition. Remarkably, the designs of most studies exploring this topic so far excluded even the simplest traces of social interaction, such as a movement of the observer toward another individual. This ...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/jocn_a_00602

    authors: Heimann K,Umiltà MA,Guerra M,Gallese V

    更新日期:2014-09-01 00:00:00

  • The White Matter Module-Hub Network of Semantics Revealed by Semantic Dementia.

    abstract::Cognitive neuroscience exploring the architecture of semantics has shown that coherent supramodal concepts are computed in the anterior temporal lobes (ATL), but it is unknown how/where modular information implemented by posterior cortices (word/object/face forms) is conveyed to the ATL hub. We investigated the semant...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/jocn_a_01549

    authors: Sundqvist M,Routier A,Dubois B,Colliot O,Teichmann M

    更新日期:2020-07-01 00:00:00

  • Minimal Recognizable Configurations Elicit Category-selective Responses in Higher Order Visual Cortex.

    abstract::Visual object recognition is performed effortlessly by humans notwithstanding the fact that it requires a series of complex computations, which are, as yet, not well understood. Here, we tested a novel account of the representations used for visual recognition and their neural correlates using fMRI. The rationale is b...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/jocn_a_01420

    authors: Holzinger Y,Ullman S,Harari D,Behrmann M,Avidan G

    更新日期:2019-09-01 00:00:00

  • Numerical values leave a semantic imprint on associated signs in monkeys.

    abstract::Animals and humans share an evolutionary ancient quantity representation which is characterized by analog magnitude features: Discriminating magnitudes becomes more difficult with increasing set sizes (size effect) and with decreasing distance between two numerosities (distance effect). Humans show these effects even ...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/jocn.2009.21193

    authors: Diester I,Nieder A

    更新日期:2010-01-01 00:00:00

  • Neurophysiological correlates of comprehending emotional meaning in context.

    abstract::Although the neurocognitive mechanisms of nonaffective language comprehension have been studied extensively, relatively less is known about how the emotional meaning of language is processed. In this study, electrophysiological responses to affectively positive, negative, and neutral words, presented within nonconstra...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/jocn.2008.21151

    authors: Holt DJ,Lynn SK,Kuperberg GR

    更新日期:2009-11-01 00:00:00

  • Cross-modal emotional attention: emotional voices modulate early stages of visual processing.

    abstract::Emotional attention, the boosting of the processing of emotionally relevant stimuli, has, up to now, mainly been investigated within a sensory modality, for instance, by using emotional pictures to modulate visual attention. In real-life environments, however, humans typically encounter simultaneous input to several d...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/jocn.2009.21110

    authors: Brosch T,Grandjean D,Sander D,Scherer KR

    更新日期:2009-09-01 00:00:00

  • The angry brain: neural correlates of anger, angry rumination, and aggressive personality.

    abstract::Very little is known about the neural circuitry guiding anger, angry rumination, and aggressive personality. In the present fMRI experiment, participants were insulted and induced to ruminate. Activity in the dorsal anterior cingulate cortex was positively related to self-reported feelings of anger and individual diff...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/jocn.2009.21051

    authors: Denson TF,Pedersen WC,Ronquillo J,Nandy AS

    更新日期:2009-04-01 00:00:00

  • Semantic advantage for learning new phonological form representations.

    abstract::Learning a new word requires discrimination between a novel sequence of sounds and similar known words. We investigated whether semantic information facilitates the acquisition of new phonological representations in adults and whether this learning enhancement is modulated by overnight consolidation. Participants lear...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/jocn_a_00730

    authors: Hawkins E,Astle DE,Rastle K

    更新日期:2015-04-01 00:00:00

  • Familiarity or conceptual priming: event-related potentials in name recognition.

    abstract::Recent interest has been drawn to the separate components of recognition memory, as studied by event-related potentials (ERPs). In ERPs, recollection is usually accompanied by a late, parietal positive deflection. An earlier, frontal component has been suggested to be a counterpart, accompanying recognition by familia...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/jocn.2009.21045

    authors: Stenberg G,Hellman J,Johansson M,Rosén I

    更新日期:2009-03-01 00:00:00

  • Auditory imagery modulates frequency-specific areas in the human auditory cortex.

    abstract::Neural responses in early sensory areas are influenced by top-down processing. In the visual system, early visual areas have been shown to actively participate in top-down processing based on their topographical properties. Although it has been suggested that the auditory cortex is involved in top-down control, functi...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/jocn_a_00280

    authors: Oh J,Kwon JH,Yang PS,Jeong J

    更新日期:2013-02-01 00:00:00

  • Facial expressions and the evolution of the speech rhythm.

    abstract::In primates, different vocalizations are produced, at least in part, by making different facial expressions. Not surprisingly, humans, apes, and monkeys all recognize the correspondence between vocalizations and the facial postures associated with them. However, one major dissimilarity between monkey vocalizations and...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章,评审

    doi:10.1162/jocn_a_00575

    authors: Ghazanfar AA,Takahashi DY

    更新日期:2014-06-01 00:00:00

  • Context-dependent deactivation of the amygdala during pain.

    abstract::The amygdala has been implicated in fundamental functions for the survival of the organism, such as fear and pain. In accord with this, several studies have shown increased amygdala activity during fear conditioning and the processing of fear-relevant material in human subjects. In contrast, functional neuroimaging st...

    journal_title:Journal of cognitive neuroscience

    pub_type: 临床试验,杂志文章

    doi:10.1162/0898929041920469

    authors: Petrovic P,Carlsson K,Petersson KM,Hansson P,Ingvar M

    更新日期:2004-09-01 00:00:00

  • Declarative and nondeclarative memory: multiple brain systems supporting learning and memory.

    abstract::Abstract The topic of multiple forms of memory is considered from a biological point of view. Fact-and-event (declarative, explicit) memory is contrasted with a collection of non conscious (non-declarative, implicit) memory abilities including skills and habits, priming, and simple conditioning. Recent evidence is rev...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/jocn.1992.4.3.232

    authors: Squire LR

    更新日期:1992-07-01 00:00:00

  • The Sources of Dual-task Costs in Multisensory Working Memory Tasks.

    abstract::We investigated the sources of dual-task costs arising in multisensory working memory (WM) tasks, where stimuli from different modalities have to be simultaneously maintained. Performance decrements relative to unimodal single-task baselines have been attributed to a modality-unspecific central WM store, but such cost...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/jocn_a_01348

    authors: Katus T,Eimer M

    更新日期:2019-02-01 00:00:00

  • The strategic control of gaze direction in the Tower-of-London task.

    abstract::In this paper, we describe a novel approach to the study of problem solving involving the detailed analysis of natural scanning eye movements during the "one-touch" Tower-of-London (TOL) task. We showed subjects a series of pictures depicting two arrangements of colored balls in pockets within the upper and lower halv...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/089892900562499

    authors: Hodgson TL,Bajwa A,Owen AM,Kennard C

    更新日期:2000-09-01 00:00:00

  • Attentional modulation in the detection of irrelevant deviance: a simultaneous ERP/fMRI study.

    abstract::Little is known about the neural mechanisms that control attentional modulation of deviance detection in the auditory modality. In this study, we manipulated the difficulty of a primary task to test the relation between task difficulty and the detection of infrequent, task-irrelevant deviant (D) tones (1,300 Hz) prese...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/jocn.2006.18.5.689

    authors: Sabri M,Liebenthal E,Waldron EJ,Medler DA,Binder JR

    更新日期:2006-05-01 00:00:00

  • On the interaction of selective attention and lexical knowledge: a connectionist account of neglect dyslexia.

    abstract::Neglect dyslexia, a reading impairment acquired as a consequence of brain injury, is traditionally interpreted as a disturbance of selective attention. Patients with neglect dyslexia may ignore the left side of an open book, the beginning words of a line of text, or the beginning letters of a single word. These patien...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/jocn.1990.2.2.96

    authors: Mozer MC,Behrmann M

    更新日期:1990-04-01 00:00:00

  • Early visual responses predict conscious face perception within and between subjects during binocular rivalry.

    abstract::Previous studies indicate that conscious face perception may be related to neural activity in a large time window around 170-800 msec after stimulus presentation, yet in the majority of these studies changes in conscious experience are confounded with changes in physical stimulation. Using multivariate classification ...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/jocn_a_00353

    authors: Sandberg K,Bahrami B,Kanai R,Barnes GR,Overgaard M,Rees G

    更新日期:2013-06-01 00:00:00

  • Multimodal imaging of incidental retrieval: the low route to memory.

    abstract::Memories of past episodes frequently come to mind incidentally, without directed search. It has remained unclear how incidental retrieval processes are initiated in the brain. Here we used fMRI and ERP recordings to find brain activity that specifically correlates with incidental retrieval, as compared to intentional ...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/jocn.2010.21494

    authors: Kompus K,Eichele T,Hugdahl K,Nyberg L

    更新日期:2011-04-01 00:00:00