Effects of Cross-modal Asynchrony on Informational Masking in Human Cortex.

Abstract:

:In many everyday listening situations, an otherwise audible sound may go unnoticed amid multiple other sounds. This auditory phenomenon, called informational masking (IM), is sensitive to visual input and involves early (50-250 msec) activity in the auditory cortex (the so-called awareness-related negativity). It is still unclear whether and how the timing of visual input influences the neural correlates of IM in auditory cortex. To address this question, we obtained simultaneous behavioral and neural measures of IM from human listeners in the presence of a visual input stream and varied the asynchrony between the visual stream and the rhythmic auditory target stream (in-phase, antiphase, or random). Results show effects of cross-modal asynchrony on both target detectability (RT and sensitivity) and the awareness-related negativity measured with EEG, which were driven primarily by antiphasic audiovisual stimuli. The neural effect was limited to the interval shortly before listeners' behavioral report of the target. Our results indicate that the relative timing of visual input can influence the IM of a target sound in the human auditory cortex. They further show that this audiovisual influence occurs early during the perceptual buildup of the target sound. In summary, these findings provide novel insights into the interaction of IM and multisensory interaction in the human brain.

journal_name

J Cogn Neurosci

authors

Hausfeld L,Gutschalk A,Formisano E,Riecke L

doi

10.1162/jocn_a_01097

subject

Has Abstract

pub_date

2017-06-01 00:00:00

pages

980-990

issue

6

eissn

0898-929X

issn

1530-8898

journal_volume

29

pub_type

杂志文章
  • Neural organization of linguistic short-term memory is sensory modality-dependent: evidence from signed and spoken language.

    abstract::Despite decades of research, there is still disagreement regarding the nature of the information that is maintained in linguistic short-term memory (STM). Some authors argue for abstract phonological codes, whereas others argue for more general sensory traces. We assess these possibilities by investigating linguistic ...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/jocn.2008.20154

    authors: Pa J,Wilson SM,Pickell H,Bellugi U,Hickok G

    更新日期:2008-12-01 00:00:00

  • Functionally Separable Font-invariant and Font-sensitive Neural Populations in Occipitotemporal Cortex.

    abstract::Reading relies on the rapid visual recognition of words viewed in a wide variety of fonts. We used fMRI to identify neural populations showing reduced fMRI responses to repeated words displayed in different fonts ("font-invariant" repetition suppression). We also identified neural populations showing greater fMRI resp...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/jocn_a_01408

    authors: Zhou Z,Vilis T,Strother L

    更新日期:2019-07-01 00:00:00

  • Conceptual processing in music as revealed by N400 effects on words and musical targets.

    abstract::The cognitive processing of concepts, that is, abstract general ideas, has been mostly studied with language. However, other domains, such as music, can also convey concepts. Koelsch et al. [Koelsch, S., Kasper, E., Sammler, D., Schulze, K., Gunter, T., & Friederici, A. D. Music, language and meaning: Brain signatures...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/jocn.2009.21113

    authors: Daltrozzo J,Schön D

    更新日期:2009-10-01 00:00:00

  • Foraging Value, Risk Avoidance, and Multiple Control Signals: How the Anterior Cingulate Cortex Controls Value-based Decision-making.

    abstract::Recent work on the role of the ACC in cognition has focused on choice difficulty, action value, risk avoidance, conflict resolution, and the value of exerting control among other factors. A main underlying question is what are the output signals of ACC, and relatedly, what is their effect on downstream cognitive proce...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/jocn_a_01140

    authors: Brown JW,Alexander WH

    更新日期:2017-10-01 00:00:00

  • The first does the work, but the third time's the charm: the effects of massed repetition on episodic encoding of multimodal face-name associations.

    abstract::In social interactions, it is often necessary to rapidly encode the association between visually presented faces and auditorily presented names. The present study used event-related potentials to examine the neural correlates of associative encoding for multimodal face-name pairs. We assessed study-phase processes lea...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/jocn.2009.21201

    authors: Mangels JA,Manzi A,Summerfield C

    更新日期:2010-03-01 00:00:00

  • Auditory cortical responses to speech-like stimuli in dyslexic adults.

    abstract::Auditory cortical processing of speech-like sounds was studied in 9 dyslexic and 11 normal-reading adults. Noise/square-wave sequences, mimicking transitions from a fricative consonant to a vowel, were presented binaurally once every 1.1 sec and the cortical responses were recorded with a whole-scalp neuromagnetometer...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/08989290260138654

    authors: Renvall H,Hari R

    更新日期:2002-07-01 00:00:00

  • The Role of Hierarchical Dynamical Functions in Coding for Episodic Memory and Cognition.

    abstract::Behavioral research in human verbal memory function led to the initial definition of episodic memory and semantic memory. A complete model of the neural mechanisms of episodic memory must include the capacity to encode and mentally reconstruct everything that humans can recall from their experience. This article propo...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/jocn_a_01439

    authors: Dannenberg H,Alexander AS,Robinson JC,Hasselmo ME

    更新日期:2019-09-01 00:00:00

  • Rapid interactions between lexical semantic and word form analysis during word recognition in context: evidence from ERPs.

    abstract::We used ERPs to investigate the time course of interactions between lexical semantic and sublexical visual word form processing during word recognition. Participants read sentence-embedded pseudowords that orthographically resembled a contextually supported real word (e.g., "She measured the flour so she could bake a ...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/jocn_a_00148

    authors: Kim A,Lai V

    更新日期:2012-05-01 00:00:00

  • Phonological Processing in Primary Progressive Aphasia.

    abstract::Individuals with primary progressive aphasia (PPA) show selective breakdown in regions within the proposed dorsal (articulatory-phonological) and ventral (lexical-semantic) pathways involved in language processing. Phonological STM impairment, which has been attributed to selective damage to dorsal pathway structures,...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/jocn_a_00901

    authors: Henry ML,Wilson SM,Babiak MC,Mandelli ML,Beeson PM,Miller ZA,Gorno-Tempini ML

    更新日期:2016-02-01 00:00:00

  • Boosting Cognition: Effects of Multiple-Session Transcranial Direct Current Stimulation on Working Memory.

    abstract::Transcranial direct current stimulation (tDCS) is a promising tool for neurocognitive enhancement. Several studies have shown that just a single session of tDCS over the left dorsolateral pFC (lDLPFC) can improve the core cognitive function of working memory (WM) in healthy adults. Yet, recent studies combining multip...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/jocn_a_01077

    authors: Talsma LJ,Kroese HA,Slagter HA

    更新日期:2017-04-01 00:00:00

  • Figure-ground representation and its decay in primary visual cortex.

    abstract::We used fMRI to study figure-ground representation and its decay in primary visual cortex (V1). Human observers viewed a motion-defined figure that gradually became camouflaged by a cluttered background after it stopped moving. V1 showed positive fMRI responses corresponding to the moving figure and negative fMRI resp...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/jocn_a_00190

    authors: Strother L,Lavell C,Vilis T

    更新日期:2012-04-01 00:00:00

  • Humor comprehension and appreciation: an FMRI study.

    abstract::Humor is a unique ability in human beings. Suls [A two-stage model for the appreciation of jokes and cartoons. In P. E. Goldstein & J. H. McGhee (Eds.), The psychology of humour. Theoretical perspectives and empirical issues. New York: Academic Press, 1972, pp. 81-100] proposed a two-stage model of humor: detection an...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/jocn.2006.18.11.1789

    authors: Bartolo A,Benuzzi F,Nocetti L,Baraldi P,Nichelli P

    更新日期:2006-11-01 00:00:00

  • Neural correlates of species-typical illogical cognitive bias in human inference.

    abstract::The ability to think logically is a hallmark of human intelligence, yet our innate inferential abilities are marked by implicit biases that often lead to illogical inference. For example, given AB ("if A then B"), people frequently but fallaciously infer the inverse, BA. This mode of inference, called symmetry, is log...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/jocn.2009.21330

    authors: Ogawa A,Yamazaki Y,Ueno K,Cheng K,Iriki A

    更新日期:2010-09-01 00:00:00

  • Shared neural circuits for mentalizing about the self and others.

    abstract::Although many examples exist for shared neural representations of self and other, it is unknown how such shared representations interact with the rest of the brain. Furthermore, do high-level inference-based shared mentalizing representations interact with lower level embodied/simulation-based shared representations? ...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/jocn.2009.21287

    authors: Lombardo MV,Chakrabarti B,Bullmore ET,Wheelwright SJ,Sadek SA,Suckling J,MRC AIMS Consortium.,Baron-Cohen S

    更新日期:2010-07-01 00:00:00

  • Transcranial magnetic stimulation in a finger-tapping task separates motor from timing mechanisms and induces frequency doubling.

    abstract::We study the interplay between motor programs and their timing in the brain by using precise pulses of transcranial magnetic stimulation (TMS) applied to the primary motor cortex. The movement of the finger performing a tapping task is periodically perturbed in synchronization with a metronome. TMS perturbation can pr...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/jocn.2007.19.5.721

    authors: Levit-Binnun N,Handzy NZ,Peled A,Modai I,Moses E

    更新日期:2007-05-01 00:00:00

  • Self-enhancement influences medial frontal cortex alpha power to social rejection feedback.

    abstract::Although previous research has demonstrated that individuals are motivated to self-enhance, the neurocognitive mechanisms and temporal dynamics of self-enhancement are poorly understood. The current research examined whether self-enhancing motivations affect the perceptual processing of social feedback. Participants w...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/jocn_a_00645

    authors: Leitner JB,Hehman E,Jones JM,Forbes CE

    更新日期:2014-10-01 00:00:00

  • Brain response to unexpected novel noises in children with low and high trait anxiety.

    abstract::The behavioral inhibition system [Gray, J. A. The neuropsychology of anxiety: An enquiry into the functions of the septo-hippocampal system. Oxford: Oxford University Press, 1982] proposes that anxiety is associated with the processing of novel stimuli. We aimed to explore this relationship by recording auditory event...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/jocn.2007.19.1.25

    authors: Hogan AM,Butterfield EL,Phillips L,Hadwin JA

    更新日期:2007-01-01 00:00:00

  • Brain dynamics sustaining rapid rule extraction from speech.

    abstract::Language acquisition is a complex process that requires the synergic involvement of different cognitive functions, which include extracting and storing the words of the language and their embedded rules for progressive acquisition of grammatical information. As has been shown in other fields that study learning proces...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/jocn.2011.21636

    authors: de Diego-Balaguer R,Fuentemilla L,Rodriguez-Fornells A

    更新日期:2011-10-01 00:00:00

  • Cross-domain effects of music and language experience on the representation of pitch in the human auditory brainstem.

    abstract::Neural encoding of pitch in the auditory brainstem is known to be shaped by long-term experience with language or music, implying that early sensory processing is subject to experience-dependent neural plasticity. In language, pitch patterns consist of sequences of continuous, curvilinear contours; in music, pitch pat...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/jocn.2009.21362

    authors: Bidelman GM,Gandour JT,Krishnan A

    更新日期:2011-02-01 00:00:00

  • Do rats have prefrontal cortex? The rose-woolsey-akert program reconsidered.

    abstract::Abstract Primates are unique among mammals in possessing a region of dorsolateral prefrontal cortex with a well-developed internal granular layer. This region is commonly implicated in higher cognitive functions. Despite the histological distinctiveness of primate dorsolateral prefrontal cortex, the work of Rose, Wool...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/jocn.1995.7.1.1

    authors: Preuss TM

    更新日期:1995-01-01 00:00:00

  • Facial expressions and the evolution of the speech rhythm.

    abstract::In primates, different vocalizations are produced, at least in part, by making different facial expressions. Not surprisingly, humans, apes, and monkeys all recognize the correspondence between vocalizations and the facial postures associated with them. However, one major dissimilarity between monkey vocalizations and...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章,评审

    doi:10.1162/jocn_a_00575

    authors: Ghazanfar AA,Takahashi DY

    更新日期:2014-06-01 00:00:00

  • Electrophysiological Correlates of Monitoring in Typing with and without Visual Feedback.

    abstract::New theories of monitoring in language production, regardless of their mechanistic differences, all posit monitoring mechanisms that share general computational principles with action monitoring. This perspective, if accurate, would predict that many electrophysiological signatures of performance monitoring should be ...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/jocn_a_01500

    authors: Pinet S,Nozari N

    更新日期:2020-04-01 00:00:00

  • What processing is impaired in apperceptive agnosia? Evidence from normal subjects.

    abstract::Visual agnosia is a neuropsychological syndrome characterized by a failure of object identification. Apperceptive agnosia, an object identification deficit caused by damage to early perceptual processes, has been explained by appealing to both damaged early sensory processes and to damaged preattentive grouping proces...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/089892998562979

    authors: Vecera SP,Gilds KS

    更新日期:1998-09-01 00:00:00

  • Dorsal striatal-midbrain connectivity in humans predicts how reinforcements are used to guide decisions.

    abstract::It has been suggested that the target areas of dopaminergic midbrain neurons, the dorsal (DS) and ventral striatum (VS), are differently involved in reinforcement learning especially as actor and critic. Whereas the critic learns to predict rewards, the actor maintains action values to guide future decisions. The diff...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/jocn.2009.21092

    authors: Kahnt T,Park SQ,Cohen MX,Beck A,Heinz A,Wrase J

    更新日期:2009-07-01 00:00:00

  • Visual localization ability influences cross-modal bias.

    abstract::The ability of a visual signal to influence the localization of an auditory target (i.e., "cross-modal bias") was examined as a function of the spatial disparity between the two stimuli and their absolute locations in space. Three experimental issues were examined: (a) the effect of a spatially disparate visual stimul...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/089892903321107792

    authors: Hairston WD,Wallace MT,Vaughan JW,Stein BE,Norris JL,Schirillo JA

    更新日期:2003-01-01 00:00:00

  • Zooming In and Out on One's Life: Autobiographical Representations at Multiple Time Scales.

    abstract::The ability to decouple from the present environment and explore other times is a central feature of the human mind. Research in cognitive psychology and neuroscience has shown that the personal past and future is represented at multiple timescales and levels of resolution, from broad lifetime periods that span years ...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/jocn_a_01556

    authors: D'Argembeau A

    更新日期:2020-11-01 00:00:00

  • The timing of action-monitoring processes in the anterior cingulate cortex.

    abstract::The anterior cingulate cortex (ACC) has been shown to respond to conflict between simultaneously active, incompatible response tendencies. This area is active during high-conflict correct trials and also when participants make errors. Here, we use the temporal resolution of high-density event-related potentials (ERPs)...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/08989290260045837

    authors: Van Veen V,Carter CS

    更新日期:2002-05-15 00:00:00

  • Activity in the visual cortex is modulated by top-down attention locked to reaction time.

    abstract::We studied the correlation between perception and hemodynamic activity in the visual cortex in a change detection task. Whenever the observer perceived the location of a change, rightly or wrongly, the blood oxygenation level-dependent signal increased in the primary visual cortex and the nearby extrastriate areas abo...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/jocn.2007.19.2.331

    authors: Moradi F,Hipp C,Koch C

    更新日期:2007-02-01 00:00:00

  • Thalamic and cortical mechanisms of attention suggested by recent positron emission tomographic experiments.

    abstract::An attention mechanism in the pulvinar nucleus of the thalamus appears to be involved in the filtering of a location in a cluttered visual field, according to recent PET data. The mechanism in the pulvinar is assumed to be a particular type of circuit that reciprocally connects thalamic relay cells to cortical cells. ...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/jocn.1990.2.4.358

    authors: Laberge D

    更新日期:1990-10-01 00:00:00

  • Cross-modal processing in the occipito-temporal cortex: a TMS study of the Müller-Lyer illusion.

    abstract::The Müller-Lyer illusion occurs both in vision and in touch, and transfers cross-modally from vision to haptics [Mancini, F., Bricolo, E., & Vallar, G. Multisensory integration in the Müller-Lyer illusion: From vision to haptics. Quarterly Journal of Experimental Psychology, 63, 818-830, 2010]. Recent evidence suggest...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/jocn.2010.21561

    authors: Mancini F,Bolognini N,Bricolo E,Vallar G

    更新日期:2011-08-01 00:00:00