Electrophysiological evidence for speech-specific audiovisual integration.

Abstract:

:Lip-read speech is integrated with heard speech at various neural levels. Here, we investigated the extent to which lip-read induced modulations of the auditory N1 and P2 (measured with EEG) are indicative of speech-specific audiovisual integration, and we explored to what extent the ERPs were modulated by phonetic audiovisual congruency. In order to disentangle speech-specific (phonetic) integration from non-speech integration, we used Sine-Wave Speech (SWS) that was perceived as speech by half of the participants (they were in speech-mode), while the other half was in non-speech mode. Results showed that the N1 obtained with audiovisual stimuli peaked earlier than the N1 evoked by auditory-only stimuli. This lip-read induced speeding up of the N1 occurred for listeners in speech and non-speech mode. In contrast, if listeners were in speech-mode, lip-read speech also modulated the auditory P2, but not if listeners were in non-speech mode, thus revealing speech-specific audiovisual binding. Comparing ERPs for phonetically congruent audiovisual stimuli with ERPs for incongruent stimuli revealed an effect of phonetic stimulus congruency that started at ~200 ms after (in)congruence became apparent. Critically, akin to the P2 suppression, congruency effects were only observed if listeners were in speech mode, and not if they were in non-speech mode. Using identical stimuli, we thus confirm that audiovisual binding involves (partially) different neural mechanisms for sound processing in speech and non-speech mode.

journal_name

Neuropsychologia

journal_title

Neuropsychologia

authors

Baart M,Stekelenburg JJ,Vroomen J

doi

10.1016/j.neuropsychologia.2013.11.011

subject

Has Abstract

pub_date

2014-01-01 00:00:00

pages

115-21

eissn

0028-3932

issn

1873-3514

pii

S0028-3932(13)00408-9

journal_volume

53

pub_type

杂志文章
  • Unilateral neglect and perceptual parsing: a large-group study.

    abstract::Array-centred and subarray-centred neglect were disambiguated in a group of 116 patients with left neglect by means of a modified version of the Albert test in which the central column of segments was deleted so as to create two separate sets of targets grouped by proximity. The results indicated that neglect was more...

    journal_title:Neuropsychologia

    pub_type: 临床试验,杂志文章

    doi:10.1016/s0028-3932(02)00066-0

    authors: Neppi-Mòdona M,Savazzi S,Ricci R,Genero R,Berruti G,Pepi R

    更新日期:2002-01-01 00:00:00

  • Semantic constraint, reading control, and the granularity of form-based expectations during semantic processing: Evidence from ERPs.

    abstract::We investigated the role that semantic constraint and participant control over stimulus presentation have on early stages of visual word recognition. Namely, we tested how the presence of a highly constraining sentential context influences the expectations that readers have during incremental sentence processing. Furt...

    journal_title:Neuropsychologia

    pub_type: 杂志文章

    doi:10.1016/j.neuropsychologia.2019.107294

    authors: Bulkes NZ,Christianson K,Tanner D

    更新日期:2020-02-03 00:00:00

  • Event-related potential evidence of sex differences in verbal and nonverbal memory tasks.

    abstract::ERPs were recorded from 19 scalp electrodes while 48 subjects (24 females) performed visual recognition tasks for recurring verbal items and recurring abstract figures. Reaction times were longer in the figures than verbal task; the latencies of the ERP components (P2, N4, P3, P4) were also longer for the figures. A n...

    journal_title:Neuropsychologia

    pub_type: 杂志文章

    doi:10.1016/0028-3932(90)90124-7

    authors: Taylor MJ,Smith ML,Iron KS

    更新日期:1990-01-01 00:00:00

  • Binary choice in patients with prefrontal or posterior brain damage. A relative judgement theory analysis.

    abstract::Binary choice task has been poorly evaluated in patients with focal brain damage. We assessed the decision process in normal subjects and patients with frontal or posterior brain damage using a unimanual two-choice response time (CRT) paradigm. The decision was manipulated by varying the response probability and param...

    journal_title:Neuropsychologia

    pub_type: 杂志文章

    doi:10.1016/0028-3932(96)00012-7

    authors: Godefroy O,Rousseaux M

    更新日期:1996-10-01 00:00:00

  • An investigation of learning strategy supporting transitive inference performance in humans compared to other species.

    abstract::Generalizations about neural function are often drawn from non-human animal models to human cognition, however, the assumption of cross-species conservation may sometimes be invalid. Humans may use different strategies mediated by alternative structures, or similar structures may operate differently within the context...

    journal_title:Neuropsychologia

    pub_type: 杂志文章

    doi:10.1016/j.neuropsychologia.2006.01.004

    authors: Moses SN,Villate C,Ryan JD

    更新日期:2006-01-01 00:00:00

  • Understanding retrosplenial amnesia: insights from animal studies.

    abstract::Bilateral damage in the posterior cingulate region can induce anterograde amnesia. Identifying the potential contributions of the various areas within this heterogeneous region has, however, largely depended on animal research. Within the posterior cingulate region the retrosplenial cortex stands out by virtue of its ...

    journal_title:Neuropsychologia

    pub_type: 杂志文章,评审

    doi:10.1016/j.neuropsychologia.2009.09.030

    authors: Aggleton JP

    更新日期:2010-07-01 00:00:00

  • The neural basis of biased competition in human visual cortex.

    abstract::A typical scene contains many different objects that compete for neural representation due to the limited processing capacity of the visual system. At the neural level, competition among multiple stimuli is evidenced by the mutual suppression of their visually evoked responses and occurs most strongly at the level of ...

    journal_title:Neuropsychologia

    pub_type: 杂志文章,评审

    doi:10.1016/s0028-3932(01)00116-6

    authors: Kastner S,Ungerleider LG

    更新日期:2001-01-01 00:00:00

  • Neural basis of understanding communicative actions: Changes associated with knowing the actor's intention and the meanings of the actions.

    abstract::People can communicate by using hand actions, e.g., signs. Understanding communicative actions requires that the observer knows that the actor has an intention to communicate and the meanings of the actions. Here, we investigated how this prior knowledge affects processing of observed actions. We used functional MRI t...

    journal_title:Neuropsychologia

    pub_type: 杂志文章

    doi:10.1016/j.neuropsychologia.2016.01.002

    authors: Möttönen R,Farmer H,Watkins KE

    更新日期:2016-01-29 00:00:00

  • Disruption of synaesthesia by posthypnotic suggestion: an ERP study.

    abstract::This study examined whether the behavioral and electrophysiological correlates of synaesthetic response conflict could be disrupted by posthypnotic suggestion. We recorded event-related brain potentials while a highly suggestible face-color synaesthete and matched controls viewed congruently and incongruently colored ...

    journal_title:Neuropsychologia

    pub_type: 杂志文章

    doi:10.1016/j.neuropsychologia.2010.07.004

    authors: Terhune DB,Cardeña E,Lindgren M

    更新日期:2010-09-01 00:00:00

  • Left anterior cingulate activity predicts intra-individual reaction time variability in healthy adults.

    abstract::Within-subject, or intra-individual, variability in reaction time (RT) is increasingly recognised as an important indicator of the efficiency of attentional control, yet there have been few investigations of the neural correlates of trial-to-trial RT variability in healthy adults. We sought to determine the neural cor...

    journal_title:Neuropsychologia

    pub_type: 杂志文章

    doi:10.1016/j.neuropsychologia.2015.03.015

    authors: Johnson BP,Pinar A,Fornito A,Nandam LS,Hester R,Bellgrove MA

    更新日期:2015-06-01 00:00:00

  • Seeing music: The perception of melodic 'ups and downs' modulates the spatial processing of visual stimuli.

    abstract::Musical melodies have "peaks" and "valleys". Although the vertical component of pitch and music is well-known, the mechanisms underlying its mental representation still remain elusive. We show evidence regarding the importance of previous experience with melodies for crossmodal interactions to emerge. The impact of th...

    journal_title:Neuropsychologia

    pub_type: 杂志文章

    doi:10.1016/j.neuropsychologia.2018.05.009

    authors: Romero-Rivas C,Vera-Constán F,Rodríguez-Cuadrado S,Puigcerver L,Fernández-Prieto I,Navarra J

    更新日期:2018-08-01 00:00:00

  • Appreciation of metaphoric alternative word meanings by left and right brain-damaged patients.

    abstract::Appreciation of metaphoric and nonmetaphoric alternative word meanings was assessed in 19 aphasic, left (LHD) and 15 non-aphasic, right (RHD) hemisphere brain-damaged stroke patients. With the one exception in the aphasic group, all patients were male. In an unspeeded sorting task, subjects responded on the basis of l...

    journal_title:Neuropsychologia

    pub_type: 杂志文章

    doi:10.1016/0028-3932(90)90063-t

    authors: Brownell HH,Simpson TL,Bihrle AM,Potter HH,Gardner H

    更新日期:1990-01-01 00:00:00

  • Early error detection is generic, but subsequent adaption to errors is not: evidence from ERPs.

    abstract::The aim of the present study was to investigate whether error detection and subsequent regulatory processes could be influenced by pre-familiarisation with task-relevant stimulus features. To this end, 19 healthy adults performed a speeded Go/NoGo task with compound targets, involving two concurrent stimulus attribute...

    journal_title:Neuropsychologia

    pub_type: 杂志文章

    doi:10.1016/j.neuropsychologia.2011.01.006

    authors: Dhar M,Pourtois G

    更新日期:2011-04-01 00:00:00

  • Short-term memory and temporal ordering in early Parkinson's disease: effects of disease chronicity and medication.

    abstract::Studies of Parkinson's disease (PD) have shown impaired temporal ordering but interpretation may be confounded by task requirements and the effects of medication. We examined item recognition and recency discrimination in PD in relation to treatment and performance on other tests. Patients showed increased response la...

    journal_title:Neuropsychologia

    pub_type: 杂志文章

    doi:10.1016/0028-3932(93)90149-t

    authors: Cooper JA,Sagar HJ,Sullivan EV

    更新日期:1993-09-01 00:00:00

  • Effects of anticaricaturing vs. caricaturing and their neural correlates elucidate a role of shape for face learning.

    abstract::To assess the role of shape information for unfamiliar face learning, we investigated effects of photorealistic spatial anticaricaturing and caricaturing on later face recognition. We assessed behavioural performance and event-related brain potential (ERP) correlates of recognition, using different images of anticaric...

    journal_title:Neuropsychologia

    pub_type: 杂志文章

    doi:10.1016/j.neuropsychologia.2012.06.013

    authors: Schulz C,Kaufmann JM,Walther L,Schweinberger SR

    更新日期:2012-08-01 00:00:00

  • The role of motor contagion in the prediction of action.

    abstract::It has been proposed that actions are intrinsically linked to perception. The idea behind these theories is that observing, imagining or in any way representing an action excites the motor programs used to execute that same action. There is neurophysiological evidence that neurons in premotor cortex of monkeys respond...

    journal_title:Neuropsychologia

    pub_type: 杂志文章,评审

    doi:10.1016/j.neuropsychologia.2004.11.012

    authors: Blakemore SJ,Frith C

    更新日期:2005-01-01 00:00:00

  • Cognitive abilities in left-handers: writing posture revisited.

    abstract::Among 1848 young men appearing before the Danish draft board, 232 (13%) were left-handed. Of these, 118 (51%) used an inverted, or hook-like, writing posture, 49 (21%) used a non-inverted posture and the remaining 65 (28%) could not be categorized. There were no differences between left- and right-handers on a battery...

    journal_title:Neuropsychologia

    pub_type: 杂志文章

    doi:10.1016/s0028-3932(01)00047-1

    authors: Teasdale TW,Owen DR

    更新日期:2001-01-01 00:00:00

  • Recall of remote episodic memories can appear deficient because of a gist-based retrieval orientation.

    abstract::Determining whether patients with amnesia can succeed in remembering their distant past has pivotal implications for theories of memory storage. However, various factors influence recall. We speculated that some patients with anterograde amnesia adopt a gist-based retrieval orientation for memories from all time perio...

    journal_title:Neuropsychologia

    pub_type: 杂志文章

    doi:10.1016/j.neuropsychologia.2008.12.006

    authors: Rudoy JD,Weintraub S,Paller KA

    更新日期:2009-02-01 00:00:00

  • Mapping the functional neuroanatomy of the intact human brain with brain work imaging.

    abstract::The recent development of noninvasive methods for measuring local rates of energy metabolism or blood flow in the brain has made it possible to investigate functional neuroanatomy in healthy human subjects. The best of these methods, high resolution measurement of regional cerebral blood flow (rCBF) with positron emis...

    journal_title:Neuropsychologia

    pub_type: 杂志文章,评审

    doi:10.1016/0028-3932(91)90009-w

    authors: Haxby JV,Grady CL,Ungerleider LG,Horwitz B

    更新日期:1991-01-01 00:00:00

  • Medial temporal lobe structures and autism: a review of clinical and experimental findings.

    abstract::Although substantive understanding of brain dysfunction in autism remains meager, clinical evidence as well as animal brain research on the effects of early damage to selective brain system have now yielded enough knowledge that some provisional hypotheses concerning the etiology of autism can be generated. Basically,...

    journal_title:Neuropsychologia

    pub_type: 杂志文章,评审

    doi:10.1016/0028-3932(94)90025-6

    authors: Bachevalier J

    更新日期:1994-06-01 00:00:00

  • Evidence of impaired proactive control under positive affect.

    abstract::If it can be assumed that positive affect modulates cognitive control, the underlying mechanisms remain unclear. The main aim of this study was to investigate how positive affect influences proactive and reactive modes of control and to explore the temporal dynamic of this influence, in terms of its transient and/or s...

    journal_title:Neuropsychologia

    pub_type: 杂志文章

    doi:10.1016/j.neuropsychologia.2018.04.021

    authors: Chaillou AC,Giersch A,Hoonakker M,Capa RL,Doignon-Camus N,Pham BT,Bonnefond A

    更新日期:2018-06-01 00:00:00

  • Unimpaired discrimination of fearful prosody after amygdala lesion.

    abstract::Prosody (i.e. speech melody) is an important cue to infer an interlocutor's emotional state, complementing information from face expression and body posture. Inferring fear from face expression is reported as impaired after amygdala lesions. It remains unclear whether this deficit is specific to face expression, or is...

    journal_title:Neuropsychologia

    pub_type: 杂志文章

    doi:10.1016/j.neuropsychologia.2013.07.005

    authors: Bach DR,Hurlemann R,Dolan RJ

    更新日期:2013-09-01 00:00:00

  • Effects of alpha and gamma transcranial alternating current stimulation (tACS) on verbal creativity and intelligence test performance.

    abstract::Transcranial alternating current stimulation (tACS) is a non-invasive brain stimulation method that allows to directly modulate brain oscillations of a given frequency. Using this method, it was recently shown that increasing alpha (10Hz) oscillations improved creative ideation with figural material and that increasin...

    journal_title:Neuropsychologia

    pub_type: 杂志文章

    doi:10.1016/j.neuropsychologia.2017.10.035

    authors: Grabner RH,Krenn J,Fink A,Arendasy M,Benedek M

    更新日期:2018-09-01 00:00:00

  • A developmental window into trade-offs in executive function: the case of task switching versus response inhibition in 6-year-olds.

    abstract::Good executive function has been linked to many positive outcomes in academic performance, health, and social competence. However, some aspects of executive function may interfere with other cognitive processes. Childhood provides a unique test case for investigating such cognitive trade-offs, given the dramatic failu...

    journal_title:Neuropsychologia

    pub_type: 杂志文章

    doi:10.1016/j.neuropsychologia.2014.04.016

    authors: Blackwell KA,Chatham CH,Wiseheart M,Munakata Y

    更新日期:2014-09-01 00:00:00

  • Hemispheric dominance for visuospatial attention does not predict the direction of pseudoneglect.

    abstract::Pseudoneglect refers to a tendency of neurologically healthy individuals to produce leftward perceptual biases during spatial tasks, which is traditionally measured using line bisection tasks. This behavioral asymmetry is often explained as a consequence of right hemispheric dominance for visuospatial attention. The p...

    journal_title:Neuropsychologia

    pub_type: 杂志文章

    doi:10.1016/j.neuropsychologia.2020.107634

    authors: Gerrits R,Verhelst H,Vingerhoets G

    更新日期:2020-11-01 00:00:00

  • Cognitive modelling of face processing: evidence from Alzheimer patients.

    abstract::This is a prospective neuropsychological study on face processing in Alzheimer's disease (AD). The aim was to assess the prevalence and the nature of face processing disorders in AD, and at investigating possible inter-test dissociations within the framework of currently used face processing models. A standardized fou...

    journal_title:Neuropsychologia

    pub_type: 临床试验,杂志文章

    doi:10.1016/0028-3932(95)00009-r

    authors: Della Sala S,Muggia S,Spinnler H,Zuffi M

    更新日期:1995-06-01 00:00:00

  • Quantifier processing can be dissociated from numerical processing: evidence from semantic dementia patients.

    abstract::Quantifiers such as frequency adverbs (e.g., "always", "never") and quantity pronouns (e.g., "many", "none") convey quantity information. Whether quantifiers are processed as numbers or as general semantics has been a matter of much debate. Some neuropsychological and fMRI studies have found that the processing of qua...

    journal_title:Neuropsychologia

    pub_type: 杂志文章

    doi:10.1016/j.neuropsychologia.2013.07.003

    authors: Cheng D,Zhou A,Yu X,Chen C,Jia J,Zhou X

    更新日期:2013-09-01 00:00:00

  • The association of grey matter volume and cortical complexity with individual differences in children's arithmetic fluency.

    abstract::Only a small amount of studies have looked at the structural neural correlates of children's arithmetic. Furthermore, these studies mainly implemented voxel-based morphometry, which only takes the volume of regions into account, without looking at other structural properties. The current study aimed to contribute know...

    journal_title:Neuropsychologia

    pub_type: 杂志文章

    doi:10.1016/j.neuropsychologia.2019.107293

    authors: Polspoel B,Vandermosten M,De Smedt B

    更新日期:2020-02-03 00:00:00

  • What is a memory schema? A historical perspective on current neuroscience literature.

    abstract::The term "schema" has been used to describe vastly different knowledge structures within the memory neuroscience literature. Ambiguous terminology hinders cross-study comparisons and confounds interpretation of the suggested role of the ventromedial prefrontal cortex (vmPFC) in schema functions. Based on an extensive ...

    journal_title:Neuropsychologia

    pub_type: 杂志文章,评审

    doi:10.1016/j.neuropsychologia.2013.11.010

    authors: Ghosh VE,Gilboa A

    更新日期:2014-01-01 00:00:00

  • Differential-handed response to verbal and visual spatial stimuli: evidence of specialized hemispheric processing following callosotomy.

    abstract::Left- and right-hand responses were studied in a patient who had undergone complete corpus callosotomy to examine selective hemispheric processing employing free-field stimuli. Tests of verbal and visual spatial processing were presented, and multiple choice performances were obtained using both left and right hands. ...

    journal_title:Neuropsychologia

    pub_type: 杂志文章

    doi:10.1016/0028-3932(89)90005-5

    authors: Loring DW,Meador KJ,Lee GP

    更新日期:1989-01-01 00:00:00