The time course of auditory-visual processing of speech and body actions: evidence for the simultaneous activation of an extended neural network for semantic processing.

Abstract:

:An extensive network of cortical areas is involved in multisensory object and action recognition. This network draws on inferior frontal, posterior temporal, and parietal areas; activity is modulated by familiarity and the semantic congruency of auditory and visual component signals even if semantic incongruences are created by combining visual and auditory signals representing very different signal categories, such as speech and whole body actions. Here we present results from a high-density ERP study designed to examine the time-course and source location of responses to semantically congruent and incongruent audiovisual speech and body actions to explore whether the network involved in action recognition consists of a hierarchy of sequentially activated processing modules or a network of simultaneously active processing sites. We report two main results:1) There are no significant early differences in the processing of congruent and incongruent audiovisual action sequences. The earliest difference between congruent and incongruent audiovisual stimuli occurs between 240 and 280 ms after stimulus onset in the left temporal region. Between 340 and 420 ms, semantic congruence modulates responses in central and right frontal areas. Late differences (after 460 ms) occur bilaterally in frontal areas.2) Source localisation (dipole modelling and LORETA) reveals that an extended network encompassing inferior frontal, temporal, parasaggital, and superior parietal sites are simultaneously active between 180 and 420 ms to process auditory–visual action sequences. Early activation (before 120 ms) can be explained by activity in mainly sensory cortices. . The simultaneous activation of an extended network between 180 and 420 ms is consistent with models that posit parallel processing of complex action sequences in frontal, temporal and parietal areas rather than models that postulate hierarchical processing in a sequence of brain regions.

journal_name

Neuropsychologia

journal_title

Neuropsychologia

authors

Meyer GF,Harrison NR,Wuerger SM

doi

10.1016/j.neuropsychologia.2013.05.014

subject

Has Abstract

pub_date

2013-08-01 00:00:00

pages

1716-25

issue

9

eissn

0028-3932

issn

1873-3514

pii

S0028-3932(13)00163-2

journal_volume

51

pub_type

杂志文章
  • Language and task switching in the bilingual brain: Bilinguals are staying, not switching, experts.

    abstract::Bilinguals' ability to control which language they speak and to switch between languages may rely on neurocognitive mechanisms shared with non-linguistic task switching. However, recent studies also reveal some limitations on the extent control mechanisms are shared across domains, introducing the possibility that som...

    journal_title:Neuropsychologia

    pub_type: 杂志文章

    doi:10.1016/j.neuropsychologia.2014.10.037

    authors: Weissberger GH,Gollan TH,Bondi MW,Clark LR,Wierenga CE

    更新日期:2015-01-01 00:00:00

  • Seeing music: The perception of melodic 'ups and downs' modulates the spatial processing of visual stimuli.

    abstract::Musical melodies have "peaks" and "valleys". Although the vertical component of pitch and music is well-known, the mechanisms underlying its mental representation still remain elusive. We show evidence regarding the importance of previous experience with melodies for crossmodal interactions to emerge. The impact of th...

    journal_title:Neuropsychologia

    pub_type: 杂志文章

    doi:10.1016/j.neuropsychologia.2018.05.009

    authors: Romero-Rivas C,Vera-Constán F,Rodríguez-Cuadrado S,Puigcerver L,Fernández-Prieto I,Navarra J

    更新日期:2018-08-01 00:00:00

  • Diagnostic validity of line bisection in the acute phase of stroke.

    abstract::The line bisection task is commonly depicted as a valid diagnostic tool to help differentiate between primary visual field defects and spatial neglect. However, recent studies have addressed possible drawbacks in the acute phase after stroke onset. We investigated these critical assumptions in a large and homogeneous ...

    journal_title:Neuropsychologia

    pub_type: 杂志文章

    doi:10.1016/j.neuropsychologia.2016.01.026

    authors: Sperber C,Karnath HO

    更新日期:2016-02-01 00:00:00

  • Crossmodal enhancement of visual orientation discrimination by looming sounds requires functional activation of primary visual areas: a case study.

    abstract::Approaching or looming sounds are salient, potentially threatening stimuli with particular impact on visual processing. The early crossmodal effects by looming sounds (Romei, Murray, Cappe, & Thut, 2009) and their selective impact on visual orientation discrimination (Leo, Romei, Freeman, Ladavas, & Driver, 2011) sugg...

    journal_title:Neuropsychologia

    pub_type: 杂志文章

    doi:10.1016/j.neuropsychologia.2014.02.008

    authors: Cecere R,Romei V,Bertini C,Làdavas E

    更新日期:2014-04-01 00:00:00

  • Patients with hippocampal amnesia successfully integrate gesture and speech.

    abstract::During conversation, people integrate information from co-speech hand gestures with information in spoken language. For example, after hearing the sentence, "A piece of the log flew up and hit Carl in the face" while viewing a gesture directed at the nose, people tend to later report that the log hit Carl in the nose ...

    journal_title:Neuropsychologia

    pub_type: 杂志文章

    doi:10.1016/j.neuropsychologia.2018.06.012

    authors: Hilverman C,Clough SA,Duff MC,Cook SW

    更新日期:2018-08-01 00:00:00

  • How does the topic of conversation affect verbal exchange and eye gaze? A comparison between typical development and high-functioning autism.

    abstract::Conversation is a primary area of difficulty for individuals with high-functioning autism (HFA) although they have unimpaired formal language abilities. This likely stems from the unstructured nature of face-to-face conversation as well as the need to coordinate other modes of communication (e.g. eye gaze) with speech...

    journal_title:Neuropsychologia

    pub_type: 杂志文章

    doi:10.1016/j.neuropsychologia.2010.05.020

    authors: Nadig A,Lee I,Singh L,Bosshart K,Ozonoff S

    更新日期:2010-07-01 00:00:00

  • A cognitive activation study of memory for spatial relationships.

    abstract::Twelve neurologically normal right-handed subjects were asked to remember the locations of eight representational drawings, presented one at a time, together with two landmarks (white squares), on a computer screen. Subjects were then scanned using positron emission tomography (PET) while performing forced-choice reco...

    journal_title:Neuropsychologia

    pub_type: 杂志文章

    doi:10.1016/s0028-3932(98)00136-5

    authors: Johnsrude IS,Owen AM,Crane J,Milner B,Evans AC

    更新日期:1999-06-01 00:00:00

  • Exploring the relationship between cerebellar asymmetry and handedness in chimpanzees (Pan troglodytes) and capuchins (Cebus apella).

    abstract::A comparative study of chimpanzee (Pan troglodytes) and capuchin monkey (Cebus apella) cerebellar asymmetry and its relationship to handedness was conducted. Magnetic resonance images of the brain and behavioral data on a coordinated bimanual task were obtained from 16 chimpanzees and 11 capuchins. Chimpanzees display...

    journal_title:Neuropsychologia

    pub_type: 杂志文章

    doi:10.1016/j.neuropsychologia.2007.02.010

    authors: Phillips KA,Hopkins WD

    更新日期:2007-06-11 00:00:00

  • Hemispheric asymmetry of processing temporal aspects of repetitive movement in two patients with infarction involving the corpus callosum.

    abstract::Two right-handed patients with infarction involving the forebrain commissural fibres produced irregular but rapid repetitive movements with their left hands while producing normal movements with their right hands as well as having normal oral expression. The abnormality was more conspicuous when producing slow tapping...

    journal_title:Neuropsychologia

    pub_type: 杂志文章

    doi:10.1016/0028-3932(89)90004-3

    authors: Kashiwagi A,Kashiwagi T,Nishikawa T,Okuda J

    更新日期:1989-01-01 00:00:00

  • Improvement of deficits in mnemonic rhyme for multiplication in Japanese aphasics.

    abstract::Since Japanese learn the multiplication tables by means of mnemonic rhymes called kuku, i.e., via the auditory-speaking route, it is hypothesized that aphasics who have a deficit in kuku might relearn it via the visual-writing route. After having ordinary language therapy for more than 3 months, eight patients were ad...

    journal_title:Neuropsychologia

    pub_type: 杂志文章

    doi:10.1016/0028-3932(87)90032-7

    authors: Kashiwagi A,Kashiwagi T,Hasegawa T

    更新日期:1987-01-01 00:00:00

  • "Inhibition of return' without visual input.

    abstract::Inhibition of return (IOR) is the name that is associated with a response time (RT) delay to a visual stimulus presented at a recently cued spatial location. Two experiments with 26 undergraduates used an auditory analog to the visual IOR paradigm to examine whether manual RT inhibition would occur in the absence of v...

    journal_title:Neuropsychologia

    pub_type: 杂志文章

    doi:10.1016/0028-3932(96)00015-2

    authors: Schmidt WC

    更新日期:1996-10-01 00:00:00

  • Effects of acoustic periodicity and intelligibility on the neural oscillations in response to speech.

    abstract::Although several studies have investigated neural oscillations in response to acoustically degraded speech, it is still a matter of debate which neural frequencies reflect speech intelligibility. Part of the problem is that effects of acoustics and intelligibility have so far not been considered independently. In the ...

    journal_title:Neuropsychologia

    pub_type: 杂志文章

    doi:10.1016/j.neuropsychologia.2016.12.003

    authors: Steinmetzger K,Rosen S

    更新日期:2017-01-27 00:00:00

  • Impaired word-stem completion priming but intact perceptual identification priming with novel words: evidence from the amnesic patient H.M.

    abstract::We hypothesized that word-stem completion (WSC) priming and perceptual identification (PI) priming, two types of repetition priming, rely on different cognitive and neural mechanisms: WSC priming on a modification mechanism that influences lexical retrieval, and PI priming on plasticity in pre-lexical perceptual syste...

    journal_title:Neuropsychologia

    pub_type: 杂志文章

    doi:10.1016/s0028-3932(97)00155-3

    authors: Postle BR,Corkin S

    更新日期:1998-05-01 00:00:00

  • Selective loss of verbal imagery.

    abstract::This single case study of the ability to generate verbal and non-verbal imagery in a woman who sustained a gunshot wound to the brain reports a significant difficulty in generating images of word shapes but not a significant problem in generating object images. Further dissociation, however, was observed in her abilit...

    journal_title:Neuropsychologia

    pub_type: 临床试验,杂志文章

    doi:10.1016/0028-3932(95)00120-4

    authors: Mehta Z,Newcombe F

    更新日期:1996-05-01 00:00:00

  • Processing of binaural spatial information in human auditory cortex: neuromagnetic responses to interaural timing and level differences.

    abstract::This study was designed to test two hypotheses about binaural hearing: (1) that binaural cues are primarily processed in the hemisphere contralateral to the perceived location of a sound; and (2) that the two main binaural cues, interaural timing differences and interaural level differences, are processed in separate ...

    journal_title:Neuropsychologia

    pub_type: 杂志文章

    doi:10.1016/j.neuropsychologia.2010.05.008

    authors: Johnson BW,Hautus MJ

    更新日期:2010-07-01 00:00:00

  • Emotion and cognition and the amygdala: from "what is it?" to "what's to be done?".

    abstract::The amygdala is a fascinating, complex structure that lies at the center of much of our current thinking about emotion. Here, I will review data that suggest that the amygdala is involved in several processes linked to determining what a stimulus is and what the organism should therefore do - the two questions that ar...

    journal_title:Neuropsychologia

    pub_type: 杂志文章,评审

    doi:10.1016/j.neuropsychologia.2010.06.038

    authors: Pessoa L

    更新日期:2010-10-01 00:00:00

  • Audio-visual stimulation improves oculomotor patterns in patients with hemianopia.

    abstract::Patients with visual field disorders often exhibit impairments in visual exploration and a typical defective oculomotor scanning behaviour. Recent evidence [Bolognini, N., Rasi, F., Coccia, M., & Làdavas, E. (2005b). Visual search improvement in hemianopic patients after audio-visual stimulation. Brain, 128, 2830-2842...

    journal_title:Neuropsychologia

    pub_type: 杂志文章

    doi:10.1016/j.neuropsychologia.2008.10.008

    authors: Passamonti C,Bertini C,Làdavas E

    更新日期:2009-01-01 00:00:00

  • Vision and cognition in Alzheimer's disease.

    abstract::Alzheimer's disease (AD) is known to affect visual pathways, but potential concomitant effects on vision and cognitive performance are not well understood. We studied 43 individuals with AD of mild severity and 22 individuals without dementia on a battery of tests designed to measure multiple aspects of basic and high...

    journal_title:Neuropsychologia

    pub_type: 杂志文章

    doi:10.1016/s0028-3932(00)00023-3

    authors: Rizzo M,Anderson SW,Dawson J,Nawrot M

    更新日期:2000-01-01 00:00:00

  • Mesolimbic interaction of emotional valence and reward improves memory formation.

    abstract::Animal studies suggest that dopaminergic neuromodulation is critical for hippocampal memory formation. Compatible with this notion, recent functional imaging evidence in humans showed that reward modulates the hippocampus-dependent formation of episodic memories through activation of areas belonging to the mesolimbic ...

    journal_title:Neuropsychologia

    pub_type: 杂志文章

    doi:10.1016/j.neuropsychologia.2007.11.020

    authors: Wittmann BC,Schiltz K,Boehler CN,Düzel E

    更新日期:2008-03-07 00:00:00

  • Rehabilitation of executive function: facilitation of effective goal management on complex tasks using periodic auditory alerts.

    abstract::The 'dysexecutive syndrome' represents a major challenge to functional recovery and adaptation following brain injury--and an important target for rehabilitation. Previous reports of everyday difficulties, and performance on complex, life-like tasks, indicate that an adequately represented goal may become neglected as...

    journal_title:Neuropsychologia

    pub_type: 杂志文章

    doi:10.1016/s0028-3932(01)00094-x

    authors: Manly T,Hawkins K,Evans J,Woldt K,Robertson IH

    更新日期:2002-01-01 00:00:00

  • Neuroanatomical correlates of executive functions in children and adolescents: a magnetic resonance imaging (MRI) study of cortical thickness.

    abstract::A range of cognitive abilities improves in childhood and adolescence. It has been proposed that the protracted development of executive functions is related to the relatively late maturation of the prefrontal cortex. However, this has rarely been directly investigated. In this cross-sectional study, 98 healthy childre...

    journal_title:Neuropsychologia

    pub_type: 杂志文章

    doi:10.1016/j.neuropsychologia.2010.04.024

    authors: Tamnes CK,Østby Y,Walhovd KB,Westlye LT,Due-Tønnessen P,Fjell AM

    更新日期:2010-07-01 00:00:00

  • Career choice and handedness: a survey among university applicants.

    abstract::By means of the Edinburgh Handedness Inventory the patterns of handedness were studied in 16,590 applicant students to several professional courses in a Brazilian university. The distributions of the laterality quotient (LQ) were different for male and female students, with more left-handers found among the males. The...

    journal_title:Neuropsychologia

    pub_type: 杂志文章

    doi:10.1016/0028-3932(93)90062-5

    authors: Cosenza RM,Mingoti SA

    更新日期:1993-05-01 00:00:00

  • Event-based prospective memory failure in amnestic mild cognitive impairment.

    abstract::Prospective memory (PM) deficits have recently been documented in individuals with amnestic mild cognitive impairment (aMCI). In this paper, we investigated whether these deficits are due to the failure of retrospective memory processes. We also examined the role played by attentional/executive processes in PM functio...

    journal_title:Neuropsychologia

    pub_type: 杂志文章

    doi:10.1016/j.neuropsychologia.2011.03.016

    authors: Costa A,Perri R,Zabberoni S,Barban F,Caltagirone C,Carlesimo GA

    更新日期:2011-07-01 00:00:00

  • Omega-3 fatty acids moderate effects of physical activity on cognitive function.

    abstract::Greater amounts of physical activity (PA) and omega-3 fatty acids have both been independently associated with better cognitive performance. Because of the overlapping biological effects of omega-3 fatty acids and PA, fatty acid intake may modify the effects of PA on neurocognitive function. The present study tested t...

    journal_title:Neuropsychologia

    pub_type: 杂志文章

    doi:10.1016/j.neuropsychologia.2014.04.018

    authors: Leckie RL,Manuck SB,Bhattacharjee N,Muldoon MF,Flory JM,Erickson KI

    更新日期:2014-07-01 00:00:00

  • Working memory impairments in traumatic brain injury: evidence from a dual-task paradigm.

    abstract::Although many individuals with traumatic brain injury (TBI) perform well on standard neuropsychological tests, they often exhibit marked functional difficulties. The functions which are impaired seem to be analogous to the role of the central executive system (CES) in Baddeley's [Working Memory, 1986, Oxford Universit...

    journal_title:Neuropsychologia

    pub_type: 杂志文章

    doi:10.1016/s0028-3932(97)00082-1

    authors: McDowell S,Whyte J,D'Esposito M

    更新日期:1997-10-01 00:00:00

  • Item memory, context memory and the hippocampus: fMRI evidence.

    abstract::Dual-process models of recognition memory distinguish between the retrieval of qualitative information about a prior event (recollection), and judgments of prior occurrence based on an acontextual sense of familiarity. fMRI studies investigating the neural correlates of memory encoding and retrieval conducted within t...

    journal_title:Neuropsychologia

    pub_type: 杂志文章,评审

    doi:10.1016/j.neuropsychologia.2012.06.004

    authors: Rugg MD,Vilberg KL,Mattson JT,Yu SS,Johnson JD,Suzuki M

    更新日期:2012-11-01 00:00:00

  • Crossing the midline by four to eight year old children.

    abstract::In Experiment 1 children (Kinder, 4-5 yr; Prep, 5-6 yr; Grade 1, 6-7 yr; Grade 2, 7-8 yr) bisected horizontal lines placed to the left, right or across the midline. The youngest groups displayed symmetrical neglect, erring to the left with the left hand and to the right with the right, the adult pattern of leftwards e...

    journal_title:Neuropsychologia

    pub_type: 杂志文章

    doi:10.1016/0028-3932(88)90076-0

    authors: Bradshaw JL,Spataro JA,Harris M,Nettleton NC,Bradshaw J

    更新日期:1988-01-01 00:00:00

  • Individual alpha frequency modulates sleep-related emotional memory consolidation.

    abstract::Alpha-band oscillatory activity is involved in modulating memory and attention. However, few studies have investigated individual differences in oscillatory activity during the encoding of emotional memory, particularly in sleep paradigms where sleep is thought to play an active role in memory consolidation. The curre...

    journal_title:Neuropsychologia

    pub_type: 杂志文章

    doi:10.1016/j.neuropsychologia.2020.107660

    authors: Cross ZR,Santamaria A,Corcoran AW,Chatburn A,Alday PM,Coussens S,Kohler MJ

    更新日期:2020-11-01 00:00:00

  • Continuous theta-burst stimulation to primary motor cortex reduces the overproduction of forces following removal of visual feedback.

    abstract::Forward models, generated from the efference copies of motor commands, are thought to monitor the accuracy of ongoing movement. By comparing predicted with actual afferent information, forward models also aid in the differentiation of self-produced movements from externally generated ones. Many have proposed that a co...

    journal_title:Neuropsychologia

    pub_type: 杂志文章

    doi:10.1016/j.neuropsychologia.2011.06.023

    authors: Therrien AS,Richardson BA,Balasubramaniam R

    更新日期:2011-08-01 00:00:00

  • Problem-solving without awareness: an ERP investigation.

    abstract::When subjects are given the balls-and-boxes problem-solving task (Kotovsky & Simon, 1990), they move rapidly towards the goal after an extended exploratory phase, despite having no awareness of how to solve the task. We investigated possible non-conscious learning mechanisms by giving subjects three runs of the task w...

    journal_title:Neuropsychologia

    pub_type: 杂志文章

    doi:10.1016/j.neuropsychologia.2010.06.029

    authors: Paynter CA,Kotovsky K,Reder LM

    更新日期:2010-08-01 00:00:00