Category training induces cross-modal object representations in the adult human brain.

Abstract:

:The formation of cross-modal object representations was investigated using a novel paradigm that was previously successful in establishing unimodal visual category learning in monkeys and humans. The stimulus set consisted of six categories of bird shapes and sounds that were morphed to create different exemplars of each category. Subjects learned new cross-modal bird categories using a one-back task. Over time, the subjects became faster and more accurate in categorizing the birds. After 3 days of training, subjects were scanned while passively viewing and listening to trained and novel bird types. Stimulus blocks consisted of bird sounds only, bird pictures only, matching pictures and sounds (cross-modal congruent), and mismatching pictures and sounds (cross-modal incongruent). fMRI data showed unimodal and cross-modal training effects in the right fusiform gyrus. In addition, the left STS showed cross-modal training effects in the absence of unimodal training effects. Importantly, for both the right fusiform gyrus and the left STS, the newly formed cross-modal representation was specific for the trained categories. Learning did not generalize to incongruent combinations of learned sounds and shapes; their response did not differ from the response to novel cross-modal bird types. Moreover, responses were larger for congruent than for incongruent cross-modal bird types in the right fusiform gyrus and STS, providing further evidence that categorization training induced the formation of meaningful cross-modal object representations.

journal_name

J Cogn Neurosci

authors

van der Linden M,van Turennout M,Fernández G

doi

10.1162/jocn.2010.21522

subject

Has Abstract

pub_date

2011-06-01 00:00:00

pages

1315-31

issue

6

eissn

0898-929X

issn

1530-8898

journal_volume

23

pub_type

杂志文章
  • Sustained and Transient Processes in Event-based Prospective Memory in Adolescence and Adulthood.

    abstract::Prospective memory (PM) refers to the cognitive processes associated with remembering to perform an intended action after a delay. Varying the salience of PM cues while keeping the intended response constant, we investigated the extent to which participants relied on strategic monitoring, through sustained, top-down c...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/jocn_a_01604

    authors: Magis-Weinberg L,Custers R,Dumontheil I

    更新日期:2020-10-01 00:00:00

  • Sublexical properties of spoken words modulate activity in Broca's area but not superior temporal cortex: implications for models of speech recognition.

    abstract::Many models of spoken word recognition posit that the acoustic stream is parsed into phoneme level units, which in turn activate larger representations [McClelland, J. L., & Elman, J. L. The TRACE model of speech perception. Cognitive Psychology, 18, 1-86, 1986], whereas others suggest that larger units of analysis ar...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/jocn.2011.21620

    authors: Vaden KI Jr,Piquado T,Hickok G

    更新日期:2011-10-01 00:00:00

  • The Timing of Regular Sequences: Production, Perception, and Covariation.

    abstract::The temporal structure of behavior provides information that allows the tracking of temporal regularity in the sensory and sensorimotor domains. In turn, temporal regularity allows the generation of predictions about upcoming events and to adjust behavior accordingly. These mechanisms are essential to ensure behavior ...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/jocn_a_00805

    authors: Schwartze M,Kotz SA

    更新日期:2015-09-01 00:00:00

  • Dopamine function and the efficiency of human movement.

    abstract::To sustain successful behavior in dynamic environments, active organisms must be able to learn from the consequences of their actions and predict action outcomes. One of the most important discoveries in systems neuroscience over the last 15 years has been about the key role of the neurotransmitter dopamine in mediati...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/jocn_a_00503

    authors: Gepshtein S,Li X,Snider J,Plank M,Lee D,Poizner H

    更新日期:2014-03-01 00:00:00

  • Neural correlates of lexical access during visual word recognition.

    abstract::People can discriminate real words from nonwords even when the latter are orthographically and phonologically word-like, presumably because words activate specific lexical and/or semantic information. We investigated the neural correlates of this identification process using event-related functional magnetic resonance...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/089892903321593108

    authors: Binder JR,McKiernan KA,Parsons ME,Westbury CF,Possing ET,Kaufman JN,Buchanan L

    更新日期:2003-04-01 00:00:00

  • Visual imagery in hemianopic patients.

    abstract::In this article we report some findings about visual imagery in patients with stable homonymous hemianopia compared to healthy control subjects. These findings were obtained by analyzing the gaze control through recording of eye movements in different phases of viewing and imagery. We used six different visual stimuli...

    journal_title:Journal of cognitive neuroscience

    pub_type: 临床试验,杂志文章

    doi:10.1162/089892901753165782

    authors: Gbadamosi J,Zangemeister WH

    更新日期:2001-10-01 00:00:00

  • Neural precursors of delayed insight.

    abstract::The solution of a problem left unresolved in the evening can sometimes pop into mind as a sudden insight after a night of sleep in the following morning. Although favorable effects of sleep on insightful behavior have been experimentally confirmed, the neural mechanisms determining this delayed insight remain unknown....

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/jocn.2010.21550

    authors: Darsaud A,Wagner U,Balteau E,Desseilles M,Sterpenich V,Vandewalle G,Albouy G,Dang-Vu T,Collette F,Boly M,Schabus M,Degueldre C,Luxen A,Maquet P

    更新日期:2011-08-01 00:00:00

  • Transcranial direct current stimulation enhances verbal working memory training performance over time and near transfer outcomes.

    abstract::Studies attempting to increase working memory (WM) capacity show promise in enhancing related cognitive functions but have also raised criticism in the broader scientific community given the inconsistent findings produced by these studies. Transcranial direct current stimulation (tDCS) has been shown to enhance WM per...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章,随机对照试验

    doi:10.1162/jocn_a_00657

    authors: Richmond LL,Wolk D,Chein J,Olson IR

    更新日期:2014-11-01 00:00:00

  • "What"-Then-Where" in visual working memory: an event-related fMRI study.

    abstract::Behavioral studies indicate that spatial and object working memory are computed by dissociable subsystems. We investigated the neural bases of this dissociation with a whole-brain fMRI design and analysis technique that permitted direct assessment of delay-period activity, uncontaminated by other components of the tri...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/089892999563652

    authors: Postle BR,D'Esposito M

    更新日期:1999-11-01 00:00:00

  • Biased Competition during Long-term Memory Formation.

    abstract::A key task for the brain is to determine which pieces of information are worth storing in memory. To build a more complete representation of the environment, memory systems may prioritize new information that has not already been stored. Here, we propose a mechanism that supports this preferential encoding of new info...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/jocn_a_00889

    authors: Hutchinson JB,Pak SS,Turk-Browne NB

    更新日期:2016-01-01 00:00:00

  • Object-guided spatial attention in touch: holding the same object with both hands delays attentional selection.

    abstract::Previous research has shown that attention to a specific location on a uniform visual object spreads throughout the entire object. Here we demonstrate that, similar to the visual system, spatial attention in touch can be object guided. We measured event-related brain potentials to tactile stimuli arising from objects ...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/jocn.2009.21265

    authors: Gillmeister H,Adler J,Forster B

    更新日期:2010-05-01 00:00:00

  • Language acquisition and cerebral specialization in 20-month-old infants.

    abstract::Abstract The purpose of the present study was to examine patterns of neural activity relevant to language processing in 20-month-old infants, and to determine whether or not changes in cerebral organization occur as a function of specific changes in language development. Event-related potentials (ERPs) were recorded a...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/jocn.1993.5.3.317

    authors: Mills DL,Coffey-Corina SA,Neville HJ

    更新日期:1993-07-01 00:00:00

  • Susceptibility to Memory Interference Effects following Frontal Lobe Damage: Findings from Tests of Paired-Associate Learning.

    abstract::Abstract Patients with frontal lobe lesions were adminstered tests of paired-associate learning in which cue and response words are manipulated to increase interference across two study lists. In one test of paired-associate learning (AB-AC test), cue words used in one list are repeated in a second list but are associ...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/jocn.1995.7.2.144

    authors: Shimamura AP,Jurica PJ,Mangels JA,Gershberg FB,Knight RT

    更新日期:1995-04-01 00:00:00

  • Combining Multiple Functional Connectivity Methods to Improve Causal Inferences.

    abstract::Cognition and behavior emerge from brain network interactions, suggesting that causal interactions should be central to the study of brain function. Yet, approaches that characterize relationships among neural time series-functional connectivity (FC) methods-are dominated by methods that assess bivariate statistical a...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/jocn_a_01580

    authors: Sanchez-Romero R,Cole MW

    更新日期:2021-02-01 00:00:00

  • Multimodal imaging of incidental retrieval: the low route to memory.

    abstract::Memories of past episodes frequently come to mind incidentally, without directed search. It has remained unclear how incidental retrieval processes are initiated in the brain. Here we used fMRI and ERP recordings to find brain activity that specifically correlates with incidental retrieval, as compared to intentional ...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/jocn.2010.21494

    authors: Kompus K,Eichele T,Hugdahl K,Nyberg L

    更新日期:2011-04-01 00:00:00

  • Musicians and the metric structure of words.

    abstract::The present study aimed to examine the influence of musical expertise on the metric and semantic aspects of speech processing. In two attentional conditions (metric and semantic tasks), musicians listened to short sentences ending in trisyllabic words that were semantically and/or metrically congruous or incongruous. ...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/jocn.2010.21413

    authors: Marie C,Magne C,Besson M

    更新日期:2011-02-01 00:00:00

  • Syntactically based sentence processing classes: evidence from event-related brain potentials.

    abstract::Theoretical considerations and diverse empirical data from clinical, psycholinguistic, and developmental studies suggest that language comprehension processes are decomposable into separate subsystems, including distinct systems for semantic and grammatical processing. Here we report that event-related potentials (ERP...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/jocn.1991.3.2.151

    authors: Neville H,Nicol JL,Barss A,Forster KI,Garrett MF

    更新日期:1991-04-01 00:00:00

  • Preservation and Changes in Oscillatory Dynamics across the Cortical Hierarchy.

    abstract::Theta (2-8 Hz), alpha (8-12 Hz), beta (12-35 Hz), and gamma (>35 Hz) rhythms are ubiquitous in the cortex. However, there is little understanding of whether they have similar properties and functions in different cortical areas because they have rarely been compared across them. We record neuronal spikes and local fie...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/jocn_a_01600

    authors: Lundqvist M,Bastos AM,Miller EK

    更新日期:2020-10-01 00:00:00

  • The neural correlates of object familiarity and domain specificity in the human visual cortex: an FMRI study.

    abstract::Ventral occipito-temporal cortex is known to play a major role in visual object recognition. Still unknown is whether object familiarity and semantic domain are critical factors in its functional organization. Most models assume a functional locus where exemplars of familiar categories are represented: the structural ...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/jocn.2011.21629

    authors: Zannino GD,Barban F,Macaluso E,Caltagirone C,Carlesimo GA

    更新日期:2011-10-01 00:00:00

  • Savings in relearning face-name associations as evidence for "covert recognition" in prosopagnosia.

    abstract::Prosopagnosic patients appear to be impaired at recognizing faces. However, recent evidence for "covert recognition" in prosopagnosia has been taken to suggest that the impairment is not in face recognition per se, but rather in conscious access to face recognition. The most widely used test for covert recognition of ...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/jocn.1992.4.2.150

    authors: Wallace MA,Farah MJ

    更新日期:1992-04-01 00:00:00

  • The default network distinguishes construals of proximal versus distal events.

    abstract::Humans enjoy a singular capacity to imagine events that differ from the "here-and-now." Recent cognitive neuroscience research has linked such simulation processes to the brain's "default network." However, extant cognitive theories suggest that perceivers reliably simulate only relatively proximal experiences-those t...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/jocn_a_00009

    authors: Tamir DI,Mitchell JP

    更新日期:2011-10-01 00:00:00

  • From prestimulus alpha oscillation to visual-evoked response: an inverted-U function and its attentional modulation.

    abstract::Understanding the relation between prestimulus neural activity and subsequent stimulus processing has become an area of active investigation. Computational modeling, as well as in vitro and in vivo single-unit recordings in animal preparations, have explored mechanisms by which background synaptic activity can influen...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/jocn.2010.21478

    authors: Rajagovindan R,Ding M

    更新日期:2011-06-01 00:00:00

  • The Role of Hierarchical Dynamical Functions in Coding for Episodic Memory and Cognition.

    abstract::Behavioral research in human verbal memory function led to the initial definition of episodic memory and semantic memory. A complete model of the neural mechanisms of episodic memory must include the capacity to encode and mentally reconstruct everything that humans can recall from their experience. This article propo...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/jocn_a_01439

    authors: Dannenberg H,Alexander AS,Robinson JC,Hasselmo ME

    更新日期:2019-09-01 00:00:00

  • Does Transcranial Direct Current Stimulation Improve Healthy Working Memory?: A Meta-analytic Review.

    abstract::Transcranial direct current stimulation (tDCS) has been reported to improve working memory (WM) performance in healthy individuals, suggesting its value as a means of cognitive enhancement. However, recent meta-analyses concluded that tDCS has little or no effect on WM in healthy participants. In this article, we revi...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章,meta分析,评审

    doi:10.1162/jocn_a_00956

    authors: Mancuso LE,Ilieva IP,Hamilton RH,Farah MJ

    更新日期:2016-08-01 00:00:00

  • Morphosyntactic processing in late second-language learners.

    abstract::The goal of the present study was to investigate the electrophysiological correlates of second-language (L2) morphosyntactic processing in highly proficient late learners of an L2 with long exposure to the L2 environment. ERPs were collected from 22 English-Spanish late learners while they read sentences in which morp...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/jocn.2009.21304

    authors: Dowens MG,Vergara M,Barber HA,Carreiras M

    更新日期:2010-08-01 00:00:00

  • Visual object representations can be formed outside the focus of voluntary attention: evidence from event-related brain potentials.

    abstract::There is an ongoing debate whether visual object representations can be formed outside the focus of voluntary attention. Recently, implicit behavioral measures suggested that grouping processes can occur for task-irrelevant visual stimuli, thus supporting theories of preattentive object formation (e.g., Lamy, D., Sega...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/jocn.2009.21271

    authors: Müller D,Winkler I,Roeber U,Schaffer S,Czigler I,Schröger E

    更新日期:2010-06-01 00:00:00

  • Creating Colored Letters: Familial Markers of Grapheme-Color Synesthesia in Parietal Lobe Activation and Structure.

    abstract::Perception is inherently subjective, and individual differences in phenomenology are well illustrated by the phenomenon of synesthesia (highly specific, consistent, and automatic cross-modal experiences, in which the external stimulus corresponding to the additional sensation is absent). It is unknown why some people ...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/jocn_a_01105

    authors: Colizoli O,Murre JMJ,Scholte HS,Rouw R

    更新日期:2017-07-01 00:00:00

  • Planning Complexity Registers as a Cost in Metacontrol.

    abstract::Decision-making algorithms face a basic tradeoff between accuracy and effort (i.e., computational demands). It is widely agreed that humans can choose between multiple decision-making processes that embody different solutions to this tradeoff: Some are computationally cheap but inaccurate, whereas others are computati...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/jocn_a_01263

    authors: Kool W,Gershman SJ,Cushman FA

    更新日期:2018-10-01 00:00:00

  • Figure-ground representation and its decay in primary visual cortex.

    abstract::We used fMRI to study figure-ground representation and its decay in primary visual cortex (V1). Human observers viewed a motion-defined figure that gradually became camouflaged by a cluttered background after it stopped moving. V1 showed positive fMRI responses corresponding to the moving figure and negative fMRI resp...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/jocn_a_00190

    authors: Strother L,Lavell C,Vilis T

    更新日期:2012-04-01 00:00:00

  • The effect of FEF microstimulation on the responses of neurons in the lateral intraparietal area.

    abstract::The macaque FEFs and the lateral intraparietal area (LIP) are high-level cortical areas involved in both spatial attention and oculomotor behavior. Stimulating FEF at a level below the threshold for evoking saccades increases fMRI activity and gamma power in area LIP, but the precise effect exerted by the FEF on LIP n...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/jocn_a_00591

    authors: Premereur E,Vanduffel W,Janssen P

    更新日期:2014-08-01 00:00:00