Convergent and invariant object representations for sight, sound, and touch.

Abstract:

:We continuously perceive objects in the world through multiple sensory channels. In this study, we investigated the convergence of information from different sensory streams within the cerebral cortex. We presented volunteers with three common objects via three different modalities-sight, sound, and touch-and used multivariate pattern analysis of functional magnetic resonance imaging data to map the cortical regions containing information about the identity of the objects. We could reliably predict which of the three stimuli a subject had seen, heard, or touched from the pattern of neural activity in the corresponding early sensory cortices. Intramodal classification was also successful in large portions of the cerebral cortex beyond the primary areas, with multiple regions showing convergence of information from two or all three modalities. Using crossmodal classification, we also searched for brain regions that would represent objects in a similar fashion across different modalities of presentation. We trained a classifier to distinguish objects presented in one modality and then tested it on the same objects presented in a different modality. We detected audiovisual invariance in the right temporo-occipital junction, audiotactile invariance in the left postcentral gyrus and parietal operculum, and visuotactile invariance in the right postcentral and supramarginal gyri. Our maps of multisensory convergence and crossmodal generalization reveal the underlying organization of the association cortices, and may be related to the neural basis for mental concepts.

journal_name

Hum Brain Mapp

journal_title

Human brain mapping

authors

Man K,Damasio A,Meyer K,Kaplan JT

doi

10.1002/hbm.22867

subject

Has Abstract

pub_date

2015-09-01 00:00:00

pages

3629-40

issue

9

eissn

1065-9471

issn

1097-0193

journal_volume

36

pub_type

杂志文章
  • Quantitative tract-based white matter heritability in 1- and 2-year-old twins.

    abstract::White matter (WM) microstructure, as determined by diffusion tensor imaging (DTI), is increasingly recognized as an important determinant of cognitive function and is also altered in neuropsychiatric disorders. Little is known about genetic and environmental influences on WM microstructure, especially in early childho...

    journal_title:Human brain mapping

    pub_type: 杂志文章

    doi:10.1002/hbm.24436

    authors: Lee SJ,Zhang J,Neale MC,Styner M,Zhu H,Gilmore JH

    更新日期:2019-03-01 00:00:00

  • Characterization of disease-related covariance topographies with SSMPCA toolbox: effects of spatial normalization and PET scanners.

    abstract::To generate imaging biomarkers from disease-specific brain networks, we have implemented a general toolbox to rapidly perform scaled subprofile modeling (SSM) based on principal component analysis (PCA) on brain images of patients and normals. This SSMPCA toolbox can define spatial covariance patterns whose expression...

    journal_title:Human brain mapping

    pub_type: 杂志文章

    doi:10.1002/hbm.22295

    authors: Peng S,Ma Y,Spetsieris PG,Mattis P,Feigin A,Dhawan V,Eidelberg D

    更新日期:2014-05-01 00:00:00

  • Frontal and posterior cingulate metabolic impairment in the behavioral variant of frontotemporal dementia with impaired autonoetic consciousness.

    abstract::Although memory dysfunction is not a prominent feature of the behavioral variant of frontotemporal dementia (bv-FTD), there is evidence of specific deficits of episodic memory in these patients. They also have problems monitoring their memory performance. The objective of the present study was to explore the ability t...

    journal_title:Human brain mapping

    pub_type: 杂志文章

    doi:10.1002/hbm.21282

    authors: Bastin C,Feyers D,Souchay C,Guillaume B,Pepin JL,Lemaire C,Degueldre C,Collette F,Salmon E

    更新日期:2012-06-01 00:00:00

  • Fractal dimension in human cortical surface: multiple regression analysis with cortical thickness, sulcal depth, and folding area.

    abstract::Fractal dimension (FD) has been widely used to provide a quantitative description of structural complexity in the cerebral cortex. FD is an extremely compact measure of shape complexity, condensing all details into a single numeric value. We interpreted the variation of the FD in the cortical surface of normal control...

    journal_title:Human brain mapping

    pub_type: 杂志文章

    doi:10.1002/hbm.20238

    authors: Im K,Lee JM,Yoon U,Shin YW,Hong SB,Kim IY,Kwon JS,Kim SI

    更新日期:2006-12-01 00:00:00

  • Constrained spherical deconvolution of nonspherically sampled diffusion MRI data.

    abstract::Constrained spherical deconvolution (CSD) of diffusion-weighted MRI (DW-MRI) is a popular analysis method that extracts the full white matter (WM) fiber orientation density function (fODF) in the living human brain, noninvasively. It assumes that the DW-MRI signal on the sphere can be represented as the spherical conv...

    journal_title:Human brain mapping

    pub_type: 杂志文章

    doi:10.1002/hbm.25241

    authors: Morez J,Sijbers J,Vanhevel F,Jeurissen B

    更新日期:2020-11-10 00:00:00

  • Practice-related changes in neural activation patterns investigated via wavelet-based clustering analysis.

    abstract:OBJECTIVES:To evaluate brain activation using functional magnetic resonance imaging (fMRI) and specifically, activation changes across time associated with practice-related cognitive control during eye movement tasks. EXPERIMENTAL DESIGN:Participants were engaged in antisaccade performance (generating a glance away fr...

    journal_title:Human brain mapping

    pub_type: 杂志文章

    doi:10.1002/hbm.22066

    authors: Lee J,Park C,Dyckman KA,Lazar NA,Austin BP,Li Q,McDowell JE

    更新日期:2013-09-01 00:00:00

  • Neural correlates of successful semantic processing during propofol sedation.

    abstract::Sedation has a graded effect on brain responses to auditory stimuli: perceptual processing persists at sedation levels that attenuate more complex processing. We used fMRI in healthy volunteers sedated with propofol to assess changes in neural responses to spoken stimuli. Volunteers were scanned awake, sedated, and du...

    journal_title:Human brain mapping

    pub_type: 杂志文章

    doi:10.1002/hbm.22375

    authors: Adapa RM,Davis MH,Stamatakis EA,Absalom AR,Menon DK

    更新日期:2014-07-01 00:00:00

  • Challenging a decade of brain research on task switching: brain activation in the task-switching paradigm reflects adaptation rather than reconfiguration of task sets.

    abstract::In daily life, we permanently need to adapt our behavior to new task situations, requiring cognitive control. Such adaptive processes are commonly investigated with the task-switching paradigm. Many fMRI studies have interpreted stronger activation for switch than repeat trials in fronto-parietal brain areas as reflec...

    journal_title:Human brain mapping

    pub_type: 杂志文章

    doi:10.1002/hbm.21234

    authors: De Baene W,Kühn S,Brass M

    更新日期:2012-03-01 00:00:00

  • Impaired structural connectivity between dorsal attention network and pulvinar mediates the impact of premature birth on adult visual-spatial abilities.

    abstract::The dorsal attention network (DAN), including frontal eye fields and posterior parietal cortices, and its link with the posterior thalamus, contribute to visual-spatial abilities. Very premature birth impairs both visual-spatial abilities and cortico-thalamic structural connectivity. We hypothesized that impaired stru...

    journal_title:Human brain mapping

    pub_type: 杂志文章

    doi:10.1002/hbm.24685

    authors: Berndt M,Bäuml JG,Menegaux A,Meng C,Daamen M,Baumann N,Zimmer C,Boecker H,Bartmann P,Wolke D,Sorg C

    更新日期:2019-10-01 00:00:00

  • Musical training induces functional and structural auditory-motor network plasticity in young adults.

    abstract::Playing music requires a strong coupling of perception and action mediated by multimodal integration of brain regions, which can be described as network connections measured by anatomical and functional correlations between regions. However, the structural and functional connectivities within and between the auditory ...

    journal_title:Human brain mapping

    pub_type: 杂志文章

    doi:10.1002/hbm.23989

    authors: Li Q,Wang X,Wang S,Xie Y,Li X,Xie Y,Li S

    更新日期:2018-05-01 00:00:00

  • Pathological amygdala activation during working memory performance: Evidence for a pathophysiological trait marker in bipolar affective disorder.

    abstract::Recent evidence suggests that deficits of working memory may be a promising neurocognitive endophenotype of bipolar affective disorder. However, little is known about the neurobiological correlates of these deficits. The aim of this study was to determine possible pathophysiological trait markers of bipolar disorder i...

    journal_title:Human brain mapping

    pub_type: 杂志文章

    doi:10.1002/hbm.20849

    authors: Gruber O,Tost H,Henseler I,Schmael C,Scherk H,Ende G,Ruf M,Falkai P,Rietschel M

    更新日期:2010-01-01 00:00:00

  • Surprise beyond prediction error.

    abstract::Surprise drives learning. Various neural "prediction error" signals are believed to underpin surprise-based reinforcement learning. Here, we report a surprise signal that reflects reinforcement learning but is neither un/signed reward prediction error (RPE) nor un/signed state prediction error (SPE). To exclude these ...

    journal_title:Human brain mapping

    pub_type: 杂志文章

    doi:10.1002/hbm.22513

    authors: Chumbley JR,Burke CJ,Stephan KE,Friston KJ,Tobler PN,Fehr E

    更新日期:2014-09-01 00:00:00

  • Nonlinear neuroplasticity corresponding to sports experience: A voxel-based morphometry and resting-state functional connectivity study.

    abstract::We aimed to investigate the structural neuroplasticity associated with different levels of sports experience and its effect on the corresponding resting-state functional circuitry. We recruited 18 skilled baseball batters (SB), 19 intermediate baseball batters (IB), and 17 healthy controls (HC), and used magnetic reso...

    journal_title:Human brain mapping

    pub_type: 杂志文章

    doi:10.1002/hbm.24280

    authors: Chang CY,Chen YH,Yen NS

    更新日期:2018-11-01 00:00:00

  • Modulation of neural oscillations during working memory update, maintenance, and readout: An hdEEG study.

    abstract::Working memory (WM) performance is very often measured using the n-back task, in which the participant is presented with a sequence of stimuli, and required to indicate whether the current stimulus matches the one presented n steps earlier. In this study, we used high-density electroencephalography (hdEEG) coupled to ...

    journal_title:Human brain mapping

    pub_type: 杂志文章

    doi:10.1002/hbm.25283

    authors: Semprini M,Bonassi G,Barban F,Pelosin E,Iandolo R,Chiappalone M,Mantini D,Avanzino L

    更新日期:2020-11-17 00:00:00

  • Sensation-to-cognition cortical streams in attention-deficit/hyperactivity disorder.

    abstract::We sought to determine whether functional connectivity streams that link sensory, attentional, and higher-order cognitive circuits are atypical in attention-deficit/hyperactivity disorder (ADHD). We applied a graph-theory method to the resting-state functional magnetic resonance imaging data of 120 children with ADHD ...

    journal_title:Human brain mapping

    pub_type: 杂志文章

    doi:10.1002/hbm.22790

    authors: Carmona S,Hoekzema E,Castellanos FX,García-García D,Lage-Castellanos A,Van Dijk KR,Navas-Sánchez FJ,Martínez K,Desco M,Sepulcre J

    更新日期:2015-07-01 00:00:00

  • Linearity of the fMRI response in category-selective regions of human visual cortex.

    abstract::The goal of this study was to determine the linearity of the blood oxygen level-dependent (BOLD) response, as measured by functional magnetic resonance imaging (fMRI), in category-selective regions of human visual cortex. We defined regions of the temporal lobe that were selective to faces (fusiform face area, FFA) an...

    journal_title:Human brain mapping

    pub_type: 杂志文章

    doi:10.1002/hbm.20694

    authors: Horner AJ,Andrews TJ

    更新日期:2009-08-01 00:00:00

  • Common neural correlates of emotion perception in humans.

    abstract::Whether neuroimaging findings support discriminable neural correlates of emotion categories is a longstanding controversy. Two recent meta-analyses arrived at opposite conclusions, with one supporting (Vytal and Hamann []: J Cogn Neurosci 22:2864-2885) and the other opposing this proposition (Lindquist et al. []: Beha...

    journal_title:Human brain mapping

    pub_type: 杂志文章

    doi:10.1002/hbm.22910

    authors: Jastorff J,Huang YA,Giese MA,Vandenbulcke M

    更新日期:2015-10-01 00:00:00

  • Brain structural correlates of irritability: Findings in a large healthy cohort.

    abstract::Irritability and nonviolent aggression are common behavioral features across the population, yet there is limited neurobiological research into subclinical phenotypes representing the lower edge of a symptom continuum ranging from slight irritability to criminal violence. We studied brain structural correlates of irri...

    journal_title:Human brain mapping

    pub_type: 杂志文章,多中心研究

    doi:10.1002/hbm.23824

    authors: Besteher B,Squarcina L,Spalthoff R,Bellani M,Gaser C,Brambilla P,Nenadić I

    更新日期:2017-12-01 00:00:00

  • Detection of mild cognitive impairment in a community-dwelling population using quantitative, multiparametric MRI-based classification.

    abstract::Early and accurate mild cognitive impairment (MCI) detection within a heterogeneous, nonclinical population is needed to improve care for persons at risk of developing dementia. Magnetic resonance imaging (MRI)-based classification may aid early diagnosis of MCI, but has only been applied within clinical cohorts. We a...

    journal_title:Human brain mapping

    pub_type: 杂志文章

    doi:10.1002/hbm.24554

    authors: Bouts MJRJ,van der Grond J,Vernooij MW,Koini M,Schouten TM,de Vos F,Feis RA,Cremers LGM,Lechner A,Schmidt R,de Rooij M,Niessen WJ,Ikram MA,Rombouts SARB

    更新日期:2019-06-15 00:00:00

  • 3D tract-specific local and global analysis of white matter integrity in Alzheimer's disease.

    abstract::Alzheimer's disease (AD) is a chronic neurodegenerative disease characterized by progressive decline in memory and other aspects of cognitive function. Diffusion-weighted imaging (DWI) offers a non-invasive approach to delineate the effects of AD on white matter (WM) integrity. Previous studies calculated either some ...

    journal_title:Human brain mapping

    pub_type: 杂志文章

    doi:10.1002/hbm.23448

    authors: Jin Y,Huang C,Daianu M,Zhan L,Dennis EL,Reid RI,Jack CR Jr,Zhu H,Thompson PM,Alzheimer's Disease Neuroimaging Initiative.

    更新日期:2017-03-01 00:00:00

  • Internal representations for face detection: an application of noise-based image classification to BOLD responses.

    abstract::What basic visual structures underlie human face detection and how can we extract such structures directly from the amplitude of neural responses elicited by face processing? Here, we address these issues by investigating an extension of noise-based image classification to BOLD responses recorded in high-level visual ...

    journal_title:Human brain mapping

    pub_type: 杂志文章

    doi:10.1002/hbm.22128

    authors: Nestor A,Vettel JM,Tarr MJ

    更新日期:2013-11-01 00:00:00

  • Cortical thickness is not associated with current depression in a clinical treatment study.

    abstract:BACKGROUND:Reduced cortical thickness is a candidate biological marker of depression, although findings are inconsistent. This could reflect analytic heterogeneity, such as use of region-wise cortical thickness based on the Freesurfer Desikan-Killiany (DK) atlas or surface-based morphometry (SBM). The Freesurfer Destri...

    journal_title:Human brain mapping

    pub_type: 杂志文章,多中心研究,随机对照试验

    doi:10.1002/hbm.23664

    authors: Perlman G,Bartlett E,DeLorenzo C,Weissman M,McGrath P,Ogden T,Jin T,Adams P,Trivedi M,Kurian B,Oquendo M,McInnis M,Weyandt S,Fava M,Cooper C,Malchow A,Parsey R

    更新日期:2017-09-01 00:00:00

  • Texturing 3D-reconstructions of the human brain with EEG-activity maps.

    abstract::A method for representing the results of statistical EEG analysis in a visually comprehensive and concentrated way is presented. It consists of a combination of scattered data interpolation, texture mapping, and volume rendering techniques. First, starting with an EEG study of the proband in question, a smoothly inter...

    journal_title:Human brain mapping

    pub_type: 杂志文章

    doi:

    authors: Dimitrov LI

    更新日期:1998-01-01 00:00:00

  • Functional cerebral asymmetry analyses reveal how the control system implements its flexibility.

    abstract::The control system in human brain generally exerts the goal-directed regulation on a variety of mental processes. To deal with different control demands, these brain areas of the control system, especially the dorsolateral prefrontal cortex (DLPFC), may be flexibly recruited across different tasks. However, few studie...

    journal_title:Human brain mapping

    pub_type: 杂志文章

    doi:10.1002/hbm.24313

    authors: Chen Z,Zhao X,Fan J,Chen A

    更新日期:2018-12-01 00:00:00

  • Performing label-fusion-based segmentation using multiple automatically generated templates.

    abstract::Classically, model-based segmentation procedures match magnetic resonance imaging (MRI) volumes to an expertly labeled atlas using nonlinear registration. The accuracy of these techniques are limited due to atlas biases, misregistration, and resampling error. Multi-atlas-based approaches are used as a remedy and invol...

    journal_title:Human brain mapping

    pub_type: 杂志文章

    doi:10.1002/hbm.22092

    authors: Chakravarty MM,Steadman P,van Eede MC,Calcott RD,Gu V,Shaw P,Raznahan A,Collins DL,Lerch JP

    更新日期:2013-10-01 00:00:00

  • Isotropic resolution diffusion tensor imaging with whole brain acquisition in a clinically acceptable time.

    abstract::Our objective was to develop a diffusion tensor MR imaging pulse sequence that allows whole brain coverage with isotropic resolution within a clinically acceptable time. A single-shot, cardiac-gated MR pulse sequence, optimized for measuring the diffusion tensor in human brain, was developed to provide whole-brain cov...

    journal_title:Human brain mapping

    pub_type: 杂志文章

    doi:10.1002/hbm.10018

    authors: Jones DK,Williams SC,Gasston D,Horsfield MA,Simmons A,Howard R

    更新日期:2002-04-01 00:00:00

  • Altered interregional molecular associations of the serotonin transporter in attention deficit/hyperactivity disorder assessed with PET.

    abstract::Altered serotonergic neurotransmission has been found to cause impulsive and aggressive behavior, as well as increased motor activity, all exemplifying key symptoms of ADHD. The main objectives of this positron emission tomography (PET) study were to investigate the serotonin transporter binding potential (SERT BPND )...

    journal_title:Human brain mapping

    pub_type: 杂志文章

    doi:10.1002/hbm.23418

    authors: Vanicek T,Kutzelnigg A,Philippe C,Sigurdardottir HL,James GM,Hahn A,Kranz GS,Höflich A,Kautzky A,Traub-Weidinger T,Hacker M,Wadsak W,Mitterhauser M,Kasper S,Lanzenberger R

    更新日期:2017-02-01 00:00:00

  • Longitudinal associations between white matter maturation and cognitive development across early childhood.

    abstract::From birth to 5 years of age, brain structure matures and evolves alongside emerging cognitive and behavioral abilities. In relating concurrent cognitive functioning and measures of brain structure, a major challenge that has impeded prior investigation of their time-dynamic relationships is the sparse and irregular n...

    journal_title:Human brain mapping

    pub_type: 杂志文章

    doi:10.1002/hbm.24690

    authors: Dai X,Hadjipantelis P,Wang JL,Deoni SCL,Müller HG

    更新日期:2019-10-01 00:00:00

  • Dynamic regional phase synchrony (DRePS): An Instantaneous Measure of Local fMRI Connectivity Within Spatially Clustered Brain Areas.

    abstract::Dynamic functional brain connectivity analysis is a fast expanding field in computational neuroscience research with the promise of elucidating brain network interactions. Sliding temporal window based approaches are commonly used in order to explore dynamic behavior of brain networks in task-free functional magnetic ...

    journal_title:Human brain mapping

    pub_type: 杂志文章

    doi:10.1002/hbm.23151

    authors: Omidvarnia A,Pedersen M,Walz JM,Vaughan DN,Abbott DF,Jackson GD

    更新日期:2016-05-01 00:00:00

  • The cerebellum shrinks faster than normal ageing in Alzheimer's disease but not in mild cognitive impairment.

    abstract:BACKGROUND:While acceleration in age-related cerebral atrophy has been well documented in Alzheimer's disease, the cerebellar contributions to this effect have not been thoroughly investigated. OBJECTIVE:This study investigated cerebellar volume and atrophy rate using magnetic resonance imaging in individuals with nor...

    journal_title:Human brain mapping

    pub_type: 杂志文章

    doi:10.1002/hbm.23580

    authors: Tabatabaei-Jafari H,Walsh E,Shaw ME,Cherbuin N,Alzheimer's Disease Neuroimaging Initiative (ADNI).

    更新日期:2017-06-01 00:00:00