Similarity judgments and cortical visual responses reflect different properties of object and scene categories in naturalistic images.

Abstract:

:Numerous factors have been reported to underlie the representation of complex images in high-level human visual cortex, including categories (e.g. faces, objects, scenes), animacy, and real-world size, but the extent to which this organization reflects behavioral judgments of real-world stimuli is unclear. Here, we compared representations derived from explicit behavioral similarity judgments and ultra-high field (7T) fMRI of human visual cortex for multiple exemplars of a diverse set of naturalistic images from 48 object and scene categories. While there was a significant correlation between similarity judgments and fMRI responses, there were striking differences between the two representational spaces. Behavioral judgements primarily revealed a coarse division between man-made (including humans) and natural (including animals) images, with clear groupings of conceptually-related categories (e.g. transportation, animals), while these conceptual groupings were largely absent in the fMRI representations. Instead, fMRI responses primarily seemed to reflect a separation of both human and non-human faces/bodies from all other categories. Further, comparison of the behavioral and fMRI representational spaces with those derived from the layers of a deep neural network (DNN) showed a strong correspondence with behavior in the top-most layer and with fMRI in the mid-level layers. These results suggest a complex relationship between localized responses in high-level visual cortex and behavioral similarity judgments - each domain reflects different properties of the images, and responses in high-level visual cortex may correspond to intermediate stages of processing between basic visual features and the conceptual categories that dominate the behavioral response.

journal_name

Neuroimage

journal_title

NeuroImage

authors

King ML,Groen IIA,Steel A,Kravitz DJ,Baker CI

doi

10.1016/j.neuroimage.2019.04.079

subject

Has Abstract

pub_date

2019-08-15 00:00:00

pages

368-382

eissn

1053-8119

issn

1095-9572

pii

S1053-8119(19)30370-2

journal_volume

197

pub_type

杂志文章
  • The effect of medial frontal and posterior parietal demyelinating lesions on stroop interference.

    abstract::Functional imaging has consistently shown that attention-related areas of medial frontal and posterior parietal cortices are active during the attentional conflict induced by color naming in the presence of distracting words (Stroop task). Such studies, however, have provided few details of the correlational nature be...

    journal_title:NeuroImage

    pub_type: 临床试验,杂志文章

    doi:10.1006/nimg.2000.0662

    authors: Pujol J,Vendrell P,Deus J,Junqué C,Bello J,Martí-Vilalta JL,Capdevila A

    更新日期:2001-01-01 00:00:00

  • Hybrid diffusion imaging.

    abstract::Diffusion measurements in the human central nervous system are complex to characterize and a broad spectrum of methods have been proposed. In this study, a comprehensive diffusion encoding and analysis approach, hybrid diffusion imaging (HYDI), is described. The HYDI encoding scheme is composed of multiple concentric ...

    journal_title:NeuroImage

    pub_type: 杂志文章

    doi:10.1016/j.neuroimage.2007.02.050

    authors: Wu YC,Alexander AL

    更新日期:2007-07-01 00:00:00

  • Neuroplasticity to a single-episode traumatic stress revealed by resting-state fMRI in awake rats.

    abstract::Substantial evidence has suggested that the brain structures of the medial prefrontal cortex (mPFC) and amygdala (AMYG) are implicated in the pathophysiology of stress-related disorders. However, little is known with respect to the system-level adaptation of their neural circuitries to the perturbations of traumatic s...

    journal_title:NeuroImage

    pub_type: 杂志文章

    doi:10.1016/j.neuroimage.2014.08.050

    authors: Liang Z,King J,Zhang N

    更新日期:2014-12-01 00:00:00

  • Familial and disease specific abnormalities in the neural correlates of the Stroop Task in Bipolar Disorder.

    abstract::Patients with Bipolar Disorder (BD) perform poorly on tasks of selective attention and inhibitory control. Although similar behavioural deficits have been noted in their relatives, it is yet unclear whether they reflect dysfunction in the same neural circuits. We used functional magnetic resonance imaging and the Stro...

    journal_title:NeuroImage

    pub_type: 杂志文章

    doi:10.1016/j.neuroimage.2011.02.052

    authors: Pompei F,Jogia J,Tatarelli R,Girardi P,Rubia K,Kumari V,Frangou S

    更新日期:2011-06-01 00:00:00

  • Internal noise in contrast discrimination propagates forwards from early visual cortex.

    abstract::Human contrast discrimination performance is limited by transduction nonlinearities and variability of the neural representation (noise). Whereas the nonlinearities have been well-characterised, there is less agreement about the specifics of internal noise. Psychophysical models assume that it impacts late in sensory ...

    journal_title:NeuroImage

    pub_type: 杂志文章

    doi:10.1016/j.neuroimage.2019.02.049

    authors: Vilidaite G,Marsh E,Baker DH

    更新日期:2019-05-01 00:00:00

  • Parietal magnetic stimulation delays visuomotor mental rotation at increased processing demands.

    abstract::Visuomotor rotation (VMR) is a variant of the classic mental rotation paradigm. Subjects perform a center-out arm reaching movement, with the instruction to point clockwise or anticlockwise away from the direction of a reaction signal by a prespecified amount. Like classic mental rotation (MR) tasks, there is a linear...

    journal_title:NeuroImage

    pub_type: 杂志文章

    doi:10.1006/nimg.2002.1266

    authors: Bestmann S,Thilo KV,Sauner D,Siebner HR,Rothwell JC

    更新日期:2002-11-01 00:00:00

  • Promise and pitfalls of g-ratio estimation with MRI.

    abstract::The fiber g-ratio is the ratio of the inner to the outer diameter of the myelin sheath of a myelinated axon. It has a limited dynamic range in healthy white matter, as it is optimized for speed of signal conduction, cellular energetics, and spatial constraints. In vivo imaging of the g-ratio in health and disease woul...

    journal_title:NeuroImage

    pub_type: 杂志文章,评审

    doi:10.1016/j.neuroimage.2017.08.038

    authors: Campbell JSW,Leppert IR,Narayanan S,Boudreau M,Duval T,Cohen-Adad J,Pike GB,Stikov N

    更新日期:2018-11-15 00:00:00

  • Developmental changes in brain regions involved in phonological and orthographic processing during spoken language processing.

    abstract::Developmental differences in brain activation of 9- to 15-year-old children were examined during an auditory rhyme decision task to spoken words using functional magnetic resonance imaging (fMRI). As a group, children showed activation in the left superior/middle temporal gyri (BA 22, 21), right middle temporal gyrus ...

    journal_title:NeuroImage

    pub_type: 杂志文章

    doi:10.1016/j.neuroimage.2008.02.055

    authors: Cone NE,Burman DD,Bitan T,Bolger DJ,Booth JR

    更新日期:2008-06-01 00:00:00

  • Simulations of the effect of diffusion on asymmetric spin echo based quantitative BOLD: An investigation of the origin of deoxygenated blood volume overestimation.

    abstract::Quantitative BOLD (qBOLD) is a technique for mapping oxygen extraction fraction (OEF) and deoxygenated blood volume (DBV) in the human brain. Recent measurements using an asymmetric spin echo (ASE) based qBOLD approach produced estimates of DBV which were systematically higher than measurements from other techniques. ...

    journal_title:NeuroImage

    pub_type: 杂志文章

    doi:10.1016/j.neuroimage.2019.116035

    authors: Stone AJ,Holland NC,Berman AJL,Blockley NP

    更新日期:2019-11-01 00:00:00

  • Efficacy of different dynamic functional connectivity methods to capture cognitively relevant information.

    abstract::Given the dynamic nature of the human brain, there has been an increasing interest in investigating short-term temporal changes in functional connectivity, also known as dynamic functional connectivity (dFC), i.e., the time-varying inter-regional statistical dependence of blood oxygenation level-dependent (BOLD) signa...

    journal_title:NeuroImage

    pub_type: 杂志文章

    doi:10.1016/j.neuroimage.2018.12.037

    authors: Xie H,Zheng CY,Handwerker DA,Bandettini PA,Calhoun VD,Mitra S,Gonzalez-Castillo J

    更新日期:2019-03-01 00:00:00

  • Detection of optical neuronal signals in the visual cortex using continuous wave near-infrared spectroscopy.

    abstract::Near-infrared spectroscopy (NIRS) measures slow hemodynamic signals noninvasively to indirectly infer the neuronal activity in the brain. However, it remains a controversy on whether this optical measurement technique can detect the optical neuronal signal, which reflects the optical changes directly associated with n...

    journal_title:NeuroImage

    pub_type: 杂志文章

    doi:10.1016/j.neuroimage.2013.11.003

    authors: Sun B,Zhang L,Gong H,Sun J,Luo Q

    更新日期:2014-02-15 00:00:00

  • Deconvolution of impulse response in event-related BOLD fMRI.

    abstract::The temporal characteristics of the BOLD response in sensorimotor and auditory cortices were measured in subjects performing finger tapping while listening to metronome pacing tones. A repeated trial paradigm was used with stimulus durations of 167 ms to 16 s and intertrial times of 30 s. Both cortical systems were fo...

    journal_title:NeuroImage

    pub_type: 临床试验,杂志文章

    doi:10.1006/nimg.1998.0419

    authors: Glover GH

    更新日期:1999-04-01 00:00:00

  • Non-diffeomorphic registration of brain tumor images by simulating tissue loss and tumor growth.

    abstract::Although a variety of diffeomorphic deformable registration methods exist in the literature, application of these methods in the presence of space-occupying lesions is not straightforward. The motivation of this work is spatial normalization of MR images from patients with brain tumors in a common stereotaxic space, a...

    journal_title:NeuroImage

    pub_type: 杂志文章

    doi:10.1016/j.neuroimage.2009.01.051

    authors: Zacharaki EI,Hogea CS,Shen D,Biros G,Davatzikos C

    更新日期:2009-07-01 00:00:00

  • The role of the angular gyrus in the modulation of visuospatial attention by the mental number line.

    abstract::We tend to mentally organize numbers along a left-to-right oriented horizontal mental number line, with the smaller numbers occupying the more leftward positions. This mental number line has been shown to exert an influence on the visuospatial allocation of attention, with presentation of numbers from the low and high...

    journal_title:NeuroImage

    pub_type: 杂志文章

    doi:10.1016/j.neuroimage.2008.09.003

    authors: Cattaneo Z,Silvanto J,Pascual-Leone A,Battelli L

    更新日期:2009-01-15 00:00:00

  • Lack of generalizability of sex differences in the fMRI BOLD activity associated with language processing in adults.

    abstract::A lack of consensus exists as to whether there are sex differences in the fMRI BOLD signal correlates of language processing in the human brain. Here, whole-brain fMRI was used to examine the neural activity of 46 adults performing one of two sets of language tasks. Conservative quantitative and qualitative criteria i...

    journal_title:NeuroImage

    pub_type: 杂志文章

    doi:10.1016/j.neuroimage.2008.12.034

    authors: Ihnen SK,Church JA,Petersen SE,Schlaggar BL

    更新日期:2009-04-15 00:00:00

  • Representation of pitch chroma by multi-peak spectral tuning in human auditory cortex.

    abstract::Musical notes played at octave intervals (i.e., having the same pitch chroma) are perceived as similar. This well-known perceptual phenomenon lays at the foundation of melody recognition and music perception, yet its neural underpinnings remain largely unknown to date. Using fMRI with high sensitivity and spatial reso...

    journal_title:NeuroImage

    pub_type: 杂志文章,随机对照试验

    doi:10.1016/j.neuroimage.2014.11.044

    authors: Moerel M,De Martino F,Santoro R,Yacoub E,Formisano E

    更新日期:2015-02-01 00:00:00

  • Accelerated vs. unaccelerated serial MRI based TBM-SyN measurements for clinical trials in Alzheimer's disease.

    abstract:OBJECTIVE:Our primary objective was to compare the performance of unaccelerated vs. accelerated structural MRI for measuring disease progression using serial scans in Alzheimer's disease (AD). METHODS:We identified cognitively normal (CN), early mild cognitive impairment (EMCI), late mild cognitive impairment (LMCI) a...

    journal_title:NeuroImage

    pub_type: 杂志文章

    doi:10.1016/j.neuroimage.2015.03.026

    authors: Vemuri P,Senjem ML,Gunter JL,Lundt ES,Tosakulwong N,Weigand SD,Borowski BJ,Bernstein MA,Zuk SM,Lowe VJ,Knopman DS,Petersen RC,Fox NC,Thompson PM,Weiner MW,Jack CR Jr,Alzheimer's Disease Neuroimaging Initiative.

    更新日期:2015-06-01 00:00:00

  • The LONI Pipeline Processing Environment.

    abstract::The analysis of raw data in neuroimaging has become a computationally entrenched process with many intricate steps run on increasingly larger datasets. Many software packages exist that provide either complete analyses or specific steps in an analysis. These packages often possess diverse input and output requirements...

    journal_title:NeuroImage

    pub_type: 杂志文章

    doi:10.1016/s1053-8119(03)00185-x

    authors: Rex DE,Ma JQ,Toga AW

    更新日期:2003-07-01 00:00:00

  • Ethical issues in global neuroimaging genetics collaborations.

    abstract::Neuroimaging genetics is a rapidly developing field that combines neuropsychiatric genetics studies with imaging modalities to investigate how genetic variation influences brain structure and function. As both genetic and imaging technologies improve further, their combined power may hold translational potential in te...

    journal_title:NeuroImage

    pub_type: 杂志文章

    doi:10.1016/j.neuroimage.2020.117208

    authors: Palk A,Illes J,Thompson PM,Stein DJ

    更新日期:2020-11-01 00:00:00

  • Investigating the variability of cardiac pulse artifacts across heartbeats in simultaneous EEG-fMRI recordings: A 7T study.

    abstract::Electroencephalography (EEG) recordings performed in magnetic resonance imaging (MRI) scanners are affected by complex artifacts caused by heart function, often termed pulse artifacts (PAs). PAs can strongly compromise EEG data quality, and remain an open problem for EEG-fMRI. This study investigated the properties an...

    journal_title:NeuroImage

    pub_type: 杂志文章

    doi:10.1016/j.neuroimage.2019.02.021

    authors: Jorge J,Bouloc C,Bréchet L,Michel CM,Gruetter R

    更新日期:2019-05-01 00:00:00

  • Specialization for written words over objects in the visual cortex.

    abstract::The Visual Word Form Area (VWFA) is part of the left ventral visual stream that underlies the invariant identification of visual words. It remains debated whether this region is truly selective for words relative to common objects; why this particular part of the visual system is reproducibly engaged in reading; and w...

    journal_title:NeuroImage

    pub_type: 杂志文章

    doi:10.1016/j.neuroimage.2011.01.073

    authors: Szwed M,Dehaene S,Kleinschmidt A,Eger E,Valabrègue R,Amadon A,Cohen L

    更新日期:2011-05-01 00:00:00

  • Real-time fMRI neurofeedback training to improve eating behavior by self-regulation of the dorsolateral prefrontal cortex: A randomized controlled trial in overweight and obese subjects.

    abstract::Obesity is associated with altered responses to food stimuli in prefrontal brain networks that mediate inhibitory control of ingestive behavior. In particular, activity of the dorsolateral prefrontal cortex (dlPFC) is reduced in obese compared to normal-weight subjects and has been linked to the success of weight-loss...

    journal_title:NeuroImage

    pub_type: 杂志文章,随机对照试验

    doi:10.1016/j.neuroimage.2019.02.033

    authors: Kohl SH,Veit R,Spetter MS,Günther A,Rina A,Lührs M,Birbaumer N,Preissl H,Hallschmid M

    更新日期:2019-05-01 00:00:00

  • Microstructure of frontoparietal connections predicts individual resistance to sleep deprivation.

    abstract::Sleep deprivation (SD) can degrade cognitive functioning, but growing evidence suggests that there are large individual differences in the vulnerability to this effect. Some evidence suggests that baseline differences in the responsiveness of a fronto-parietal attention system that is activated during working memory (...

    journal_title:NeuroImage

    pub_type: 杂志文章,随机对照试验

    doi:10.1016/j.neuroimage.2014.11.035

    authors: Cui J,Tkachenko O,Gogel H,Kipman M,Preer LA,Weber M,Divatia SC,Demers LA,Olson EA,Buchholz JL,Bark JS,Rosso IM,Rauch SL,Killgore WD

    更新日期:2015-02-01 00:00:00

  • The influence of brain tumor treatment on pathological delta activity in MEG.

    abstract::The goal of the MEG study was to investigate the influence of tumor treatment on pathological delta activity (1-4 Hz). The treatment consisted of neurosurgery, and in some of the patients, additional radiotherapy. MEG and MR recordings were made both before and after the treatment in 17 patients. The signal power in t...

    journal_title:NeuroImage

    pub_type: 杂志文章

    doi:10.1016/j.neuroimage.2003.07.030

    authors: de Jongh A,Baayen JC,de Munck JC,Heethaar RM,Vandertop WP,Stam CJ

    更新日期:2003-12-01 00:00:00

  • Modulation of brain magnetic activity by different verbal learning strategies.

    abstract::In this study we examined spatiotemporal profiles of brain activity in the context of tasks designed to engage different verbal learning strategies (serial order, phonological, and semantic). The profile of activation associated with the serial-order strategy, which resulted in poor recall performance, featured early ...

    journal_title:NeuroImage

    pub_type: 临床试验,杂志文章

    doi:10.1016/S1053-8119(03)00309-4

    authors: Maestú F,Simos PG,Campo P,Fernández A,Amo C,Paul N,González-Marqués J,Ortiz T

    更新日期:2003-10-01 00:00:00

  • Locating the initial stages of speech-sound processing in human temporal cortex.

    abstract::It is commonly assumed that, in the cochlea and the brainstem, the auditory system processes speech sounds without differentiating them from any other sounds. At some stage, however, it must treat speech sounds and nonspeech sounds differently, since we perceive them as different. The purpose of this study was to deli...

    journal_title:NeuroImage

    pub_type: 杂志文章

    doi:10.1016/j.neuroimage.2006.01.004

    authors: Uppenkamp S,Johnsrude IS,Norris D,Marslen-Wilson W,Patterson RD

    更新日期:2006-07-01 00:00:00

  • Psychosocial stress is associated with in vivo dopamine release in human ventromedial prefrontal cortex: a positron emission tomography study using [¹⁸F]fallypride.

    abstract::Rodent studies suggest that prefrontal dopamine neurotransmission plays an important role in the neural processing of psychosocial stress. Human studies investigating stress-induced changes in dopamine levels, however, have focused solely on striatal dopamine transmission. The aim of this study was to investigate in v...

    journal_title:NeuroImage

    pub_type: 杂志文章

    doi:10.1016/j.neuroimage.2011.07.030

    authors: Lataster J,Collip D,Ceccarini J,Haas D,Booij L,van Os J,Pruessner J,Van Laere K,Myin-Germeys I

    更新日期:2011-10-15 00:00:00

  • Recent advances in recording electrophysiological data simultaneously with magnetic resonance imaging.

    abstract::Simultaneous recording of brain activity by different neurophysiological modalities can yield insights that reach beyond those obtained by each technique individually, even when compared to those from the post-hoc integration of results from each technique recorded sequentially. Success in the endeavour of real-time m...

    journal_title:NeuroImage

    pub_type: 杂志文章,评审

    doi:10.1016/j.neuroimage.2007.11.039

    authors: Laufs H,Daunizeau J,Carmichael DW,Kleinschmidt A

    更新日期:2008-04-01 00:00:00

  • Longitudinal evaluation of demyelinated lesions in a multiple sclerosis model using ultrashort echo time magnetization transfer (UTE-MT) imaging.

    abstract::Alterations in myelin integrity are involved in many neurological disorders and demyelinating diseases, such as multiple sclerosis (MS). Although magnetic resonance imaging (MRI) is the gold standard method to diagnose and monitor MS patients, clinically available MRI protocols show limited specificity for myelin dete...

    journal_title:NeuroImage

    pub_type: 杂志文章

    doi:10.1016/j.neuroimage.2019.116415

    authors: Guglielmetti C,Boucneau T,Cao P,Van der Linden A,Larson PEZ,Chaumeil MM

    更新日期:2020-03-01 00:00:00

  • The spatial distribution of age-related white matter changes as a function of vascular risk factors--results from the LADIS study.

    abstract::White matter hyperintensities (WMH) are a frequent finding on brain MRI of elderly subjects, and have been associated with various risk factors, as well as with development of cognitive and functional impairment. While an overall association between WMH load and risk factors is well described, possible spatially restr...

    journal_title:NeuroImage

    pub_type: 杂志文章,多中心研究

    doi:10.1016/j.neuroimage.2012.01.106

    authors: Rostrup E,Gouw AA,Vrenken H,van Straaten EC,Ropele S,Pantoni L,Inzitari D,Barkhof F,Waldemar G,LADIS study group.

    更新日期:2012-04-15 00:00:00