当前位置： SCI文献检索 > NEUROIMAGE期刊下所有文献 > Evidence for similar patterns of neural activity elicited by picture- and word-based representations of natural scenes.

Evidence for similar patterns of neural activity elicited by picture- and word-based representations of natural scenes.

Abstract：

:A long-standing core question in cognitive science is whether different modalities and representation types (pictures, words, sounds, etc.) access a common store of semantic information. Although different input types have been shown to activate a shared network of brain regions, this does not necessitate that there is a common representation, as the neurons in these regions could still differentially process the different modalities. However, multi-voxel pattern analysis can be used to assess whether, e.g., pictures and words evoke a similar pattern of activity, such that the patterns that separate categories in one modality transfer to the other. Prior work using this method has found support for a common code, but has two limitations: they have either only examined disparate categories (e.g. animals vs. tools) that are known to activate different brain regions, raising the possibility that the pattern separation and inferred similarity reflects only large scale differences between the categories or they have been limited to individual object representations. By using natural scene categories, we not only extend the current literature on cross-modal representations beyond objects, but also, because natural scene categories activate a common set of brain regions, we identify a more fine-grained (i.e. higher spatial resolution) common representation. Specifically, we studied picture- and word-based representations of natural scene stimuli from four different categories: beaches, cities, highways, and mountains. Participants passively viewed blocks of either phrases (e.g. "sandy beach") describing scenes or photographs from those same scene categories. To determine whether the phrases and pictures evoke a common code, we asked whether a classifier trained on one stimulus type (e.g. phrase stimuli) would transfer (i.e. cross-decode) to the other stimulus type (e.g. picture stimuli). The analysis revealed cross-decoding in the occipitotemporal, posterior parietal and frontal cortices. This similarity of neural activity patterns across the two input types, for categories that co-activate local brain regions, provides strong evidence of a common semantic code for pictures and words in the brain.

journal_name

Neuroimage

journal_title

NeuroImage

authors

Kumar M,Federmeier KD,Fei-Fei L,Beck DM

doi

10.1016/j.neuroimage.2017.03.037

subject

Has Abstract

pub_date

2017-07-15 00:00:00

pages

422-436

eissn

1053-8119

issn

1095-9572

pii

S1053-8119(17)30245-8

journal_volume

155

pub_type

杂志文章

在线工具

Evidence for similar patterns of neural activity elicited by picture- and word-based representations of natural scenes.