Deep neural networks capture texture sensitivity in V2.

Abstract:

:Deep convolutional neural networks (CNNs) trained on visual objects have shown intriguing ability to predict some response properties of visual cortical neurons. However, the factors (e.g., if the model is trained or not, receptive field size) and computations (e.g., convolution, rectification, pooling, normalization) that give rise to such ability, at what level, and the role of intermediate processing stages in explaining changes that develop across areas of the cortical hierarchy are poorly understood. We focused on the sensitivity to textures as a paradigmatic example, since recent neurophysiology experiments provide rich data pointing to texture sensitivity in secondary (but not primary) visual cortex (V2). We initially explored the CNN without any fitting to the neural data and found that the first two layers of the CNN showed qualitative correspondence to the first two cortical areas in terms of texture sensitivity. We therefore developed a quantitative approach to select a population of CNN model neurons that best fits the brain neural recordings. We found that the CNN could develop compatibility to secondary cortex in the second layer following rectification and that this was improved following pooling but only mildly influenced by the local normalization operation. Higher layers of the CNN could further, though modestly, improve the compatibility with the V2 data. The compatibility was reduced when incorporating random rather than learned weights. Our results show that the CNN class of model is effective for capturing changes that develop across early areas of cortex, and has the potential to help identify the computations that give rise to hierarchical processing in the brain (code is available in GitHub).

journal_name

J Vis

journal_title

Journal of vision

authors

Laskar MNU,Sanchez Giraldo LG,Schwartz O

doi

10.1167/jov.20.7.21

subject

Has Abstract

pub_date

2020-07-01 00:00:00

pages

21-1

issue

7

issn

1534-7362

pii

2770349

journal_volume

20

pub_type

杂志文章
  • Orientations for the successful categorization of facial expressions and their link with facial features.

    abstract::Horizontal information was recently suggested to be crucial for face identification. In the present paper, we expand on this finding and investigate the role of orientations for all the basic facial expressions and neutrality. To this end, we developed orientation bubbles to quantify utilization of the orientation spe...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/17.14.7

    authors: Duncan J,Gosselin F,Cobarro C,Dugas G,Blais C,Fiset D

    更新日期:2017-12-01 00:00:00

  • Roles of visual and non-visual information in the perception of scene-relative object motion during walking.

    abstract::Perceiving object motion during self-movement is an essential ability of humans. Previous studies have reported that the visual system can use both visual information (such as optic flow) and non-visual information (such as vestibular, somatosensory, and proprioceptive information) to identify and globally subtract th...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/jov.20.10.15

    authors: Xie M,Niehorster DC,Lappe M,Li L

    更新日期:2020-10-01 00:00:00

  • Temporal dynamics of saccadic distraction.

    abstract::The saccadic distractor effect, in which irrelevant stimuli delay saccades to target stimuli, is a popular tool for investigating saccadic competition. Here, we outline the main components of a competition framework to account for the temporal dynamics of the distractor effect, inspired by race models of saccade gener...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/9.9.17

    authors: Bompas A,Sumner P

    更新日期:2009-08-28 00:00:00

  • Mach bands and multiscale models of spatial vision: the role of first, second, and third derivative operators in encoding bars and edges.

    abstract::Ernst Mach observed that light or dark bands could be seen at abrupt changes of luminance gradient in the absence of peaks or troughs in luminance. Many models of feature detection share the idea that bars, lines, and Mach bands are found at peaks and troughs in the output of even-symmetric spatial filters. Our experi...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/12.13.18

    authors: Wallis SA,Georgeson MA

    更新日期:2012-12-21 00:00:00

  • Pursuit of the ineffable: perceptual and motor reversals during the tracking of apparent motion.

    abstract::Pursuit can be guided by perceived rather than physical motion, but the temporal relationship between motion perception and pursuit is unknown. We used an apparent motion stimulus consisting of a horizontal row of evenly spaced Kanizsa illusory squares (1.44 deg2): the illusory contours appeared at the midpoints of th...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/3.11.1

    authors: Madelain L,Krauzlis RJ

    更新日期:2003-11-18 00:00:00

  • Contrast dependence of center and surround integration in primary visual cortex of the cat.

    abstract::The magnitudes of spike responses of area 17 (striate cortex, area V1) neurons to stimulation of their classical receptive fields were reduced (suppressed) when the stimuli extended into the silent surround regions. We found that when optimally oriented sine-wave drifting grating patches extended into the distant part...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/9.1.20

    authors: Wang C,Bardy C,Huang JY,FitzGibbon T,Dreher B

    更新日期:2009-01-16 00:00:00

  • Effect of overlaid luminance contrast on perceived color contrast: Shadows enhance, borders suppress.

    abstract::Natural scenes contain both color and luminance variations at different sizes and orientations that are sometimes spatially overlaid and sometimes not. Here, we explore visual interactions between overlaid color and luminance contrast that are both suprathreshold and highly visible. We used a color-luminance plaid in ...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/16.11.15

    authors: Kim YJ,Mullen KT

    更新日期:2016-09-01 00:00:00

  • The effects of smooth occlusions and directions of illumination on the visual perception of 3-D shape from shading.

    abstract::Human observers made local orientation judgments of smoothly shaded surfaces illuminated from different directions by large area lights, both with and without visible smooth occlusion contours. Test-retest correlations between the first and second halves of the experiment revealed that observers' judgments were highly...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/15.2.24

    authors: Egan EJ,Todd JT

    更新日期:2015-02-24 00:00:00

  • Perceived timing of new objects and feature changes.

    abstract::Recent psychophysical studies have shown that perceived timings of events can be dissociated from their physical temporal relationship. In the flash-lag effect (FLE), a flash presented at the same spatiotemporal position as a continuously moving stimulus is perceived to lag behind the moving stimulus. In the present s...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/9.7.5

    authors: Kanai R,Carlson TA,Verstraten FA,Walsh V

    更新日期:2009-07-09 00:00:00

  • Guidance toward and away from distractors in repeated visual search.

    abstract::When searching for two targets consecutively in the same display, participants use memory of recently fixated distractors that become the target in the second search to find that target more quickly. Here we ask whether participants are also using memory for fixated distractors that do not become the target. In Experi...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/15.5.12

    authors: Höfler M,Gilchrist ID,Körner C

    更新日期:2015-01-01 00:00:00

  • Task precision at transfer determines specificity of perceptual learning.

    abstract::Perceptual learning, the improvement in performance with practice, reflects plasticity in the adult visual system. We challenge a standard claim that specificity of perceptual learning depends on task difficulty during training, instead showing that specificity, or conversely transfer, is primarily controlled by the p...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/9.3.1

    authors: Jeter PE,Dosher BA,Petrov A,Lu ZL

    更新日期:2009-03-05 00:00:00

  • Evidence for long-range spatiotemporal interactions in infant and adult visual cortex.

    abstract::The development of spatiotemporal interactions giving rise to classical receptive field properties has been well studied in animal models, but little is known about the development of putative nonclassical mechanisms in any species. Here we used visual evoked potentials to study the developmental status of spatiotempo...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/17.6.12

    authors: Norcia AM,Pei F,Kohler PJ

    更新日期:2017-06-01 00:00:00

  • Ocular following in humans: spatial properties.

    abstract::Ocular following responses (OFRs) are tracking eye movements elicited at ultrashort latency by the sudden movement of a textured pattern. Here we report the results of our study of their dependency on the spatial arrangement of the motion stimulus. Unlike previous studies that looked at the effect of stimulus size, we...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/12.4.13

    authors: Quaia C,Sheliga BM,Fitzgibbon EJ,Optican LM

    更新日期:2012-04-20 00:00:00

  • Synchronous motion modulates animacy perception.

    abstract::Visual motion serves as a cue for high-level percepts. The present study reports novel modulation of animacy perception through synchronous motion. A target dot moving along a random trajectory was presented. The trajectory was generated based on a variant of 1/f noise; hence, the dot could be perceived as animate. Pa...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/15.8.17

    authors: Takahashi K,Watanabe K

    更新日期:2015-01-01 00:00:00

  • The separable effects of feature precision and item load in visual short-term memory.

    abstract::Visual short-term memory (VSTM) has been described as being limited by the number of discrete visual objects, the aggregate quantity of information across multiple visual objects, or some combination of the two. Many recent studies examining these capacity limitations have shown that increasing the number of items in ...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/19.1.2

    authors: Lilburn SD,Smith PL,Sewell DK

    更新日期:2019-01-02 00:00:00

  • Floating square illusion: perceptual uncoupling of static and dynamic objects in motion.

    abstract::One of the primary goals of motion analysis is to accurately track the movement of objects in the environment. We report on a novel illusion in which two objects moving with identical physical velocities have different perceived velocities, creating an apparent offset in their relative spatial positions. The stimulus ...

    journal_title:Journal of vision

    pub_type: 杂志文章,随机对照试验

    doi:10.1167/6.2.4

    authors: Carlson TA,Schrater P,He S

    更新日期:2006-02-13 00:00:00

  • Suprathreshold contrast summation over area using drifting gratings.

    abstract::This study investigated contrast summation over area for moving targets applied to a fixed-size contrast pedestal-a technique originally developed by Meese and Summers (2007) to demonstrate strong spatial summation of contrast for static patterns at suprathreshold contrast levels. Target contrast increments (drifting ...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/18.4.20

    authors: McDougall TJ,Dickinson JE,Badcock DR

    更新日期:2018-04-01 00:00:00

  • Spatial relationships between contours impact rapid scene classification.

    abstract::Photographs and line drawings of natural scenes are easily classified even when the image is only briefly visible to the observer. Contour junctions and points of high curvature have been shown to be important for perceptual organization (Attneave, 1954; Biederman, 1987) and have been proposed to be influential in rap...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/18.8.1

    authors: Wilder J,Dickinson S,Jepson A,Walther DB

    更新日期:2018-08-01 00:00:00

  • Suppressive and facilitatory spatial interactions in peripheral vision: peripheral crowding is neither size invariant nor simple contrast masking.

    abstract::Peripheral vision is characterized by reduced spatial resolution and inhibitory spatial interactions that extend over long distances. This work had three goals. (1) We considered whether the extensive crowding in peripheral vision is a consequence of a shift in the spatial scale of analysis. To test this, using a larg...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/2.2.3

    authors: Levi DM,Hariharan S,Klein SA

    更新日期:2002-01-01 00:00:00

  • The perception of 2D orientation is categorically biased.

    abstract::Three experimental paradigms were used to investigate the perception of orientation relative to internal categorical standards of vertical and horizontal. In Experiment 1, magnitude estimation of orientation (in degrees) relative to vertical and horizontal replicated a previously reported spatial orientation bias also...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/11.8.13

    authors: Durgin FH,Li Z

    更新日期:2011-07-22 00:00:00

  • Discrimination of locomotion direction in impoverished displays of walkers by macaque monkeys.

    abstract::A vast literature exists on human biological motion perception in impoverished displays, e.g., point-light walkers. Less is known about the perception of impoverished biological motion displays in macaques. We trained 3 macaques in the discrimination of facing direction (left versus right) and forward versus backward ...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/10.4.22

    authors: Vangeneugden J,Vancleef K,Jaeggli T,VanGool L,Vogels R

    更新日期:2009-04-28 00:00:00

  • Global attention facilitates the planning, but not execution of goal-directed reaches.

    abstract::In daily life, humans interact with multiple objects in complex environments. A large body of literature demonstrates that target selection is biased toward recently attended features, such that reaches are faster and trajectory curvature is reduced when target features (i.e., color) are repeated (priming of pop-out)....

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/16.9.7

    authors: McCarthy JD,Song JH

    更新日期:2016-07-01 00:00:00

  • A moving-barber-pole illusion.

    abstract::In the barber-pole illusion (BPI), a diagonally moving grating is perceived as moving vertically because of the shape of the vertically oriented window through which it is viewed-a strong shape-motion interaction. We introduce a novel stimulus-the moving barber pole-in which a diagonal, drifting sinusoidal carrier is ...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/14.5.1

    authors: Sun P,Chubb C,Sperling G

    更新日期:2014-05-01 00:00:00

  • Dynamic information for the recognition of conversational expressions.

    abstract::Communication is critical for normal, everyday life. During a conversation, information is conveyed in a number of ways, including through body, head, and facial changes. While much research has examined these latter forms of communication, the majority of it has focused on static representations of a few, supposedly ...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/9.13.7

    authors: Cunningham DW,Wallraven C

    更新日期:2009-12-07 00:00:00

  • Automatic grouping of regular structures.

    abstract::To cope with the continuously incoming stream of input, the visual system has to group information across space and time. Usually, spatial and temporal grouping are investigated separately. However, recent findings revealed that these two grouping mechanisms strongly interact and should therefore be studied together r...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/10.8.5

    authors: Hermens F,Scharnowski F,Herzog MH

    更新日期:2010-07-01 00:00:00

  • Partial modal completion under occlusion: what do modal and amodal percepts represent?

    abstract::In the occlusion illusion, a partly occluded object is perceived as though it were less occluded than it actually is (Palmer, Brooks, & Lai, 2007). We confirm and extend this finding using a stimulus with a moving occluder. In agreement with Palmer et al.'s (2007) findings and their partial-modal-completion hypothesis...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/15.1.22

    authors: Scherzer TR,Ekroll V

    更新日期:2015-01-22 00:00:00

  • Cue combination on the circle and the sphere.

    abstract::Bayesian cue combination models have been used to examine how human observers combine information from several cues to form estimates of linear quantities like depth. Here we develop an analogous theory for circular quantities like planar direction. The circular theory is broadly similar to the linear theory but diffe...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/10.11.15

    authors: Murray RF,Morgenstern Y

    更新日期:2010-09-01 00:00:00

  • Crowding and perceptual organization: Target's objecthood influences the relative strength of part-level and configural-level crowding.

    abstract::In visual crowding, identification of a peripheral object is impaired by nearby objects. Recent studies have demonstrated that crowding is not limited only to interaction between low-level features or parts, as presumed by most models of crowding, but can also occur between high-level, configural representations of ob...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/17.11.7

    authors: Pirkner Y,Kimchi R

    更新日期:2017-09-01 00:00:00

  • Learning Bayesian priors for depth perception.

    abstract::How the visual system learns the statistical regularities (e.g., symmetry) needed to interpret pictorial cues to depth is one of the outstanding questions in perceptual science. We test the hypothesis that the visual system can adapt its model of the statistics of planar figures for estimating three-dimensional surfac...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/7.8.13

    authors: Knill DC

    更新日期:2007-06-26 00:00:00

  • Sensory and cognitive influences on the training-related improvement of reading speed in peripheral vision.

    abstract::Reading speed in normal peripheral vision is slow but can be increased through training on a letter-recognition task. The aim of the present study is to investigate the sensory and cognitive factors responsible for this improvement. The visual span is hypothesized to be a sensory bottleneck limiting reading speed. Thr...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/13.7.14

    authors: He Y,Legge GE,Yu D

    更新日期:2013-06-24 00:00:00