Selectivity and robustness of sparse coding networks.

Abstract:

:We investigate how the population nonlinearities resulting from lateral inhibition and thresholding in sparse coding networks influence neural response selectivity and robustness. We show that when compared to pointwise nonlinear models, such population nonlinearities improve the selectivity to a preferred stimulus and protect against adversarial perturbations of the input. These findings are predicted from the geometry of the single-neuron iso-response surface, which provides new insight into the relationship between selectivity and adversarial robustness. Inhibitory lateral connections curve the iso-response surface outward in the direction of selectivity. Since adversarial perturbations are orthogonal to the iso-response surface, adversarial attacks tend to be aligned with directions of selectivity. Consequently, the network is less easily fooled by perceptually irrelevant perturbations to the input. Together, these findings point to benefits of integrating computational principles found in biological vision systems into artificial neural networks.

journal_name

J Vis

journal_title

Journal of vision

authors

Paiton DM,Frye CG,Lundquist SY,Bowen JD,Zarcone R,Olshausen BA

doi

10.1167/jov.20.12.10

subject

Has Abstract

pub_date

2020-11-02 00:00:00

pages

10

issue

12

issn

1534-7362

pii

2772000

journal_volume

20

pub_type

杂志文章
  • Planning multiple movements within a fixed time limit: the cost of constrained time allocation in a visuo-motor task.

    abstract::S.-W. Wu, M. F. Dal Martello, and L. T. Maloney (2009) evaluated subjects' performance in a visuo-motor task where subjects were asked to hit two targets in sequence within a fixed time limit. Hitting targets earned rewards and Wu et al. varied rewards associated with targets. They found that subjects failed to maximi...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/10.6.1

    authors: Zhang H,Wu SW,Maloney LT

    更新日期:2010-06-01 00:00:00

  • Detection of linear ego-acceleration from optic flow.

    abstract::Human observers are able to estimate various ego-motion parameters from optic flow, including rotation, translational heading, time-to-collision (TTC), time-to-passage (TTP), etc. The perception of linear ego-acceleration or deceleration, i.e., changes of translational velocity, is less well understood. While time-to-...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/12.7.10

    authors: Festl F,Recktenwald F,Yuan C,Mallot HA

    更新日期:2012-07-20 00:00:00

  • Is goal-directed attentional guidance just intertrial priming? A review.

    abstract::According to most models of selective visual attention, our goals at any given moment and saliency in the visual field determine attentional priority. But selection is not carried out in isolation--we typically track objects through space and time. This is not well captured within the distinction between goal-directed...

    journal_title:Journal of vision

    pub_type: 杂志文章,评审

    doi:10.1167/13.3.14

    authors: Lamy DF,Kristjánsson A

    更新日期:2013-07-01 00:00:00

  • The extra-retinal motion aftereffect.

    abstract::Repetitive eye movements are known to produce motion aftereffect (MAE) when made to track a moving stimulus. Explanations typically centre on the retinal motion created in the peripheral visual field by the eye movement. This retinal motion is thought to induce perceived motion in the central test, either through the ...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/3.11.11

    authors: Freeman TC,Sumnall JH,Snowden RJ

    更新日期:2003-12-05 00:00:00

  • Impairment of cyclopean surface processing by disparity-defined masking stimuli.

    abstract::Binocular disparity signals allow for the estimation of three-dimensional shape, even in the absence of monocular depth cues. The perception of such disparity-defined form depends, however, on the linkage of multiple disparity measurements over space. Performance limitations in cyclopean tasks thus inform us about err...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/jov.20.2.1

    authors: Goutcher R,Hibbard PB

    更新日期:2020-02-10 00:00:00

  • Temporal dynamics of saccadic distraction.

    abstract::The saccadic distractor effect, in which irrelevant stimuli delay saccades to target stimuli, is a popular tool for investigating saccadic competition. Here, we outline the main components of a competition framework to account for the temporal dynamics of the distractor effect, inspired by race models of saccade gener...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/9.9.17

    authors: Bompas A,Sumner P

    更新日期:2009-08-28 00:00:00

  • Feature specificity in attentional capture by size and color.

    abstract::Top-down guidance of visual attention has classically been thought to operate in a feature-specific manner. However, recent studies have shown that top-down visual attention can also be guided by information about target-nontarget feature relations (e.g., larger, redder, brighter). Here we recommend a minimal set of c...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/13.3.12

    authors: Harris AM,Remington RW,Becker SI

    更新日期:2013-05-06 00:00:00

  • Signs of depth-luminance covariance in 3-D cluttered scenes.

    abstract::In three-dimensional (3-D) cluttered scenes such as foliage, deeper surfaces often are more shadowed and hence darker, and so depth and luminance often have negative covariance. We examined whether the sign of depth-luminance covariance plays a role in depth perception in 3-D clutter. We compared scenes rendered with ...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/18.3.5

    authors: Scaccia M,Langer MS

    更新日期:2018-03-01 00:00:00

  • Sustained spatial attention can affect feature fusion.

    abstract::When two verniers are presented in rapid succession at the same location, feature fusion occurs. Instead of perceiving two separate verniers, participants typically report perceiving one fused vernier, whose offset is a combination of the two previous verniers, with the later one slightly dominating. Here, we examined...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/18.6.20

    authors: Hochmitz I,Lauffs MM,Herzog MH,Yeshurun Y

    更新日期:2018-06-01 00:00:00

  • Gaze behavior during 3-D face identification is depth cue invariant.

    abstract::Gaze behavior during scene and object recognition can highlight the relevant information for a task. For example, salience maps-highlighting regions that have heightened luminance, contrast, color, etc. in a scene-can be used to predict gaze targets. Certain tasks, such as face recognition, result in a typical pattern...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/17.2.9

    authors: Akhavein H,Farivar R

    更新日期:2017-02-01 00:00:00

  • Sensory and decisional factors in motion-induced blindness.

    abstract::The processes underlying motion-induced blindness (MIB) are widely debated. Ultimately, however, they must reduce to a sensitivity drop and/or to an upward shift of the decision criterion. The first possibility was tested by assessing the detection threshold for a contrast (or luminance) increment applied to the MIB t...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/7.7.4

    authors: Caetta F,Gorea A,Bonneh Y

    更新日期:2007-05-23 00:00:00

  • A new two-alternative forced choice method for the unbiased characterization of perceptual bias and discriminability.

    abstract::Perception is often biased by secondary stimulus attributes (e.g., stimulus noise, attention, or spatial context). A correct quantitative characterization of perceptual bias is essential for testing hypotheses about the underlying perceptual mechanisms and computations. We demonstrate that the standard two-alternative...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/14.3.20

    authors: Jogan M,Stocker AA

    更新日期:2014-03-13 00:00:00

  • Head and eye movements and the role of memory limitations in a visual search paradigm.

    abstract::The image information guiding visual behavior is acquired and maintained in an interplay of gaze shifts and visual short-term memory (VSTM). If storage capacity of VSTM is exhausted, gaze shifts can be used to regain information not currently represented in memory. By varying the separation between relevant image regi...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/8.1.7

    authors: Hardiess G,Gillner S,Mallot HA

    更新日期:2008-01-15 00:00:00

  • The crowding factor method applied to parafoveal vision.

    abstract::Crowding increases with eccentricity and is most readily observed in the periphery. During natural, active vision, however, central vision plays an important role. Measures of critical distance to estimate crowding are difficult in central vision, as these distances are small. Any overlap of flankers with the target m...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/16.11.30

    authors: Ghahghaei S,Walker L

    更新日期:2016-09-01 00:00:00

  • Region grouping in natural foliage scenes: image statistics and human performance.

    abstract::This study investigated the mechanisms of grouping and segregation in natural scenes of close-up foliage, an important class of scenes for human and non-human primates. Close-up foliage images were collected with a digital camera calibrated to match the responses of human L, M, and S cones at each pixel. The images we...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/10.4.10

    authors: Ing AD,Wilson JA,Geisler WS

    更新日期:2010-04-27 00:00:00

  • Do the eyes really have it? Dynamic allocation of attention when viewing moving faces.

    abstract::What controls gaze allocation during dynamic face perception? We monitored participants' eye movements while they watched videos featuring close-ups of pedestrians engaged in interviews. Contrary to previous findings using static displays, we observed no general preference to fixate eyes. Instead, gaze was dynamically...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/12.13.3

    authors: Võ ML,Smith TJ,Mital PK,Henderson JM

    更新日期:2012-12-03 00:00:00

  • Different reaction-times for subitizing, estimation, and texture.

    abstract::Humans can estimate and encode numerosity over a large range, from very few items to several hundreds. Two distinct mechanisms have been proposed: subitizing, for numbers up to four and estimation for larger numerosities. We have recently extended this idea by suggesting that for very densely packed arrays, when items...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/19.6.14

    authors: Pomè A,Anobile G,Cicchini GM,Burr DC

    更新日期:2019-06-03 00:00:00

  • Future path and tangent point models in the visual control of locomotion in curve driving.

    abstract::Studying human behavior in the natural context of everyday visual tasks--including locomotor tasks such as driving--can reveal visual strategies or even suggest underlying visual mechanisms. This paper reviews empirical and theoretical work in the past 20 years (1994-2014) on the visual control of steering a vehicle a...

    journal_title:Journal of vision

    pub_type: 杂志文章,评审

    doi:10.1167/14.12.21

    authors: Lappi O

    更新日期:2014-10-21 00:00:00

  • The geometric structure of color.

    abstract::Color is commonly described in terms of the three perceptual attributes-hue, saturation, and brightness-of which only hue has a qualitative nature, saturation and brightness being of a quantitative nature. A possible reason for such a phenomenological structure of the color manifold, and its geometric representation, ...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/15.1.16

    authors: Logvinenko AD

    更新日期:2015-01-14 00:00:00

  • Differential changes in human perception of speed due to motion adaptation.

    abstract::Visual systems adapt to the prevailing image conditions. This improves the ability to discriminate between two similar stimuli but has the side effect that veridical perception is degraded. For example, prolonged driving at 100 km/h may reduce the perceived speed to 80 km/h but improve the sensitivity to changes in th...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/8.11.6

    authors: Hietanen MA,Crowder NA,Ibbotson MR

    更新日期:2008-08-11 00:00:00

  • Motion processing at low light levels: Differential effects on the perception of specific motion types.

    abstract::While many aspects of human vision at low light levels have been studied in great detail, motion perception has rarely been investigated so far. Here we address differential effects of light level on the perception of coherent motion, heading from radial flow, and biological motion. We determined detection thresholds ...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/8.3.14

    authors: Billino J,Bremmer F,Gegenfurtner KR

    更新日期:2008-03-18 00:00:00

  • Flowers in the Attic: Lateralization of the detection of meaning in visual noise.

    abstract::The brain is a slave to sense; we see and hear things that are not there and engage in ongoing correction of these illusory experiences, commonly termed pareidolia. The current study investigates whether the predisposition to see meaning in noise is lateralized to one hemisphere or the other and how this predispositio...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/jov.20.10.11

    authors: Cropper SJ,McCauley A,Gwinn OS,Bartlett M,Nicholls MER

    更新日期:2020-10-01 00:00:00

  • Sequential perceptual learning of letter identification and "uncrowding" in normal peripheral vision: Effects of task, training order, and cholinergic enhancement.

    abstract::Human adults with normal vision are capable of improving performance on visual tasks through repeated practice. Previous work has shown that enhancing synaptic levels of acetylcholine (ACh) in healthy human adults with donepezil (trade name: Aricept) can increase the magnitude and specificity of perceptual learning (P...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/jov.20.4.24

    authors: Levi DM,Li RW,Silver MA,Chung STL

    更新日期:2020-04-09 00:00:00

  • Motion-induced position shift in stereoscopic and dichoptic viewing.

    abstract::The static envelope of a Gabor patch with a moving sinusoidal carrier appears shifted in the direction of the carrier motion (De Valois & De Valois, 1991). This phenomenon is called motion-induced position shift. Although several motion-processing stages, ranging from low- to high-level processes, may contribute to po...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/16.13.3

    authors: Hisakata R,Hayashi D,Murakami I

    更新日期:2016-10-01 00:00:00

  • Crowding and perceptual organization: Target's objecthood influences the relative strength of part-level and configural-level crowding.

    abstract::In visual crowding, identification of a peripheral object is impaired by nearby objects. Recent studies have demonstrated that crowding is not limited only to interaction between low-level features or parts, as presumed by most models of crowding, but can also occur between high-level, configural representations of ob...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/17.11.7

    authors: Pirkner Y,Kimchi R

    更新日期:2017-09-01 00:00:00

  • Optimal stimulus encoders for natural tasks.

    abstract::Determining the features of natural stimuli that are most useful for specific natural tasks is critical for understanding perceptual systems. A new approach is described that involves finding the optimal encoder for the natural task of interest, given a relatively small population of noisy "neurons" between the encode...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/9.13.17

    authors: Geisler WS,Najemnik J,Ing AD

    更新日期:2009-12-16 00:00:00

  • Transcranial direct current stimulation over posterior parietal cortex modulates visuospatial localization.

    abstract::Visual localization is based on the complex interplay of bottom-up and top-down processing. Based on previous work, the posterior parietal cortex (PPC) is assumed to play an essential role in this interplay. In this study, we investigated the causal role of the PPC in visual localization. Specifically, our goal was to...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/14.9.5

    authors: Wright JM,Krekelberg B

    更新日期:2014-08-07 00:00:00

  • Perceived orientation of complex shape reflects graded part decomposition.

    abstract::Although the orientation of line segments and simple shapes is a well-studied area of vision, little is known about geometric factors that influence perceived orientation of complex multipart shapes. The study of these factors is of interest because it allows for an insight into the basic problem of how local geometri...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/6.8.4

    authors: Cohen EH,Singh M

    更新日期:2006-07-14 00:00:00

  • Retinotopic encoding of the Ternus-Pikler display reflected in the early visual areas.

    abstract::The visual representation of the world is often assumed to be retinotopic, and many visual brain areas are indeed organized retinotopically. Visual perception, however, is not based on a reference frame anchored in retinotopic coordinates. For example, when an object moves, motion of its constituent parts is perceived...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/16.3.26

    authors: Thunell E,van der Zwaag W,Ögmen H,Plomp G,Herzog MH

    更新日期:2016-01-01 00:00:00

  • Serial dependence in the perception of visual variance.

    abstract::The recent history of perceptual experience has been shown to influence subsequent perception. Classically, this dependence on perceptual history has been examined in sensory-adaptation paradigms, wherein prolonged exposure to a particular stimulus (e.g., a vertically oriented grating) produces changes in perception o...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/18.7.4

    authors: Suárez-Pinilla M,Seth AK,Roseboom W

    更新日期:2018-07-02 00:00:00