Estimating nonlinear receptive fields from natural images.

Abstract:

:The response of visual cells is a nonlinear function of their stimuli. In addition, an increasing amount of evidence shows that visual cells are optimized to process natural images. Hence, finding good nonlinear models to characterize visual cells using natural stimuli is important. The Volterra model is an appealing nonlinear model for visual cells. However, their large number of parameters and the limited size of physiological recordings have hindered its application. Recently, a substantiated hypothesis stating that the responses of each visual cell could depend on an especially low-dimensional subspace of the image space has been proposed. We use this low-dimensional subspace in the Volterra relevant-space technique to allow the estimation of high-order Volterra models. Most laboratories characterize the response of visual cells as a nonlinear function on the low-dimensional subspace. They estimate this nonlinear function using histograms and by fitting parametric functions to them. Here, we compare the Volterra model with these histogram-based techniques. We use simulated data from cortical simple cells as well as simulated and physiological data from cortical complex cells. Volterra models yield equal or superior predictive power in all conditions studied. Several methods have been proposed to estimate the low-dimensional subspace. In this article, we test projection pursuit regression (PPR), a nonlinear regression algorithm. We compare PPR with two popular models used in vision: spike-triggered average (STA) and spike-triggered covariance (STC). We observe that PPR has advantages over these alternative algorithms. Hence, we conclude that PPR is a viable algorithm to recover the relevant subspace from natural images and that the Volterra model, estimated through the Volterra relevant-space technique, is a compelling alternative to histogram-based techniques.

journal_name

J Vis

journal_title

Journal of vision

authors

Rapela J,Mendel JM,Grzywacz NM

doi

10.1167/6.4.11

subject

Has Abstract

pub_date

2006-05-16 00:00:00

pages

441-74

issue

4

issn

1534-7362

pii

6/4/11

journal_volume

6

pub_type

杂志文章
  • Color constancy supports cross-illumination color selection.

    abstract::We rely on color to select objects as the targets of our actions (e.g., the freshest fish, the ripest fruit). To be useful for selection, color must provide accurate guidance about object identity across changes in illumination. Although the visual system partially stabilizes object color appearance across illuminatio...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/15.6.13

    authors: Radonjić A,Cottaris NP,Brainard DH

    更新日期:2015-01-01 00:00:00

  • Spatial statistics for gaze patterns in scene viewing: Effects of repeated viewing.

    abstract::Scene viewing is used to study attentional selection in complex but still controlled environments. One of the main observations on eye movements during scene viewing is the inhomogeneous distribution of fixation locations: While some parts of an image are fixated by almost all observers and are inspected repeatedly by...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/19.6.5

    authors: Trukenbrod HA,Barthelmé S,Wichmann FA,Engbert R

    更新日期:2019-06-03 00:00:00

  • Interocular suppression patterns in binocularly abnormal observers using luminance- and contrast-modulated noise stimuli.

    abstract::In binocular viewing, images presented to the amblyopic eye are suppressed in the cortex to prevent confusion or diplopia. The present study measures depth and extent of interocular suppression across the central circular 24° visual field in observers with strabismus and microstrabismus. Visual stimuli were concentric...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/16.10.20

    authors: Chima AS,Formankiewicz MA,Waugh SJ

    更新日期:2016-08-01 00:00:00

  • Both parallelism and orthogonality are used to perceive 3D slant of rectangles from 2D images.

    abstract::A 2D perspective image of a slanted rectangular object is sufficient for a strong 3D percept. Two computational assumptions that could be used to interpret 3D from images of rectangles are as follows: (1) converging lines in an image are parallel in the world, and (2) skewed angles in an image are orthogonal in the wo...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/7.6.7

    authors: Saunders JA,Backus BT

    更新日期:2007-04-13 00:00:00

  • Perceptual evidence for saccadic updating of color stimuli.

    abstract::In retinotopically organized areas of the macaque visual cortex, neurons have been found that shift their receptive fields before a saccade to their postsaccadic position. This saccadic remapping has been interpreted as a mechanism contributing to perceptual stability of space across eye movements. So far, there is on...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/8.14.9

    authors: Wittenberg M,Bremmer F,Wachtler T

    更新日期:2008-10-23 00:00:00

  • The effect of active selection in human path integration.

    abstract::Path integration refers to the ability to integrate self-motion information to estimate one's current position and orientation relative to the origin. To investigate the effect of active selection in path integration, we used a virtual homing task in which participants traveled along hallways and attempted to directly...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/10.11.25

    authors: Wan X,Wang RF,Crowell JA

    更新日期:2010-09-27 00:00:00

  • Blur perception throughout the visual field in myopia and emmetropia.

    abstract::We evaluated the ability of emmetropic and myopic observers to detect and discriminate blur across the retina under monocular or binocular viewing conditions. We recruited 39 young (23-30 years) healthy adults (n = 19 myopes) with best-corrected visual acuity 0.0 LogMAR (20/20) or better in each eye and no binocular o...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/17.5.3

    authors: Maiello G,Walker L,Bex PJ,Vera-Diaz FA

    更新日期:2017-05-01 00:00:00

  • Sensitivity to curvature deformations along closed contours.

    abstract::Human observers are exquisitely sensitive to curvature deformations along a circular closed contour (Wilkinson, Wilson, & Habak, 1998; Hess, Wang, & Dakin, 1999; Loffler, Wilson, & Wilkinson, 2003). Such remarkable sensitivity has been attributed to the curvature encoding scheme used by V4 neurons, which typically are...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/19.13.7

    authors: Slugocki M,Sekuler AB,Bennett PJ

    更新日期:2019-11-01 00:00:00

  • The segmental structure of faces and its use in gender recognition.

    abstract::What is the relationship between object segmentation and recognition? First, we develop a feature segmentation method that parses faces into features and, in doing so, attempts to approximate human performance. This segmentation-based approach allows us to build featural representations that make explicit the part-who...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/8.7.7

    authors: Nestor A,Tarr MJ

    更新日期:2008-05-23 00:00:00

  • Sensory reliability shapes perceptual inference via two mechanisms.

    abstract::To obtain a coherent percept of the environment, the brain should integrate sensory signals from common sources and segregate those from independent sources. Recent research has demonstrated that humans integrate audiovisual information during spatial localization consistent with Bayesian Causal Inference (CI). Howeve...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/15.5.22

    authors: Rohe T,Noppeney U

    更新日期:2015-01-01 00:00:00

  • Individual differences in response precision correlate with adaptation bias.

    abstract::The internal representation of stimuli is imperfect and subject to bias. Noise introduced at initial encoding and during maintenance degrades the precision of representation. Stimulus estimation is also biased away from recently encountered stimuli, a phenomenon known as adaptation. Within a Bayesian framework, greate...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/18.13.18

    authors: Mattar MG,Carter MV,Zebrowitz MS,Thompson-Schill SL,Aguirre GK

    更新日期:2018-12-03 00:00:00

  • Origin of the fast negative ERG component from isolated aspartate-treated mouse retina.

    abstract::The leading edge of the a-wave of the ERG is generally believed to accurately reflect the changes in the circulating current through the cGMP-gated channels in the outer segment plasma membrane of rods and cones. The aspartate-isolated mammalian electroretinogram (ERG) to a rod-saturating flash contains a fast "nose"-...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/9.12.9

    authors: Vinberg FJ,Strandman S,Koskelainen A

    更新日期:2009-11-17 00:00:00

  • Demand-based dynamic distribution of attention and monitoring of velocities during multiple-object tracking.

    abstract::The ability to track multiple moving objects with attention has been the focus of much research. However, the literature is relatively inconclusive regarding two key aspects of this ability, (1) whether the distribution of attention among the tracked targets is fixed during a period of tracking or is dynamically adjus...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/9.4.1

    authors: Iordanescu L,Grabowecky M,Suzuki S

    更新日期:2009-04-03 00:00:00

  • How we perceive the trajectory of an approaching object.

    abstract::Various equations that describe how observers could recover the trajectory of an approaching object have been put forward. Many are relatively complex formulations that recover the veridical trajectory by scaling retinal cues, such as looming and changing disparity. However, these equations do not seem to describe hum...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/12.3.9

    authors: Duke PA,Rushton SK

    更新日期:2012-03-08 00:00:00

  • Depth estimation from retinal disparity requires eye and head orientation signals.

    abstract::To reach for an object, one needs to know its egocentric distance (absolute depth). It remains an unresolved issue which signals are required by the brain to calculate this absolute depth information. We devised a geometric model of binocular 3D eye orientation and investigated the signals necessary to uniquely determ...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/8.16.3

    authors: Blohm G,Khan AZ,Ren L,Schreiber KM,Crawford JD

    更新日期:2008-12-15 00:00:00

  • The precision of binocular and monocular depth judgments in natural settings.

    abstract::We measured binocular and monocular depth thresholds for objects presented in a real environment. Observers judged the depth separating a pair of metal rods presented either in relative isolation, or surrounded by other objects, including a textured surface. In the isolated setting, binocular thresholds were greatly s...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/10.10.5

    authors: McKee SP,Taylor DG

    更新日期:2010-08-01 00:00:00

  • Insufficient compensation for self-motion during perception of object speed: The vestibular Aubert-Fleischl phenomenon.

    abstract::To estimate object speed with respect to the self, retinal signals must be summed with extraretinal signals that encode the speed of eye and head movement. Prior work has shown that differences in perceptual estimates of object speed based on retinal and oculomotor signals lead to biased percepts such as the Aubert-Fl...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/18.13.9

    authors: Garzorz IT,Freeman TCA,Ernst MO,MacNeilage PR

    更新日期:2018-12-03 00:00:00

  • Perceived timing of new objects and feature changes.

    abstract::Recent psychophysical studies have shown that perceived timings of events can be dissociated from their physical temporal relationship. In the flash-lag effect (FLE), a flash presented at the same spatiotemporal position as a continuously moving stimulus is perceived to lag behind the moving stimulus. In the present s...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/9.7.5

    authors: Kanai R,Carlson TA,Verstraten FA,Walsh V

    更新日期:2009-07-09 00:00:00

  • Signs of depth-luminance covariance in 3-D cluttered scenes.

    abstract::In three-dimensional (3-D) cluttered scenes such as foliage, deeper surfaces often are more shadowed and hence darker, and so depth and luminance often have negative covariance. We examined whether the sign of depth-luminance covariance plays a role in depth perception in 3-D clutter. We compared scenes rendered with ...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/18.3.5

    authors: Scaccia M,Langer MS

    更新日期:2018-03-01 00:00:00

  • Global attention facilitates the planning, but not execution of goal-directed reaches.

    abstract::In daily life, humans interact with multiple objects in complex environments. A large body of literature demonstrates that target selection is biased toward recently attended features, such that reaches are faster and trajectory curvature is reduced when target features (i.e., color) are repeated (priming of pop-out)....

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/16.9.7

    authors: McCarthy JD,Song JH

    更新日期:2016-07-01 00:00:00

  • Evaluating the human X-chromosome pigment gene promoter sequences as predictors of L:M cone ratio variation.

    abstract::Men with normal color vision vary widely in the ratio of long- (L) to middle-wavelength sensitive (M) cones. This variation provides opportunities to test models for the mechanism that produces L versus M cones during development. The L and M photopigment genes lie in a tandem array. Each gene has a promoter, and upst...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/4.3.7

    authors: McMahon C,Neitz J,Neitz M

    更新日期:2004-03-25 00:00:00

  • Eye movement statistics in humans are consistent with an optimal search strategy.

    abstract::Most models of visual search are based on the intuition that humans choose fixation locations containing features that best match the features of the target. The optimal version of this feature-based strategy is what we term "maximum a posteriori (MAP) search." Alternatively, humans could choose fixations that maximiz...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/8.3.4

    authors: Najemnik J,Geisler WS

    更新日期:2008-03-07 00:00:00

  • Unfocused spatial attention underlies the crowding effect in indirect form vision.

    abstract::We studied mechanisms underlying the crowding effect in indirect form vision by measuring recognition contrast sensitivity of a character with flankers to the left and right. Attentional and featural contributions to the effect can be separated by a new paradigm that distinguishes pattern location errors from pattern ...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/5.11.8

    authors: Strasburger H

    更新日期:2005-12-29 00:00:00

  • A neurophysiologically plausible population code model for human contrast discrimination.

    abstract::The pedestal effect is the improvement in the detectability of a sinusoidal grating in the presence of another grating of the same orientation, spatial frequency, and phase-usually called the pedestal. Recent evidence has demonstrated that the pedestal effect is differently modified by spectrally flat and notch-filter...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/9.7.15

    authors: Goris RL,Wichmann FA,Henning GB

    更新日期:2009-07-31 00:00:00

  • Contrast-response functions for multifocal visual evoked potentials: a test of a model relating V1 activity to multifocal visual evoked potentials activity.

    abstract::The multifocal visual evoked potential (mfVEP) is largely generated in V1. To relate the electrical activity recorded from humans to recordings from single cells in nonhuman primate (V1) cortex, contrast-response functions for the human mfVEP were compared to predictions from a model of V1 activity (D. J. Heeger, A. C...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/6.5.4

    authors: Hood DC,Ghadiali Q,Zhang JC,Graham NV,Wolfson SS,Zhang X

    更新日期:2006-04-24 00:00:00

  • Human trimodal perception follows optimal statistical inference.

    abstract::Our nervous system typically processes signals from multiple sensory modalities at any given moment and is therefore posed with two important problems: which of the signals are caused by a common event, and how to combine those signals. We investigated human perception in the presence of auditory, visual, and tactile ...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/8.3.24

    authors: Wozny DR,Beierholm UR,Shams L

    更新日期:2008-03-27 00:00:00

  • Optimal decisions for contrast discrimination.

    abstract::Contrast discrimination functions for simple gratings famously look like a dipper. Discrimination thresholds are lower than detection thresholds for moderate pedestal contrasts, and the rate of growth of thresholds as the pedestal contrast gets larger typically lies between the values implied by two popular treatments...

    journal_title:Journal of vision

    pub_type: 杂志文章,评审

    doi:10.1167/11.14.9

    authors: Sanborn AN,Dayan P

    更新日期:2011-12-08 00:00:00

  • What makes cast shadows hard to see?

    abstract::Visual search is slowed for cast shadows lit from above, as compared to the same search items inverted and so not interpreted as shadows (R. A. Rensink & P. Cavanagh, 2004). The underlying mechanisms for such impaired shadow processing are still not understood. Here we investigated the processing levels at which this ...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/10.3.13

    authors: Porter G,Tales A,Leonards U

    更新日期:2010-03-29 00:00:00

  • Adaptation reveals that facial expression averaging occurs during rapid serial presentation.

    abstract::How do we interpret the rapidly changing visual stimuli we encounter? How does our past visual experience shape our perception? Recent work has suggested that our visual system is able to interpret multiple faces presented temporally via integration or ensemble coding. Visual adaptation is widely used to probe such sh...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/17.1.15

    authors: Ying H,Xu H

    更新日期:2017-01-01 00:00:00

  • Induced movement: the flying bluebottle illusion.

    abstract::Two small objects (flies) followed identical circular orbits. However, a large background that circled around behind them in different phases made one orbit look twice as large as the other (size illusion) or made the circles look like very thin horizontal or vertical ellipses with aspect ratios of 7.5:1 or more (shap...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/6.10.8

    authors: Anstis S,Casco C

    更新日期:2006-09-22 00:00:00