Optimal stimulus encoders for natural tasks.

Abstract:

:Determining the features of natural stimuli that are most useful for specific natural tasks is critical for understanding perceptual systems. A new approach is described that involves finding the optimal encoder for the natural task of interest, given a relatively small population of noisy "neurons" between the encoder and decoder. The optimal encoder, which necessarily specifies the most useful features, is found by maximizing accuracy in the natural task, where the decoder is the Bayesian ideal observer operating on the population responses. The approach is illustrated for a patch identification task, where the goal is to identify patches of natural image, and for a foreground identification task, where the goal is to identify which side of a natural surface boundary belongs to the foreground object. The optimal features (receptive fields) are intuitive and perform well in the two tasks. The approach also provides insight into general principles of neural encoding and decoding.

journal_name

J Vis

journal_title

Journal of vision

authors

Geisler WS,Najemnik J,Ing AD

doi

10.1167/9.13.17

subject

Has Abstract

pub_date

2009-12-16 00:00:00

pages

17.1-16

issue

13

issn

1534-7362

pii

9/13/17

journal_volume

9

pub_type

杂志文章
  • The effect of object-centered instructions in Cartesian and polar coordinates on saccade vector.

    abstract::Express saccades (ES) are the most reflexive saccadic eye movements, with very short reaction times of 70-110 ms. It is likely that ES have the shortest saccade reaction times (SRTs) possible given the known physiological and anatomical delays present in sensory and motor systems. Nevertheless, it has been demonstrate...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/17.3.2

    authors: Edelman JA,Mieses AM,Konnova K,Shiu D

    更新日期:2017-03-01 00:00:00

  • Why do people appear not to extrapolate trajectories during multiple object tracking? A computational investigation.

    abstract::Intuitively, extrapolating object trajectories should make visual tracking more accurate. This has proven to be true in many contexts that involve tracking a single item. But surprisingly, when tracking multiple identical items in what is known as "multiple object tracking," observers often appear to ignore direction ...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/14.12.12

    authors: Zhong SH,Ma Z,Wilson C,Liu Y,Flombaum JI

    更新日期:2014-10-13 00:00:00

  • Dynamic interaction between retinal and extraretinal signals in motion integration for smooth pursuit.

    abstract::Due to the aperture problem, the initial direction of tracking responses to a translating bar is biased towards the direction orthogonal to the bar. This observation offers a powerful way to explore the interactions between retinal and extraretinal signals in controlling our actions. We conducted two experiments to pr...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/13.13.5

    authors: Bogadhi AR,Montagnini A,Masson GS

    更新日期:2013-11-04 00:00:00

  • Anisotropies in judging the direction of moving natural scenes.

    abstract::Although visual systems are optimized to deal with the natural visual environment, our understanding of human motion perception is in large part based on the use of artificial stimuli. Here, we assessed observers' ability to estimate the direction of translating natural images and fractals by having them adjust the or...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/10.11.5

    authors: Dakin SC,Apthorp D,Alais D

    更新日期:2010-09-03 00:00:00

  • Flowers in the Attic: Lateralization of the detection of meaning in visual noise.

    abstract::The brain is a slave to sense; we see and hear things that are not there and engage in ongoing correction of these illusory experiences, commonly termed pareidolia. The current study investigates whether the predisposition to see meaning in noise is lateralized to one hemisphere or the other and how this predispositio...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/jov.20.10.11

    authors: Cropper SJ,McCauley A,Gwinn OS,Bartlett M,Nicholls MER

    更新日期:2020-10-01 00:00:00

  • Monocular occlusions determine the perceived shape and depth of occluding surfaces.

    abstract::Recent experiments have established that monocular areas arising due to occlusion of one object by another contribute to stereoscopic depth perception. It has been suggested that the primary role of monocular occlusions is to define depth discontinuities and object boundaries in depth. Here we use a carefully designed...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/10.6.11

    authors: Tsirlin I,Wilcox LM,Allison RS

    更新日期:2010-06-01 00:00:00

  • The geometric structure of color.

    abstract::Color is commonly described in terms of the three perceptual attributes-hue, saturation, and brightness-of which only hue has a qualitative nature, saturation and brightness being of a quantitative nature. A possible reason for such a phenomenological structure of the color manifold, and its geometric representation, ...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/15.1.16

    authors: Logvinenko AD

    更新日期:2015-01-14 00:00:00

  • Robust object-based encoding in visual working memory.

    abstract::Recently, researchers have begun to investigate how nonspatial perceptual information is extracted into visual working memory (VWM), focusing particularly on object-based encoding (OBE). That is, whenever even one feature-dimension is selected for entry into VWM, the others are also extracted automatically. While ther...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/13.2.1

    authors: Shen M,Tang N,Wu F,Shui R,Gao Z

    更新日期:2013-02-01 00:00:00

  • Learning in shifts of transient attention improves recognition of parts of ambiguous figure-ground displays.

    abstract::Previously demonstrated learning effects in shifts of transient attention have only been shown to result in beneficial effects upon secondary discrimination tasks and affect landing points of express saccades. Can such learning result in more direct effects upon perception than previously demonstrated? Observers perfo...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/9.4.21

    authors: Kristjánsson A

    更新日期:2009-04-24 00:00:00

  • Changes in apparent duration follow shifts in perceptual timing.

    abstract::It is well established that the apparent duration of moving visual objects is greater at higher as compared to slower speeds. Here we report the effects of acceleration and deceleration on the perceived duration of a drifting grating with average speed kept constant (10°/s).For acceleration, increasing the speed range...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/15.6.2

    authors: Bruno A,Ayhan I,Johnston A

    更新日期:2015-01-01 00:00:00

  • Limits of lightness identification for real objects under natural viewing conditions.

    abstract::We examined whether observers veridically perceive the reflectances of real objects under natural viewing conditions. A new forced-choice paradigm was used to measure observers' abilities to identify (not match) the reflectance of randomly crumpled gray papers across two levels of illumination, and also to simultaneou...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/4.9.9

    authors: Robilotto R,Zaidi Q

    更新日期:2004-09-15 00:00:00

  • Differential effects of visual attention and working memory on binocular rivalry.

    abstract::The investigation of cognitive influence on binocular rivalry has a long history. However, the effects of visual WM on rivalry have never been studied so far. We examined top-down modulation of rivalry perception in four experiments to compare the effects of visual WM and sustained selective attention: In the first th...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/14.5.13

    authors: Scocchia L,Valsecchi M,Gegenfurtner KR,Triesch J

    更新日期:2014-05-30 00:00:00

  • Contributions of gaze-centered and object-centered coding in a double-step saccade task.

    abstract::The position of a saccade target can be encoded in gaze-centered coordinates, that is, relative to the current gaze position, or in object-centered coordinates, that is, relative to an object in the environment. We tested the role of gaze-centered and object-centered coding in a double-step saccade task involving the ...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/16.14.12

    authors: de Brouwer AJ,Medendorp WP,Smeets JB

    更新日期:2016-11-01 00:00:00

  • Both parallelism and orthogonality are used to perceive 3D slant of rectangles from 2D images.

    abstract::A 2D perspective image of a slanted rectangular object is sufficient for a strong 3D percept. Two computational assumptions that could be used to interpret 3D from images of rectangles are as follows: (1) converging lines in an image are parallel in the world, and (2) skewed angles in an image are orthogonal in the wo...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/7.6.7

    authors: Saunders JA,Backus BT

    更新日期:2007-04-13 00:00:00

  • Allocation of attention during pursuit of large objects is no different than during fixation.

    abstract::Attention allocation during pursuit of a spot is usually characterized as asymmetric with more attention placed ahead of the target than behind it. However, attention is symmetrically allocated across larger pursuit stimuli. An unresolved issue is how tightly attention is constrained on large stimuli during pursuit. A...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/15.9.9

    authors: Watamaniuk SN,Heinen SJ

    更新日期:2015-01-01 00:00:00

  • Slow gain fluctuations limit benefits of temporal integration in visual cortex.

    abstract::Sensory neurons represent stimulus information with sequences of action potentials that differ across repeated measurements. This variability limits the information that can be extracted from momentary observations of a neuron's response. It is often assumed that integrating responses over time mitigates this limitati...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/18.8.8

    authors: Goris RLT,Ziemba CM,Movshon JA,Simoncelli EP

    更新日期:2018-08-01 00:00:00

  • Probability and the changing shape of response distributions for orientation.

    abstract::Spatial attention and feature-based attention are regarded as two independent mechanisms for biasing the processing of sensory stimuli. Feature attention is held to be a spatially invariant mechanism that advantages a single feature per sensory dimension. In contrast to the prediction of location independence, I found...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/14.13.15

    authors: Anderson B

    更新日期:2014-11-18 00:00:00

  • How we perceive the trajectory of an approaching object.

    abstract::Various equations that describe how observers could recover the trajectory of an approaching object have been put forward. Many are relatively complex formulations that recover the veridical trajectory by scaling retinal cues, such as looming and changing disparity. However, these equations do not seem to describe hum...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/12.3.9

    authors: Duke PA,Rushton SK

    更新日期:2012-03-08 00:00:00

  • Effect of spatial distance to the task stimulus on task-irrelevant perceptual learning of static Gabors.

    abstract::It was previously shown that sensitivity improvements to a task-irrelevant motion direction can be obtained when it is presented in concurrence with observers' performance of an attended task (A. R. Seitz & T. Watanabe, 2003; T. Watanabe, J. E. Náñez, & Y. Sasaki, 2001). To test whether this task-irrelevant perceptual...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/7.13.2

    authors: Nishina S,Seitz AR,Kawato M,Watanabe T

    更新日期:2007-10-12 00:00:00

  • Dynamics of attentional deployment during saccadic programming.

    abstract::The dynamics of attentional deployment before saccade execution was studied with a dual-task paradigm. Observers made a horizontal saccade whose direction was indicated by a symbolic precue and had to discriminate the orientation of a Gabor patch displayed at different delays after the precue (but before saccade onset...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/6.3.2

    authors: Castet E,Jeanjean S,Montagnini A,Laugier D,Masson GS

    更新日期:2006-03-03 00:00:00

  • Adaptation to conflicting visual and physical heading directions during walking.

    abstract::We investigated the role of global optic flow for visual-motor adaptation of walking direction. In an immersive virtual environment, observers walked to a circular target lying on either a homogeneous ground plane (target-motion condition) or a textured ground plane (ground-flow condition). During adaptation trials, w...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/11.3.15

    authors: Saunders JA,Durgin FH

    更新日期:2011-03-22 00:00:00

  • Saccades and drifts differentially modulate neuronal activity in V1: effects of retinal image motion, position, and extraretinal influences.

    abstract::In natural vision, continuously changing input is generated by fast saccadic eye movements and slow drifts. We analyzed effects of fixational saccades, voluntary saccades, and drifts on the activity of macaque V1 neurons. Effects of fixational saccades and small voluntary saccades were equivalent. In the presence of a...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/8.14.19

    authors: Kagan I,Gur M,Snodderly DM

    更新日期:2008-11-27 00:00:00

  • Visual stability across combined eye and body motion.

    abstract::In order to maintain visual stability during self-motion, the brain needs to update any egocentric spatial representations of the environment. Here, we use a novel psychophysical approach to investigate how and to what extent the brain integrates visual, extraocular, and vestibular signals pertaining to this spatial u...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/12.12.8

    authors: Clemens IA,Selen LP,Koppen M,Medendorp WP

    更新日期:2012-11-14 00:00:00

  • Complexity and specificity of experimentally-induced expectations in motion perception.

    abstract::Our perceptions are fundamentally altered by our expectations, i.e., priors about the world. In previous statistical learning experiments (Chalk, Seitz, & Seriès, 2010), we investigated how such priors are formed by presenting subjects with white low contrast moving dots on a blank screen and using a bimodal distribut...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/13.4.8

    authors: Gekas N,Chalk M,Seitz AR,Seriès P

    更新日期:2013-03-13 00:00:00

  • A functional role for trans-saccadic luminance differences.

    abstract::In typical natural environments, the visual system receives different inputs in quick succession as gaze moves around. We examined whether local trans-saccadic differences in luminance, contrast, and orientation influenced perception and target selection in the eye movement system. Observers initially fixated a periph...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/12.13.14

    authors: Ludwig CJ,Davies JR,Gegenfurtner KR

    更新日期:2012-01-01 00:00:00

  • Surround facilitation for rapid motion perception.

    abstract::Because we live in a dynamic environment with moving eyes and body, our retinas are often stimulated by new scenes that appear suddenly and are only briefly available. How the visual system successfully extracts information from such challenging stimulation is not yet understood. For some stimuli, like photos of natur...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/12.10.3

    authors: Linares D,Motoyoshi I,Nishida S

    更新日期:2012-09-06 00:00:00

  • Is the straddle effect in contrast perception limited to second-order spatial vision?

    abstract::Previous work on the straddle effect in contrast perception (Foley, 2011; Graham & Wolfson, 2007; Wolfson & Graham, 2007, 2009) has used visual patterns and observer tasks of the type known as spatially second-order. After adaptation of about 1 s to a grid of Gabor patches all at one contrast, a second-order test patt...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/18.5.15

    authors: Graham NV,Wolfson SS

    更新日期:2018-05-01 00:00:00

  • Monitoring mouse retinal degeneration with high-resolution spectral-domain optical coherence tomography.

    abstract::Progression of retinal degeneration in a mouse model was studied in vivo with high-resolution spectral-domain optical coherence tomography (SD-OCT). Imaging in 3D with high depth resolution (<3 mum), SD-OCT resolved all the major layers of the retina of control C57BL/6J mice. Images of transgenic mice having a null mu...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/8.1.17

    authors: Kim KH,Puoris'haag M,Maguluri GN,Umino Y,Cusato K,Barlow RB,de Boer JF

    更新日期:2008-01-24 00:00:00

  • Obligatory encoding of task-irrelevant features depletes working memory resources.

    abstract::Selective attention is often considered the "gateway" to visual working memory (VWM). However, the extent to which we can voluntarily control which of an object's features enter memory remains subject to debate. Recent research has converged on the concept of VWM as a limited commodity distributed between elements of ...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/13.2.21

    authors: Marshall L,Bays PM

    更新日期:2013-02-18 00:00:00

  • How is facial expression coded?

    abstract::Facial expression is theorized to be visually represented in a multidimensional expression space, relative to a norm. This norm-based coding is typically argued to be implemented by a two-pool opponent coding system. However, the evidence supporting the opponent coding of expression cannot rule out the presence of a t...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/15.1.1

    authors: Burton N,Jeffery L,Calder AJ,Rhodes G

    更新日期:2015-01-02 00:00:00