A computational-observer model of spatial contrast sensitivity: Effects of wave-front-based optics, cone-mosaic structure, and inference engine.

Abstract:

:We present a computational-observer model of the human spatial contrast-sensitivity function based on the Image Systems Engineering Toolbox for Biology (ISETBio) simulation framework. We demonstrate that ISETBio-derived contrast-sensitivity functions agree well with ones derived using traditional ideal-observer approaches, when the mosaic, optics, and inference engine are matched. Further simulations extend earlier work by considering more realistic cone mosaics, more recent measurements of human physiological optics, and the effect of varying the inference engine used to link visual representations to psychophysical performance. Relative to earlier calculations, our simulations show that the spatial structure of realistic cone mosaics reduces the upper bounds on performance at low spatial frequencies, whereas realistic optics derived from modern wave-front measurements lead to increased upper bounds at high spatial frequencies. Finally, we demonstrate that the type of inference engine used has a substantial effect on the absolute level of predicted performance. Indeed, the performance gap between an ideal observer with exact knowledge of the relevant signals and human observers is greatly reduced when the inference engine has to learn aspects of the visual task. ISETBio-derived estimates of stimulus representations at various stages along the visual pathway provide a powerful tool for computing the limits of human performance.

journal_name

J Vis

journal_title

Journal of vision

authors

Cottaris NP,Jiang H,Ding X,Wandell BA,Brainard DH

doi

10.1167/19.4.8

subject

Has Abstract

pub_date

2019-04-01 00:00:00

pages

8

issue

4

issn

1534-7362

pii

2730345

journal_volume

19

pub_type

杂志文章
  • Combining local and global limitations of visual search.

    abstract::There are different opinions about the roles of local interactions and central processing capacity in visual search. This study attempts to clarify the problem using a new version of relevant set cueing. A central precue indicates two symmetrical segments (that may contain a target object) within a circular array of o...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/17.4.10

    authors: Põder E

    更新日期:2017-04-01 00:00:00

  • Gaze behavior during 3-D face identification is depth cue invariant.

    abstract::Gaze behavior during scene and object recognition can highlight the relevant information for a task. For example, salience maps-highlighting regions that have heightened luminance, contrast, color, etc. in a scene-can be used to predict gaze targets. Certain tasks, such as face recognition, result in a typical pattern...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/17.2.9

    authors: Akhavein H,Farivar R

    更新日期:2017-02-01 00:00:00

  • Adaptation to conflicting visual and physical heading directions during walking.

    abstract::We investigated the role of global optic flow for visual-motor adaptation of walking direction. In an immersive virtual environment, observers walked to a circular target lying on either a homogeneous ground plane (target-motion condition) or a textured ground plane (ground-flow condition). During adaptation trials, w...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/11.3.15

    authors: Saunders JA,Durgin FH

    更新日期:2011-03-22 00:00:00

  • A matched comparison of binocular rivalry and depth perception with fMRI.

    abstract::Psychophysical experiments have demonstrated that it is possible to simultaneously perceive binocular depth and rivalry in plaids (A. Buckthought & H. R. Wilson, 2007). Here, we used fMRI at 3T to image activity in the visual cortex while human subjects perceived depth and rivalry from plaids. Six subjects performed e...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/11.6.3

    authors: Buckthought A,Mendola JD

    更新日期:2011-05-05 00:00:00

  • Comparison of contrast-response functions from multifocal visual-evoked potentials (mfVEPs) and functional MRI responses.

    abstract::Contrast response functions (CRFs) from multifocal visual-evoked potential (mfVEP) and BOLD fMRI responses were obtained using the same stimuli to test the hypothesis of a linear relationship between the mfVEP and BOLD fMRI responses. Monocular mfVEP and BOLD fMRI responses were obtained using an 8 degrees in diameter...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/8.10.8

    authors: Park JC,Zhang X,Ferrera J,Hirsch J,Hood DC

    更新日期:2008-10-22 00:00:00

  • Size scaling compensates for sensitivity loss produced by a simulated central scotoma in a shape-from-texture task.

    abstract::Studies of eccentricity-dependent sensitivity loss typically require participants to maintain fixation while making judgments about stimuli presented at a range of sizes and eccentricities. However, training participants to fixate can prove difficult, and as stimulus size increases, they become poorly localized and ma...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/10.12.18

    authors: Johnson A,Gurnsey R

    更新日期:2010-10-01 00:00:00

  • The detection of multiple global directions: capacity limits with spatially segregated and transparent-motion signals.

    abstract::An important constraint on motion processing is the maximum number of directions that can be perceived at the same time. When transparent-motion stimuli are constructed based solely on direction differences, prior studies demonstrate that no more than two directions are seen simultaneously. However, this limit has bee...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/9.1.40

    authors: Greenwood JA,Edwards M

    更新日期:2009-01-30 00:00:00

  • Nulling the motion aftereffect with dynamic random-dot stimuli: limitations and implications.

    abstract::We used biased random-dot dynamic test stimuli to measure the strength of the motion aftereffect (MAE) to evaluate the usefulness of this technique as a measure of motion adaptation strength. The stimuli consisted of noise dots whose individual directions were random and of signal dots moving in a unique direction. Al...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/2.4.3

    authors: Castet E,Keeble DR,Verstraten FA

    更新日期:2002-01-01 00:00:00

  • What makes cast shadows hard to see?

    abstract::Visual search is slowed for cast shadows lit from above, as compared to the same search items inverted and so not interpreted as shadows (R. A. Rensink & P. Cavanagh, 2004). The underlying mechanisms for such impaired shadow processing are still not understood. Here we investigated the processing levels at which this ...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/10.3.13

    authors: Porter G,Tales A,Leonards U

    更新日期:2010-03-29 00:00:00

  • A functional role for trans-saccadic luminance differences.

    abstract::In typical natural environments, the visual system receives different inputs in quick succession as gaze moves around. We examined whether local trans-saccadic differences in luminance, contrast, and orientation influenced perception and target selection in the eye movement system. Observers initially fixated a periph...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/12.13.14

    authors: Ludwig CJ,Davies JR,Gegenfurtner KR

    更新日期:2012-01-01 00:00:00

  • Limits of lightness identification for real objects under natural viewing conditions.

    abstract::We examined whether observers veridically perceive the reflectances of real objects under natural viewing conditions. A new forced-choice paradigm was used to measure observers' abilities to identify (not match) the reflectance of randomly crumpled gray papers across two levels of illumination, and also to simultaneou...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/4.9.9

    authors: Robilotto R,Zaidi Q

    更新日期:2004-09-15 00:00:00

  • Pupil responses to high-level image content.

    abstract::The link between arousal and pupil dilation is well studied, but it is less known that other cognitive processes can trigger pupil responses. Here we present evidence that pupil responses can be induced by high-level scene processing, independent of changes in low-level features or arousal. In Experiment 1, we recorde...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/13.6.7

    authors: Naber M,Nakayama K

    更新日期:2013-05-17 00:00:00

  • Rapid learning of visual ensembles.

    abstract::We recently demonstrated that observers are capable of encoding not only summary statistics, such as mean and variance of stimulus ensembles, but also the shape of the ensembles. Here, for the first time, we show the learning dynamics of this process, investigate the possible priors for the distribution shape, and dem...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/17.2.21

    authors: Chetverikov A,Campana G,Kristjánsson Á

    更新日期:2017-02-01 00:00:00

  • The effect of flankers on three tasks in central, peripheral, and amblyopic vision.

    abstract::Using identical stimuli and methods, we assessed the effects of flankers on three different tasks, orientation discrimination, contrast discrimination, and detection, in central, peripheral, and amblyopic vision. The goal was to understand the factors that limit performance of a task in the presence of flankers in eac...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/11.1.10

    authors: Levi DM,Carney T

    更新日期:2011-01-10 00:00:00

  • Effects of visual stimulus characteristics and individual differences in heading estimation.

    abstract::Visual heading estimation is subject to periodic patterns of constant (bias) and variable (noise) error. The nature of the errors, however, appears to differ between studies, showing underestimation in some, but overestimation in others. We investigated whether field of view (FOV), the availability of binocular dispar...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/18.11.9

    authors: de Winkel KN,Kurtz M,Bülthoff HH

    更新日期:2018-10-01 00:00:00

  • Individual differences in response precision correlate with adaptation bias.

    abstract::The internal representation of stimuli is imperfect and subject to bias. Noise introduced at initial encoding and during maintenance degrades the precision of representation. Stimulus estimation is also biased away from recently encountered stimuli, a phenomenon known as adaptation. Within a Bayesian framework, greate...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/18.13.18

    authors: Mattar MG,Carter MV,Zebrowitz MS,Thompson-Schill SL,Aguirre GK

    更新日期:2018-12-03 00:00:00

  • Short-term global motion adaptation induces a compression in the subjective duration of dynamic visual events.

    abstract::Apparent duration can be manipulated in a local region of visual field by long-term adaptation to motion or flicker (Johnston, Arnold, & Nishida, 2006). These effects show narrow spatial tuning (Ayhan, Bruno, Nishida, & Johnston, 2009), as well as retinotopic position dependency (Bruno, Ayhan, & Johnston, 2010), suppo...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/19.5.19

    authors: Gulhan D,Ayhan I

    更新日期:2019-05-01 00:00:00

  • Evaluating the correspondence between face-, scene-, and object-selectivity and retinotopic organization within lateral occipitotemporal cortex.

    abstract::The organization of human lateral occipitotemporal cortex (lOTC) has been characterized largely according to two distinct principles: retinotopy and category-selectivity. Whereas category-selective regions were originally thought to exist beyond retinotopic maps, recent evidence highlights overlap. Here, we combined d...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/16.6.14

    authors: Silson EH,Groen II,Kravitz DJ,Baker CI

    更新日期:2016-01-01 00:00:00

  • Effects of target typicality on categorical search.

    abstract::The role of target typicality in a categorical visual search task was investigated by cueing observers with a target name, followed by a five-item target present/absent search array in which the target images were rated in a pretest to be high, medium, or low in typicality with respect to the basic-level target cue. C...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/14.12.1

    authors: Maxfield JT,Stalder WD,Zelinsky GJ

    更新日期:2014-10-01 00:00:00

  • Perceived timing of new objects and feature changes.

    abstract::Recent psychophysical studies have shown that perceived timings of events can be dissociated from their physical temporal relationship. In the flash-lag effect (FLE), a flash presented at the same spatiotemporal position as a continuously moving stimulus is perceived to lag behind the moving stimulus. In the present s...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/9.7.5

    authors: Kanai R,Carlson TA,Verstraten FA,Walsh V

    更新日期:2009-07-09 00:00:00

  • Investigating cultural diversity for extrafoveal information use in visual scenes.

    abstract::Culture shapes how people gather information from the visual world. We recently showed that Western observers focus on the eyes region during face recognition, whereas Eastern observers fixate predominantly the center of faces, suggesting a more effective use of extrafoveal information for Easterners compared to Weste...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/10.6.21

    authors: Miellet S,Zhou X,He L,Rodger H,Caldara R

    更新日期:2010-06-01 00:00:00

  • Evidence for reciprocal antagonism between motion sensors tuned to coarse and fine features.

    abstract::Early visual processing analyses fine and coarse image features separately. Here we show that motion signals derived from fine and coarse analyses are combined in rather a surprising way: Coarse and fine motion sensors representing the same direction of motion inhibit one another and an imbalance can reverse the motio...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/7.12.8

    authors: Serrano-Pedraza I,Goddard P,Derrington AM

    更新日期:2007-09-20 00:00:00

  • Origin of the fast negative ERG component from isolated aspartate-treated mouse retina.

    abstract::The leading edge of the a-wave of the ERG is generally believed to accurately reflect the changes in the circulating current through the cGMP-gated channels in the outer segment plasma membrane of rods and cones. The aspartate-isolated mammalian electroretinogram (ERG) to a rod-saturating flash contains a fast "nose"-...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/9.12.9

    authors: Vinberg FJ,Strandman S,Koskelainen A

    更新日期:2009-11-17 00:00:00

  • Demand-based dynamic distribution of attention and monitoring of velocities during multiple-object tracking.

    abstract::The ability to track multiple moving objects with attention has been the focus of much research. However, the literature is relatively inconclusive regarding two key aspects of this ability, (1) whether the distribution of attention among the tracked targets is fixed during a period of tracking or is dynamically adjus...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/9.4.1

    authors: Iordanescu L,Grabowecky M,Suzuki S

    更新日期:2009-04-03 00:00:00

  • Perceptual insensitivity to higher-order statistical moments of coherent random dot motion.

    abstract::When the visual system analyzes distributed patterns of sensory inputs, what features of those distributions does it use? It has been previously demonstrated that higher-order statistical moments of luminance distributions influence perception of static surfaces and textures. Here, we tested whether the brain also rep...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/18.6.9

    authors: Waskom ML,Asfour J,Kiani R

    更新日期:2018-06-01 00:00:00

  • Probability and the changing shape of response distributions for orientation.

    abstract::Spatial attention and feature-based attention are regarded as two independent mechanisms for biasing the processing of sensory stimuli. Feature attention is held to be a spatially invariant mechanism that advantages a single feature per sensory dimension. In contrast to the prediction of location independence, I found...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/14.13.15

    authors: Anderson B

    更新日期:2014-11-18 00:00:00

  • Eye movements in repeated multiple object tracking.

    abstract::Contrary to other tasks (free viewing, recognition, visual search), participants often fail to recognize repetition of trials in multiple object tracking (MOT). This study examines the intra- and interindividual variability of eye movements in repeated MOT trials along with the adherence of eye movements to the previo...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/13.7.9

    authors: Lukavský J

    更新日期:2013-06-13 00:00:00

  • Is the world full of circles?

    abstract::The statistical arrangement of oriented segments in natural scenes was recently proposed to be indicative of a cocircularity rule. In particular, the probability density function of the relative position of two oriented segments was found to be maximal along fixed angles on the plane, consistent with the two segments ...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/2.8.4

    authors: Chow CC,Jin DZ,Treves A

    更新日期:2002-01-01 00:00:00

  • Precision of sustained fixation in trained and untrained observers.

    abstract::During visual fixation, microscopic eye movements shift the image on the retina over a large number of photoreceptors. Although these movements have been investigated for almost a century, the amount of retinal image motion they create remains unclear. Currently available estimates rely on assumptions about the probab...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/12.6.31

    authors: Cherici C,Kuang X,Poletti M,Rucci M

    更新日期:2012-06-22 00:00:00

  • Is the straddle effect in contrast perception limited to second-order spatial vision?

    abstract::Previous work on the straddle effect in contrast perception (Foley, 2011; Graham & Wolfson, 2007; Wolfson & Graham, 2007, 2009) has used visual patterns and observer tasks of the type known as spatially second-order. After adaptation of about 1 s to a grid of Gabor patches all at one contrast, a second-order test patt...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/18.5.15

    authors: Graham NV,Wolfson SS

    更新日期:2018-05-01 00:00:00