Human sensitivity to perturbations constrained by a model of the natural image manifold.

Abstract:

:Humans are remarkably well tuned to the statistical properties of natural images. However, quantitative characterization of processing within the domain of natural images has been difficult because most parametric manipulations of a natural image make that image appear less natural. We used generative adversarial networks (GANs) to constrain parametric manipulations to remain within an approximation of the manifold of natural images. In the first experiment, seven observers decided which one of two synthetic perturbed images matched a synthetic unperturbed comparison image. Observers were significantly more sensitive to perturbations that were constrained to an approximate manifold of natural images than they were to perturbations applied directly in pixel space. Trial-by-trial errors were consistent with the idea that these perturbations disrupt configural aspects of visual structure used in image segmentation. In a second experiment, five observers discriminated paths along the image manifold as recovered by the GAN. Observers were remarkably good at this task, confirming that observers are tuned to fairly detailed properties of an approximate manifold of natural images. We conclude that human tuning to natural images is more general than detecting deviations from natural appearance, and that humans have, to some extent, access to detailed interrelations between natural images.

journal_name

J Vis

journal_title

Journal of vision

authors

Fruend I,Stalker E

doi

10.1167/18.11.20

subject

Has Abstract

pub_date

2018-10-01 00:00:00

pages

20

issue

11

issn

1534-7362

pii

2712331

journal_volume

18

pub_type

杂志文章
  • Evaluating the correspondence between face-, scene-, and object-selectivity and retinotopic organization within lateral occipitotemporal cortex.

    abstract::The organization of human lateral occipitotemporal cortex (lOTC) has been characterized largely according to two distinct principles: retinotopy and category-selectivity. Whereas category-selective regions were originally thought to exist beyond retinotopic maps, recent evidence highlights overlap. Here, we combined d...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/16.6.14

    authors: Silson EH,Groen II,Kravitz DJ,Baker CI

    更新日期:2016-01-01 00:00:00

  • Action priming suppression by forward masks.

    abstract::Visual stimuli may produce strong and reliable effects on subsequent actions irrespective of their visibility. This dissociation between action priming and conscious perception of the stimuli suggests two ways of processing of visual stimuli. One way of processing leads to the emergence of conscious visual perception,...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/19.5.10

    authors: Becker N,Mattler U

    更新日期:2019-05-01 00:00:00

  • Coding of identity-diagnostic information in transsaccadic object perception.

    abstract::In four experiments, we examined the hypothesis that a presaccadic extrafoveal preview of an object normally affects subsequent postsaccadic foveal processing of the object. On each trial, viewers inspected an array of three objects and were instructed to remember one object characteristic (in-depth orientation, image...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/8.14.29

    authors: Van Eccelpoel C,Germeys F,De Graef P,Verfaillie K

    更新日期:2008-12-30 00:00:00

  • The classical TDT perceptual learning is mostly temporal learning.

    abstract::The seminal study on perceptual learning of TDT (a texture discrimination task) has greatly shaped the field of perceptual learning up to the present time. However, here we demonstrate that this classic learning mostly involves temporal learning, rather than texture discrimination learning. Specifically, observers fir...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/13.5.9

    authors: Wang R,Cong LJ,Yu C

    更新日期:2013-04-12 00:00:00

  • Inhibition of target detection in apparent motion trajectory.

    abstract::Letter discrimination performance is degraded when a letter is presented within an apparent motion (AM) trajectory of a spot. This finding suggests that the internal representation of AM stimuli can perceptually interact with other stimuli. In this study, we demonstrated that AM interference could also occur for patte...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/11.10.2

    authors: Hidaka S,Nagai M,Sekuler AB,Bennett PJ,Gyoba J

    更新日期:2011-09-07 00:00:00

  • The effects of smooth occlusions and directions of illumination on the visual perception of 3-D shape from shading.

    abstract::Human observers made local orientation judgments of smoothly shaded surfaces illuminated from different directions by large area lights, both with and without visible smooth occlusion contours. Test-retest correlations between the first and second halves of the experiment revealed that observers' judgments were highly...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/15.2.24

    authors: Egan EJ,Todd JT

    更新日期:2015-02-24 00:00:00

  • Effects of target typicality on categorical search.

    abstract::The role of target typicality in a categorical visual search task was investigated by cueing observers with a target name, followed by a five-item target present/absent search array in which the target images were rated in a pretest to be high, medium, or low in typicality with respect to the basic-level target cue. C...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/14.12.1

    authors: Maxfield JT,Stalder WD,Zelinsky GJ

    更新日期:2014-10-01 00:00:00

  • Gaze categorization under uncertainty: psychophysics and modeling.

    abstract::The accurate perception of another person's gaze direction underlies most social interactions and provides important information about his or her future intentions. As a first step to measuring gaze perception, most experiments determine the range of gaze directions that observers judge as being direct: the cone of di...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/13.5.18

    authors: Mareschal I,Calder AJ,Dadds MR,Clifford CW

    更新日期:2013-04-22 00:00:00

  • Switching between visuomotor mappings: learning absolute mappings or relative shifts.

    abstract::Adaptation to specific visuomotor mappings becomes faster when switching back and forth between them. What is learned when repeatedly switching between the visuomotor mappings: the absolute mappings or the relative shift between the mappings? To test this, we trained participants in a rapid pointing task using a uniqu...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/13.2.26

    authors: van Dam LC,Hawellek DJ,Ernst MO

    更新日期:2013-01-01 00:00:00

  • Contributions of gaze-centered and object-centered coding in a double-step saccade task.

    abstract::The position of a saccade target can be encoded in gaze-centered coordinates, that is, relative to the current gaze position, or in object-centered coordinates, that is, relative to an object in the environment. We tested the role of gaze-centered and object-centered coding in a double-step saccade task involving the ...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/16.14.12

    authors: de Brouwer AJ,Medendorp WP,Smeets JB

    更新日期:2016-11-01 00:00:00

  • The detection of multiple global directions: capacity limits with spatially segregated and transparent-motion signals.

    abstract::An important constraint on motion processing is the maximum number of directions that can be perceived at the same time. When transparent-motion stimuli are constructed based solely on direction differences, prior studies demonstrate that no more than two directions are seen simultaneously. However, this limit has bee...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/9.1.40

    authors: Greenwood JA,Edwards M

    更新日期:2009-01-30 00:00:00

  • The motion-induced shift in the perceived location of a grating also shifts its aftereffect.

    abstract::Motion can bias the perceived location of a stationary stimulus (Whitney & Cavanagh, 2000), but whether this occurs at a high level of representation or at early, retinotopic stages of visual processing remains an open question. As coding of orientation emerges early in visual processing, we tested whether motion coul...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/12.8.7

    authors: Kosovicheva AA,Maus GW,Anstis S,Cavanagh P,Tse PU,Whitney D

    更新日期:2012-01-01 00:00:00

  • Global attention facilitates the planning, but not execution of goal-directed reaches.

    abstract::In daily life, humans interact with multiple objects in complex environments. A large body of literature demonstrates that target selection is biased toward recently attended features, such that reaches are faster and trajectory curvature is reduced when target features (i.e., color) are repeated (priming of pop-out)....

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/16.9.7

    authors: McCarthy JD,Song JH

    更新日期:2016-07-01 00:00:00

  • Simulating prosthetic vision: Optimizing the information content of a limited visual display.

    abstract::Visual prostheses for the restoration of functional vision are currently under development. To guide prosthesis research and allow for an accurate prognosis of functional gain, simulating the experience of a retinal prosthesis in healthy individuals is desirable. Current simulation paradigms lack crucial aspects of th...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/10.14.32

    authors: van Rheede JJ,Kennard C,Hicks SL

    更新日期:2010-12-29 00:00:00

  • Human trimodal perception follows optimal statistical inference.

    abstract::Our nervous system typically processes signals from multiple sensory modalities at any given moment and is therefore posed with two important problems: which of the signals are caused by a common event, and how to combine those signals. We investigated human perception in the presence of auditory, visual, and tactile ...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/8.3.24

    authors: Wozny DR,Beierholm UR,Shams L

    更新日期:2008-03-27 00:00:00

  • Updating visual working memory in the change detection paradigm.

    abstract::An updating version of a visual change detection paradigm was used to investigate the behavioral outcomes and event-related potential (ERP) correlates of visual working memory updating. In each trial, participants were either presented with a memory array followed by a test probe, or with two successive memory arrays....

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/15.9.18

    authors: Kessler Y,Rac-Lubashevsky R,Lichtstein C,Markus H,Simchon A,Moscovitch M

    更新日期:2015-01-01 00:00:00

  • Suppressive and facilitatory spatial interactions in peripheral vision: peripheral crowding is neither size invariant nor simple contrast masking.

    abstract::Peripheral vision is characterized by reduced spatial resolution and inhibitory spatial interactions that extend over long distances. This work had three goals. (1) We considered whether the extensive crowding in peripheral vision is a consequence of a shift in the spatial scale of analysis. To test this, using a larg...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/2.2.3

    authors: Levi DM,Hariharan S,Klein SA

    更新日期:2002-01-01 00:00:00

  • Evaluation of an organic light-emitting diode display for precise visual stimulation.

    abstract::A new type of visual display for presentation of a visual stimulus with high quality was assessed. The characteristics of an organic light-emitting diode (OLED) display (Sony PVM-2541, 24.5 in.; Sony Corporation, Tokyo, Japan) were measured in detail from the viewpoint of its applicability to visual psychophysics. We ...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/13.7.6

    authors: Ito H,Ogawa M,Sunaga S

    更新日期:2013-06-11 00:00:00

  • Methods for determining equiluminance in terms of L/M cone ratios.

    abstract::Heterochromatic flicker photometry (HFP), minimum motion (MM), and minimally distinct border (MDB) settings have often been used to determine equiluminance, a relative intensity setting for two chromaticities that, in theory, eliminates the responses of a luminance or achromatic psychophysical mechanism. These setting...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/jov.20.4.22

    authors: He J,Taveras Cruz Y,Eskew RT Jr

    更新日期:2020-04-09 00:00:00

  • Dynamic information for the recognition of conversational expressions.

    abstract::Communication is critical for normal, everyday life. During a conversation, information is conveyed in a number of ways, including through body, head, and facial changes. While much research has examined these latter forms of communication, the majority of it has focused on static representations of a few, supposedly ...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/9.13.7

    authors: Cunningham DW,Wallraven C

    更新日期:2009-12-07 00:00:00

  • Transfer in motion discrimination learning was no greater in double training than in single training.

    abstract::We investigated the controversy regarding double training in motion discrimination learning. We collected data from 43 participants in a motion direction discrimination learning task with either double training (i.e., training plus exposure) or single training (i.e., no exposure). By pooling these data with those in t...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/17.6.7

    authors: Huang J,Liang J,Zhou Y,Liu Z

    更新日期:2017-06-01 00:00:00

  • Sequential perceptual learning of letter identification and "uncrowding" in normal peripheral vision: Effects of task, training order, and cholinergic enhancement.

    abstract::Human adults with normal vision are capable of improving performance on visual tasks through repeated practice. Previous work has shown that enhancing synaptic levels of acetylcholine (ACh) in healthy human adults with donepezil (trade name: Aricept) can increase the magnitude and specificity of perceptual learning (P...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/jov.20.4.24

    authors: Levi DM,Li RW,Silver MA,Chung STL

    更新日期:2020-04-09 00:00:00

  • Differential effects of visual attention and working memory on binocular rivalry.

    abstract::The investigation of cognitive influence on binocular rivalry has a long history. However, the effects of visual WM on rivalry have never been studied so far. We examined top-down modulation of rivalry perception in four experiments to compare the effects of visual WM and sustained selective attention: In the first th...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/14.5.13

    authors: Scocchia L,Valsecchi M,Gegenfurtner KR,Triesch J

    更新日期:2014-05-30 00:00:00

  • Integrated global motion influences smooth pursuit in infants.

    abstract::Smooth pursuit eye movements (SP) were studied in 5- and 9-month-old infants and adults in response to a rhombus oscillating horizontally behind three spatially separated vertical occluders. During motion, the rhombus vertices were never visible. Thus the perception of the global motion of the rhombus required integra...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/8.11.16

    authors: Kochukhova O,Rosander K

    更新日期:2008-08-22 00:00:00

  • Systematic distortions of perceived planar surface motion in active vision.

    abstract::Recent studies suggest that the active observer combines optic flow information with extra-retinal signals resulting from head motion. Such a combination allows, in principle, a correct discrimination of the presence or absence of surface rotation. In Experiments 1 and 2, observers were asked to perform such discrimin...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/10.5.12

    authors: Fantoni C,Caudek C,Domini F

    更新日期:2010-05-01 00:00:00

  • Optimal observer model of single-fixation oddity search predicts a shallow set-size function.

    abstract::A common finding in oddity search, a search in which the target is unknown but defined to be different from the distractors, is that human performance remains insensitive or even improves with number of distractors (set size). A number of explanations based on perceptual and attentional mechanisms have been proposed t...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/7.10.1

    authors: Schoonveld W,Shimozaki SS,Eckstein MP

    更新日期:2007-07-06 00:00:00

  • Visual search: the role of peripheral information measured using gaze-contingent displays.

    abstract::Two of the factors limiting progress in understanding the mechanisms of visual search are the difficulty of controlling and manipulating the retinal stimulus when the eyes are free to move and the lack of an ideal observer theory for fixation selection during search. Recently, we developed a method to precisely contro...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/6.9.1

    authors: Geisler WS,Perry JS,Najemnik J

    更新日期:2006-08-03 00:00:00

  • Monitoring mouse retinal degeneration with high-resolution spectral-domain optical coherence tomography.

    abstract::Progression of retinal degeneration in a mouse model was studied in vivo with high-resolution spectral-domain optical coherence tomography (SD-OCT). Imaging in 3D with high depth resolution (<3 mum), SD-OCT resolved all the major layers of the retina of control C57BL/6J mice. Images of transgenic mice having a null mu...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/8.1.17

    authors: Kim KH,Puoris'haag M,Maguluri GN,Umino Y,Cusato K,Barlow RB,de Boer JF

    更新日期:2008-01-24 00:00:00

  • Lateral visual occlusion does not change walking trajectories.

    abstract::Difficulties with walking are often reported following brain damage that causes a lateralized loss of awareness on one side. Whether lateralized loss of awareness has a direct causal impact on walking is unknown. A review of the literature on visually guided walking suggests several reasons why a lateralized loss of v...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/18.9.11

    authors: Dunn MJ,Rushton SK

    更新日期:2018-09-04 00:00:00

  • Attention enhances contrast appearance via increased input baseline of neural responses.

    abstract::Covert spatial attention increases the perceived contrast of stimuli at attended locations, presumably via enhancement of visual neural responses. However, the relation between perceived contrast and the underlying neural responses has not been characterized. In this study, we systematically varied stimulus contrast, ...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/14.14.16

    authors: Cutrone EK,Heeger DJ,Carrasco M

    更新日期:2014-12-30 00:00:00