Sensory reliability shapes perceptual inference via two mechanisms.

Abstract:

:To obtain a coherent percept of the environment, the brain should integrate sensory signals from common sources and segregate those from independent sources. Recent research has demonstrated that humans integrate audiovisual information during spatial localization consistent with Bayesian Causal Inference (CI). However, the decision strategies that human observers employ for implicit and explicit CI remain unclear. Further, despite the key role of sensory reliability in multisensory integration, Bayesian CI has never been evaluated across a wide range of sensory reliabilities. This psychophysics study presented participants with spatially congruent and discrepant audiovisual signals at four levels of visual reliability. Participants localized the auditory signals (implicit CI) and judged whether auditory and visual signals came from common or independent sources (explicit CI). Our results demonstrate that humans employ model averaging as a decision strategy for implicit CI; they report an auditory spatial estimate that averages the spatial estimates under the two causal structures weighted by their posterior probabilities. Likewise, they explicitly infer a common source during the common-source judgment when the posterior probability for a common source exceeds a fixed threshold of 0.5. Critically, sensory reliability shapes multisensory integration in Bayesian CI via two distinct mechanisms: First, higher sensory reliability sensitizes humans to spatial disparity and thereby sharpens their multisensory integration window. Second, sensory reliability determines the relative signal weights in multisensory integration under the assumption of a common source. In conclusion, our results demonstrate that Bayesian CI is fundamental for integrating signals of variable reliabilities.

journal_name

J Vis

journal_title

Journal of vision

authors

Rohe T,Noppeney U

doi

10.1167/15.5.22

subject

Has Abstract

pub_date

2015-01-01 00:00:00

pages

22

issue

5

issn

1534-7362

pii

2288871

journal_volume

15

pub_type

杂志文章
  • Anticipatory grasping control modulates somatosensory perception.

    abstract::Somatosensory perception is hampered on the moving limb during a goal-directed movement. This somatosensory suppression is mostly attributed to a forward model that predicts future states of the system based on the established motor command. Here, we examined whether and how this suppression is modulated by the predic...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/19.5.4

    authors: Voudouris D,Broda MD,Fiehler K

    更新日期:2019-05-01 00:00:00

  • Asymmetry in the perception of motion in depth induced by moving cast shadows.

    abstract::An expanding object, which may represent an approaching motion, is easier to detect than a contracting one, which may represent a receding object. To confirm the generality of asymmetry in the detection of approaching and receding motions, we focused on the perception of apparent motion in depth created by moving cast...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/8.13.10

    authors: Imura T,Shirai N,Tomonaga M,Yamaguchi MK,Yagi A

    更新日期:2008-10-31 00:00:00

  • Insufficient compensation for self-motion during perception of object speed: The vestibular Aubert-Fleischl phenomenon.

    abstract::To estimate object speed with respect to the self, retinal signals must be summed with extraretinal signals that encode the speed of eye and head movement. Prior work has shown that differences in perceptual estimates of object speed based on retinal and oculomotor signals lead to biased percepts such as the Aubert-Fl...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/18.13.9

    authors: Garzorz IT,Freeman TCA,Ernst MO,MacNeilage PR

    更新日期:2018-12-03 00:00:00

  • Region grouping in natural foliage scenes: image statistics and human performance.

    abstract::This study investigated the mechanisms of grouping and segregation in natural scenes of close-up foliage, an important class of scenes for human and non-human primates. Close-up foliage images were collected with a digital camera calibrated to match the responses of human L, M, and S cones at each pixel. The images we...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/10.4.10

    authors: Ing AD,Wilson JA,Geisler WS

    更新日期:2010-04-27 00:00:00

  • Luminance cues constrain chromatic blur discrimination in natural scene stimuli.

    abstract::Introducing blur into the color components of a natural scene has very little effect on its percept, whereas blur introduced into the luminance component is very noticeable. Here we quantify the dominance of luminance information in blur detection and examine a number of potential causes. We show that the interaction ...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/13.4.14

    authors: Sharman RJ,McGraw PV,Peirce JW

    更新日期:2013-03-22 00:00:00

  • Abnormality in face scanning by children with autism spectrum disorder is limited to the eye region: evidence from multi-method analyses of eye tracking data.

    abstract::There has been considerable controversy regarding whether children with autism spectrum disorder (ASD) and typically developing children (TD) show different eye movement patterns when processing faces. We investigated ASD and age- and IQ-matched TD children's scanning of faces using a novel multi-method approach. We f...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/13.10.5

    authors: Yi L,Fan Y,Quinn PC,Feng C,Huang D,Li J,Mao G,Lee K

    更新日期:2013-08-08 00:00:00

  • Distinguishing influences of overt and covert attention in anticipatory attentional target tracking.

    abstract::This study investigated the relative contributions of overt and covert attention on the apparent anticipatory nature of attention in two experiments, using two different object tracking tasks, both combined with a probe detection task. In Experiment 1, we investigated the distribution of attention for overtly and cove...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/17.4.3

    authors: Frielink-Loing AF,Koning A,van Lier R

    更新日期:2017-04-01 00:00:00

  • A neurophysiologically plausible population code model for human contrast discrimination.

    abstract::The pedestal effect is the improvement in the detectability of a sinusoidal grating in the presence of another grating of the same orientation, spatial frequency, and phase-usually called the pedestal. Recent evidence has demonstrated that the pedestal effect is differently modified by spectrally flat and notch-filter...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/9.7.15

    authors: Goris RL,Wichmann FA,Henning GB

    更新日期:2009-07-31 00:00:00

  • A role for incidental auditory learning in auditory-visual word learning among kindergarten children.

    abstract::This study focused on the potential role of incidental, auditory perceptual learning in among children learning new words. To this end, we examined how irrelevant auditory similarities across words, that provide no cues regarding their visual or conceptual attributes, influence pseudo-word learning in a name/picture m...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/jovi.20.3.4

    authors: Banai K,Nir B,Moav-Scheff R,Bar-Ziv N

    更新日期:2020-03-17 00:00:00

  • Integrating audiovisual information for the control of overt attention.

    abstract::In everyday life, our brains decide about the relevance of huge amounts of sensory input. Further complicating this situation, this input is distributed over different modalities. This raises the question of how different sources of information interact for the control of overt attention during free exploration of the...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/7.10.11

    authors: Onat S,Libertus K,König P

    更新日期:2007-07-25 00:00:00

  • Interactions between luminance and color signals: effects on shape.

    abstract::Although luminance and color are thought to be processed independently at early stages of visual processing, there is evidence that they interact at later stages. For example, chromatic information has been shown to enhance or suppress depth from luminance depending on whether chromatic edges are aligned or orthogonal...

    journal_title:Journal of vision

    pub_type: 杂志文章,评审

    doi:10.1167/13.5.16

    authors: Clery S,Bloj M,Harris JM

    更新日期:2013-04-18 00:00:00

  • Tuning for temporal interval in human apparent motion detection.

    abstract::Detection of apparent motion in random dot patterns requires correlation across time and space. It has been difficult to study the temporal requirements for the correlation step because motion detection also depends on temporal filtering preceding correlation and on integration at the next levels. To specifically stud...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/7.1.2

    authors: Bours RJ,Stuur S,Lankheet MJ

    更新日期:2007-01-08 00:00:00

  • Contrast summation across eyes and space is revealed along the entire dipper function by a "Swiss cheese" stimulus.

    abstract::Previous contrast discrimination experiments have shown that luminance contrast is summed across ocular (T. S. Meese, M. A. Georgeson, & D. H. Baker, 2006) and spatial (T. S. Meese & R. J. Summers, 2007) dimensions at threshold and above. However, is this process sufficiently general to operate across the conjunction ...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/11.1.23

    authors: Meese TS,Baker DH

    更新日期:2011-01-27 00:00:00

  • Neural correlates of object-based attention.

    abstract::Much research has been directed toward disentangling the "units" of attention: Is attention directed to locations in space, visual objects, or to individual features of an object? Moreover, there is considerable interest in whether attention increases the gain of neural mechanisms (signal enhancement) or acts by other...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/2.9.1

    authors: Pei F,Pettet MW,Norcia AM

    更新日期:2002-01-01 00:00:00

  • Guidance toward and away from distractors in repeated visual search.

    abstract::When searching for two targets consecutively in the same display, participants use memory of recently fixated distractors that become the target in the second search to find that target more quickly. Here we ask whether participants are also using memory for fixated distractors that do not become the target. In Experi...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/15.5.12

    authors: Höfler M,Gilchrist ID,Körner C

    更新日期:2015-01-01 00:00:00

  • Ultra-rapid categorization requires visual attention: Scenes with multiple foreground objects.

    abstract::Human observers can determine whether natural scenes contain an animal or not on the basis of as little as 20 ms viewing; a phenomenon termed ultra-rapid categorization (URC). Recent studies have suggested that URC is unimpaired even when attention resources are concurrently devoted to a second task. This apparent ind...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/8.4.21

    authors: Walker S,Stafford P,Davis G

    更新日期:2008-04-23 00:00:00

  • Visual search for transparency and opacity: attentional guidance by cue combination?

    abstract::A series of seven experiments explored search for opaque targets among transparent distractors or vice versa. Static stimuli produced very inefficient search. With moving items, search for an opaque target among transparent distractors was quite efficient while search for transparent targets was less efficient (Experi...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/5.3.9

    authors: Wolfe JM,Birnkrant RS,Kunar MA,Horowitz TS

    更新日期:2005-03-30 00:00:00

  • Cue combination on the circle and the sphere.

    abstract::Bayesian cue combination models have been used to examine how human observers combine information from several cues to form estimates of linear quantities like depth. Here we develop an analogous theory for circular quantities like planar direction. The circular theory is broadly similar to the linear theory but diffe...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/10.11.15

    authors: Murray RF,Morgenstern Y

    更新日期:2010-09-01 00:00:00

  • Attention modulates neuronal correlates of interhemispheric integration and global motion perception.

    abstract::In early retinotopic areas of the human visual system, information from the left and right visual hemifields (VHFs) is processed contralaterally in two hemispheres. Despite this segregation, we have the perceptual experience of a unified, coherent, and uninterrupted single visual field. How exactly the visual system i...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/14.12.30

    authors: Akin B,Ozdem C,Eroglu S,Keskin DT,Fang F,Doerschner K,Kersten D,Boyaci H

    更新日期:2014-10-27 00:00:00

  • Adaptation to conflicting visual and physical heading directions during walking.

    abstract::We investigated the role of global optic flow for visual-motor adaptation of walking direction. In an immersive virtual environment, observers walked to a circular target lying on either a homogeneous ground plane (target-motion condition) or a textured ground plane (ground-flow condition). During adaptation trials, w...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/11.3.15

    authors: Saunders JA,Durgin FH

    更新日期:2011-03-22 00:00:00

  • Robust object-based encoding in visual working memory.

    abstract::Recently, researchers have begun to investigate how nonspatial perceptual information is extracted into visual working memory (VWM), focusing particularly on object-based encoding (OBE). That is, whenever even one feature-dimension is selected for entry into VWM, the others are also extracted automatically. While ther...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/13.2.1

    authors: Shen M,Tang N,Wu F,Shui R,Gao Z

    更新日期:2013-02-01 00:00:00

  • What makes cast shadows hard to see?

    abstract::Visual search is slowed for cast shadows lit from above, as compared to the same search items inverted and so not interpreted as shadows (R. A. Rensink & P. Cavanagh, 2004). The underlying mechanisms for such impaired shadow processing are still not understood. Here we investigated the processing levels at which this ...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/10.3.13

    authors: Porter G,Tales A,Leonards U

    更新日期:2010-03-29 00:00:00

  • Higher order image structure enables boundary segmentation in the absence of luminance or contrast cues.

    abstract::Lower order image statistics, which can be described by an image's Fourier energy content, enable segmentation when they are different on either side of a boundary. We have previously demonstrated that the spatial distribution of the energy in an image (described by its higher order statistics or structure) could infl...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/14.4.14

    authors: Zavitz E,Baker CL Jr

    更新日期:2014-01-01 00:00:00

  • Contrast-response functions for multifocal visual evoked potentials: a test of a model relating V1 activity to multifocal visual evoked potentials activity.

    abstract::The multifocal visual evoked potential (mfVEP) is largely generated in V1. To relate the electrical activity recorded from humans to recordings from single cells in nonhuman primate (V1) cortex, contrast-response functions for the human mfVEP were compared to predictions from a model of V1 activity (D. J. Heeger, A. C...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/6.5.4

    authors: Hood DC,Ghadiali Q,Zhang JC,Graham NV,Wolfson SS,Zhang X

    更新日期:2006-04-24 00:00:00

  • Necker cube: stimulus-related (low-level) and percept-related (high-level) EEG signatures early in occipital cortex.

    abstract::During observation of an ambiguous Necker cube, our percept changes spontaneously although the external stimulus does not. An EEG paradigm allowing time-resolved EEG measurement during endogenous perceptual reversals recently revealed a chain of ERP correlates beginning with an early occipital positivity at around 130...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/11.9.12

    authors: Kornmeier J,Pfäffle M,Bach M

    更新日期:2011-08-24 00:00:00

  • Feature-based attention modulates surround suppression.

    abstract::Stimuli appearing in the surround of the classical receptive field (CRF) can reduce neuronal firing and perceived contrast of a preferred stimulus in the CRF, a phenomenon referred to as surround suppression. Suppression is greatest when the surrounding stimulus has the same orientation and spatial frequency (SF) as t...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/15.1.29

    authors: Flevaris AV,Murray SO

    更新日期:2015-01-28 00:00:00

  • Understanding rapid category detection via multiply degraded images.

    abstract::Rapid category detection, as discovered by S. Thorpe, D. Fize, and C. Marlot (1996), demonstrated that the human visual system can detect object categories in natural images in as little as 150 ms. To gain insight into this phenomenon and to determine its relevance to naturally occurring conditions, we degrade the sti...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/9.6.19

    authors: Nandakumar C,Malik J

    更新日期:2009-06-29 00:00:00

  • Rapid and accurate processing of multiple objects in briefly presented scenes.

    abstract::Humans can detect multiple objects in briefly presented natural visual scenes, but the mechanisms through which the objects are segmented from the background and consciously accessed remain open. By asking participants to report how many humans natural photos presented for 50 ms contain, we show that up to three items...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/16.3.8

    authors: Railo H,Karhu VM,Mast J,Pesonen H,Koivisto M

    更新日期:2016-01-01 00:00:00

  • Cross-orientation masking is speed invariant between ocular pathways but speed dependent within them.

    abstract::In human (D. H. Baker, T. S. Meese, & R. J. Summers, 2007b) and in cat (B. Li, M. R. Peterson, J. K. Thompson, T. Duong, & R. D. Freeman, 2005; F. Sengpiel & V. Vorobyov, 2005) there are at least two routes to cross-orientation suppression (XOS): a broadband, non-adaptable, monocular (within-eye) pathway and a more na...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/9.5.2

    authors: Meese TS,Baker DH

    更新日期:2009-05-04 00:00:00

  • Distinct temporal mechanisms modulate numerosity perception.

    abstract::Our ability to process numerical and temporal information is an evolutionary skill thought to originate from a common magnitude system. In line with a common magnitude system, we have previously shown that adaptation to duration alters numerosity perception. Here, we investigate two hypotheses on how duration influenc...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/19.6.19

    authors: Tsouli A,van der Smagt MJ,Dumoulin SO,Pas SFT

    更新日期:2019-06-03 00:00:00