Human trimodal perception follows optimal statistical inference.

Abstract:

:Our nervous system typically processes signals from multiple sensory modalities at any given moment and is therefore posed with two important problems: which of the signals are caused by a common event, and how to combine those signals. We investigated human perception in the presence of auditory, visual, and tactile stimulation in a numerosity judgment task. Observers were presented with stimuli in one, two, or three modalities simultaneously and were asked to report their percepts in each modality. The degree of congruency between the modalities varied across trials. For example, a single flash was paired in some trials with two beeps and two taps. Cross-modal illusions were observed in most conditions in which there was incongruence among the two or three stimuli, revealing robust interactions among the three modalities in all directions. The observers' bimodal and trimodal percepts were remarkably consistent with a Bayes-optimal strategy of combining the evidence in each modality with the prior probability of the events. These findings provide evidence that the combination of sensory information among three modalities follows optimal statistical inference for the entire spectrum of conditions.

journal_name

J Vis

journal_title

Journal of vision

authors

Wozny DR,Beierholm UR,Shams L

doi

10.1167/8.3.24

subject

Has Abstract

pub_date

2008-03-27 00:00:00

pages

24.1-11

issue

3

issn

1534-7362

pii

8/3/24

journal_volume

8

pub_type

杂志文章
  • Effect of pattern complexity on the visual span for Chinese and alphabet characters.

    abstract::The visual span for reading is the number of letters that can be recognized without moving the eyes and is hypothesized to impose a sensory limitation on reading speed. Factors affecting the size of the visual span have been studied using alphabet letters. There may be common constraints applying to recognition of oth...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/14.8.6

    authors: Wang H,He X,Legge GE

    更新日期:2014-07-03 00:00:00

  • Effects of scene inversion on change detection of targets matched for visual salience.

    abstract::This work examines how context may influence the detection of changes in flickering scenes. Each scene contained two changes that were matched for low-level visual salience. One of the changes was of high interest to the meaning of the scene, and the other was of lower interest. High-interest changes were more readily...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/3.1.1

    authors: Kelley TA,Chun MM,Chua KP

    更新日期:2003-01-01 00:00:00

  • Future path and tangent point models in the visual control of locomotion in curve driving.

    abstract::Studying human behavior in the natural context of everyday visual tasks--including locomotor tasks such as driving--can reveal visual strategies or even suggest underlying visual mechanisms. This paper reviews empirical and theoretical work in the past 20 years (1994-2014) on the visual control of steering a vehicle a...

    journal_title:Journal of vision

    pub_type: 杂志文章,评审

    doi:10.1167/14.12.21

    authors: Lappi O

    更新日期:2014-10-21 00:00:00

  • Impacts of older age on the temporal properties of collinear facilitation.

    abstract::Collinear facilitation is a visual phenomenon by which the contrast detection threshold of a central target is reduced (facilitation) when placed equidistant between two high-contrast flankers. The neural mechanisms underpinning this phenomenon originate from feed-forward lateral facilitation between cell layers in V1...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/19.14.5

    authors: Chan YM,Brooks CJ,McKendrick AM

    更新日期:2019-12-02 00:00:00

  • Attention changes perceived size of moving visual patterns.

    abstract::Spatial attention shifts receptive fields in monkey extrastriate visual cortex toward the focus of attention (S. Ben Hamed, J. R. Duhamel, F. Bremmer, & W. Graf, 2002; C. E. Connor, J. L. Gallant, D. C. Preddie, & D. C. Van Essen, 1996; C. E. Connor, D. C. Preddie, J. L. Gallant, & D. C. Van Essen, 1997; T. Womelsdorf...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/7.11.5

    authors: Anton-Erxleben K,Henrich C,Treue S

    更新日期:2007-08-23 00:00:00

  • Uncovering gender discrimination cues in a realistic setting.

    abstract::Which face cues do we use for gender discrimination? Few studies have tried to answer this question and the few that have tried typically used only a small set of grayscale stimuli, often distorted and presented a large number of times. Here, we reassessed the importance of facial cues for gender discrimination in a m...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/9.2.10

    authors: Dupuis-Roy N,Fortin I,Fiset D,Gosselin F

    更新日期:2009-02-10 00:00:00

  • Both parallelism and orthogonality are used to perceive 3D slant of rectangles from 2D images.

    abstract::A 2D perspective image of a slanted rectangular object is sufficient for a strong 3D percept. Two computational assumptions that could be used to interpret 3D from images of rectangles are as follows: (1) converging lines in an image are parallel in the world, and (2) skewed angles in an image are orthogonal in the wo...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/7.6.7

    authors: Saunders JA,Backus BT

    更新日期:2007-04-13 00:00:00

  • Optimal stimulus encoders for natural tasks.

    abstract::Determining the features of natural stimuli that are most useful for specific natural tasks is critical for understanding perceptual systems. A new approach is described that involves finding the optimal encoder for the natural task of interest, given a relatively small population of noisy "neurons" between the encode...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/9.13.17

    authors: Geisler WS,Najemnik J,Ing AD

    更新日期:2009-12-16 00:00:00

  • Planning multiple movements within a fixed time limit: the cost of constrained time allocation in a visuo-motor task.

    abstract::S.-W. Wu, M. F. Dal Martello, and L. T. Maloney (2009) evaluated subjects' performance in a visuo-motor task where subjects were asked to hit two targets in sequence within a fixed time limit. Hitting targets earned rewards and Wu et al. varied rewards associated with targets. They found that subjects failed to maximi...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/10.6.1

    authors: Zhang H,Wu SW,Maloney LT

    更新日期:2010-06-01 00:00:00

  • Similar effects of repetitive transcranial magnetic stimulation of MT+ and a dorsomedial extrastriate site including V3A on pattern detection and position discrimination of rotating and radial motion patterns.

    abstract::Our recent psychophysical experiments have identified differences in the spatial summation characteristics of pattern detection and position discrimination tasks performed with rotating, expanding, and contracting stimuli. Areas MT and MST are well established to be involved in processing these stimuli. fMRI results h...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/10.5.21

    authors: Harvey BM,Braddick OJ,Cowey A

    更新日期:2010-05-01 00:00:00

  • Foveal to peripheral extrapolation of brightness within objects.

    abstract::Peripheral viewing is characterized by poor resolution and distortions as compared to central viewing; nevertheless, when we move our gaze around, the visual scene does not appear to change. One possible mechanism leading to perceptual uniformity would be that peripheral appearance is extrapolated based on foveal info...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/17.9.14

    authors: Toscani M,Gegenfurtner KR,Valsecchi M

    更新日期:2017-08-01 00:00:00

  • Speeded classification in simultaneous masking.

    abstract::In simultaneous masking, flanking elements impair performance on a visual target. Previous studies on simultaneous masking have predominantly used discrimination threshold estimation to quantify performance on the target. Results based on thresholds suggest that an important factor in simultaneous masking is the stren...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/14.6.6

    authors: Hermens F,Bell A

    更新日期:2014-10-27 00:00:00

  • Silent-substitution stimuli silence the light responses of cones but not their output.

    abstract::Chromatic vision starts at the retinal photoreceptors but photoreceptors are themselves color-blind, responding only to their effective quantal catch and not to the wavelength of the caught photon per se. Mitchell and Rushton (1971) termed this phenomenon the univariance concept, and it is widely used in designing sil...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/19.5.14

    authors: Kamar S,Howlett MHC,Kamermans M

    更新日期:2019-05-01 00:00:00

  • Serial dependence in the perception of visual variance.

    abstract::The recent history of perceptual experience has been shown to influence subsequent perception. Classically, this dependence on perceptual history has been examined in sensory-adaptation paradigms, wherein prolonged exposure to a particular stimulus (e.g., a vertically oriented grating) produces changes in perception o...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/18.7.4

    authors: Suárez-Pinilla M,Seth AK,Roseboom W

    更新日期:2018-07-02 00:00:00

  • The face-in-the-crowd effect: when angry faces are just cross(es).

    abstract::A common theme running through much of the visual recognition literature is that faces are special. Many studies now describe evidence for the idea that faces are processed in a dedicated center in cortex. Studies have also argued for the presence of evolutionarily expedient pathways dedicated to the processing of cer...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/10.1.7

    authors: Coelho CM,Cloete S,Wallis G

    更新日期:2010-01-13 00:00:00

  • Lateral visual occlusion does not change walking trajectories.

    abstract::Difficulties with walking are often reported following brain damage that causes a lateralized loss of awareness on one side. Whether lateralized loss of awareness has a direct causal impact on walking is unknown. A review of the literature on visually guided walking suggests several reasons why a lateralized loss of v...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/18.9.11

    authors: Dunn MJ,Rushton SK

    更新日期:2018-09-04 00:00:00

  • The timescale of adaptation at early and mid-level stages of visual processing.

    abstract::The visual environment changes at multiple timescales. It has been recently demonstrated that visual adaptation is composed of multiple mechanisms operating at differing timescales to accommodate the environmental changes. However, whether multiple adaptation mechanisms correspond to different stages of visual process...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/17.1.1

    authors: Mei G,Dong X,Bao M

    更新日期:2017-01-01 00:00:00

  • Floating square illusion: perceptual uncoupling of static and dynamic objects in motion.

    abstract::One of the primary goals of motion analysis is to accurately track the movement of objects in the environment. We report on a novel illusion in which two objects moving with identical physical velocities have different perceived velocities, creating an apparent offset in their relative spatial positions. The stimulus ...

    journal_title:Journal of vision

    pub_type: 杂志文章,随机对照试验

    doi:10.1167/6.2.4

    authors: Carlson TA,Schrater P,He S

    更新日期:2006-02-13 00:00:00

  • Classification image weights and internal noise level estimation.

    abstract::For the linear discrimination of two stimuli in white Gaussian noise in the presence of internal noise, a method is described for estimating linear classification weights from the sum of noise images segregated by stimulus and response. The recommended method for combining the two response images for the same stimulus...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/2.1.8

    authors: Ahumada AJ Jr

    更新日期:2002-01-01 00:00:00

  • Cues for the control of ocular accommodation and vergence during postnatal human development.

    abstract::Accommodation and vergence help maintain single and focused visual experience while an object moves in depth. The relative importance of retinal blur and disparity, the primary sensory cues to accommodation and vergence, is largely unknown during development; a period when growth of the eye and head necessitate contin...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/8.16.14

    authors: Bharadwaj SR,Candy TR

    更新日期:2008-12-22 00:00:00

  • Cross-modal effects of auditory magnitude on visually guided grasping.

    abstract::Recent research has established the role of objects' semantic properties in the planning of motor actions with respect to these objects. It has been shown that visual numerical magnitude affects visuomotor control in a similar direction to the effect of physical size: The larger the numerical value, the larger the gri...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/15.8.2

    authors: Namdar G,Ganel T

    更新日期:2015-01-01 00:00:00

  • Perceptual learning transfer between hemispheres and tasks for easy and hard feature search conditions.

    abstract::Perceptual learning involves modification of cortical processes so that transfer to new task variants depends on neuronal representation overlap. Neuron selectivity varies with cortical level, so that the degree of transfer should depend on training-induced modification level. We ask how different can stimuli be, how ...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/11.1.8

    authors: Pavlovskaya M,Hochstein S

    更新日期:2011-01-07 00:00:00

  • The detection of multiple global directions: capacity limits with spatially segregated and transparent-motion signals.

    abstract::An important constraint on motion processing is the maximum number of directions that can be perceived at the same time. When transparent-motion stimuli are constructed based solely on direction differences, prior studies demonstrate that no more than two directions are seen simultaneously. However, this limit has bee...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/9.1.40

    authors: Greenwood JA,Edwards M

    更新日期:2009-01-30 00:00:00

  • Investigating cultural diversity for extrafoveal information use in visual scenes.

    abstract::Culture shapes how people gather information from the visual world. We recently showed that Western observers focus on the eyes region during face recognition, whereas Eastern observers fixate predominantly the center of faces, suggesting a more effective use of extrafoveal information for Easterners compared to Weste...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/10.6.21

    authors: Miellet S,Zhou X,He L,Rodger H,Caldara R

    更新日期:2010-06-01 00:00:00

  • Visual acuity in the archerfish: behavior, anatomy, and neurophysiology.

    abstract::Archerfish are known for their remarkable behavior of shooting water jets at prey hanging on vegetation above water. Motivated by the fish's capacity to knock down small prey as high as two meters above water level, we studied the role of the retina in facilitating their excellent visual acuity. First, we show behavio...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/12.12.18

    authors: Ben-Simon A,Ben-Shahar O,Vasserman G,Ben-Tov M,Segev R

    更新日期:2012-11-28 00:00:00

  • Action priming suppression by forward masks.

    abstract::Visual stimuli may produce strong and reliable effects on subsequent actions irrespective of their visibility. This dissociation between action priming and conscious perception of the stimuli suggests two ways of processing of visual stimuli. One way of processing leads to the emergence of conscious visual perception,...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/19.5.10

    authors: Becker N,Mattler U

    更新日期:2019-05-01 00:00:00

  • Do the eyes really have it? Dynamic allocation of attention when viewing moving faces.

    abstract::What controls gaze allocation during dynamic face perception? We monitored participants' eye movements while they watched videos featuring close-ups of pedestrians engaged in interviews. Contrary to previous findings using static displays, we observed no general preference to fixate eyes. Instead, gaze was dynamically...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/12.13.3

    authors: Võ ML,Smith TJ,Mital PK,Henderson JM

    更新日期:2012-12-03 00:00:00

  • Interactions between luminance and color signals: effects on shape.

    abstract::Although luminance and color are thought to be processed independently at early stages of visual processing, there is evidence that they interact at later stages. For example, chromatic information has been shown to enhance or suppress depth from luminance depending on whether chromatic edges are aligned or orthogonal...

    journal_title:Journal of vision

    pub_type: 杂志文章,评审

    doi:10.1167/13.5.16

    authors: Clery S,Bloj M,Harris JM

    更新日期:2013-04-18 00:00:00

  • Neural correlates of object-based attention.

    abstract::Much research has been directed toward disentangling the "units" of attention: Is attention directed to locations in space, visual objects, or to individual features of an object? Moreover, there is considerable interest in whether attention increases the gain of neural mechanisms (signal enhancement) or acts by other...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/2.9.1

    authors: Pei F,Pettet MW,Norcia AM

    更新日期:2002-01-01 00:00:00

  • An in-depth look at saccadic search in infancy.

    abstract::Two questions were posed in the present study: (1) Do infants search for discrepant items in the absence of instructions? We outline where previous research has been inconclusive in answering this question. (2) In what manner do infants search, and what are the fixation and saccade characteristics in saccadic search? ...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/16.8.10

    authors: Hessels RS,Hooge IT,Kemner C

    更新日期:2016-06-01 00:00:00