Adaptive allocation of human visual working memory capacity during statistical and categorical learning.

Abstract:

:Human brains are finite, and thus have bounded capacity. An efficient strategy for a capacity-limited agent is to continuously adapt by dynamically reallocating capacity in a task-dependent manner. Here we study this strategy in the context of visual working memory (VWM). People use their VWM stores to remember visual information over seconds or minutes. However, their memory performances are often error-prone, presumably due to VWM capacity limits. We hypothesize that people attempt to be flexible and robust by strategically reallocating their limited VWM capacity based on two factors: (a) the statistical regularities (e.g., stimulus feature means and variances) of the to-be-remembered items, and (b) the requirements of the task that they are attempting to perform. The latter specifies, for example, which types of errors are costly versus irrelevant for task performance. These hypotheses are formalized within a normative computational modeling framework based on rate-distortion theory, an extension of conventional Bayesian approaches that uses information theory to study rate-limited (or capacity-limited) processes. Using images of plants that are naturalistic and precisely controlled, we carried out two sets of experiments. Experiment 1 found that when a stimulus dimension (the widths of plants' leaves) was assigned a distribution, subjects adapted their VWM performances based on this distribution. Experiment 2 found that when one stimulus dimension (e.g., leaf width) was relevant for distinguishing plant categories but another dimension (leaf angle) was irrelevant, subjects' responses in a memory task became relatively more sensitive to the relevant stimulus dimension. Together, these results illustrate the task-dependent robustness of VWM, thereby highlighting the dependence of memory on learning.

journal_name

J Vis

journal_title

Journal of vision

authors

Bates CJ,Lerch RA,Sims CR,Jacobs RA

doi

10.1167/19.2.11

subject

Has Abstract

pub_date

2019-02-01 00:00:00

pages

11

issue

2

issn

1534-7362

pii

2726860

journal_volume

19

pub_type

杂志文章
  • Reaching and grasping actions and their context shape the perception of object size.

    abstract::Humans frequently estimate the size of objects to grasp them. In fact, when performing an action, our perception is focused towards the visual properties of the object that enable us to successfully execute the action. However, the motor system is also able to influence perception, but only a few studies have reported...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/17.12.10

    authors: Bosco A,Daniele F,Fattori P

    更新日期:2017-10-01 00:00:00

  • Similar effects of repetitive transcranial magnetic stimulation of MT+ and a dorsomedial extrastriate site including V3A on pattern detection and position discrimination of rotating and radial motion patterns.

    abstract::Our recent psychophysical experiments have identified differences in the spatial summation characteristics of pattern detection and position discrimination tasks performed with rotating, expanding, and contracting stimuli. Areas MT and MST are well established to be involved in processing these stimuli. fMRI results h...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/10.5.21

    authors: Harvey BM,Braddick OJ,Cowey A

    更新日期:2010-05-01 00:00:00

  • Is goal-directed attentional guidance just intertrial priming? A review.

    abstract::According to most models of selective visual attention, our goals at any given moment and saliency in the visual field determine attentional priority. But selection is not carried out in isolation--we typically track objects through space and time. This is not well captured within the distinction between goal-directed...

    journal_title:Journal of vision

    pub_type: 杂志文章,评审

    doi:10.1167/13.3.14

    authors: Lamy DF,Kristjánsson A

    更新日期:2013-07-01 00:00:00

  • Motion perception by a moving observer in a three-dimensional environment.

    abstract::Perceiving three-dimensional object motion while moving through the world is hard: not only must optic flow be segmented and parallax resolved into shape and motion, but also observer motion needs to be taken into account in order to perceive absolute, rather than observer-relative motion. In order to simplify the las...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/13.2.15

    authors: Dupin L,Wexler M

    更新日期:2013-02-08 00:00:00

  • Optimal stimulus encoders for natural tasks.

    abstract::Determining the features of natural stimuli that are most useful for specific natural tasks is critical for understanding perceptual systems. A new approach is described that involves finding the optimal encoder for the natural task of interest, given a relatively small population of noisy "neurons" between the encode...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/9.13.17

    authors: Geisler WS,Najemnik J,Ing AD

    更新日期:2009-12-16 00:00:00

  • Effects of scene inversion on change detection of targets matched for visual salience.

    abstract::This work examines how context may influence the detection of changes in flickering scenes. Each scene contained two changes that were matched for low-level visual salience. One of the changes was of high interest to the meaning of the scene, and the other was of lower interest. High-interest changes were more readily...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/3.1.1

    authors: Kelley TA,Chun MM,Chua KP

    更新日期:2003-01-01 00:00:00

  • Face gender and emotion expression: are angry women more like men?

    abstract::Certain features of facial appearance perceptually resemble expressive cues related to facial displays of emotion. We hypothesized that because expressive markers of anger (such as lowered eyebrows) overlap with perceptual markers of male sex, perceivers would identify androgynous angry faces as more likely to be a ma...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/9.12.19

    authors: Hess U,Adams RB Jr,Grammer K,Kleck RE

    更新日期:2009-11-24 00:00:00

  • Serial dependence in the perception of visual variance.

    abstract::The recent history of perceptual experience has been shown to influence subsequent perception. Classically, this dependence on perceptual history has been examined in sensory-adaptation paradigms, wherein prolonged exposure to a particular stimulus (e.g., a vertically oriented grating) produces changes in perception o...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/18.7.4

    authors: Suárez-Pinilla M,Seth AK,Roseboom W

    更新日期:2018-07-02 00:00:00

  • A functional role for trans-saccadic luminance differences.

    abstract::In typical natural environments, the visual system receives different inputs in quick succession as gaze moves around. We examined whether local trans-saccadic differences in luminance, contrast, and orientation influenced perception and target selection in the eye movement system. Observers initially fixated a periph...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/12.13.14

    authors: Ludwig CJ,Davies JR,Gegenfurtner KR

    更新日期:2012-01-01 00:00:00

  • Head and eye movements and the role of memory limitations in a visual search paradigm.

    abstract::The image information guiding visual behavior is acquired and maintained in an interplay of gaze shifts and visual short-term memory (VSTM). If storage capacity of VSTM is exhausted, gaze shifts can be used to regain information not currently represented in memory. By varying the separation between relevant image regi...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/8.1.7

    authors: Hardiess G,Gillner S,Mallot HA

    更新日期:2008-01-15 00:00:00

  • The effects of fixational tremor on the retinal image.

    abstract::The study of fixational eye motion has implications for the neural and computational underpinnings of vision. One component of fixational eye motion is tremor, a high-frequency oscillatory jitter reported to be anywhere from ∼11-60 arcseconds in amplitude. In order to isolate the effects of tremor on the retinal image...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/19.11.8

    authors: Bowers NR,Boehm AE,Roorda A

    更新日期:2019-09-03 00:00:00

  • The darker-is-deeper heuristic for the perception of 3D shape from shading: Is it perceptually or ecologically valid?

    abstract::The darker-is-deeper heuristic was originally proposed by Langer and Zucker (1994) for approximating 3D shape from shading under conditions of diffuse illumination that typically occur for outdoor scenes on a cloudy day, and it is based on the assumption that vignetting is the primary source of luminance variation und...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/15.15.2

    authors: Todd JT,Egan EJ,Kallie CS

    更新日期:2015-01-01 00:00:00

  • Wriggling motion trajectory illusion.

    abstract::In this paper, we report on a novel visual motion illusion. When hundreds of dots move in straight trajectories and random directions without colliding, the trajectories are perceived as wriggling rather than straight (Experiment 1). We examined the nature of this "wriggling motion trajectory illusion" via six separat...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/12.12.4

    authors: Kuwahara M,Sato T,Yotsumoto Y

    更新日期:2012-11-08 00:00:00

  • Spatial and temporal limits of motion perception across variations in speed, eccentricity, and low vision.

    abstract::We evaluated spatial displacement and temporal duration thresholds for discriminating the motion direction of gratings for a broad range of speeds (0.06 degrees/s to 30 degrees/s) in fovea and at +/-30 degrees eccentricity. In general, increased speed yielded lower duration thresholds but higher displacement threshold...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/9.1.30

    authors: Lappin JS,Tadin D,Nyquist JB,Corn AL

    更新日期:2009-01-22 00:00:00

  • MRI study of the changes in crystalline lens shape with accommodation and aging in humans.

    abstract::Magnetic Resonance Imaging was used to study changes in the crystalline lens and ciliary body with accommodation and aging. Monocular images were obtained in 15 young (19-29 years) and 15 older (60-70 years) emmetropes when viewing at far (6 m) and at individual near points (14.5 to 20.9 cm) in the younger group. With...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/11.3.19

    authors: Kasthurirangan S,Markwell EL,Atchison DA,Pope JM

    更新日期:2011-03-25 00:00:00

  • Time dilation in a perceptually jittering dot pattern.

    abstract::Although it is known that a moving stimulus appears to dilate in duration compared to a stationary stimulus, whether subjective motion devoid of stimulus motion is sufficient remains unknown. To elucidate this, we used a motion illusion in which an actually static stimulus clearly appears to move, a useful dissociatio...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/16.14.2

    authors: Aoki S,Kawano A,Terao M,Murakami I

    更新日期:2016-11-01 00:00:00

  • The effect of object-centered instructions in Cartesian and polar coordinates on saccade vector.

    abstract::Express saccades (ES) are the most reflexive saccadic eye movements, with very short reaction times of 70-110 ms. It is likely that ES have the shortest saccade reaction times (SRTs) possible given the known physiological and anatomical delays present in sensory and motor systems. Nevertheless, it has been demonstrate...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/17.3.2

    authors: Edelman JA,Mieses AM,Konnova K,Shiu D

    更新日期:2017-03-01 00:00:00

  • Davida Teller Award Lecture 2013: the importance of prediction and anticipation in the control of smooth pursuit eye movements.

    abstract::The ability of smooth pursuit eye movements to anticipate the future motion of targets has been known since the pioneering work of Dodge, Travis, and Fox (1930) and Westheimer (1954). This article reviews aspects of anticipatory smooth eye movements, focusing on the roles of the different internal or external cues tha...

    journal_title:Journal of vision

    pub_type:

    doi:10.1167/14.5.10

    authors: Kowler E,Aitkin CD,Ross NM,Santos EM,Zhao M

    更新日期:2014-05-16 00:00:00

  • Accuracy and precision of objective refraction from wavefront aberrations.

    abstract::We determined the accuracy and precision of 33 objective methods for predicting the results of conventional, sphero-cylindrical refraction from wavefront aberrations in a large population of 200 eyes. Accuracy for predicting defocus (as specified by the population mean error of prediction) varied from -0.50 D to +0.25...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/4.4.9

    authors: Thibos LN,Hong X,Bradley A,Applegate RA

    更新日期:2004-04-23 00:00:00

  • Limits of lightness identification for real objects under natural viewing conditions.

    abstract::We examined whether observers veridically perceive the reflectances of real objects under natural viewing conditions. A new forced-choice paradigm was used to measure observers' abilities to identify (not match) the reflectance of randomly crumpled gray papers across two levels of illumination, and also to simultaneou...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/4.9.9

    authors: Robilotto R,Zaidi Q

    更新日期:2004-09-15 00:00:00

  • Associating peripheral and foveal visual input across saccades: a default mode of the human visual system?

    abstract::Spatial processing resolution of a particular object in the visual field can differ considerably due to eye movements. The same object will be represented with high acuity in the fovea but only coarsely in periphery. Herwig and Schneider (in press) proposed that the visual system counteracts such resolution difference...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/14.11.7

    authors: Weiß K,Schneider WX,Herwig A

    更新日期:2014-09-09 00:00:00

  • Evidence for long-range spatiotemporal interactions in infant and adult visual cortex.

    abstract::The development of spatiotemporal interactions giving rise to classical receptive field properties has been well studied in animal models, but little is known about the development of putative nonclassical mechanisms in any species. Here we used visual evoked potentials to study the developmental status of spatiotempo...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/17.6.12

    authors: Norcia AM,Pei F,Kohler PJ

    更新日期:2017-06-01 00:00:00

  • The perceived depth from disparity as function of luminance contrast.

    abstract::Does human vision show the contrast invariance expected of an ideal stereoscopic system for computing depth from disparity? We used random-dot stereograms to investigate the luminance contrast effect on perceived depth from disparity. The perceived depth of disparity corrugations was measured by adjusting the length o...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/16.11.20

    authors: Chen PY,Chen CC,Tyler CW

    更新日期:2016-09-01 00:00:00

  • Larger visual stimuli are perceived to last longer from time to time: The internal clock is not affected by nontemporal visual stimulus size.

    abstract::Performance on interval timing is often explained by the assumption of an internal clock based on neural counting. According to this account, a neural pacemaker generates pulses, and the number of pulses relating to a physical time interval is recorded by a counter. Thus, the number of accumulated pulses is the intern...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/15.3.5

    authors: Rammsayer TH,Verner M

    更新日期:2015-03-10 00:00:00

  • Blur clarified: a review and synthesis of blur discrimination.

    abstract::Blur is an important attribute of human spatial vision, and sensitivity to blur has been the subject of considerable experimental research and theoretical modeling. Often, these models have invoked specialized concepts or mechanisms, such as intrinsic blur, multiple spatial frequency channels, or blur estimation units...

    journal_title:Journal of vision

    pub_type: 杂志文章,评审

    doi:10.1167/11.5.10

    authors: Watson AB,Ahumada AJ

    更新日期:2011-09-19 00:00:00

  • Disentangling the effects of spatial inconsistency of targets and distractors when searching in realistic scenes.

    abstract::Previous research has suggested that correctly placed objects facilitate eye guidance, but also that objects violating spatial associations within scenes may be prioritized for selection and subsequent inspection. We analyzed the respective eye guidance of spatial expectations and target template (precise picture or v...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/15.2.12

    authors: Spotorno S,Malcolm GL,Tatler BW

    更新日期:2015-02-10 00:00:00

  • Visual search: the role of peripheral information measured using gaze-contingent displays.

    abstract::Two of the factors limiting progress in understanding the mechanisms of visual search are the difficulty of controlling and manipulating the retinal stimulus when the eyes are free to move and the lack of an ideal observer theory for fixation selection during search. Recently, we developed a method to precisely contro...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/6.9.1

    authors: Geisler WS,Perry JS,Najemnik J

    更新日期:2006-08-03 00:00:00

  • Perceptual merging contributes to cueing effects.

    abstract::An uninformative exogenous cue speeds target detection if cue and target appear in the same location separated by a brief temporal interval. This finding is usually ascribed to the orienting of spatial attention to the cued location. Here we examine the role of perceptual merging of the two trial events in speeded tar...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/14.7.13

    authors: Krüger HM,MacInnes WJ,Hunt AR

    更新日期:2014-06-24 00:00:00

  • Visual search and location probability learning from variable perspectives.

    abstract::Do moving observers code attended locations relative to the external world or relative to themselves? To address this question we asked participants to conduct visual search on a tabletop. The search target was more likely to occur in some locations than others. Participants walked to different sides of the table from...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/13.6.13

    authors: Jiang YV,Swallow KM,Capistrano CG

    更新日期:2013-05-28 00:00:00

  • Stereo and motion Dmax in infants.

    abstract::These experiments compared the maximum displacement and disparity limits (Dmax) for apparent motion and stereopsis in random-dot displays in adult and 12-28 week-old infant subjects. Both stereo and motion Dmax increased during development, from about 0.3 deg in the youngest infants to 2 deg in adults. Some of the you...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/9.6.9

    authors: Wattam-Bell J

    更新日期:2009-06-18 00:00:00