Smooth pursuit detection in binocular eye-tracking data with automatic video-based performance evaluation.

Abstract:

:An increasing number of researchers record binocular eye-tracking signals from participants viewing moving stimuli, but the majority of event-detection algorithms are monocular and do not consider smooth pursuit movements. The purposes of the present study are to develop an algorithm that discriminates between fixations and smooth pursuit movements in binocular eye-tracking signals and to evaluate its performance using an automated video-based strategy. The proposed algorithm uses a clustering approach that takes both spatial and temporal aspects of the binocular eye-tracking signal into account, and is evaluated using a novel video-based evaluation strategy based on automatically detected moving objects in the video stimuli. The binocular algorithm detects 98% of fixations in image stimuli compared to 95% when only one eye is used, while for video stimuli, both the binocular and monocular algorithms detect around 40% of smooth pursuit movements. The present article shows that using binocular information for discrimination of fixations and smooth pursuit movements is advantageous in static stimuli, without impairing the algorithm's ability to detect smooth pursuit movements in video and moving-dot stimuli. With an automated evaluation strategy, time-consuming manual annotations are avoided and a larger amount of data can be used in the evaluation process.

journal_name

J Vis

journal_title

Journal of vision

authors

Larsson L,Nyström M,Ardö H,Åström K,Stridh M

doi

10.1167/16.15.20

subject

Has Abstract

pub_date

2016-12-01 00:00:00

pages

20

issue

15

issn

1534-7362

pii

2594397

journal_volume

16

pub_type

杂志文章
  • Bistable Gestalts reduce activity in the whole of V1, not just the retinotopically predicted parts.

    abstract::Activity in the primary visual cortex reduces when certain stimuli can be perceptually organized as a unified Gestalt. This reduction could offer important insights into the nature of feedback computations within the human visual system; however, the properties of this response reduction have not yet been investigated...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/12.11.12

    authors: de-Wit LH,Kubilius J,Wagemans J,Op de Beeck HP

    更新日期:2012-10-22 00:00:00

  • Systematic distortions of perceived planar surface motion in active vision.

    abstract::Recent studies suggest that the active observer combines optic flow information with extra-retinal signals resulting from head motion. Such a combination allows, in principle, a correct discrimination of the presence or absence of surface rotation. In Experiments 1 and 2, observers were asked to perform such discrimin...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/10.5.12

    authors: Fantoni C,Caudek C,Domini F

    更新日期:2010-05-01 00:00:00

  • Gaze categorization under uncertainty: psychophysics and modeling.

    abstract::The accurate perception of another person's gaze direction underlies most social interactions and provides important information about his or her future intentions. As a first step to measuring gaze perception, most experiments determine the range of gaze directions that observers judge as being direct: the cone of di...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/13.5.18

    authors: Mareschal I,Calder AJ,Dadds MR,Clifford CW

    更新日期:2013-04-22 00:00:00

  • Adaptive allocation of human visual working memory capacity during statistical and categorical learning.

    abstract::Human brains are finite, and thus have bounded capacity. An efficient strategy for a capacity-limited agent is to continuously adapt by dynamically reallocating capacity in a task-dependent manner. Here we study this strategy in the context of visual working memory (VWM). People use their VWM stores to remember visual...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/19.2.11

    authors: Bates CJ,Lerch RA,Sims CR,Jacobs RA

    更新日期:2019-02-01 00:00:00

  • Effects of number, complexity, and familiarity of flankers on crowded letter identification.

    abstract::We tested identification of target letters surrounded by a varying number (2, 4, 6) of horizontally aligned flanking elements. Strings were presented left or right of a central fixation dot, and targets were always at the center of the string. Flankers could be other letters, digits, symbols, simple shapes, or false f...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/14.6.7

    authors: Chanceaux M,Mathôt S,Grainger J

    更新日期:2014-11-10 00:00:00

  • Asymmetry in the perception of motion in depth induced by moving cast shadows.

    abstract::An expanding object, which may represent an approaching motion, is easier to detect than a contracting one, which may represent a receding object. To confirm the generality of asymmetry in the detection of approaching and receding motions, we focused on the perception of apparent motion in depth created by moving cast...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/8.13.10

    authors: Imura T,Shirai N,Tomonaga M,Yamaguchi MK,Yagi A

    更新日期:2008-10-31 00:00:00

  • Why do people appear not to extrapolate trajectories during multiple object tracking? A computational investigation.

    abstract::Intuitively, extrapolating object trajectories should make visual tracking more accurate. This has proven to be true in many contexts that involve tracking a single item. But surprisingly, when tracking multiple identical items in what is known as "multiple object tracking," observers often appear to ignore direction ...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/14.12.12

    authors: Zhong SH,Ma Z,Wilson C,Liu Y,Flombaum JI

    更新日期:2014-10-13 00:00:00

  • Effects of microsaccades on contrast detection and V1 responses in macaques.

    abstract::Microsaccades can elevate contrast detection thresholds of human observers and modulate the activity of neurons in monkey visual cortex. Whether microsaccades elevate contrast detection thresholds in monkey observers is not known and bears on the interpretation of neurophysiological experiments. To answer this questio...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/11.3.3

    authors: Hass CA,Horwitz GD

    更新日期:2011-03-04 00:00:00

  • Slow gain fluctuations limit benefits of temporal integration in visual cortex.

    abstract::Sensory neurons represent stimulus information with sequences of action potentials that differ across repeated measurements. This variability limits the information that can be extracted from momentary observations of a neuron's response. It is often assumed that integrating responses over time mitigates this limitati...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/18.8.8

    authors: Goris RLT,Ziemba CM,Movshon JA,Simoncelli EP

    更新日期:2018-08-01 00:00:00

  • Obligatory encoding of task-irrelevant features depletes working memory resources.

    abstract::Selective attention is often considered the "gateway" to visual working memory (VWM). However, the extent to which we can voluntarily control which of an object's features enter memory remains subject to debate. Recent research has converged on the concept of VWM as a limited commodity distributed between elements of ...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/13.2.21

    authors: Marshall L,Bays PM

    更新日期:2013-02-18 00:00:00

  • Evaluation of an organic light-emitting diode display for precise visual stimulation.

    abstract::A new type of visual display for presentation of a visual stimulus with high quality was assessed. The characteristics of an organic light-emitting diode (OLED) display (Sony PVM-2541, 24.5 in.; Sony Corporation, Tokyo, Japan) were measured in detail from the viewpoint of its applicability to visual psychophysics. We ...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/13.7.6

    authors: Ito H,Ogawa M,Sunaga S

    更新日期:2013-06-11 00:00:00

  • Categorical facilitation with equally discriminable colors.

    abstract::This study investigates the impact of language on color perception. By categorical facilitation, we refer to an aspect of categorical perception, in which the linguistic distinction between categories affects color discrimination beyond the low-level, sensory sensitivity to color differences. According to this idea, d...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/15.8.22

    authors: Witzel C,Gegenfurtner KR

    更新日期:2015-01-01 00:00:00

  • Integrated global motion influences smooth pursuit in infants.

    abstract::Smooth pursuit eye movements (SP) were studied in 5- and 9-month-old infants and adults in response to a rhombus oscillating horizontally behind three spatially separated vertical occluders. During motion, the rhombus vertices were never visible. Thus the perception of the global motion of the rhombus required integra...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/8.11.16

    authors: Kochukhova O,Rosander K

    更新日期:2008-08-22 00:00:00

  • The crowding factor method applied to parafoveal vision.

    abstract::Crowding increases with eccentricity and is most readily observed in the periphery. During natural, active vision, however, central vision plays an important role. Measures of critical distance to estimate crowding are difficult in central vision, as these distances are small. Any overlap of flankers with the target m...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/16.11.30

    authors: Ghahghaei S,Walker L

    更新日期:2016-09-01 00:00:00

  • Contributions of gaze-centered and object-centered coding in a double-step saccade task.

    abstract::The position of a saccade target can be encoded in gaze-centered coordinates, that is, relative to the current gaze position, or in object-centered coordinates, that is, relative to an object in the environment. We tested the role of gaze-centered and object-centered coding in a double-step saccade task involving the ...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/16.14.12

    authors: de Brouwer AJ,Medendorp WP,Smeets JB

    更新日期:2016-11-01 00:00:00

  • Speeded classification in simultaneous masking.

    abstract::In simultaneous masking, flanking elements impair performance on a visual target. Previous studies on simultaneous masking have predominantly used discrimination threshold estimation to quantify performance on the target. Results based on thresholds suggest that an important factor in simultaneous masking is the stren...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/14.6.6

    authors: Hermens F,Bell A

    更新日期:2014-10-27 00:00:00

  • Coding of identity-diagnostic information in transsaccadic object perception.

    abstract::In four experiments, we examined the hypothesis that a presaccadic extrafoveal preview of an object normally affects subsequent postsaccadic foveal processing of the object. On each trial, viewers inspected an array of three objects and were instructed to remember one object characteristic (in-depth orientation, image...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/8.14.29

    authors: Van Eccelpoel C,Germeys F,De Graef P,Verfaillie K

    更新日期:2008-12-30 00:00:00

  • Effects of target typicality on categorical search.

    abstract::The role of target typicality in a categorical visual search task was investigated by cueing observers with a target name, followed by a five-item target present/absent search array in which the target images were rated in a pretest to be high, medium, or low in typicality with respect to the basic-level target cue. C...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/14.12.1

    authors: Maxfield JT,Stalder WD,Zelinsky GJ

    更新日期:2014-10-01 00:00:00

  • Investigating cultural diversity for extrafoveal information use in visual scenes.

    abstract::Culture shapes how people gather information from the visual world. We recently showed that Western observers focus on the eyes region during face recognition, whereas Eastern observers fixate predominantly the center of faces, suggesting a more effective use of extrafoveal information for Easterners compared to Weste...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/10.6.21

    authors: Miellet S,Zhou X,He L,Rodger H,Caldara R

    更新日期:2010-06-01 00:00:00

  • Sensitivity to curvature deformations along closed contours.

    abstract::Human observers are exquisitely sensitive to curvature deformations along a circular closed contour (Wilkinson, Wilson, & Habak, 1998; Hess, Wang, & Dakin, 1999; Loffler, Wilson, & Wilkinson, 2003). Such remarkable sensitivity has been attributed to the curvature encoding scheme used by V4 neurons, which typically are...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/19.13.7

    authors: Slugocki M,Sekuler AB,Bennett PJ

    更新日期:2019-11-01 00:00:00

  • Shape from shading under inconsistent illumination.

    abstract::People are able to perceive the 3D shape of illuminated surfaces using image shading cues. Theories about how we accomplish this often assume that the human visual system estimates a single lighting direction and interprets shading cues in accord with that estimate. In natural scenes, however, lighting can be much mor...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/19.6.2

    authors: Wilder JD,Adams WJ,Murray RF

    更新日期:2019-06-03 00:00:00

  • Exogenous and endogenous attention during perceptual learning differentially affect post-training target thresholds.

    abstract::There is conflicting evidence in the literature regarding the role played by attention in perceptual learning. To further examine this issue, we independently manipulated exogenous and endogenous attention and measured the rate of perceptual learning of oriented Gabor patches presented in different quadrants of the vi...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/11.1.25

    authors: Mukai I,Bahadur K,Kesavabhotla K,Ungerleider LG

    更新日期:2011-01-31 00:00:00

  • Anisotropies in judging the direction of moving natural scenes.

    abstract::Although visual systems are optimized to deal with the natural visual environment, our understanding of human motion perception is in large part based on the use of artificial stimuli. Here, we assessed observers' ability to estimate the direction of translating natural images and fractals by having them adjust the or...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/10.11.5

    authors: Dakin SC,Apthorp D,Alais D

    更新日期:2010-09-03 00:00:00

  • Sensory and decisional factors in motion-induced blindness.

    abstract::The processes underlying motion-induced blindness (MIB) are widely debated. Ultimately, however, they must reduce to a sensitivity drop and/or to an upward shift of the decision criterion. The first possibility was tested by assessing the detection threshold for a contrast (or luminance) increment applied to the MIB t...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/7.7.4

    authors: Caetta F,Gorea A,Bonneh Y

    更新日期:2007-05-23 00:00:00

  • Lightness perception in simple images: testing the anchoring rules.

    abstract::One approach toward understanding how vision computes surface lightness is to first determine what principles govern lightness in simple stimuli and then test whether these hold for more complex stimuli. Gilchrist (2006) proposed that in the simplest images that produce the experience of a surface (two surfaces differ...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/14.13.25

    authors: Radonjić A,Gilchrist AL

    更新日期:2014-11-25 00:00:00

  • Automatic grouping of regular structures.

    abstract::To cope with the continuously incoming stream of input, the visual system has to group information across space and time. Usually, spatial and temporal grouping are investigated separately. However, recent findings revealed that these two grouping mechanisms strongly interact and should therefore be studied together r...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/10.8.5

    authors: Hermens F,Scharnowski F,Herzog MH

    更新日期:2010-07-01 00:00:00

  • Evidence for distinct mechanisms underlying attentional priming and sensory memory for bistable perception.

    abstract::Attentional selection in visual search paradigms and perceptual selection in bistable perception paradigms show functional similarities. For example, both are sensitive to trial history: They are biased toward previously selected targets or interpretations. We investigated whether priming by target selection in visual...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/15.11.8

    authors: Brinkhuis MA,Kristjánsson Á,Brascamp JW

    更新日期:2015-08-01 00:00:00

  • Comparing models of contrast gain using psychophysical experiments.

    abstract::In a wide variety of neural systems, neurons tuned to a primary dimension of interest often have responses that are modulated in a multiplicative manner by other features such as stimulus intensity or contrast. In this methodological study, we present a demonstration that it is possible to use psychophysical experimen...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/16.9.1

    authors: DiMattina C

    更新日期:2016-07-01 00:00:00

  • Fourth-root summation of contrast over area: No end in sight when spatially inhomogeneous sensitivity is compensated by a witch's hat.

    abstract::Measurements of area summation for luminance-modulated stimuli are typically confounded by variations in sensitivity across the retina. Recently we conducted a detailed analysis of sensitivity across the visual field (Baldwin, Meese, & Baker, 2012) and found it to be well described by a bilinear "witch's hat" function...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/15.15.4

    authors: Baldwin AS,Meese TS

    更新日期:2015-01-01 00:00:00

  • Robust sensitivity to facial identity in the right human occipito-temporal cortex as revealed by steady-state visual-evoked potentials.

    abstract::Understanding how the human brain discriminates complex visual patterns, such as individual faces, is an important issue in Vision Science. Here we tested sensitivity to individual faces using steady-state visual-evoked potentials (SSVEPs). Twelve participants were presented with 90-s sequences of faces appearing at a...

    journal_title:Journal of vision

    pub_type: 杂志文章

    doi:10.1167/11.2.16

    authors: Rossion B,Boremanse A

    更新日期:2011-02-23 00:00:00