Zooming in on the cognitive neuroscience of visual narrative.

Abstract:

:Visual narratives like comics and films often shift between showing full scenes and close, zoomed-in viewpoints. These zooms are similar to the "spotlight of attention" cast across a visual scene in perception. We here measured ERPs to visual narratives (comic strips) that used zoomed-in and full-scene panels either throughout the whole sequence context or at specific critical panels. Zoomed-in panels were automatically generated on the basis of fixations from prior participants' eye movements to the crucial content of panels (Foulsham & Cohn, 2020). We found that these fixation panels evoked a smaller N300 than full-scenes, indicative of reduced cost for object identification, but that they also evoked a slightly larger amplitude N400 response, suggesting a greater cost for accessing semantic memory with constrained content. Panels in sequences where fixation panels persisted across all positions of the sequence also evoked larger posterior P600s, implying that constrained views required more updating or revision processes throughout the sequence. Altogether, these findings suggest that constraining a visual scene to its crucial parts triggers various processes related not only to the density of its information but also to its integration into a sequential context.

journal_name

Brain Cogn

journal_title

Brain and cognition

authors

Cohn N,Foulsham T

doi

10.1016/j.bandc.2020.105634

subject

Has Abstract

pub_date

2020-12-01 00:00:00

pages

105634

eissn

0278-2626

issn

1090-2147

pii

S0278-2626(20)30237-2

journal_volume

146

pub_type

杂志文章
  • Dual task performance in children: generalized and lateralized effects of memory encoding upon the rate and variability of concurrent finger tapping.

    abstract::Interference between concurrent tasks was used to investigate the brain basis of capacity limitations apparent when children encode information. Seventy-three right-handed children in Grades 1-4 engaged in speeded unilateral finger tapping while encoding a variable number of faces or numbers for subsequent recognition...

    journal_title:Brain and cognition

    pub_type: 杂志文章

    doi:10.1016/0278-2626(87)90044-3

    authors: Hiscock M,Kinsbourne M,Samuels M,Krause AE

    更新日期:1987-01-01 00:00:00

  • Psychological verbs and the double-dependency hypothesis.

    abstract::The double-dependency hypothesis (DDH, Mauner et al., 1993) holds that where two dependencies of a certain kind are present, comprehension in Broca's aphasia will be random, but that where there is only one dependency, comprehension will be intact. We tested this hypothesis by examining the performance of Broca's apha...

    journal_title:Brain and cognition

    pub_type: 杂志文章

    doi:10.1016/s0278-2626(01)80030-0

    authors: Beretta A,Campbell C

    更新日期:2001-06-01 00:00:00

  • False memories to emotional stimuli are not equally affected in right- and left-brain-damaged stroke patients.

    abstract::Previous research has attributed to the right hemisphere (RH) a key role in eliciting false memories to visual emotional stimuli. These results have been explained in terms of two right-hemisphere properties: (i) that emotional stimuli are preferentially processed in the RH and (ii) that visual stimuli are represented...

    journal_title:Brain and cognition

    pub_type: 杂志文章

    doi:10.1016/j.bandc.2014.07.002

    authors: Buratto LG,Zimmermann N,Ferré P,Joanette Y,Fonseca RP,Stein LM

    更新日期:2014-10-01 00:00:00

  • Failure to update the egocentric representation of the visual space through labyrinthine signal.

    abstract::The present study evaluated the capacity to compare retinal and vestibular signals in a heterosensorial matching task. In the first experiment, subjects evaluated the magnitude of passive whole-body rotations in relation to the eccentricity of a visual target briefly presented before rotation. Such a task elicits mult...

    journal_title:Brain and cognition

    pub_type: 杂志文章

    doi:10.1006/brcg.1995.1264

    authors: Blouin J,Gauthier GM,Vercher JL

    更新日期:1995-10-01 00:00:00

  • Differentially tuned responses to restricted versus prolonged awareness of threat: a preliminary fMRI investigation.

    abstract::Responses to threat occur via two known independent processing routes. We propose that early, reflexive processing is predominantly tuned to the detection of congruent combinations of facial cues that signal threat, whereas later, reflective processing is predominantly tuned to incongruent combinations of threat. To t...

    journal_title:Brain and cognition

    pub_type: 杂志文章

    doi:10.1016/j.bandc.2011.05.001

    authors: Adams RB Jr,Franklin RG Jr,Nelson AJ,Gordon HL,Kleck RE,Whalen PJ,Ambady N

    更新日期:2011-10-01 00:00:00

  • Remembering 1500 pictures: the right hemisphere remembers better than the left.

    abstract::We hypothesized that the right hemisphere would be superior to the left hemisphere in remembering having seen a specific picture before, given its superiority in perceptually encoding specific aspects of visual form. A large set of pictures (N=1500) of animals, human faces, artifacts, landscapes, and art paintings wer...

    journal_title:Brain and cognition

    pub_type: 杂志文章

    doi:10.1016/j.bandc.2006.10.009

    authors: Laeng B,Øvervoll M,Ole Steinsvik O

    更新日期:2007-03-01 00:00:00

  • Neurocognitive correlates of white matter quality in adolescent substance users.

    abstract:BACKGROUND:Progressive myelination during adolescence implicates an increased vulnerability to neurotoxic substances and enduring neurocognitive consequences. This study examined the cognitive manifestations of altered white matter microstructure in chronic marijuana and alcohol-using (MJ+ALC) adolescents. METHODS:Thi...

    journal_title:Brain and cognition

    pub_type: 杂志文章

    doi:10.1016/j.bandc.2009.10.012

    authors: Bava S,Jacobus J,Mahmood O,Yang TT,Tapert SF

    更新日期:2010-04-01 00:00:00

  • Right up there: hemispatial and hand asymmetries of altitudinal pseudoneglect.

    abstract:BACKGROUND:Pseudoneglect is a normal left sided spatial bias observed with attempted bisections of horizontal lines and a normal upward bias observed with attempted bisections of vertical lines. Horizontal pseudoneglect has been attributed to right hemispheric dominance for the allocation of attention. The goal of this...

    journal_title:Brain and cognition

    pub_type: 杂志文章

    doi:10.1016/j.bandc.2012.03.003

    authors: Suavansri K,Falchook AD,Williamson JB,Heilman KM

    更新日期:2012-08-01 00:00:00

  • Pace yourself: Neural activation and connectivity changes over time vary by task type and pacing.

    abstract::Performance deterioration over time, or time-on-task (TOT) effects, can be observed across a variety of tasks, but little attention has been paid to how TOT-related brain activity may differ based on task pacing and cognitive demands. Here, we employ a set of three closely related tasks to investigate the effect of th...

    journal_title:Brain and cognition

    pub_type: 杂志文章

    doi:10.1016/j.bandc.2019.103629

    authors: Teng J,Massar SAA,Tandi J,Lim J

    更新日期:2019-12-01 00:00:00

  • Machiavellianism and Theory of Mind in people affected by schizophrenia.

    abstract:CONTEXT:People affected by schizophrenia show deficits in social interaction (Cramer, Bowen, & O'Neill, 1992); such a deficit may stem from an alteration in the representation of mental states. OBJECT:In this study we have examined 42 people affected by schizophrenia, diagnosed according to DSM-IV criteria, by testing...

    journal_title:Brain and cognition

    pub_type: 杂志文章

    doi:10.1016/s0278-2626(03)00018-6

    authors: Mazza M,De Risio A,Tozzini C,Roncone R,Casacchia M

    更新日期:2003-04-01 00:00:00

  • Distinct FN400/N400 memory effects for perceptually fluent and disfluent words.

    abstract::Recognition memory studies have shown that increased perceptual fluency results in more "old" responses and, presumably, increases familiarity. However, the exact neural mechanisms of these effects remain unresolved. We conducted two ERP experiments in which participants encoded words and performed a recognition test ...

    journal_title:Brain and cognition

    pub_type: 杂志文章

    doi:10.1016/j.bandc.2020.105661

    authors: Stróżak P,Leynes PA,Wojtasiński M

    更新日期:2020-12-24 00:00:00

  • Dorsal stream deficits suggest hidden dyslexia among deaf poor readers: correlated evidence from reduced perceptual speed and elevated coherent motion detection thresholds.

    abstract::Prelingual deafness and developmental dyslexia have confounding developmental effects on reading acquisition. Therefore, standard reading assessment methods for diagnosing dyslexia in hearing people are ineffective for use with deaf people. Recently, Samar, Parasnis, and Berent (2002) reported visual evoked potential ...

    journal_title:Brain and cognition

    pub_type: 临床试验,杂志文章

    doi:10.1016/j.bandc.2005.02.004

    authors: Samar VJ,Parasnis I

    更新日期:2005-08-01 00:00:00

  • Emotional stimulation, defensive orientation, and hemispheric activation.

    abstract::Lateral eye movements (LEM) were measured for 32 right-handed subjects while responding to questions rated for verbal and visual-spatial cognitive content and for varying levels of emotionally stimulating content. The results indicated that eye movements were distributed to the right and left in response to verbal and...

    journal_title:Brain and cognition

    pub_type: 杂志文章

    doi:10.1016/0278-2626(82)90022-7

    authors: Krikorian R,Rafales L

    更新日期:1982-10-01 00:00:00

  • Perceptual biases in processing facial identity and emotion.

    abstract::Normal observers demonstrate a bias to process the left sides of faces during perceptual judgments about identity or emotion. This effect suggests a right cerebral hemisphere processing bias. To test the role of the right hemisphere and the involvement of configural processing underlying this effect, young and older c...

    journal_title:Brain and cognition

    pub_type: 杂志文章

    doi:10.1016/j.bandc.2007.07.001

    authors: Coolican J,Eskes GA,McMullen PA,Lecky E

    更新日期:2008-03-01 00:00:00

  • A case of expressive-vocal amusia in a right-handed patient with left hemispheric cerebral infarction.

    abstract::A 53-year-old right-handed woman had an extensive lesion in the left hemisphere due to an infarction caused by vasospasm secondary to subarachnoid bleeding. She exhibited persistent expressive-vocal amusia with no symptoms of aphasia. Evaluation of the patient's musical competence using the Montreal Battery for Evalua...

    journal_title:Brain and cognition

    pub_type: 杂志文章

    doi:10.1016/j.bandc.2016.01.003

    authors: Uetsuki S,Kinoshita H,Takahashi R,Obata S,Kakigi T,Wada Y,Yokoyama K

    更新日期:2016-03-01 00:00:00

  • Appearance of symmetry, beauty, and health in human faces.

    abstract::Symmetry is an important concept in biology, being related to mate selection strategies, health, and survival of species. In human faces, the relevance of left-right symmetry to attractiveness and health is not well understood. We compared the appearance of facial attractiveness, health, and symmetry in three separate...

    journal_title:Brain and cognition

    pub_type: 临床试验,杂志文章

    doi:10.1016/j.bandc.2004.08.056

    authors: Zaidel DW,Aarde SM,Baig K

    更新日期:2005-04-01 00:00:00

  • Spatial selective attention biases are shaped by long-term musical experience and short-term exposure to tones.

    abstract::Selective attention is a dynamic process that rapidly shifts processing resources to information that is most relevant to our goals. Although individuals often show spatial biases in attention, these biases can be modified by both long-term factors, such as musical training, or by momentary changes in the auditory con...

    journal_title:Brain and cognition

    pub_type: 杂志文章

    doi:10.1016/j.bandc.2018.06.006

    authors: Cruse A,Offen K,Markant J

    更新日期:2018-08-01 00:00:00

  • Pathological left-handedness and familial sinistrality in relation to degree of mental retardation.

    abstract::The relationship between personal and familial hand preference and mental retardation was examined. Six unimanual tasks were performed by 232 subjects within four mental retardation severity groups. Family handedness histories were obtained. Right hand preference varied inversely with severity of mental retardation. T...

    journal_title:Brain and cognition

    pub_type: 杂志文章

    doi:10.1016/0278-2626(84)90027-7

    authors: Bradshaw-McAnulty G,Hicks RE,Kinsbourne M

    更新日期:1984-10-01 00:00:00

  • Dynamic range of frontoparietal functional modulation is associated with working memory capacity limitations in older adults.

    abstract::Older adults tend to over-activate regions throughout frontoparietal cortices and exhibit a reduced range of functional modulation during WM task performance compared to younger adults. While recent evidence suggests that reduced functional modulation is associated with poorer task performance, it remains unclear whet...

    journal_title:Brain and cognition

    pub_type: 杂志文章

    doi:10.1016/j.bandc.2017.08.007

    authors: Hakun JG,Johnson NF

    更新日期:2017-11-01 00:00:00

  • Not so secret agents: Event-related potentials to semantic roles in visual event comprehension.

    abstract::Research across domains has suggested that agents, the doers of actions, have a processing advantage over patients, the receivers of actions. We hypothesized that agents as "event builders" for discrete actions (e.g., throwing a ball, punching) build on cues embedded in their preparatory postures (e.g., reaching back ...

    journal_title:Brain and cognition

    pub_type: 杂志文章

    doi:10.1016/j.bandc.2017.09.001

    authors: Cohn N,Paczynski M,Kutas M

    更新日期:2017-12-01 00:00:00

  • Visual-spatial processing in deaf brain-damaged signers.

    abstract::Sign language displays all the complex linguistic structure found in spoken languages, but conveys its syntax in large part by manipulating spatial relations. This study investigated whether deaf signers who rely on a visual-spatial language nonetheless show a principled cortical separation for language and nonlanguag...

    journal_title:Brain and cognition

    pub_type: 杂志文章

    doi:10.1016/0278-2626(84)90022-8

    authors: Poizner H,Kaplan E,Bellugi U,Padden CA

    更新日期:1984-07-01 00:00:00

  • Adolescent neural response to reward is related to participant sex and task motivation.

    abstract::Risky decision making is prominent during adolescence, perhaps contributed to by heightened sensation seeking and ongoing maturation of reward and dopamine systems in the brain, which are, in part, modulated by sex hormones. In this study, we examined sex differences in the neural substrates of reward sensitivity duri...

    journal_title:Brain and cognition

    pub_type: 杂志文章

    doi:10.1016/j.bandc.2016.10.003

    authors: Alarcón G,Cservenka A,Nagel BJ

    更新日期:2017-02-01 00:00:00

  • Priming of non-speech vocalizations in male adults: the influence of the speaker's gender.

    abstract::Previous research reported a priming effect for voices. However, the type of information primed is still largely unknown. In this study, we examined the influence of speaker's gender and emotional category of the stimulus on priming of non-speech vocalizations in 10 male participants, who performed a gender identifica...

    journal_title:Brain and cognition

    pub_type: 临床试验,杂志文章

    doi:10.1016/j.bandc.2004.02.024

    authors: Fecteau S,Armony JL,Joanette Y,Belin P

    更新日期:2004-07-01 00:00:00

  • Objects rapidly prime the motor system when located near the dominant hand.

    abstract::Objects are said to automatically "afford" various actions depending upon the motor repertoire of the actor. Such affordances play a part in how we prepare to handle or manipulate tools and other objects. Evidence obtained through fMRI, EEG and TMS has proven that this is the case but, as yet, the temporal evolution o...

    journal_title:Brain and cognition

    pub_type: 杂志文章

    doi:10.1016/j.bandc.2016.11.005

    authors: Rowe PJ,Haenschel C,Kosilo M,Yarrow K

    更新日期:2017-04-01 00:00:00

  • Responsiveness and functional connectivity of the scene-sensitive retrosplenial complex in 7-11-year-old children.

    abstract::Brain imaging studies have identified two cortical areas, the parahippocampal place area (PPA) and the retrosplenial complex (RSC), that respond preferentially to the viewing of scenes. Contrary to the PPA, little is known about the functional maturation and cognitive control of the RSC. Here we used functional magnet...

    journal_title:Brain and cognition

    pub_type: 杂志文章

    doi:10.1016/j.bandc.2014.10.005

    authors: Jiang P,Tokariev M,Aronen ET,Salonen O,Ma Y,Vuontela V,Carlson S

    更新日期:2014-12-01 00:00:00

  • Avoiding math on a rapid timescale: Emotional responsivity and anxious attention in math anxiety.

    abstract::Math anxiety (MA) is characterized by negative feelings towards mathematics, resulting in avoidance of math classes and of careers that rely on mathematical skills. Focused on a long timescale, this research may miss important cognitive and affective processes that operate moment-to-moment, changing rapid reactions ev...

    journal_title:Brain and cognition

    pub_type: 杂志文章

    doi:10.1016/j.bandc.2017.08.004

    authors: Pizzie RG,Kraemer DJM

    更新日期:2017-11-01 00:00:00

  • Cognition is cool: Can hemispheric activation be assessed by tympanic membrane thermometry?

    abstract::Hemispheric activation during cognitive tasks using functional magnetic resonance imaging (fMRI) can be difficult to interpret, uncomfortable, and is not widely available. This study investigated whether tympanic membrane thermometry could be used as a broad measure of hemispheric activation. Infrared probes measured ...

    journal_title:Brain and cognition

    pub_type: 杂志文章

    doi:10.1016/j.bandc.2004.02.014

    authors: Cherbuin N,Brinkman C

    更新日期:2004-04-01 00:00:00

  • Intelligence profiles in children and adolescents with left temporal lobe epilepsy: relationship to language laterality.

    abstract::Pre- and postoperative IQ profiles were examined in children and adolescents with left temporal-lobe epilepsy. Participants were grouped according to their pattern of speech dominance, as indicated by the intracarotid sodium amobarbital procedure. Seven participants with typical (left hemisphere) speech representation...

    journal_title:Brain and cognition

    pub_type: 杂志文章

    doi:

    authors: Billingsley R,Smith ML

    更新日期:2000-06-01 00:00:00

  • Impact of executive dysfunctions on episodic memory abilities in patients with ruptured aneurysm of the anterior communicating artery.

    abstract::Executive and memory dysfunctions are among the most frequently reported deficits following a ruptured aneurysm of the anterior communicating artery (ACoA). In order to study the impact of the dysexecutive syndrome on episodic and semantic memory, the data obtained from 59 ACoA patients were examined retrospectively. ...

    journal_title:Brain and cognition

    pub_type: 杂志文章

    doi:10.1016/s0278-2626(03)00142-8

    authors: Simard S,Rouleau I,Brosseau J,Laframboise M,Bojanowsky M

    更新日期:2003-11-01 00:00:00

  • Differential effects of aging on processes underlying task switching.

    abstract::In this study, we used event-related brain potentials (ERPs) to examine the effects of aging on processes underlying task switching. The response time data revealed an age-related increase in mixing costs before controlling for general slowing and no effect of aging on switching costs. In the cue-locked epoch, the ERP...

    journal_title:Brain and cognition

    pub_type: 杂志文章,随机对照试验

    doi:10.1016/j.bandc.2008.03.001

    authors: West R,Travers S

    更新日期:2008-10-01 00:00:00