Planning Complexity Registers as a Cost in Metacontrol.

Abstract:

:Decision-making algorithms face a basic tradeoff between accuracy and effort (i.e., computational demands). It is widely agreed that humans can choose between multiple decision-making processes that embody different solutions to this tradeoff: Some are computationally cheap but inaccurate, whereas others are computationally expensive but accurate. Recent progress in understanding this tradeoff has been catalyzed by formalizing it in terms of model-free (i.e., habitual) versus model-based (i.e., planning) approaches to reinforcement learning. Intuitively, if two tasks offer the same rewards for accuracy but one of them is much more demanding, we might expect people to rely on habit more in the difficult task: Devoting significant computation to achieve slight marginal accuracy gains would not be "worth it." We test and verify this prediction in a sequential reinforcement learning task. Because our paradigm is amenable to formal analysis, it contributes to the development of a computational model of how people balance the costs and benefits of different decision-making processes in a task-specific manner; in other words, how we decide when hard thinking is worth it.

journal_name

J Cogn Neurosci

authors

Kool W,Gershman SJ,Cushman FA

doi

10.1162/jocn_a_01263

subject

Has Abstract

pub_date

2018-10-01 00:00:00

pages

1391-1404

issue

10

eissn

0898-929X

issn

1530-8898

journal_volume

30

pub_type

杂志文章
  • Syntactically based sentence processing classes: evidence from event-related brain potentials.

    abstract::Theoretical considerations and diverse empirical data from clinical, psycholinguistic, and developmental studies suggest that language comprehension processes are decomposable into separate subsystems, including distinct systems for semantic and grammatical processing. Here we report that event-related potentials (ERP...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/jocn.1991.3.2.151

    authors: Neville H,Nicol JL,Barss A,Forster KI,Garrett MF

    更新日期:1991-04-01 00:00:00

  • Neural activity in the hippocampus and perirhinal cortex during encoding is associated with the durability of episodic memory.

    abstract::Studies examining medial temporal lobe (MTL) involvement in memory formation typically assess memory performance after a single, short delay. Thus, the relationship between MTL encoding activity and memory durability over time remains poorly characterized. To explore this relationship, we scanned participants using hi...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/jocn.2009.21381

    authors: Carr VA,Viskontas IV,Engel SA,Knowlton BJ

    更新日期:2010-11-01 00:00:00

  • Context-dependent changes in functional connectivity of auditory cortices during the perception of object words.

    abstract::Embodied theories hold that cognitive concepts are grounded in our sensorimotor systems. Specifically, a number of behavioral and neuroimaging studies have buttressed the idea that language concepts are represented in areas involved in perception and action [Pulvermueller, F. Brain mechanisms linking language and acti...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章,随机对照试验

    doi:10.1162/jocn_a_00264

    authors: van Dam WO,van Dongen EV,Bekkering H,Rueschemeyer SA

    更新日期:2012-10-01 00:00:00

  • Regional brain activation evoked when approaching a virtual human on a virtual walk.

    abstract::We investigated the necessity of biological motion for activation of the posterior superior temporal sulcus (pSTS) in circumstances in which the rapid approach of the observer to a virtual human induced the observer to make inferences about the characters intentions. Using a virtual reality environment, subjects exper...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/089892905774589253

    authors: Morris JP,Pelphrey KA,McCarthy G

    更新日期:2005-11-01 00:00:00

  • Differences in brain activity during a verbal associative memory encoding task in high- and low-fit adolescents.

    abstract::Aerobic fitness is associated with better memory performance as well as larger volumes in memory-related brain regions in children, adolescents, and elderly. It is unclear if aerobic exercise also influences learning and memory functional neural circuitry. Here, we examine brain activity in 17 high-fit (HF) and 17 low...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/jocn_a_00344

    authors: Herting MM,Nagel BJ

    更新日期:2013-04-01 00:00:00

  • Neural evidence for representation-specific response selection.

    abstract::Response selection is the mental process of choosing representations for appropriate motor behaviors given particular environmental stimuli and one's current task situation and goals. Many cognitive theories of response selection postulate a unitary process. That is, one central response-selection mechanism chooses ap...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/089892903322598085

    authors: Schumacher EH,Elston PA,D'Esposito M

    更新日期:2003-11-15 00:00:00

  • Medial Orbitofrontal Cortex, Dorsolateral Prefrontal Cortex, and Hippocampus Differentially Represent the Event Saliency.

    abstract::Two primary functions attributed to the hippocampus and prefrontal cortex (PFC) network are retaining the temporal and spatial associations of events and detecting deviant events. It is unclear, however, how these two functions converge into one mechanism. Here, we tested whether increased activity with perceiving sal...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/jocn_a_01392

    authors: Jafarpour A,Griffin S,Lin JJ,Knight RT

    更新日期:2019-06-01 00:00:00

  • Working memory capacity and visual-verbal cognitive load modulate auditory-sensory gating in the brainstem: toward a unified view of attention.

    abstract::Two fundamental research questions have driven attention research in the past: One concerns whether selection of relevant information among competing, irrelevant, information takes place at an early or at a late processing stage; the other concerns whether the capacity of attention is limited by a central, domain-gene...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章,随机对照试验

    doi:10.1162/jocn_a_00275

    authors: Sörqvist P,Stenfelt S,Rönnberg J

    更新日期:2012-11-01 00:00:00

  • Early Psychosocial Neglect Adversely Impacts Developmental Trajectories of Brain Oscillations and Their Interactions.

    abstract::Rhythmicity is a fundamental property of neural activity at multiple spatiotemporal scales, and associated oscillations represent a critical mechanism for communication and transmission of information across brain regions. During development, these oscillations evolve dynamically as a function of neural maturation and...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章,随机对照试验

    doi:10.1162/jocn_a_00877

    authors: Stamoulis C,Vanderwert RE,Zeanah CH,Fox NA,Nelson CA

    更新日期:2015-12-01 00:00:00

  • Regional white matter variation associated with domain-specific metacognitive accuracy.

    abstract::The neural mechanisms that mediate metacognitive ability (the capacity to accurately reflect on one's own cognition and experience) remain poorly understood. An important question is whether metacognitive capacity is a domain-general skill supported by a core neuroanatomical substrate or whether regionally specific ne...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/jocn_a_00741

    authors: Baird B,Cieslak M,Smallwood J,Grafton ST,Schooler JW

    更新日期:2015-03-01 00:00:00

  • Regions of mid-level human visual cortex sensitive to the global coherence of local image patches.

    abstract::The global structural arrangement and spatial layout of the visual environment must be derived from the integration of local signals represented in the lower tiers of the visual system. This interaction between the spatially local and global properties of visual stimulation underlies many of our visual capacities, and...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/jocn_a_00588

    authors: Mannion DJ,Kersten DJ,Olman CA

    更新日期:2014-08-01 00:00:00

  • Perceptual fusion tendency of speech sounds.

    abstract::To discriminate and to recognize sound sources in a noisy, reverberant environment, listeners need to perceptually integrate the direct wave with the reflections of each sound source. It has been confirmed that perceptual fusion between direct and reflected waves of a speech sound helps listeners recognize this speech...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/jocn.2010.21470

    authors: Huang Y,Li J,Zou X,Qu T,Wu X,Mao L,Wu Y,Li L

    更新日期:2011-04-01 00:00:00

  • Dissociation between Temporal and Spatial Anticipation in the Neural Dynamics of Goal-directed Movement Preparation.

    abstract::It is well documented that providing advanced information regarding the spatial location of a target stimulus (i.e., spatial anticipation) or its timing of occurrence (i.e., temporal anticipation) influences reach preparation, reducing RTs. Yet, it remains unknown whether the RT gains attributable to temporal and spat...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/jocn_a_01547

    authors: Canaveral CA,Savoie FA,Danion FR,Bernier PM

    更新日期:2020-07-01 00:00:00

  • Neural correlates of post-error slowing during a stop signal task: a functional magnetic resonance imaging study.

    abstract::The ability to detect errors and adjust behavior accordingly is essential for maneuvering in an uncertain environment. Errors are particularly prone to occur when multiple, conflicting responses are registered in a situation that requires flexible behavioral outputs; for instance, when a go signal requires a response ...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/jocn.2008.20071

    authors: Li CS,Huang C,Yan P,Paliwal P,Constable RT,Sinha R

    更新日期:2008-06-01 00:00:00

  • The magnitude representation of small and large symbolic numbers in the left and right hemisphere: an event-related fMRI study.

    abstract::Numbers are known to be processed along the left and right intraparietal sulcus. The present study investigated hemispheric differences between the magnitude representation of small and large symbolic numbers. To this purpose, an fMRI adaptation paradigm was used, where the continuous presentation of a habituation num...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/jocn.2010.21445

    authors: Notebaert K,Nelis S,Reynvoet B

    更新日期:2011-03-01 00:00:00

  • Attention to detail: why considering task demands is essential for single-trial analysis of BOLD correlates of the visual P1 and N1.

    abstract::Single-trial fluctuations in the EEG signal have been shown to temporally correlate with the fMRI BOLD response and are valuable for modeling trial-to-trial fluctuations in responses. The P1 and N1 components of the visual ERP are sensitive to different attentional modulations, suggesting that different aspects of sti...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/jocn_a_00490

    authors: Warbrick T,Arrubla J,Boers F,Neuner I,Shah NJ

    更新日期:2014-03-01 00:00:00

  • Leveling the Field for a Fairer Race between Going and Stopping: Neural Evidence for the Race Model of Motor Inhibition from a New Version of the Stop Signal Task.

    abstract::The stop signal task (SST) is the gold standard experimental model of inhibitory control. However, neither SST condition-contrast (stop vs. go, successful vs. failed stop) purely operationalizes inhibition. Because stop trials include a second, infrequent signal, the stop versus go contrast confounds inhibition with a...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/jocn_a_01503

    authors: Dykstra T,Waller DA,Hazeltine E,Wessel JR

    更新日期:2020-04-01 00:00:00

  • Interview with alfonso caramazza.

    abstract::Abstract Alfonso Caramazza is the David T. McLaughlin Distinguished Professor at Dartmouth College. He received the B.A. degree in psychology from McGill University in 1970 and the Ph.D. from Johns Hopkins University in 1974. He joined the Hopkins faculty in 1974 and taught there first in the Psychology Department and...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/jocn.1995.7.2.303

    authors:

    更新日期:1995-04-01 00:00:00

  • Rapid interactions between lexical semantic and word form analysis during word recognition in context: evidence from ERPs.

    abstract::We used ERPs to investigate the time course of interactions between lexical semantic and sublexical visual word form processing during word recognition. Participants read sentence-embedded pseudowords that orthographically resembled a contextually supported real word (e.g., "She measured the flour so she could bake a ...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/jocn_a_00148

    authors: Kim A,Lai V

    更新日期:2012-05-01 00:00:00

  • Neural correlates of lexical access during visual word recognition.

    abstract::People can discriminate real words from nonwords even when the latter are orthographically and phonologically word-like, presumably because words activate specific lexical and/or semantic information. We investigated the neural correlates of this identification process using event-related functional magnetic resonance...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/089892903321593108

    authors: Binder JR,McKiernan KA,Parsons ME,Westbury CF,Possing ET,Kaufman JN,Buchanan L

    更新日期:2003-04-01 00:00:00

  • Brain basis of developmental change in visuospatial working memory.

    abstract::Although brain changes associated with the acquisition of cognitive abilities in early childhood involve increasing localized specialization, little is known about the brain changes associated with the refinement of existing cognitive abilities that reach maturity in adolescence. The goal of this study was to investig...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/jocn.2006.18.7.1045

    authors: Scherf KS,Sweeney JA,Luna B

    更新日期:2006-07-01 00:00:00

  • Replay of Stimulus-specific Temporal Patterns during Associative Memory Formation.

    abstract::Forming a memory often entails the association of recent experience with present events. This recent experience is usually an information-rich and dynamic representation of the world around us. We here show that associating a static cue with a previously shown dynamic stimulus yields a detectable, dynamic representati...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/jocn_a_01304

    authors: Michelmann S,Bowman H,Hanslmayr S

    更新日期:2018-11-01 00:00:00

  • General-purpose monitoring during speech production.

    abstract::The concept of "monitoring" refers to our ability to control our actions on-line. Monitoring involved in speech production is often described in psycholinguistic models as an inherent part of the language system. We probed the specificity of speech monitoring in two psycholinguistic experiments where electroencephalog...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章,随机对照试验

    doi:10.1162/jocn.2010.21467

    authors: Riès S,Janssen N,Dufau S,Alario FX,Burle B

    更新日期:2011-06-01 00:00:00

  • Numerical values leave a semantic imprint on associated signs in monkeys.

    abstract::Animals and humans share an evolutionary ancient quantity representation which is characterized by analog magnitude features: Discriminating magnitudes becomes more difficult with increasing set sizes (size effect) and with decreasing distance between two numerosities (distance effect). Humans show these effects even ...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/jocn.2009.21193

    authors: Diester I,Nieder A

    更新日期:2010-01-01 00:00:00

  • The neural correlates of object familiarity and domain specificity in the human visual cortex: an FMRI study.

    abstract::Ventral occipito-temporal cortex is known to play a major role in visual object recognition. Still unknown is whether object familiarity and semantic domain are critical factors in its functional organization. Most models assume a functional locus where exemplars of familiar categories are represented: the structural ...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/jocn.2011.21629

    authors: Zannino GD,Barban F,Macaluso E,Caltagirone C,Carlesimo GA

    更新日期:2011-10-01 00:00:00

  • Novel vs. well-learned memory for faces: a positron emission tomography study.

    abstract::Previous work has suggested that familiarity/novelty of learned materials affects the circuitry involved in memory, primarily in the size of activations rather than the pattern of activation. Although this work has examined both recall and recognition, it has been limited to verbal material. In this study, we set out ...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/089892900562084

    authors: Wiser AK,Andreasen N,O'Leary DS,Crespo-Facorro B,Boles-Ponto LL,Watkins GL,Hichwa RD

    更新日期:2000-03-01 00:00:00

  • The effect of FEF microstimulation on the responses of neurons in the lateral intraparietal area.

    abstract::The macaque FEFs and the lateral intraparietal area (LIP) are high-level cortical areas involved in both spatial attention and oculomotor behavior. Stimulating FEF at a level below the threshold for evoking saccades increases fMRI activity and gamma power in area LIP, but the precise effect exerted by the FEF on LIP n...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/jocn_a_00591

    authors: Premereur E,Vanduffel W,Janssen P

    更新日期:2014-08-01 00:00:00

  • Neural biases to covert and overt signals of fear: dissociation by trait anxiety and depression.

    abstract::Although biases toward signals of fear may be an evolutionary adaptation necessary for survival, heightened biases may be maladaptive and associated with anxiety or depression. In this study, event-related potentials (ERPs) were used to examine the time course of neural responses to facial fear stimuli (versus neutral...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/jocn.2007.19.10.1595

    authors: Williams LM,Kemp AH,Felmingham K,Liddell BJ,Palmer DM,Bryant RA

    更新日期:2007-10-01 00:00:00

  • Auditory imagery modulates frequency-specific areas in the human auditory cortex.

    abstract::Neural responses in early sensory areas are influenced by top-down processing. In the visual system, early visual areas have been shown to actively participate in top-down processing based on their topographical properties. Although it has been suggested that the auditory cortex is involved in top-down control, functi...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/jocn_a_00280

    authors: Oh J,Kwon JH,Yang PS,Jeong J

    更新日期:2013-02-01 00:00:00

  • Long-term expertise with artificial objects increases visual competition with early face categorization processes.

    abstract::The degree of commonality between the perceptual mechanisms involved in processing faces and objects of expertise is intensely debated. To clarify this issue, we recorded occipito-temporal event-related potentials in response to faces when concurrently processing visual objects of expertise. In car experts fixating pi...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/jocn.2007.19.3.543

    authors: Rossion B,Collins D,Goffaux V,Curran T

    更新日期:2007-03-01 00:00:00