Dorsal striatal-midbrain connectivity in humans predicts how reinforcements are used to guide decisions.

Abstract:

:It has been suggested that the target areas of dopaminergic midbrain neurons, the dorsal (DS) and ventral striatum (VS), are differently involved in reinforcement learning especially as actor and critic. Whereas the critic learns to predict rewards, the actor maintains action values to guide future decisions. The different midbrain connections to the DS and the VS seem to play a critical role in this functional distinction. Here, subjects performed a dynamic, reward-based decision-making task during fMRI acquisition. A computational model of reinforcement learning was used to estimate the different effects of positive and negative reinforcements on future decisions for each subject individually. We found that activity in both the DS and the VS correlated with reward prediction errors. Using functional connectivity, we show that the DS and the VS are differentially connected to different midbrain regions (possibly corresponding to the substantia nigra [SN] and the ventral tegmental area [VTA], respectively). However, only functional connectivity between the DS and the putative SN predicted the impact of different reinforcement types on future behavior. These results suggest that connections between the putative SN and the DS are critical for modulating action values in the DS according to both positive and negative reinforcements to guide future decision making.

journal_name

J Cogn Neurosci

authors

Kahnt T,Park SQ,Cohen MX,Beck A,Heinz A,Wrase J

doi

10.1162/jocn.2009.21092

subject

Has Abstract

pub_date

2009-07-01 00:00:00

pages

1332-45

issue

7

eissn

0898-929X

issn

1530-8898

journal_volume

21

pub_type

杂志文章
  • A Neural Correlate of Strategic Exploration at the Onset of Adolescence.

    abstract::The onset of adolescence is associated with an increase in the behavioral tendency to explore and seek novel experiences. However, this exploration has rarely been quantified, and its neural correlates during this period remain unclear. Previously, activity within specific regions of the rostrolateral PFC (rlPFC) in a...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/jocn_a_00896

    authors: Kayser AS,Op de Macks Z,Dahl RE,Frank MJ

    更新日期:2016-02-01 00:00:00

  • Decoding and Reconstructing the Focus of Spatial Attention from the Topography of Alpha-band Oscillations.

    abstract::Many aspects of perception and cognition are supported by activity in neural populations that are tuned to different stimulus features (e.g., orientation, spatial location, color). Goal-directed behavior, such as sustained attention, requires a mechanism for the selective prioritization of contextually appropriate rep...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/jocn_a_00955

    authors: Samaha J,Sprague TC,Postle BR

    更新日期:2016-08-01 00:00:00

  • Images of illusory motion in primary visual cortex.

    abstract::Illusory motion can be generated by successively flashing a stationary visual stimulus in two spatial locations separated by several degrees of visual angle. In appropriate conditions, the apparent motion is indistinguishable from real motion: The observer experiences a luminous object traversing a continuous path fro...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/jocn.2006.18.7.1174

    authors: Larsen A,Madsen KH,Lund TE,Bundesen C

    更新日期:2006-07-01 00:00:00

  • Time-locked perceptual fading induced by visual transients.

    abstract::After prolonged fixation, a stationary object placed in the peripheral visual field fades and disappears from our visual awareness, especially at low luminance contrast (the Troxler effect). Here, we report that similar fading can be triggered by visual transients, such as additional visual stimuli flashed near the ob...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/089892903322307384

    authors: Kanai R,Kamitani Y

    更新日期:2003-07-01 00:00:00

  • Stimulus-induced Alpha Suppression Tracks the Difficulty of Attentional Selection, Not Visual Working Memory Storage.

    abstract::Human alpha-band activity (8-12 Hz) has been proposed to index a variety of mechanisms during visual processing. Here, we distinguished between an account in which alpha suppression indexes selective attention versus an account in which it indexes subsequent working memory storage. We manipulated two aspects of the vi...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/jocn_a_01637

    authors: Wang S,Megla EE,Woodman GF

    更新日期:2020-10-15 00:00:00

  • The end of the line for a brain-damaged model of unilateral neglect.

    abstract::For more than a century, it has been known that damage to the right hemisphere of the brain can cause patients to be unaware of the contralesional side of space. This condition, known as unilateral neglect, represents a collection of clinically related spatial disorders characterized by the failure in free vision to r...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/jocn.1997.9.2.171

    authors: Mozer MC,Halligan PW,Marshall JC

    更新日期:1997-03-01 00:00:00

  • "Do you see yonder cloud?"--On priming concepts, a new test, and a familiar outcome. Reply to Lucas et al.: "Familiarity or conceptual priming? Good question! Comment on Stenberg, Hellman, Johansson, and Rosén (2009)".

    abstract::Lucas, Voss, and Paller sympathize with our intentions but disagree with our findings. They argue that a relation between frequency and conceptual priming may have been obscured by methodological details in our second experiment, therefore failing to complete a bridge between conceptual priming and FN400 with name fre...

    journal_title:Journal of cognitive neuroscience

    pub_type: 评论,杂志文章

    doi:10.1162/jocn.2009.21268

    authors: Stenberg G,Johansson M,Hellman J,Rosén I

    更新日期:2010-04-01 00:00:00

  • Interacting cortical and basal ganglia networks underlying finding and tapping to the musical beat.

    abstract::Humans are able to find and tap to the beat of musical rhythms varying in complexity from children's songs to modern jazz. Musical beat has no one-to-one relationship with auditory features-it is an abstract perceptual representation that emerges from the interaction between sensory cues and higher-level cognitive org...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/jocn_a_00325

    authors: Kung SJ,Chen JL,Zatorre RJ,Penhune VB

    更新日期:2013-03-01 00:00:00

  • The timing of action-monitoring processes in the anterior cingulate cortex.

    abstract::The anterior cingulate cortex (ACC) has been shown to respond to conflict between simultaneously active, incompatible response tendencies. This area is active during high-conflict correct trials and also when participants make errors. Here, we use the temporal resolution of high-density event-related potentials (ERPs)...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/08989290260045837

    authors: Van Veen V,Carter CS

    更新日期:2002-05-15 00:00:00

  • Short- and long-delay intracranial ERP repetition effects dissociate memory systems in the human brain.

    abstract::Prior exposure to a stimulus can facilitate the performance to subsequent presentations of that stimulus. ERP studies have shown that this facilitation is associated with the modulation of two components (N400 and P600). Investigation of the time course of both behavioral and ERP repetition effects have led to the ass...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/089892999563526

    authors: Guillem F,Rougier A,Claverie B

    更新日期:1999-07-01 00:00:00

  • The Timing of Regular Sequences: Production, Perception, and Covariation.

    abstract::The temporal structure of behavior provides information that allows the tracking of temporal regularity in the sensory and sensorimotor domains. In turn, temporal regularity allows the generation of predictions about upcoming events and to adjust behavior accordingly. These mechanisms are essential to ensure behavior ...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/jocn_a_00805

    authors: Schwartze M,Kotz SA

    更新日期:2015-09-01 00:00:00

  • Susceptibility to Memory Interference Effects following Frontal Lobe Damage: Findings from Tests of Paired-Associate Learning.

    abstract::Abstract Patients with frontal lobe lesions were adminstered tests of paired-associate learning in which cue and response words are manipulated to increase interference across two study lists. In one test of paired-associate learning (AB-AC test), cue words used in one list are repeated in a second list but are associ...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/jocn.1995.7.2.144

    authors: Shimamura AP,Jurica PJ,Mangels JA,Gershberg FB,Knight RT

    更新日期:1995-04-01 00:00:00

  • Left-lateralized N170 effects of visual expertise in reading: evidence from Japanese syllabic and logographic scripts.

    abstract::The N170 component of the event-related potential (ERP) reflects experience-dependent neural changes in several forms of visual expertise, including expertise for visual words. Readers skilled in writing systems that link characters to phonemes (i.e., alphabetic writing) typically produce a left-lateralized N170 to vi...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/jocn.2008.20125

    authors: Maurer U,Zevin JD,McCandliss BD

    更新日期:2008-10-01 00:00:00

  • Encapsulation of implicit and explicit memory in sequence learning.

    abstract::Contrasts between implicit and explicit knowledge in the serial reaction time (SJRT) paradigm have been challenged because they have depended on a single dissociation; intact implicit knowledge in the absence of corresponding explicit knowledge. In the SRT task, subjects respond with a corresponding keypress to a cue ...

    journal_title:Journal of cognitive neuroscience

    pub_type: 临床试验,杂志文章

    doi:10.1162/089892998562681

    authors: Reber PJ,Squire LR

    更新日期:1998-03-01 00:00:00

  • Rules rule! Brain activity dissociates the representations of stimulus contingencies with varying levels of complexity.

    abstract::The significance of stimuli is linked not only to their nature but also to the sequential structure in which they are embedded, which gives rise to contingency rules. Humans have an extraordinary ability to extract and exploit these rules, as exemplified by the role of grammar and syntax in language. To study the brai...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/jocn_a_00229

    authors: Tse CY,Low KA,Fabiani M,Gratton G

    更新日期:2012-09-01 00:00:00

  • Numerical values leave a semantic imprint on associated signs in monkeys.

    abstract::Animals and humans share an evolutionary ancient quantity representation which is characterized by analog magnitude features: Discriminating magnitudes becomes more difficult with increasing set sizes (size effect) and with decreasing distance between two numerosities (distance effect). Humans show these effects even ...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/jocn.2009.21193

    authors: Diester I,Nieder A

    更新日期:2010-01-01 00:00:00

  • Learning places from views: variation in scene processing as a function of experience and navigational ability.

    abstract::Humans and animals use information obtained from different viewpoints to form representations of the spatial structure of the world. We used functional magnetic resonance imaging (fMRI) adaptation to investigate the neural basis of this learning process and to show how the concomitant representations vary across indiv...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/0898929052879987

    authors: Epstein RA,Higgins JS,Thompson-Schill SL

    更新日期:2005-01-01 00:00:00

  • Dynamic oscillatory processes governing cued orienting and allocation of auditory attention.

    abstract::In everyday listening situations, we need to constantly switch between alternative sound sources and engage attention according to cues that match our goals and expectations. The exact neuronal bases of these processes are poorly understood. We investigated oscillatory brain networks controlling auditory attention usi...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/jocn_a_00452

    authors: Ahveninen J,Huang S,Belliveau JW,Chang WT,Hämäläinen M

    更新日期:2013-11-01 00:00:00

  • Fronto-temporal interactions during overt verbal initiation and suppression.

    abstract::The Hayling Sentence Completion Task (HSCT) is known to activate left hemisphere frontal and temporal language regions. However, the effective connectivity between frontal and temporal language regions associated with the task has yet to be examined. The aims of the study were to examine activation and effective conne...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/jocn.2008.20107

    authors: Allen P,Mechelli A,Stephan KE,Day F,Dalton J,Williams S,McGuire PK

    更新日期:2008-09-01 00:00:00

  • Hippocampal Contribution to Ordinal Psychological Time in the Human Brain.

    abstract::The chronology of events in time-space is naturally available to the senses, and the spatial and temporal dimensions of events entangle in episodic memory when navigating the real world. The mapping of time-space during navigation in both animals and humans implicates the hippocampal formation. Yet, one arguably uniqu...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/jocn_a_01586

    authors: Gauthier B,Prabhu P,Kotegar KA,van Wassenhove V

    更新日期:2020-11-01 00:00:00

  • Cerebrocerebellar circuits for the perceptual cancellation of eye-movement-induced retinal image motion.

    abstract::Despite smooth pursuit eye movements, we are unaware of resultant retinal image motion. This example of perceptual invariance is achieved by comparing retinal image slip with an internal reference signal predicting the sensory consequences of the eye movement. This prediction can be manipulated experimentally, allowin...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/jocn.2006.18.11.1899

    authors: Lindner A,Haarmeier T,Erb M,Grodd W,Thier P

    更新日期:2006-11-01 00:00:00

  • The functional effect of transcranial magnetic stimulation: signal suppression or neural noise generation?

    abstract::Transcranial magnetic stimulation (TMS) is a popular tool for mapping perceptual and cognitive processes in the human brain. It uses a magnetic field to stimulate the brain, modifying ongoing activity in neural tissue under the stimulating coil, producing an effect that has been likened to a "virtual lesion." However,...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/jocn.2008.20048

    authors: Harris JA,Clifford CW,Miniussi C

    更新日期:2008-04-01 00:00:00

  • Brain activity associated with syntactic incongruencies in words and pseudo-words.

    abstract::Event-related brain potentials (EMS) were recorded while normal German subjects read either simple declarative sen- tences made up from real German words, or sentences that contained German pseudo-words instead of nouns and verbs. The verb (pseudo-verb) of the sentences disagreed in number with the subject noun (pseud...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/jocn.1997.9.3.318

    authors: Münte TF,Matzke M,Johannes S

    更新日期:1997-05-01 00:00:00

  • The Case of the Cognitive (Opti)miser: Electrophysiological Correlates of Working Memory Maintenance Predict Demand Avoidance.

    abstract::People are often considered cognitive misers. When given a free choice between two tasks, people tend to choose tasks requiring less cognitive effort. Such demand avoidance (DA) is associated with cognitive control, but it is still not clear to what extent individual differences in cognitive control can account for va...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/jocn_a_01566

    authors: Nador J,Harel A,Juvina I,Minnery B

    更新日期:2020-08-01 00:00:00

  • What processing is impaired in apperceptive agnosia? Evidence from normal subjects.

    abstract::Visual agnosia is a neuropsychological syndrome characterized by a failure of object identification. Apperceptive agnosia, an object identification deficit caused by damage to early perceptual processes, has been explained by appealing to both damaged early sensory processes and to damaged preattentive grouping proces...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/089892998562979

    authors: Vecera SP,Gilds KS

    更新日期:1998-09-01 00:00:00

  • Orbito-frontal cortex is necessary for temporal context memory.

    abstract::Lesion and neuroimaging studies suggest that orbito-frontal cortex (OFC) supports temporal aspects of episodic memory. However, it is unclear whether OFC contributes to the encoding and/or retrieval of temporal context and whether it is selective for temporal relative to nontemporal (spatial) context memory. We addres...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/jocn.2009.21316

    authors: Duarte A,Henson RN,Knight RT,Emery T,Graham KS

    更新日期:2010-08-01 00:00:00

  • Alternate task inhibits single-neuron category-selective responses in the human hippocampus while preserving selectivity in the amygdala.

    abstract::One fifth of neurons in the medial-temporal lobe of human epilepsy patients respond selectively to categories of images, such as faces or cars. Here we show that responses of hippocampal neurons are rapidly modified as subjects alternate (over 60 sec) between two tasks (1) identifying images from a category, or (2) pl...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/jocn.2008.21017

    authors: Steinmetz PN

    更新日期:2009-02-01 00:00:00

  • Reward acts on the pFC to enhance distractor resistance of working memory representations.

    abstract::Working memory and reward processing are often thought to be separate, unrelated processes. However, most daily activities involve integrating these two types of information, and the two processes rarely, if ever, occur in isolation. Here, we show that working memory and reward interact in a task-dependent manner and ...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/jocn_a_00676

    authors: Fallon SJ,Cools R

    更新日期:2014-12-01 00:00:00

  • On the interaction of selective attention and lexical knowledge: a connectionist account of neglect dyslexia.

    abstract::Neglect dyslexia, a reading impairment acquired as a consequence of brain injury, is traditionally interpreted as a disturbance of selective attention. Patients with neglect dyslexia may ignore the left side of an open book, the beginning words of a line of text, or the beginning letters of a single word. These patien...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/jocn.1990.2.2.96

    authors: Mozer MC,Behrmann M

    更新日期:1990-04-01 00:00:00

  • Temporal Tuning of Word- and Face-selective Cortex.

    abstract::Sensitivity to temporal change places fundamental limits on object processing in the visual system. An emerging consensus from the behavioral and neuroimaging literature suggests that temporal resolution differs substantially for stimuli of different complexity and for brain areas at different levels of the cortical h...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/jocn_a_01002

    authors: Yeatman JD,Norcia AM

    更新日期:2016-11-01 00:00:00