A universal role of the ventral striatum in reward-based learning: evidence from human studies.

Abstract:

:Reinforcement learning enables organisms to adjust their behavior in order to maximize rewards. Electrophysiological recordings of dopaminergic midbrain neurons have shown that they code the difference between actual and predicted rewards, i.e., the reward prediction error, in many species. This error signal is conveyed to both the striatum and cortical areas and is thought to play a central role in learning to optimize behavior. However, in human daily life rewards are diverse and often only indirect feedback is available. Here we explore the range of rewards that are processed by the dopaminergic system in human participants, and examine whether it is also involved in learning in the absence of explicit rewards. While results from electrophysiological recordings in humans are sparse, evidence linking dopaminergic activity to the metabolic signal recorded from the midbrain and striatum with functional magnetic resonance imaging (fMRI) is available. Results from fMRI studies suggest that the human ventral striatum (VS) receives valuation information for a diverse set of rewarding stimuli. These range from simple primary reinforcers such as juice rewards over abstract social rewards to internally generated signals on perceived correctness, suggesting that the VS is involved in learning from trial-and-error irrespective of the specific nature of provided rewards. In addition, we summarize evidence that the VS can also be implicated when learning from observing others, and in tasks that go beyond simple stimulus-action-outcome learning, indicating that the reward system is also recruited in more complex learning tasks.

journal_name

Neurobiol Learn Mem

authors

Daniel R,Pollmann S

doi

10.1016/j.nlm.2014.05.002

subject

Has Abstract

pub_date

2014-10-01 00:00:00

pages

90-100

eissn

1074-7427

issn

1095-9564

pii

S1074-7427(14)00085-9

journal_volume

114

pub_type

杂志文章,评审
  • The dorsal hippocampus mediates synaptic destabilization and memory lability in the amygdala in the absence of contextual novelty.

    abstract::The recall of a previously formed fear memory triggers a process through which synapses in the amygdala become "destabilized". This labile state at retrieval may be critical for the plasticity required to modify, update, or disrupt long-term memories. One component of this process involves the rapid internalization of...

    journal_title:Neurobiology of learning and memory

    pub_type: 杂志文章

    doi:10.1016/j.nlm.2019.107089

    authors: Ferrara NC,Trask S,Pullins SE,Helmstetter FJ

    更新日期:2019-12-01 00:00:00

  • Systemic administrations of β-estradiol alleviate both conditioned and sensitized fear responses in an ovariectomized rat model of post-traumatic stress disorder.

    abstract::Although no single widely accepted animal model of PTSD has been established to date, the single prolonged stress (SPS) animal model has been partially validated as a model for PTSD. SPS rats mimic the pathophysiological abnormalities and behavioral characteristics of PTSD, such as enhanced fear response to the trauma...

    journal_title:Neurobiology of learning and memory

    pub_type: 杂志文章

    doi:10.1016/j.nlm.2013.02.003

    authors: Mirshekar M,Abrari K,Goudarzi I,Rashidy-Pour A

    更新日期:2013-05-01 00:00:00

  • Learning strategy refinement reverses early sensory cortical map expansion but not behavior: Support for a theory of directed cortical substrates of learning and memory.

    abstract::Primary sensory cortical fields develop highly specific associative representational plasticity, notably enlarged area of representation of reinforced signal stimuli within their topographic maps. However, overtraining subjects after they have solved an instrumental task can reduce or eliminate the expansion while the...

    journal_title:Neurobiology of learning and memory

    pub_type: 杂志文章

    doi:10.1016/j.nlm.2015.10.006

    authors: Elias GA,Bieszczad KM,Weinberger NM

    更新日期:2015-12-01 00:00:00

  • Dose-dependent impairing effects of morphine on avoidance acquisition and performance in male mice.

    abstract::The effects of morphine (6.3, 12.6, and 25.2 mg/kg) on active avoidance behavior of BALB/C mice are explored in three acquisition sessions and in two subsequent performance sessions. Morphine-treated animals showed an increase in avoidance acquisition with respect to control group without differences in performance. H...

    journal_title:Neurobiology of learning and memory

    pub_type: 杂志文章

    doi:10.1006/nlme.1997.3804

    authors: Aguilar MA,Miñarro J,Simón VM

    更新日期:1998-03-01 00:00:00

  • Immunization with either prion protein fragment 95-123 or the fragment-specific antibodies rescue memory loss and neurodegenerative phenotype of neurons in olfactory bulbectomized mice.

    abstract::Epidemiological studies demonstrated association between head injury (HI) and the subsequent development of Alzheimer's disease (AD). Certain hallmarks of AD, e.g. amyloid-β (Aβ) containing deposits, may be found in patients following traumatic BI (TBI). Recent studies uncover the cellular prion protein, PrP(C), as a ...

    journal_title:Neurobiology of learning and memory

    pub_type: 杂志文章

    doi:10.1016/j.nlm.2013.10.019

    authors: Bobkova NV,Medvinskaya NI,Kamynina AV,Aleksandrova IY,Nesterova IV,Samokhin AN,Koroev DO,Filatova MP,Nekrasov PV,Abramov AY,Leonov SV,Volpina OM

    更新日期:2014-01-01 00:00:00

  • Hippocampal tauopathy in tau transgenic mice coincides with impaired hippocampus-dependent learning and memory, and attenuated late-phase long-term depression of synaptic transmission.

    abstract::We evaluated various forms of hippocampus-dependent learning and memory, and hippocampal synaptic plasticity in THY-Tau22 transgenic mice, a murine tauopathy model that expresses double-mutated 4-repeat human tau, and shows neuropathological tau hyperphosphorylation and aggregation throughout the brain. Focussing on h...

    journal_title:Neurobiology of learning and memory

    pub_type: 杂志文章

    doi:10.1016/j.nlm.2010.12.005

    authors: Van der Jeugd A,Ahmed T,Burnouf S,Belarbi K,Hamdame M,Grosjean ME,Humez S,Balschun D,Blum D,Buée L,D'Hooge R

    更新日期:2011-03-01 00:00:00

  • Anterior but not intralaminar thalamic nuclei support allocentric spatial memory.

    abstract::Medial thalamic damage is a common cause of severe memory disruption in humans. Both the anterior thalamic nuclei (ATN) and the intralaminar thalamic nuclei (ILN) have been suggested as primary sites of diencephalic injury underlying learning and memory deficits, but their respective roles have yet to be resolved. The...

    journal_title:Neurobiology of learning and memory

    pub_type: 杂志文章

    doi:10.1016/j.nlm.2008.01.007

    authors: Wolff M,Gibb SJ,Cassel JC,Dalrymple-Alford JC

    更新日期:2008-07-01 00:00:00

  • Broad domains of histone 3 lysine 4 trimethylation are associated with transcriptional activation in CA1 neurons of the hippocampus during memory formation.

    abstract::Transcriptional changes in the hippocampus are required for memory formation, and these changes are regulated by numerous post-translational modifications of chromatin-associated proteins. One of the epigenetic marks that has been implicated in memory formation is histone 3 lysine 4 trimethylation (H3K4me3), and this ...

    journal_title:Neurobiology of learning and memory

    pub_type: 杂志文章

    doi:10.1016/j.nlm.2019.04.009

    authors: Collins BE,Sweatt JD,Greer CB

    更新日期:2019-05-01 00:00:00

  • Slow-wave disruption enhances the accessibility of positive memory traces.

    abstract::The purpose of this study was to explore the effects of slow-wave disruption on positive and negative word recognition in a sample of healthy control participants and those with major depressive disorder. Prior to sleep, participants learned a set of emotional and neutral words during an encoding task by responding wh...

    journal_title:Neurobiology of learning and memory

    pub_type: 杂志文章

    doi:10.1016/j.nlm.2015.09.006

    authors: Goldschmied JR,Cheng P,Kim HS,Casement M,Armitage R,Deldin PJ

    更新日期:2015-11-01 00:00:00

  • High-salt diet enhances hippocampal oxidative stress and cognitive impairment in mice.

    abstract::Previous evidence suggests that a high-salt (HS) diet may increase oxidative stress and contribute to the development of hypertension that is already present. Oxidative stress is thought to play a critical role in the development of neurodegenerative diseases. Lower dietary sodium intake putatively contributes to a lo...

    journal_title:Neurobiology of learning and memory

    pub_type: 杂志文章

    doi:10.1016/j.nlm.2014.04.010

    authors: Liu YZ,Chen JK,Li ZP,Zhao T,Ni M,Li DJ,Jiang CL,Shen FM

    更新日期:2014-10-01 00:00:00

  • Androgens' performance-enhancing effects in the inhibitory avoidance and water maze tasks may involve actions at intracellular androgen receptors in the dorsal hippocampus.

    abstract::Androgens can have performance-enhancing effects in some cognitive tasks, but the mechanism of these effects has not been established. Experiments examined whether androgens' actions to bind to intracellular androgen receptors (ARs) in the hippocampus are necessary to enhance cognitive performance in the inhibitory av...

    journal_title:Neurobiology of learning and memory

    pub_type: 杂志文章

    doi:10.1016/j.nlm.2006.08.008

    authors: Edinger KL,Frye CA

    更新日期:2007-02-01 00:00:00

  • Long-lasting alterations of hippocampal GABAergic neurotransmission in adult rats following perinatal Δ9-THC exposure.

    abstract::The long-lasting effects of gestational cannabinoids exposure on the adult brain of the offspring are still controversial. It has already been shown that pre- or perinatal cannabinoids exposure induces learning and memory disruption in rat adult offspring, associated with permanent alterations of cortical glutamatergi...

    journal_title:Neurobiology of learning and memory

    pub_type: 杂志文章

    doi:10.1016/j.nlm.2016.12.023

    authors: Beggiato S,Borelli AC,Tomasini MC,Morgano L,Antonelli T,Tanganelli S,Cuomo V,Ferraro L

    更新日期:2017-03-01 00:00:00

  • Neurogenesis decreases with age in the canine hippocampus and correlates with cognitive function.

    abstract::New neurons are continually produced in the adult mammalian brain from progenitor cells located in specific brain regions, including the subgranular zone (SGZ) of the dentate gyrus of the hippocampus. We hypothesized that neurogenesis occurs in the canine brain and is reduced with age. We examined neurogenesis in the ...

    journal_title:Neurobiology of learning and memory

    pub_type: 杂志文章

    doi:10.1016/j.nlm.2007.05.001

    authors: Siwak-Tapp CT,Head E,Muggenburg BA,Milgram NW,Cotman CW

    更新日期:2007-09-01 00:00:00

  • Reduced activity-dependent protein levels in a mouse model of the fragile X premutation.

    abstract::Environmental enrichment results in increased levels of Fmrp in brain and increased dendritic complexity. The present experiment evaluated activity-dependent increases in Fmrp levels in the motor cortex in response to training on a skilled forelimb reaching task in the CGG KI mouse model of the fragile X premutation. ...

    journal_title:Neurobiology of learning and memory

    pub_type: 杂志文章

    doi:10.1016/j.nlm.2014.01.011

    authors: von Leden RE,Curley LC,Greenberg GD,Hunsaker MR,Willemsen R,Berman RF

    更新日期:2014-03-01 00:00:00

  • Phosphorylation state of CREB in the rat hippocampus: a molecular switch between spatial novelty and spatial familiarity?

    abstract::The activation of cAMP response element-binding protein (CREB) after a learning experience is a common feature in the formation of several associative memories. We recently demonstrated that the increase in the hippocampal phosphorylated CREB (pCREB) levels 1 h after a short exploration of an open field (OF) was assoc...

    journal_title:Neurobiology of learning and memory

    pub_type: 杂志文章

    doi:10.1016/j.nlm.2005.12.002

    authors: Moncada D,Viola H

    更新日期:2006-07-01 00:00:00

  • Differential effects of anterior and posterior insular cortex lesions on the acquisition of conditioned taste aversion and spatial learning.

    abstract::In this study, we evaluated the effects of NMDA-induced lesions in different sites of the insular cortex of the rat on the acquisition of conditioned taste aversion and spatial learning in the Morris water maze. The lesions were produced by bilateral microinjections of NMDA in the insular cortex at +3.7 mm (Anterior g...

    journal_title:Neurobiology of learning and memory

    pub_type: 杂志文章

    doi:10.1006/nlme.1996.0042

    authors: Nerad L,Ramírez-Amaya V,Ormsby CE,Bermúdez-Rattoni F

    更新日期:1996-07-01 00:00:00

  • Experience with songs in adulthood reduces song-induced gene expression in songbird auditory forebrain.

    abstract::Male songbirds learn to produce song within a limited phase early in life; however they continue to learn to recognize songs in adulthood. Studies looking at Zenk activation after exposure to songs learned early in life for song production and songs learned in adulthood show opposite patterns of activation, suggesting...

    journal_title:Neurobiology of learning and memory

    pub_type: 杂志文章

    doi:10.1016/j.nlm.2006.05.002

    authors: McKenzie TL,Hernandez AM,MacDougall-Shackleton SA

    更新日期:2006-11-01 00:00:00

  • Inhibition of endogenous carbon monoxide production induces transient retention losses in the day-old chick when trained using a single trial passive avoidance learning task.

    abstract::Carbon monoxide (CO) is most often thought of as an exogenous toxin rather than as a possible endogenous nootrope. However, a limited number of studies have suggested that CO is necessary in memory processing for at least some tasks. While nitric oxide (NO) and CO are known activators of guanylyl cyclase (GC), only th...

    journal_title:Neurobiology of learning and memory

    pub_type: 杂志文章

    doi:10.1016/j.nlm.2005.01.004

    authors: Cutajar MC,Edwards TM,Ng KT

    更新日期:2005-05-01 00:00:00

  • Dorsomedial pallium lesions impair taste aversion learning in goldfish.

    abstract::The present work shows that the dorsomedial telencephalic pallium of teleost fish, proposed as homologous to the amygdala of mammals, is involved in taste aversion learning (TAL). To analyze the behavioral properties of TAL in goldfish, in Experiment 1, we used a delayed procedure similar to that employed with mammals...

    journal_title:Neurobiology of learning and memory

    pub_type: 杂志文章

    doi:10.1016/j.nlm.2011.06.003

    authors: Martín I,Gómez A,Salas C,Puerto A,Rodríguez F

    更新日期:2011-09-01 00:00:00

  • Information processing with frequency-dependent synaptic connections.

    abstract::The efficacy of synaptic transmission between two neurons changes as a function of the history of previous activations of the synaptic connection. This history dependence can be characterized by examining the dependence of transmission on the frequency of stimulation. In this framework synaptic plasticity can also be ...

    journal_title:Neurobiology of learning and memory

    pub_type: 杂志文章

    doi:10.1006/nlme.1998.3841

    authors: Markram H,Gupta A,Uziel A,Wang Y,Tsodyks M

    更新日期:1998-07-01 00:00:00

  • Stress during puberty boosts metabolic activation associated with fear-extinction learning in hippocampus, basal amygdala and cingulate cortex.

    abstract::Adolescence is characterized by major developmental changes that may render the individual vulnerable to stress and the development of psychopathologies in a sex-specific manner. Earlier we reported lower anxiety-like behavior and higher risk-taking and novelty seeking in rats previously exposed to peri-pubertal stres...

    journal_title:Neurobiology of learning and memory

    pub_type: 杂志文章

    doi:10.1016/j.nlm.2012.05.006

    authors: Toledo-Rodriguez M,Pitiot A,Paus T,Sandi C

    更新日期:2012-07-01 00:00:00

  • Modulation of adenosine signaling prevents scopolamine-induced cognitive impairment in zebrafish.

    abstract::Adenosine, a purine ribonucleoside, exhibits neuromodulatory and neuroprotective effects in the brain and is involved in memory formation and cognitive function. Adenosine signaling is mediated by adenosine receptors (A1, A2A, A2B, and A3); in turn, nucleotide and nucleoside-metabolizing enzymes and adenosine transpor...

    journal_title:Neurobiology of learning and memory

    pub_type: 杂志文章

    doi:10.1016/j.nlm.2014.11.016

    authors: Bortolotto JW,Melo GM,Cognato Gde P,Vianna MR,Bonan CD

    更新日期:2015-02-01 00:00:00

  • D-cycloserine in the basolateral amygdala prevents extinction and enhances reconsolidation of odor-reward associative learning in rats.

    abstract::It is well established that D-cycloserine (DCS), a partial agonist of the NMDA receptor glycine site, enhances learning and memory processes. Although the effects of DCS have been especially elucidated in the extinction and reconsolidation of aversive behavioral paradigms or drug-related behaviors, they have not been ...

    journal_title:Neurobiology of learning and memory

    pub_type: 杂志文章

    doi:10.1016/j.nlm.2012.11.003

    authors: Portero-Tresserra M,Martí-Nicolovius M,Guillazo-Blanch G,Boadas-Vaello P,Vale-Martínez A

    更新日期:2013-02-01 00:00:00

  • Both electrolytic and excitotoxic lesions of nucleus accumbens disrupt latent inhibition of learning in rats.

    abstract::Evidence indicating a role for the nucleus accumbens in the development of latent inhibition of learning has accumulated. Two experiments were conducted using Wistar rats to investigate this role directly. Experiment 1 used a conditioned emotional response paradigm to assess the effects of discrete electrolytic lesion...

    journal_title:Neurobiology of learning and memory

    pub_type: 杂志文章

    doi:10.1006/nlme.1995.1042

    authors: Tai CT,Cassaday HJ,Feldon J,Rawlins JN

    更新日期:1995-07-01 00:00:00

  • Sex specific recruitment of a medial prefrontal cortex-hippocampal-thalamic system during context-dependent renewal of responding to food cues in rats.

    abstract::Renewal, or reinstatement, of responding to food cues after extinction may explain the inability to resist palatable foods and change maladaptive eating habits. Previously, we found sex differences in context-dependent renewal of extinguished Pavlovian conditioned responding to food cues. Context-induced renewal invol...

    journal_title:Neurobiology of learning and memory

    pub_type: 杂志文章

    doi:10.1016/j.nlm.2016.12.004

    authors: Anderson LC,Petrovich GD

    更新日期:2017-03-01 00:00:00

  • A sex comparison of increments in FOS immunoreactivity in forebrain neurons of gonadectomized, testosterone-treated rats after mounting an estrous female.

    abstract::The protein product of the immediate-early gene, c-fos, was visualized immunocytochemically in forebrain neurons of gonadectomized male and female rats which were injected daily with testosterone propionate (TP) and either tested for mounting directed toward a sexually receptive female or left alone in a test arena. L...

    journal_title:Neurobiology of learning and memory

    pub_type: 杂志文章

    doi:10.1006/nlme.1995.1006

    authors: Oboh AM,Paredes RG,Baum MJ

    更新日期:1995-01-01 00:00:00

  • Exposure to a retrieval cue in rats induces changes in regional brain glucose metabolism in the amygdala and other related brain structures.

    abstract::Pre-test exposure to training-related cues is known to improve subsequent retention performance. To identify brain regions engaged in processes promoted by retrieval cues, a brain imaging approach using the [6-14C]glucose autoradiographic technique was used. Sprague-Dawley rats trained in a brightness discrimination a...

    journal_title:Neurobiology of learning and memory

    pub_type: 杂志文章

    doi:10.1016/s1074-7427(02)00010-2

    authors: Boujabit M,Bontempi B,Destrade C,Gisquet-Verrier P

    更新日期:2003-01-01 00:00:00

  • Extinction of conditioned cues attenuates incubation of cocaine craving in adolescent and adult rats.

    abstract::Relapse to drug use is often precipitated by exposure to drug associated cues that evoke craving. Cue-induced drug craving has been observed in both animals and humans to increase over the first few weeks of abstinence and remain high over extended periods, a phenomenon known as 'incubation of craving'. As adolescence...

    journal_title:Neurobiology of learning and memory

    pub_type: 杂志文章

    doi:10.1016/j.nlm.2016.09.002

    authors: Madsen HB,Zbukvic IC,Luikinga SJ,Lawrence AJ,Kim JH

    更新日期:2017-09-01 00:00:00

  • ADRB2 gene polymorphism modulates the retention of fear extinction memory.

    abstract::Individual differences in regulation of fear and extinction memory play significant roles in the aetiology development of post-traumatic stress disorder (PTSD). Previous animal based studies showed that the activity of β-adrenergic receptors (β-ARs) are involved in memory modulation. However in humans it is not clear ...

    journal_title:Neurobiology of learning and memory

    pub_type: 杂志文章

    doi:10.1016/j.nlm.2018.11.004

    authors: Shi L,Chen SJ,Deng JH,Que JY,Lin X,Sun Y,Bao YP,Shi J,Lu L

    更新日期:2018-12-01 00:00:00

  • The influence of sleep on emotional and cognitive processing is primarily trait- (but not state-) dependent.

    abstract::Human studies of sleep and cognition have established thatdifferent sleep stages contribute to distinct aspects of cognitive and emotional processing. However, since the majority of these findings are based on single-night studies, it is difficult to determine whether such effects arise due to individual, between-subj...

    journal_title:Neurobiology of learning and memory

    pub_type: 杂志文章

    doi:10.1016/j.nlm.2016.07.032

    authors: Lerner I,Lupkin SM,Corter JE,Peters SE,Cannella LA,Gluck MA

    更新日期:2016-10-01 00:00:00