Abstract：
:Cue- and reward-evoked phasic dopamine activity during Pavlovian and operant conditioning paradigms is well correlated with reward-prediction errors from formal reinforcement learning models, which feature teaching signals in the form of discrepancies between actual and expected reward outcomes. Additionally, in learning tasks where conditioned cues probabilistically predict rewards, dopamine neurons show sustained cue-evoked responses that are correlated with the variance of reward and are maximal to cues predicting rewards with a probability of 0.5. Therefore, it has been suggested that sustained dopamine activity after cue presentation encodes the uncertainty of impending reward delivery. In the current study we examined the acquisition and maintenance of these neural correlates using fast-scan cyclic voltammetry in rats implanted with carbon fiber electrodes in the nucleus accumbens core during probabilistic Pavlovian conditioning. The advantage of this technique is that we can sample from the same animal and recording location throughout learning with single trial resolution. We report that dopamine release in the nucleus accumbens core contains correlates of both expected value and variance. A quantitative analysis of these signals throughout learning, and during the ongoing updating process after learning in probabilistic conditions, demonstrates that these correlates are dynamically encoded during these phases. Peak CS-evoked responses are correlated with expected value and predominate during early learning while a variance-correlated sustained CS signal develops during the post-asymptotic updating phase.
journal_name
Neurobiol Learn Memjournal_title
Neurobiology of learning and memoryauthors
Hart AS,Clark JJ,Phillips PEMdoi
10.1016/j.nlm.2014.07.010subject
Has Abstractpub_date
2015-01-01 00:00:00pages
84-92eissn
1074-7427issn
1095-9564journal_volume
117pub_type
杂志文章abstract：:The current review provides a historical perspective on the evolution of hypothesized mechanisms for senescent neurophysiology, focused on the CA1 region of the hippocampus, and the relationship of senescent neurophysiology to impaired hippocampal-dependent memory. Senescent neurophysiology involves processes linked t...
journal_title：Neurobiology of learning and memory
pub_type： 杂志文章,评审
doi：10.1016/j.nlm.2019.107064
更新日期：2019-10-01 00:00:00
abstract：:Over the last decade, the interest in transcranial direct current stimulation (tDCS) has continued to increase, along with consideration of how it affects neuroplasticity mechanisms in the brain. Both human and animal studies have demonstrated numerous benefits and, although its application has increased, the neurophy...
journal_title：Neurobiology of learning and memory
pub_type： 杂志文章
doi：10.1016/j.nlm.2017.11.002
更新日期：2018-04-01 00:00:00
abstract：:The healthy aging process affects the ability to learn and remember new facts and tasks. Prior work has shown that motor learning can be adversely affected by non-motor deficits, such as time. Here we investigated how age, and a dual task influence the learning and forgetting of a new walking pattern. We studied healt...
journal_title：Neurobiology of learning and memory
pub_type： 杂志文章
doi：10.1016/j.nlm.2015.11.003
更新日期：2016-02-01 00:00:00
abstract：:The entorhinal cortex (EC) has been shown to be an integral piece of the hippocampal memory system. It sits in a unique position within the brain with strong, intricate, reciprocal connectivity with the hippocampus as well as a vast array of neocortical regions. Topographical patterns of afferent and efferent projecti...
journal_title：Neurobiology of learning and memory
pub_type： 杂志文章,meta分析,评审
doi：10.1016/j.nlm.2014.08.006
更新日期：2014-11-01 00:00:00
abstract：:This article argues both rapid eye movement (REM) and non-rapid eye movement (NREM) sleep contribute to overnight episodic memory processes but their roles differ. Episodic memory may have evolved from memory for spatial navigation in animals and humans. Equally, mnemonic navigation in world and mental space may rely ...
journal_title：Neurobiology of learning and memory
pub_type： 杂志文章,评审
doi：10.1016/j.nlm.2015.04.005
更新日期：2015-07-01 00:00:00
abstract：:The purpose of this review is to summarize the present knowledge on the interplay among the cholinergic system, Extracellular signal-Regulated Kinase (ERK) and Mammalian Target of Rapamycin (mTOR) pathways in the development of short and long term memories during the acquisition and recall of the step-down inhibitory ...
journal_title：Neurobiology of learning and memory
pub_type： 杂志文章,评审
doi：10.1016/j.nlm.2014.12.014
更新日期：2015-03-01 00:00:00
abstract：:Inactivation of the rodent medial prefrontal cortex (mPFC) and hippocampus or disconnection of the hippocampus from the mPFC produces deficits in spatial working memory tasks. Previous studies have shown that delay length determines the extent to which mPFC and hippocampus functionally interact, with both structures b...
journal_title：Neurobiology of learning and memory
pub_type： 杂志文章
doi：10.1016/j.nlm.2015.09.007
更新日期：2015-11-01 00:00:00
abstract：:Considerable work demonstrates that Pavlovian fear conditioning depends on N-methyl-D-aspartate (NMDA) receptor-dependent plasticity within the amygdala. In addition, the bed nucleus of the stria terminalis (BNST) has also been implicated in fear conditioning, particularly in the expression of fear to poor predictors ...
journal_title：Neurobiology of learning and memory
pub_type： 杂志文章
doi：10.1016/j.nlm.2020.107281
更新日期：2020-10-01 00:00:00
abstract：:Autism Spectrum Disorders are a heterogeneous group of neurodevelopmental disorders, with rising incidence but little effective therapeutic intervention available. Currently two main clinical features are described to diagnose ASDs: impaired social interaction and communication, and repetitive behaviors. Much work has...
journal_title：Neurobiology of learning and memory
pub_type： 杂志文章,评审
doi：10.1016/j.nlm.2015.07.013
更新日期：2015-10-01 00:00:00
abstract：:The immunotoxin 192-saporin, infused intracerebroventricularly into rats, destroys cholinergic neurons in the basal forebrain nuclei. Doses required for complete cholinergic loss also kill some Purkinje cells. The immunotoxin OX7-saporin, when infused intraventricularly into rats, destroys Purkinje cells in a pattern ...
journal_title：Neurobiology of learning and memory
pub_type： 杂志文章
doi：10.1006/nlme.1998.3884
更新日期：1999-05-01 00:00:00
abstract：:In the wild, house mice live in social groups, whereas in the laboratory male mice are often singly housed. Environmental enrichment such as that provided by social housing has been argued to improve the cognitive performance of laboratory animals in experimental tests. The aim of the present study was to test the cos...
journal_title：Neurobiology of learning and memory
pub_type： 杂志文章
doi：10.1016/j.nlm.2005.08.004
更新日期：2005-11-01 00:00:00
abstract：:Mitogen-activated protein kinase (MAPK) is abundantly expressed in postmitotic neurons of the developed nervous system. MAPK is activated and required for induction of long-term potentiation (LTP) in the CA1 area of the hippocampus, which is blocked by the specific inhibitor of the MAPK kinase, PD 098059. Recently it ...
journal_title：Neurobiology of learning and memory
pub_type： 杂志文章
doi：10.1006/nlme.1999.3913
更新日期：2000-01-01 00:00:00
abstract：:Acetylcholine plays an important role in regulating the processing of sensory stimuli, and understanding its specific cellular actions is critical to understanding how sensory cortex develops and functions in different behavioral states. Here we review recent work on the cellular effects of nicotinic receptor activati...
journal_title：Neurobiology of learning and memory
pub_type： 杂志文章,评审
doi：10.1016/s1074-7427(03)00062-5
更新日期：2003-11-01 00:00:00
abstract：:Molecular genetic manipulation of the mouse offers the possibility of elucidating the function of individual gene products in neural systems underlying learning and memory. Many extant learning paradigms for mice rely on negative reinforcement, involve simple problems that are relatively rapidly acquired and thus prec...
journal_title：Neurobiology of learning and memory
pub_type： 杂志文章
doi：10.1006/nlme.1999.3951
更新日期：2000-11-01 00:00:00
abstract：:Based on computational models of the hippocampus, it has been suggested that a possible mechanism for memory retrieval is pattern completion, wherein an autoassociative network recalls previous patterns of activity given noisy or degraded cues. However, there are few behavioral data examining pattern completion per se...
journal_title：Neurobiology of learning and memory
pub_type： 杂志文章
doi：10.1016/j.nlm.2004.08.001
更新日期：2005-01-01 00:00:00
abstract：:Rett syndrome is an autism spectrum disorder and a leading cause of severe mental retardation in girls. The nature of the cognitive abnormalities in Rett, as described in humans and other animal models, and its potential reversibility and treatment are the subject of this review. Rett syndrome is associated with sever...
journal_title：Neurobiology of learning and memory
pub_type： 杂志文章,评审
doi：10.1016/j.nlm.2011.05.006
更新日期：2011-11-01 00:00:00
abstract：:Renewal, or reinstatement, of responding to food cues after extinction may explain the inability to resist palatable foods and change maladaptive eating habits. Previously, we found sex differences in context-dependent renewal of extinguished Pavlovian conditioned responding to food cues. Context-induced renewal invol...
journal_title：Neurobiology of learning and memory
pub_type： 杂志文章
doi：10.1016/j.nlm.2016.12.004
更新日期：2017-03-01 00:00:00
abstract：:Inappropriate defense-alerting reaction to fear is a common feature of neuropsychiatric diseases. Therefore, impairments in brain circuits, as well as in molecular pathways underlying the neurovegetative adjustments to fear may play an essential role on developing neuropsychiatric disorders. Here we tested the hypothe...
journal_title：Neurobiology of learning and memory
pub_type： 杂志文章
doi：10.1016/j.nlm.2015.11.012
更新日期：2016-01-01 00:00:00
abstract：:Cerebellar damage occurs during developmental stages in three mutant mice (staggerer, hot-foot, and lurcher), causing disturbances in posture and equilibrium. During three tests of motor coordination, the performances of staggerer mutants was inferior to that of normal mice and did not improve with extended practice f...
journal_title：Neurobiology of learning and memory
pub_type： 杂志文章
doi：10.1006/nlme.1996.0013
更新日期：1996-03-01 00:00:00
abstract：:Primary sensory cortices have been assumed to serve as stimulus analyzers while cognitive functions such as learning and memory have been allocated to "higher" cortical areas. However, the primary auditory cortex (A1) is now known to encode the acquired significance of sound as indicated by associatively-induced speci...
journal_title：Neurobiology of learning and memory
pub_type： 杂志文章
doi：10.1016/j.nlm.2009.02.008
更新日期：2009-07-01 00:00:00
abstract：:In the marine snail Hermissenda, associative learning can be accomplished by paired presentations of light and vestibular stimulation. It is generally assumed that associative learning depends upon the intensity or salience of the conditioned or unconditioned stimulus (CS and US, respectively). Accordingly, during Her...
journal_title：Neurobiology of learning and memory
pub_type： 杂志文章
doi：10.1006/nlme.1999.3938
更新日期：2000-07-01 00:00:00
abstract：:The authors evaluate a mapping of Rescorla and Wagner's (1972) behavioral model of classical conditioning onto the cerebellar substrates for motor reflex learning and illustrate how the limitations of the Rescorla-Wagner model are just as useful as its successes for guiding the development of new psychobiological theo...
journal_title：Neurobiology of learning and memory
pub_type： 杂志文章,评审
doi：10.1006/nlme.2001.4031
更新日期：2001-11-01 00:00:00
abstract：:Sign-tracking behavior, in which animals interact with a cue that predicts reward, provides an example of how incentive salience can be attributed to cues and elicit motivation. The nucleus accumbens (NAc) and ventral pallidum (VP) are two regions involved in cue-driven motivation. The VP, and NAc subregions including...
journal_title：Neurobiology of learning and memory
pub_type： 杂志文章
doi：10.1016/j.nlm.2019.05.001
更新日期：2019-07-01 00:00:00
abstract：:Non-selective inhibition of histone deacetylases (HDACs), enzymes that remove acetyl groups from histone core proteins, enhances cognition and NMDAR-dependent long-term potentiation at hippocampal CA3-CA1 synapses. It is not known whether this is a general mechanism by which HDACs modulate plasticity at other hippocam...
journal_title：Neurobiology of learning and memory
pub_type： 杂志文章
doi：10.1016/j.nlm.2014.06.008
更新日期：2014-10-01 00:00:00
abstract：:Previous studies have reported that drugs affecting neuromodulatory systems within the basolateral amygdala (BLA), including drugs affecting muscarinic cholinergic receptors, modulate the consolidation of many kinds of training, including contextual fear conditioning (CFC). The present experiments investigated the inv...
journal_title：Neurobiology of learning and memory
pub_type： 杂志文章
doi：10.1016/j.nlm.2008.07.012
更新日期：2009-01-01 00:00:00
abstract：:The unique polarity of neurons requires that synaptic inputs are relayed to the nucleus to trigger changes in gene expression. This long distance signaling process is crucial for the function and survival of neuronal circuits. To that end, neurons have developed multiple modes of signal transmission from the synapse t...
journal_title：Neurobiology of learning and memory
pub_type： 杂志文章,评审
doi：10.1016/j.nlm.2016.07.024
更新日期：2017-02-01 00:00:00
abstract：:It is currently well established that the synthesis of new proteins (mRNA translation) is required for long-lasting synaptic plasticity and memory formation. Translation in the brain is regulated primarily at the initiation stage by general as well as by gene-specific mechanisms. Stored memories can become sensitive t...
journal_title：Neurobiology of learning and memory
pub_type： 杂志文章,评审
doi：10.1016/j.nlm.2017.04.015
更新日期：2017-07-01 00:00:00
abstract：:Drug abuse, overeating, and smoking are all examples of instrumental behaviors that often involve chains or sequences of behavior. A behavior chain is minimally composed of a procurement response that is required in order for a subsequent consumption response to be reinforced. Despite the translational importance of b...
journal_title：Neurobiology of learning and memory
pub_type： 杂志文章,评审
doi：10.1016/j.nlm.2016.06.005
更新日期：2016-09-01 00:00:00
abstract：:The consolidation of newly formed memories occurs slowly, allowing memories to be altered by experience for some time after their formation. Various treatments, including arousal, can modulate memory consolidation when given soon after learning, but the degree of time-dependency of these treatments in humans has not b...
journal_title：Neurobiology of learning and memory
pub_type： 杂志文章
doi：10.1016/j.nlm.2007.03.005
更新日期：2007-07-01 00:00:00
abstract：:Every learning event is embedded in a context, but not always does the context become an integral part of the memory; however, for extinction learning it usually does, resulting in context-specific conditioned responding. The neuronal mechanisms underlying contextual control have been mainly investigated for Pavlovian...
journal_title：Neurobiology of learning and memory
pub_type： 杂志文章
doi：10.1016/j.nlm.2017.05.012
更新日期：2017-10-01 00:00:00
