Nonlinear temporal integration of brain stimulation reward.

Abstract:

:A good deal is known about psychological factors that contribute to reward value, but very little is known about how reward is computed in the brain. Integration in the circuit for brain stimulation reward may provide a simple model system. Parametric studies have favored the idea that the integration is linear, although a few have suggested that it involves adaptation. However, these studies have generally not focused on relevance to psychological factors such as temporal discounting of reward. To begin to address these issues, I gave rats a choice between a simple train of 2 seconds of stimulation at a uniform frequency and a compound train of 1 second of stimulation at either 50, 150, or 250 Hz immediately followed by 1 second of stimulation at 50, 150, or 250 Hz, for a total of nine compound trains. For each compound train, the frequency of the simple train was varied until a level was found that produced indifference. The order of the frequencies was important, with Hi-Lo compound stimulation having a higher matching frequency than the symmetrical Lo-Hi. Furthermore, there was an interaction between the first and second frequencies, with the second frequency counting less when the first frequency was high. The results could be fit by computational models incorporating the ideas of either (a) adaptation or (b) temporal discounting and a power function psychological scale. These results suggest that integration in the brain stimulation reward system is nonlinear, and involves either adaptation or temporal discounting of reward value.

journal_name

Behav Neurosci

journal_title

Behavioral neuroscience

authors

Hawkins RD

doi

10.1037/a0026180

subject

Has Abstract

pub_date

2011-12-01 00:00:00

pages

892-9

issue

6

eissn

0735-7044

issn

1939-0084

pii

2011-27519-006

journal_volume

125

pub_type

杂志文章
  • Effects of passive-avoidance training on sleep-wake state-specific activity in the basolateral and central nuclei of the amygdala.

    abstract::This study examined the effects of intense emotional learning on the sleep-wake state-specific electroencephalographic (EEG) activities of the basolateral (BLA) and central (CeA) nuclei of the amygdala. Rats were trained on a passive-avoidance learning (PAL) protocol that was followed by 6 hr of undisturbed polygraphi...

    journal_title:Behavioral neuroscience

    pub_type: 杂志文章

    doi:10.1037/0735-7044.117.4.751

    authors: Mavanji V,Siwek DF,Patterson EH,Spoley EE,Datta S

    更新日期:2003-08-01 00:00:00

  • Instrumental learning within the rat spinal cord: localization of the essential neural circuit.

    abstract::Following spinal transection of the upper thoracic spinal cord, male Sprague-Dawley rats given legshock whenever a hindlimb is extended learn to maintain the leg in a flexed position. The region of the cord that mediates this instrumental learning was isolated using neuroanatomical tracing, localized infusion of lidoc...

    journal_title:Behavioral neuroscience

    pub_type: 杂志文章

    doi:10.1037/0735-7044.119.2.538

    authors: Liu GT,Ferguson AR,Crown ED,Bopp AC,Miranda RC,Grau JW

    更新日期:2005-04-01 00:00:00

  • Identification of quantitative trait loci involved in contextual and auditory-cued fear conditioning in BXD recombinant inbred strains.

    abstract::Fear conditioning shows associations formed between contextual or auditory stimuli with an unconditioned stimulus. Inbred mouse strains differ in their ability to demonstrate fear conditioning, suggesting at least a partial genetic influence. The present study identified the possible chromosomal loci regulating fear c...

    journal_title:Behavioral neuroscience

    pub_type: 杂志文章

    doi:10.1037//0735-7044.111.2.292

    authors: Owen EH,Christensen SC,Paylor R,Wehner JM

    更新日期:1997-04-01 00:00:00

  • Response characteristics of neurons in the medial component of the medial geniculate nucleus during Pavlovian differential fear conditioning in rabbits.

    abstract::Recent evidence suggests that the amygdaloid central nucleus (ACE) may contribute significantly to Pavlovian fear-conditioned bradycardic responses during the presentation of conditioned emotional stimuli. Because the medial component of the medial geniculate nucleus (MGm) is a major source of input to the region of t...

    journal_title:Behavioral neuroscience

    pub_type: 杂志文章

    doi:10.1037//0735-7044.103.6.1276

    authors: Supple WF Jr,Kapp BS

    更新日期:1989-12-01 00:00:00

  • Muscarinic cholinergic neuromodulation reduces proactive interference between stored odor memories during associative learning in rats.

    abstract::Previous electrophysiological studies and computational modeling suggest the hypothesis that cholinergic neuromodulation may reduce olfactory associative interference during learning (M. E. Hasselmo, B. P. Anderson, & J. M. Bower, 1992; M. E. Hasselmo & J. M. Bower, 1993). These results provide behavioral evidence sup...

    journal_title:Behavioral neuroscience

    pub_type: 杂志文章

    doi:

    authors: De Rosa E,Hasselmo ME

    更新日期:2000-02-01 00:00:00

  • Sensitivity to ethanol in inbred mice: genotypic correlations among several behavioral responses.

    abstract::The sensitivity of several inbred strains of mice was assessed for ethanol's effects on activity, body temperature, ataxia, balance, and the righting reflex. Genotypic correlations among the mean responses for the strains were estimated as indexes of pleiotropic influences of genes on drug responses. Three major group...

    journal_title:Behavioral neuroscience

    pub_type: 杂志文章

    doi:10.1037//0735-7044.97.2.280

    authors: Crabbe JC

    更新日期:1983-04-01 00:00:00

  • Hippocampal and amygdaloid involvement in nonspatial and spatial working memory in rats: effects of delay and interference.

    abstract::Parametric manipulations of the task demand were used to examine the role of the hippocampus and amygdala in nonspatial and spatial working memory in rats. Hippocampal lesions produced an immediate and long-lasting impairment of nonspatial working memory in an operant task. The memory deficits increased as the delay i...

    journal_title:Behavioral neuroscience

    pub_type: 杂志文章

    doi:10.1037//0735-7044.108.5.866

    authors: Wan RQ,Pang K,Olton DS

    更新日期:1994-10-01 00:00:00

  • Early postnatal handling alters glucocorticoid receptor concentrations in selected brain regions.

    abstract::Norway rat pups were either handled (H) or undisturbed (nonhandled, NH) in the period between birth and weaning on Day 21. Following weaning, half of the animals in each group were housed socially (Soc), and half were housed in isolation (Isol). At 120-150 days of age, all animals were sacrificed, and the following re...

    journal_title:Behavioral neuroscience

    pub_type: 杂志文章

    doi:10.1037//0735-7044.99.4.765

    authors: Meaney MJ,Aitken DH,Bodnoff SR,Iny LJ,Tatarewicz JE,Sapolsky RM

    更新日期:1985-08-01 00:00:00

  • Role of the hippocampus plus subjacent cortex but not amygdala in visuomotor conditional learning in rhesus monkeys.

    abstract::Rhesus monkeys were trained to learn a large series of visuomotor conditional associations, each involving the arbitrary coupling of a visual stimulus with 1 of 3 potentially correct forelimb movements. The monkeys then received bilateral aspiration lesions of either the amygdala plus subjacent cortex or the hippocamp...

    journal_title:Behavioral neuroscience

    pub_type: 杂志文章

    doi:10.1037//0735-7044.110.6.1261

    authors: Murray EA,Wise SP

    更新日期:1996-12-01 00:00:00

  • Emotion-modulated startle reflex during reappraisal: Probe timing and behavioral correlates.

    abstract::Down-regulation of negative emotions has been shown to reliably inhibit the emotion-modulated startle reflex, but it remains unclear whether the timing of the startle probe influences the quantification of emotion regulation with this measure. Moreover, it is not known whether the degree of startle inhibition correspo...

    journal_title:Behavioral neuroscience

    pub_type: 杂志文章

    doi:10.1037/bne0000271

    authors: Zaehringer J,Schmahl C,Ende G,Paret C

    更新日期:2018-12-01 00:00:00

  • Taste-potentiated odor conditioning: impairment produced by infusion of an N-methyl-D-aspartate antagonist into basolateral amygdala.

    abstract::Two experiments examined the effects of infusing an N-methyl-D-aspartate (NMDA) receptor antagonist, d-2-amino-5-phosphonovalerate(d-APV), on taste-potentiated odor conditioning: a form of learning that is dependent on information processing in 2 sensory modalities. In Experiment 1, rats infused with d-APV were impair...

    journal_title:Behavioral neuroscience

    pub_type: 杂志文章

    doi:10.1037//0735-7044.109.4.663

    authors: Hatfield T,Gallagher M

    更新日期:1995-08-01 00:00:00

  • Long-term effects of leucine-enkephalin on active avoidance responding in mice.

    abstract::The effects of peripherally administered leucine-enkephalin on the acquisition and retention of active avoidance behavior was studied in mice. Mice received 4 training trials on Day 1, 24 test trials on Day 2, and 10 test trials on Day 5. Leucine-enkephalin impaired the aquisition of avoidance behavior when administer...

    journal_title:Behavioral neuroscience

    pub_type: 杂志文章

    doi:10.1037//0735-7044.100.2.185

    authors: Dana RC,Martinez JL Jr

    更新日期:1986-04-01 00:00:00

  • Postischemic hyperactivity in the Mongolian gerbil correlates with loss of hippocampal neurons.

    abstract::Gerbils show a postischemic increase in locomotor activity that correlates to the extent of neuron loss in the hippocampal CA1 subfield. It has been suggested that this hyperactivity is predictive of neuron loss in the CA1. In this study the correlation between postischemic hyperactivity and neuron loss in several hip...

    journal_title:Behavioral neuroscience

    pub_type: 杂志文章

    doi:10.1037//0735-7044.111.6.1205

    authors: Andersen MB,Zimmer J,Sams-Dodd F

    更新日期:1997-12-01 00:00:00

  • Dopaminergic activity modulation via aggression, status, and a visual social signal.

    abstract::Social interaction may elicit aggression, establish social rank, and be influenced by changes in central dopaminergic activity. In the lizard Anolis carolinensis, a sign stimulus (darkening of postorbital skin or eyespots) inhibits aggressive response from opponents, in part because it forms more rapidly in dominant m...

    journal_title:Behavioral neuroscience

    pub_type: 杂志文章

    doi:10.1037/0735-7044.120.1.93

    authors: Korzan WJ,Forster GL,Watt MJ,Summers CH

    更新日期:2006-02-01 00:00:00

  • Nucleus basalis magnocellularis and substantia innominata corticopetal cholinergic lesions attenuate freezing induced by predator odor.

    abstract::Previous studies have demonstrated that corticopetal cholinergic lesions applied to the nucleus basalis magnocellularis and substantia innominata (NBM/SI) attenuate operant suppression induced by aversive events. However, these lesions have no effect on open-arm behavior in the elevated plus-maze or changes in startle...

    journal_title:Behavioral neuroscience

    pub_type: 杂志文章

    doi:10.1037/0735-7044.122.3.601

    authors: Knox D,Brothers H,Norman GJ,Berntson GG

    更新日期:2008-06-01 00:00:00

  • Quantitative analysis of the relation between gill amplitude and siphon duration in the defensive withdrawal reflex of Aplysia.

    abstract::The defensive withdrawal reflex of the mantle organs (gill, siphon, and mantle shelf) of the marine mollusc Aplysia californica has been the subject of numerous studies investigating the cellular and molecular mechanisms of learning. In behavioral experiments, the reflex has been monitored by means of two different re...

    journal_title:Behavioral neuroscience

    pub_type: 杂志文章

    doi:10.1037//0735-7044.101.2.292

    authors: Stopfer M,Carew TJ

    更新日期:1987-04-01 00:00:00

  • Effects of hydrocortisone on false memory recognition in healthy men and women.

    abstract::Most of the studies focusing on the effect of stress on false memories by using psychosocial and physiological stressors yielded diverse results. In the present study, we systematically tested the effect of exogenous hydrocortisone using a false memory paradigm. In this placebo-controlled study, 37 healthy men and 38 ...

    journal_title:Behavioral neuroscience

    pub_type: 杂志文章

    doi:10.1037/bne0000170

    authors: Duesenberg M,Weber J,Schaeuffele C,Fleischer J,Hellmann-Regen J,Roepke S,Moritz S,Otte C,Wingenfeld K

    更新日期:2016-12-01 00:00:00

  • Naloxone, preshock, and defensive burying.

    abstract::Rats were injected with naloxone hydrochloride (3 mg/kg) or saline and subjected to preshock or no preshock prior to receiving a test shock that elicited defensive burying. Preshock was administered in a context different from, or the same as, that in which the test shock was delivered. The combination of naloxone and...

    journal_title:Behavioral neuroscience

    pub_type: 杂志文章

    doi:10.1037//0735-7044.99.3.436

    authors: Whiteside DA,Devenport LD

    更新日期:1985-06-01 00:00:00

  • Auditory streaming by phase relations between components of harmonic complexes: a comparative study of human subjects and bird forebrain neurons.

    abstract::Auditory streaming describes a percept in which a sequential series of sounds either is segregated into different streams or is integrated into one stream based on differences in their spectral or temporal characteristics. This phenomenon has been analyzed in human subjects (psychophysics) and European starlings (neur...

    journal_title:Behavioral neuroscience

    pub_type: 杂志文章

    doi:10.1037/a0030249

    authors: Dolležal LV,Itatani N,Günther S,Klump GM

    更新日期:2012-12-01 00:00:00

  • Dependence of adolescent novelty-seeking behavior on response phenotype and effects of apparatus scaling.

    abstract::Adult rats have been phenotyped as high (HRs) or low (LRs) responders to novelty, the former associated with high-risk behaviors. Data indicating that adolescent rodents exhibit increased novelty-seeking relative to adults are equivocal, and phenotypic variations in adolescent novel stimulus reactivity are unknown. To...

    journal_title:Behavioral neuroscience

    pub_type: 杂志文章

    doi:10.1037/0735-7044.122.4.861

    authors: Philpot RM,Wecker L

    更新日期:2008-08-01 00:00:00

  • Selective effects of triazolam on memory for emotional, relative to neutral, stimuli: differential effects on gist versus detail.

    abstract::Benzodiazepines are known to reduce learning and memory performance, presumably through their facilitation of GABAergic neurotransmission, but the effects of these drugs specifically on memory for emotional material has not been addressed in humans. The effects of a benzodiazepine (triazolam, 0.25 mg) on nonincidental...

    journal_title:Behavioral neuroscience

    pub_type: 临床试验,杂志文章,随机对照试验

    doi:10.1037/0735-7044.117.3.517

    authors: Buchanan TW,Karafin MS,Adolphs R

    更新日期:2003-06-01 00:00:00

  • Phantom auditory sensation in rats: an animal model for tinnitus.

    abstract::In order to measure tinnitus induced by sodium salicylate injections, 84 pigmented rats, distributed among 14 groups in five experiments, were used in a conditioned suppression paradigm. In Experiment 1, all groups were trained with a conditioned stimulus (CS) consisting of the offset of a continuous background noise....

    journal_title:Behavioral neuroscience

    pub_type: 杂志文章

    doi:10.1037//0735-7044.102.6.811

    authors: Jastreboff PJ,Brennan JF,Coleman JK,Sasaki CT

    更新日期:1988-12-01 00:00:00

  • Cholinergic mechanisms of the context preexposure facilitation effect in adolescent rats.

    abstract::The context preexposure facilitation effect (CPFE) is a variant of contextual fear conditioning in which context learning, context-shock association, and expression of context conditioning occur in 3 separate phases-preexposure, training, and testing. During the preexposure phase, the CPFE is disrupted by hippocampal ...

    journal_title:Behavioral neuroscience

    pub_type: 杂志文章

    doi:10.1037/bne0000134

    authors: Robinson-Drummer PA,Dokovna LB,Heroux NA,Stanton ME

    更新日期:2016-04-01 00:00:00

  • The union of the state: myoclonic twitching is coupled with nuchal muscle atonia in infant rats.

    abstract::Active sleep (AS), as measured by the occurrence of myoclonic twitching (MT), is the most prevalent behavioral state in newborn rats. Historically, AS has been considered a developmental precursor of REM sleep, but recently this idea has been questioned. In the present study, the authors assess, in 2-, 5-, and 8-day-o...

    journal_title:Behavioral neuroscience

    pub_type: 杂志文章

    doi:10.1037//0735-7044.116.5.912

    authors: Karlsson KA,Blumberg MS

    更新日期:2002-10-01 00:00:00

  • Facilitation of fear extinction by midbrain periaqueductal gray infusions of RB101(S), an inhibitor of enkephalin-degrading enzymes.

    abstract::Mu-opioid receptors in the ventrolateral quadrant midbrain periaqueductal gray (vIPAG) contribute to extinction of conditioned fear. The present experiment studied whether fear extinction could be facilitated by infusions of a peptidase inhibitor that reduces catabolism of vIPAG enkephalins. Rats were trained to fear ...

    journal_title:Behavioral neuroscience

    pub_type: 杂志文章

    doi:10.1037/0735-7044.119.6.1672

    authors: McNally GP

    更新日期:2005-12-01 00:00:00

  • Deficits for representational memory induced by septal and cortical lesions (singly and combined) in rats.

    abstract::A differentiation was made between dispositional memory and representational memory. A delayed-nonmatching-to-sample task in a T-maze operationalized this distinction. Experimental brain lesions in posterior septum and in prelimbic cortex resulted in amnesia for representational memories. The amnesia ameliorated as a ...

    journal_title:Behavioral neuroscience

    pub_type: 杂志文章

    doi:

    authors: Thomas GJ,Spafford PS

    更新日期:1984-06-01 00:00:00

  • Receptor contributions to configural and elemental odor mixture perception.

    abstract::Odor mixture perception can be configural (the mixture is qualitatively different from the components) or elemental (the components are recognizable). Some have argued that configural properties are dependent on chemical similarity and possible overlap at the receptor level. The authors show that a binary mixture in w...

    journal_title:Behavioral neuroscience

    pub_type: 杂志文章

    doi:10.1037/0735-7044.117.5.1108

    authors: Kay LM,Lowry CA,Jacobs HA

    更新日期:2003-10-01 00:00:00

  • Interpositus lesion abolition of the eyeblink conditioned response is not due to effects on performance.

    abstract::Classical conditioning of the rabbit eyeblink response was used to study the effects of cerebellar lesions on performance in animals trained with low-intensity unconditioned stimuli (US). Animals were trained with 1 of 2 low-intensity corneal-airpuff USs paired with a tone-conditioned stimulus. This study confirms ear...

    journal_title:Behavioral neuroscience

    pub_type: 杂志文章

    doi:10.1037//0735-7044.107.3.530

    authors: Ivkovich D,Lockard JM,Thompson RF

    更新日期:1993-06-01 00:00:00

  • Differential behavioral response to dopamine D2 agonists by sexually naive, sexually active, and sexually inactive male rats.

    abstract::This study was performed with male rats categorized as sexually naive (SN), sexually active (SA), or sexually inactive (SI). In a first experiment the effects of dopamine (DA) D2 agonist SND 919 (0.05, 1, and 10 mg/kg) on the copulatory behavior of SN, SA and SI rats were assessed. In a second experiment the DA D2 ago...

    journal_title:Behavioral neuroscience

    pub_type: 杂志文章

    doi:10.1037//0735-7044.110.4.802

    authors: Giuliani D,Ferrari F

    更新日期:1996-08-01 00:00:00

  • Temporally dimorphic recruitment of dopamine neurons into stress response circuitry in Drosophila.

    abstract::Many studies have pointed to vulnerability to stress and stress-related pathologies at different timepoints during an individual's life span. These sensitive windows are usually during periods of neural development, such as embryogenesis, infancy, and adolescence. It is critical to understand how neural circuitry may ...

    journal_title:Behavioral neuroscience

    pub_type: 杂志文章

    doi:10.1037/a0033602

    authors: Argue KJ,Neckameyer WS

    更新日期:2013-10-01 00:00:00