Building blocks of self-control: increased tolerance for delay with bundled rewards.

Abstract:

:Impulsive choice can be defined as temporary preference for a smaller-sooner reward (SS) over a larger-later reward (LL). Hyperbolic discounting implies that impulsive choices will occur less when organisms choose between a series of SSs versus LLs all at once than when they choose between single SS versus LL pairs. Eight rats were exposed to two conditions of an intertemporal choice paradigm using sucrose solution as reward. In both conditions, the LL was 150 microl delayed by 3 s, while the SS was an immediate reward that ranged from 25-150 microl across sessions. Preference for the LL was greater when the chosen reward was automatically delivered three times in succession (bundled) than when it was chosen singly and delivered after each choice. For each of the 8 rats, the estimated SS amount that produced indifference was higher in the bundled condition than in the single condition. Because bundling in humans may be based on the perception that one's current choice is predictive of future choices, the data presented here may demonstrate an important building block of self-control.

journal_name

J Exp Anal Behav

authors

Ainslie G,Monterosso JR

doi

10.1901/jeab.2003.79-37

subject

Has Abstract

pub_date

2003-01-01 00:00:00

pages

37-48

issue

1

eissn

0022-5002

issn

1938-3711

journal_volume

79

pub_type

杂志文章
  • Punished and unpunished responding in multiple variable-interval schedules.

    abstract::The performance of rats trained on multiple variable-interval schedules was examined before, during, and after punishment. The same linear function related relative response rates to relative density of reinforcement both in the presence and absence of punishment. Equal relative suppression was seen in both the high a...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1968.11-147

    authors: Tullis C,Walters G

    更新日期:1968-03-01 00:00:00

  • A quantitative analysis of sensitivity to the conditioned reinforcing value of terminal-link stimuli in a concurrent-chains schedule.

    abstract::Pigeons were exposed to a concurrent-chains schedule in which a single variable-interval 30-s schedule was used in the initial links and fixed-time schedules were used in the terminal links. Three types of keylight conditions were used in the terminal links. In the first condition, different delays were associated wit...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1993.60-587

    authors: Omino T

    更新日期:1993-11-01 00:00:00

  • Simple and conditional visual discrimination with wheel running as reinforcement in rats.

    abstract::Three experiments explored whether access to wheel running is sufficient as reinforcement to establish and maintain simple and conditional visual discriminations in nondeprived rats. In Experiment 1, 2 rats learned to press a lit key to produce access to running; responding was virtually absent when the key was dark, ...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1998.70-103

    authors: Iversen IH

    更新日期:1998-09-01 00:00:00

  • Timeout postponement without increased reinforcement frequency.

    abstract::Three experiments were conducted to examine pigeons' postponement of signaled extinction periods (timeouts) from a schedule of food reinforcement when such responding neither decreased overall timeout frequency nor increased the overall frequency of food reinforcement. A discrete-trial procedure was used in which a re...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.2000.74-147

    authors: Pietras CJ,Hackenberg TD

    更新日期:2000-09-01 00:00:00

  • Negative behavioral contrast on multiple treadle-press schedules.

    abstract::Eight pigeons pressed treadles for food reinforcers delivered by several multiple variable-interval schedules. The rate of reinforcement for responding during one component schedule was held constant at 30 reinforcers per hour. The rate of reinforcement for responding during the other component varied from 0 to 120 or...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1978.29-463

    authors: McSweeney FK

    更新日期:1978-05-01 00:00:00

  • Signalled free-operant avoidance of shock by pigeons pecking a key.

    abstract::Two pigeons were trained to peck a key under a free-operant avoidance schedule. Then, changes in key color signalled the beginning (safe period) and the end (warning period) of the response-shock interval, with a response required to change the key color. Finally, a change in key color signalled the warning period and...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1977.27-281

    authors: De Moraes AB,Todorov JC

    更新日期:1977-03-01 00:00:00

  • Concurrent schedule control of human visual target fixations.

    abstract::Operant conditioning techniques were applied to the study of how target fixations are controlled by the probability of signal occurrence. In a standard vigilance setting, gaze at three illuminable volt meters was monitored by a Mackworth television eye camera with automatic recording capability. Gaze at a given meter ...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1973.20-411

    authors: Rosenberger PB

    更新日期:1973-11-01 00:00:00

  • The local organization of behavior: dissociations between a pigeon's behavior and self-reports of that behavior.

    abstract::The purpose of the experiment was to study the relation between what an organism does in a setting that demands temporal patterning of behavior and what it reports it has done. More specifically, a pigeon produced two classes, shorter and longer, of temporal patterns of key pecks (interresponse times) on a center key....

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1983.39-61

    authors: Shimp CP

    更新日期:1983-01-01 00:00:00

  • Secondary reinforcement and number of primary reinforcements.

    abstract::Pigeons' pecks on either of two concurrently available response keys produced secondary reinforcers according to independent one-minute variable-interval schedules. Different secondary reinforcers, in the presence of which the rates of primary reinforcement were equal, were associated with each key. The rate of peckin...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1968.11-9

    authors: Fantino E,Herrnstein RJ

    更新日期:1968-01-01 00:00:00

  • Key pecking as a function of response-shock and shock-shock intervals in unsignalled avoidance.

    abstract::Five pigeons were exposed to an unsignalled avoidance procedure where key pecks were maintained through shock postponement. Functions obtained showed an inverse relationship between rate of responding and length of the response-shock interval, while changes in the shock-shock interval had no systematic effect on respo...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1974.22-215

    authors: Todorov JC,Ferrari EA,De Souza DG

    更新日期:1974-07-01 00:00:00

  • Substitution and caloric regulation in a closed economy.

    abstract::Three experiments were conducted to study the effect of an imperfect substitute for food on demand for food in a closed economy. In Experiments 1 and 2, rats pressed a lever for their entire daily food ration, and a fixed ratio of presses was required for each food pellet. In both experiments, the fixed ratio was held...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1996.65-401

    authors: Bauman RA,Raslear TG,Hursh SR,Shurtleff D,Simmons L

    更新日期:1996-03-01 00:00:00

  • Rats' lever-press durations as psychophysical judgements of time.

    abstract::Hungry rats received food following lever-press durations exceeding a minimum value, which ranged from 0 to 6.4 sec. When no intertrial intervals separated successive presses, modal press durations remained at very short values as the minimum value required for food was increased. This was particularly true immediatel...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1973.19-239

    authors: Platt JR,Kuch DO,Bitgood SC

    更新日期:1973-03-01 00:00:00

  • Stimulus control and auditory discrimination learning sets in the bottlenose dolphin.

    abstract::The learning efficiency of an Atlantic bottlenose dolphin was evaluated using auditory discrimination learning-set tasks. Efficiency, as measured by the probability of a correct response on Trial 2 of a new discrete-trial, two-choice auditory discrimination problem, reached levels comparable to those attained by advan...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1973.19-379

    authors: Herman LM,Arbeit WR

    更新日期:1973-05-01 00:00:00

  • Effects of GABA modulators on the repeated acquisition of response sequences in squirrel monkeys.

    abstract::The present study investigated the effects of positive and negative GABA(A) modulators under three different baselines of repeated acquisition in squirrel monkeys in which the monkeys acquired a three-response sequence on three keys under a second-order fixed-ratio (FR) schedule of food reinforcement. In two of these ...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.2004.82-37

    authors: Campbell UC,Winsauer PJ,Stevenson MW,Moerschbaecher JM

    更新日期:2004-07-01 00:00:00

  • The reinforcement value of schedule-induced drinking.

    abstract::The effect of food reinforcement schedules on the reinforcement value of drinking water was evaluated. Food-deprived rats were exposed to concurrent, identical variable-time schedules of food presentation, the food thus being delivered independently of the rats' behavior. When the relative amount of time spent in a sc...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1975.23-37

    authors: Cohen IL

    更新日期:1975-01-01 00:00:00

  • Fixed-interval limited-hold avoidance with and without signalled reinforcement.

    abstract::Rats trained to lever press on a fixed-interval limited-hold avoidance schedule maintained a pattern of responding similar to that maintained by fixed-interval limited-hold schedules of positive reinforcement. But this positively accelerated pattern of behavior was maintained only when the occurrence of reinforcement ...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1972.17-75

    authors: Black RE,Walters GC,Webster CD

    更新日期:1972-01-01 00:00:00

  • The influence of ultraviolet radiation on the pigeon's color discrimination.

    abstract::Two experiments demonstrated the pigeon's sensitivity to ultraviolet light. In Experiment I, pigeons' responses were reinforced on a multiple schedule with a variable-interval reinforcement schedule in one component and extinction in the other component. Response rates were quite different in the two components where ...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1972.17-325

    authors: Wright AA

    更新日期:1972-05-01 00:00:00

  • PARAMETERS AFFECTING THE ACQUISITION OF SIDMAN AVOIDANCE.

    abstract::Four studies were conducted to investigate the source of reinforcement of Sidman avoidance. First it was found that the acquisition of avoidance was seriously impaired if there was no immediate stimulus consequence of responding, i.e., proprioceptive and auditory feedback. The second study showed that if the shock-sho...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1964.7-315

    authors: BOLLES RC,POPP RJ Jr

    更新日期:1964-07-01 00:00:00

  • OPERANT CONTROL OF PREENING IN PIGEONS.

    abstract::Preening in four pigeons was observed and recorded during operant level determinations, continuous and variable interval reinforcement, and extinction. The rate at which preening responses occur seems to be controlled by reinforcement in the same way as other operant behavior. Preening during VI reinforcement and exti...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1964.7-351

    authors: HOGAN JA

    更新日期:1964-09-01 00:00:00

  • On immediate function.

    abstract::Behavior is a property of living organisms, not of inanimate matter. The problems of physical science are to understand how a phenomenon works; biological science adds the questions of what a phenomenon does and how something that does such things came to be. Exclusive dedication to cause-effect explanations ignores h...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1992.57-417

    authors: Zeiler MD

    更新日期:1992-05-01 00:00:00

  • Fixed ratio and extinction performance of infants in the second year of life.

    abstract::Five 14(1/2)- to 19(1/2)-month-old infants were trained to lever press for snacks on small fixed ratio schedules of reinforcement. Within four to nine sessions, responding under FR 10 was established for four subjects and FR 15 for the other. Each subject's last session revealed behavioral patterns similar to animal a...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1966.9-105

    authors: Weisberg P,Fink E

    更新日期:1966-03-01 00:00:00

  • Uninstructed human responding: Sensitivity of low-rate performance to schedule contingencies.

    abstract::College students' presses on a telegraph key occasionally turned on a light in the presence of which button presses produced points later exchangeable for money. Initially, responding was maintained by low-rate contingencies superimposed on either random-interval or random-ratio schedules. Later, the low-rate continge...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1981.36-207

    authors: Shimoff E,Catania AC,Matthews BA

    更新日期:1981-09-01 00:00:00

  • Concurrent variable-interval variable-ratio schedules can provide only weak evidence for matching.

    abstract::Herrnstein and Heyman (1979) showed that when pigeons' pecking is reinforced on concurrent variable-interval variable-ratio schedules, (1) their behavior ratios match the ratio of the schedules' reinforcer frequencies, and (2) there is more responding on the variable interval. Since maximizing the reinforcement rate w...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1984.41-83

    authors: Ziriax JM,Silberberg A

    更新日期:1984-01-01 00:00:00

  • Short-term memory in the rhesus monkey: A behavioral analysis of delayed-response performance.

    abstract::This study obtained quantitative data on the bodily orientations of rhesus monkeys in a delayed-response task and determined whether such orientations mediate the correct response in a choice trial. The basic task was a two-key chain schedule with the key leading to food signaled in the initial component. During the s...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1980.33-359

    authors: Kojima S

    更新日期:1980-05-01 00:00:00

  • Theories of probabilistic reinforcement.

    abstract::In three experiments, pigeons chose between two alternatives that differed in the probability of reinforcement and the delay to reinforcement. A peck at a red key led to a delay of 5 s and then a possible reinforcer. A peck at a green key led to an adjusting delay and then a certain reinforcer. This delay was adjusted...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1989.51-87

    authors: Mazur JE

    更新日期:1989-01-01 00:00:00

  • TEMPORALLY SPACED RESPONDING BY PIGEONS: DEVELOPMENT AND EFFECTS OF DEPRIVATION AND EXTINCTION.

    abstract::In the first five or six sessions on a DRL 20-sec schedule of reinforcement there developed a stable performance characterized by a relatively constant conditional probability of occurrence (IRTs/op) of interresponse times (IRTs) of durations greater than 5 or 6 sec. Extinction and the level of deprivation changed bot...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1964.7-415

    authors: REYNOLDS GS

    更新日期:1964-11-01 00:00:00

  • Influences on cocaine tolerance assessed under a multiple conjunctive schedule of reinforcement.

    abstract::Under multiple schedules of reinforcement, previous research has generally observed tolerance to the rate-decreasing effects of cocaine that has been dependent on schedule-parameter size in the context of fixed-ratio (FR) schedules, but not under the context of fixed-interval (FI) schedules of reinforcement. The curre...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.2009.92-413

    authors: Yoon JH,Branch MN

    更新日期:2009-11-01 00:00:00

  • A decision model for steady-state choice in concurrent chains.

    abstract::Grace and McLean (2006) proposed a decision model for acquisition of choice in concurrent chains which assumes that after reinforcement in a terminal link, subjects make a discrimination whether the preceding reinforcer delay was short or long relative to a criterion. Their model was subsequently extended by Christens...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.2010.94-227

    authors: Christensen DR,Grace RC

    更新日期:2010-09-01 00:00:00

  • OPERANT CONDITIONING OF GOATS.

    abstract::A procedure is described for establishing an operant response in goats. The operanda are two lucite panels which can be transilluminated. The goats press the panels with their muzzles and are reinforced with whole oats. All six subjects showed reliable and accurate performance in brightness discrimination, including c...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1964.7-263

    authors: WENZEL BM,BALDWIN BA,TSCHIRGI RD

    更新日期:1964-05-01 00:00:00

  • Generalization peak shift for autoshaped and operant key pecks.

    abstract::Pigeons acquired discriminated key pecking between 528- and 540-nm stimuli by either a response-reinforcer (operant group) or a stimulus-reinforcer (autoshaped group) contingency, with other training-schedule parameters comparable over groups. For the birds in the operant group, key pecks intermittently produced grain...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1992.57-127

    authors: Weiss SJ,Weissman RD

    更新日期:1992-03-01 00:00:00