Delay discounting of different outcomes: Review and theory.

Abstract:

:Steep delay discounting is characterized by a preference for small immediate outcomes relative to larger delayed outcomes and is predictive of drug abuse, risky sexual behaviors, and other maladaptive behaviors. Nancy M. Petry was a pioneer in delay discounting research who demonstrated that people discount delayed monetary gains less steeply than they discount substances with abuse liability. Subsequent research found steep discounting for not only drugs, but other nonmonetary outcomes such as food, sex, and health. In this systematic review, we evaluate the hypotheses proposed to explain differences in discounting as a function of the type of outcome and explore the trait- and state-like nature of delay discounting. We found overwhelming evidence for the state-like quality of delay discounting: Consistent with Petry and others' work, nonmonetary outcomes are discounted more steeply than monetary outcomes. We propose two hypotheses that together may account for this effect: Decreasing Future Preference and Decreasing Future Worth. We also found clear evidence that delay discounting has trait-like qualities: People who steeply discount monetary outcomes steeply discount nonmonetary outcomes as well. The implication is that changing delay discounting for one outcome could change discounting for other outcomes.

journal_name

J Exp Anal Behav

authors

Odum AL,Becker RJ,Haynes JM,Galizio A,Frye CCJ,Downey H,Friedel JE,Perez DM

doi

10.1002/jeab.589

subject

Has Abstract

pub_date

2020-05-01 00:00:00

pages

657-679

issue

3

eissn

0022-5002

issn

1938-3711

journal_volume

113

pub_type

杂志文章
  • Delay discounting in Lewis and Fischer 344 rats: steady-state and rapid-determination adjusting-amount procedures.

    abstract::Lewis rats have been shown to make more impulsive choices than Fischer 344 rats in discrete-trial choice procedures that arrange fixed (i.e., nontitrating) reinforcement parameters. However, nontitrating procedures yield only gross estimates of preference, as choice measures in animal subjects are rarely graded at the...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.2012.97-305

    authors: Stein JS,Pinkston JW,Brewer AT,Francisco MT,Madden GJ

    更新日期:2012-05-01 00:00:00

  • Reinforcement magnitude and the inhibiting effect of reinforcement.

    abstract::In a two-key concurrent variable-interval schedule (using pigeons), if the reinforcement frequency for one response is held constant while that for the other is increased, the rate of response on the constant key decreases. The immediate reinforcement for key pecking can usually be conceptualized as the change from a ...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1979.32-265

    authors: Michael JL

    更新日期:1979-09-01 00:00:00

  • Operant reinforcement of an autonomic response: two studies.

    abstract::Two successive studies were conducted to determine the possibility of operant reinforcement of nonspecific galvanic skin resistance responses. In the first study, with five experimental and three control subjects who served for 20 to 30 min a day for 10 days, all experimental subjects learned to emit more nonspecific ...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1967.10-119

    authors: Gavalas RJ

    更新日期:1967-01-01 00:00:00

  • The utility of verbal and behavioral assessments of value.

    abstract::Subjects lived in a laboratory apartment for up to 30 days, engaging in ordinary activities such as reading, sewing, and artwork. The amount of time devoted to each activity was recorded and compared with periodic verbal ratings of the amount of time devoted to the activities. The verbal and observational assessments ...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1990.54-173

    authors: Bernstein DJ,Michael RL

    更新日期:1990-11-01 00:00:00

  • Observing responses and serial stimuli: searching for the reinforcing properties of the S-.

    abstract::The control exerted by a stimulus associated with an extinction component (S-) on observing responses was determined as a function of its temporal relation with the onset of the reinforcement component. Lever pressing by rats was reinforced on a mixed random-interval extinction schedule. Each press on a second lever p...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.2009.92-215

    authors: Escobar R,Bruner CA

    更新日期:2009-09-01 00:00:00

  • Fixed ratio and extinction performance of infants in the second year of life.

    abstract::Five 14(1/2)- to 19(1/2)-month-old infants were trained to lever press for snacks on small fixed ratio schedules of reinforcement. Within four to nine sessions, responding under FR 10 was established for four subjects and FR 15 for the other. Each subject's last session revealed behavioral patterns similar to animal a...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1966.9-105

    authors: Weisberg P,Fink E

    更新日期:1966-03-01 00:00:00

  • About Skinner and time: behavior-analytic contributions to research on animal timing.

    abstract::The article discusses two important influences of B. F. Skinner, and later workers in the behavior-analytic tradition, on the study of animal timing. The first influence is methodological, and is traced from the invention of schedules imposing temporal constraints or periodicities on animals in The Behavior of Organis...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章,评审

    doi:10.1901/jeab.2006.85.04

    authors: Lejeune H,Richelle M,Wearden JH

    更新日期:2006-01-01 00:00:00

  • Testing response-stimulus equivalence relations using differential responses as a sample.

    abstract::This study tested the notion that an equivalence relation may include a response when differential responses are paired with stimuli presented during training. Eight normal adults learned three kinds of computer mouse movements as differential response topographies (R1, R2, and R3). Next, in matching-to-sample trainin...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.2006.04-03

    authors: Shimizu H

    更新日期:2006-09-01 00:00:00

  • Quantification of rats' behavior during reinforcement periods.

    abstract::What is treated as a single unit of reinforcement often involves what could be called a reinforcement period during which two or more acts of ingestion may occur, and each of these may have associated with it a series of responses, some reflexive, some learned, that lead up to ingestion. Food-tray presentation to a pi...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1983.39-457

    authors: Gunn KP

    更新日期:1983-05-01 00:00:00

  • Background activities, induction, and behavioral allocation in operant performance.

    abstract::In experiments on operant behavior, other activities, called "background" activities, compete with the operant activities. Herrnstein's (1970) formulation of the matching law included background reinforcers in the form of a parameter rO, but remained vague about the activities (BO) that produce rO. To gain more unders...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1002/jeab.100

    authors: Baum WM,Davison M

    更新日期:2014-09-01 00:00:00

  • The general matching law describes choice on concurrent variable-interval schedules of wheel-running reinforcement.

    abstract::Six male Wistar rats were exposed to concurrent variable-interval schedules of wheel-running reinforcement. The reinforcer associated with each alternative was the opportunity to run for 15 s, and the duration of the changeover delay was 1 s. Results suggested that time allocation was more sensitive to relative reinfo...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.2001.75-299

    authors: Belke TW,Belliveau J

    更新日期:2001-05-01 00:00:00

  • Associative concept learning in animals.

    abstract::Nonhuman animals show evidence for three types of concept learning: perceptual or similarity-based in which objects/stimuli are categorized based on physical similarity; relational in which one object/stimulus is categorized relative to another (e.g., same/different); and associative in which arbitrary stimuli become ...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章,评审

    doi:10.1002/jeab.55

    authors: Zentall TR,Wasserman EA,Urcuioli PJ

    更新日期:2014-01-01 00:00:00

  • THE EFFECT OF MULTIPLE S-DELTA PERIODS ON RESPONDING ON A FIXED-INTERVAL SCHEDULE. II. IN A PRIMATE.

    abstract::A squirrel monkey was subjected to a fixed-interval pattern of reinforcement. During the course of each interval a bright white light was repeatedly presented. In the presence of the white light, a response was never immediately followed by food; the white light thus functioned as S(Delta). Responding was interrupted ...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1965.8-53

    authors: DEWS PB

    更新日期:1965-01-01 00:00:00

  • Stock optimizing: maximizing reinforcers per session on a variable-interval schedule.

    abstract::In Experiment 1, 2 monkeys earned their daily food ration by pressing a key that delivered food according to a variable-interval 3-min schedule. In Phases 1 and 4, sessions ended after 3 hr. In Phases 2 and 3, sessions ended after a fixed number of responses that reduced food intake and body weights from levels during...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1993.59-389

    authors: Silberberg A,Bauman R,Hursh S

    更新日期:1993-03-01 00:00:00

  • The effects of component duration on multiple-schedule performance in closed and open economies.

    abstract::Pigeons responded on multiple variable-interval variable-interval schedules of reinforcement in an open and a closed economy. Equal duration components were increased in duration while the component rates of reinforcement were held constant, the component schedules were reversed, and component duration was decreased. ...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1988.50-457

    authors: La Fiette MH,Fantino E

    更新日期:1988-11-01 00:00:00

  • Failure to observe untested derived stimulus relations in extinction: implications for understanding stimulus-equivalence formation.

    abstract::Wilson and Hayes (1996) and Doughty, Kastner, and Bismark (2011) observed resurgence of past equivalence relations when newer equivalence relations were punished or extinguished, respectively. Their findings support the notion that deriving stimulus relations is a form of operant behavior. Although there is consensus ...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1002/jeab.111

    authors: Doughty AH,Leake LW,Stoudemire ML

    更新日期:2014-11-01 00:00:00

  • A functional-analytic model of analogy: a relational frame analysis.

    abstract::The aim of this study was to explore a behavior-analytic model of analogical reasoning, defined as the discrimination of formal similarity via equivalence-equivalence responding. In Experiment 1, adult humans were trained and tested for the formation of four three-member equivalence relations: A1-B1-C1, A2-B2-C2, A3-B...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.2002.78-375

    authors: Stewart I,Barnes-Holmes D,Roche B,Smeets PM

    更新日期:2002-11-01 00:00:00

  • Conditional discrimination learning: a critique and amplification.

    abstract::Carter and Werner recently reviewed the literature on conditional discrimination learning by pigeons, which consists of studies of matching-to-sample and oddity-from-sample. They also discussed three models of such learning: the "multiple-rule" model (learning of stimulus-specific relations), the "configuration" model...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1980.33-291

    authors: Schrier AM,Thompson CR

    更新日期:1980-03-01 00:00:00

  • On the law of effect.

    abstract::Experiments on single, multiple, and concurrent schedules of reinforcement find various correlations between the rate of responding and the rate or magnitude of reinforcement. For concurrent schedules (i.e., simultaneous choice procedures), there is matching between the relative frequencies of responding and reinforce...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1970.13-243

    authors: Herrnstein RJ

    更新日期:1970-03-01 00:00:00

  • Concurrent variable-interval variable-ratio schedules can provide only weak evidence for matching.

    abstract::Herrnstein and Heyman (1979) showed that when pigeons' pecking is reinforced on concurrent variable-interval variable-ratio schedules, (1) their behavior ratios match the ratio of the schedules' reinforcer frequencies, and (2) there is more responding on the variable interval. Since maximizing the reinforcement rate w...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1984.41-83

    authors: Ziriax JM,Silberberg A

    更新日期:1984-01-01 00:00:00

  • Response duration is sensitive to both immediate and delayed reinforcement.

    abstract::We investigated the duration of lever pressing by rats when the delivery of appetitive reinforcers was contingent upon response duration. In the first experiment, response durations increased when duration requirements were imposed, and they decreased when duration requirements were removed. This effect occurred wheth...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1002/jeab.491

    authors: Byrne T,Sarno B

    更新日期:2019-01-01 00:00:00

  • Effects of discrete-trial and free-operant procedures on the acquisition and maintenance of successive discrimination in rats.

    abstract::Rats were trained on a successive discrete-trial discrimination between two tonal stimuli to examine the effects of availability of a lever during intertrial intervals. In the discrete-trial condition, in which a lever was removed from the chamber during intertrial intervals, 10-s trials were initiated by the presenta...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1991.55-3

    authors: Hachiya S,Ito M

    更新日期:1991-01-01 00:00:00

  • A test of the reinforcing properties of stimuli correlated with nonreinforcement.

    abstract::The information hypothesis of conditioned reinforcement predicts that a stimulus that "reduces uncertainty" about the outcome of a trial will acquire reinforcing properties, even when the stimulus reliably predicts nonreinforcement. Four pigeons' key pecks produced one of two 5-sec stimuli with 0.50 probability accord...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1976.26-45

    authors: Katz HN

    更新日期:1976-07-01 00:00:00

  • Implicit sequence learning in ring-tailed lemurs (Lemur catta).

    abstract::Implicit learning involves picking up information from the environment without explicit instruction or conscious awareness of the learning process. In nonhuman animals, conscious awareness is impossible to assess, so we define implicit learning as occurring when animals acquire information beyond what is required for ...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1002/jeab.180

    authors: Drucker CB,Baghdoyan T,Brannon EM

    更新日期:2016-01-01 00:00:00

  • Bouts of responding on variable-interval schedules: effects of deprivation level.

    abstract::Rats obtained food pellets on a variable-interval schedule of reinforcement by nose poking a lighted key. After training to establish baseline performance (with the mean variable interval set at either 60, 120, or 240 s), the rats were given free access to food during the hour just before their daily session. This sat...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.2004.81-155

    authors: Shull RL

    更新日期:2004-03-01 00:00:00

  • Randomization procedures in single-case intervention research contexts: (Some of) "the rest of the story".

    abstract::Following up on articles recently published in this journal, the present contribution tells (some of) "the rest of the story" about the value of randomization in single-case intervention research investigations. Invoking principles of internal, statistical-conclusion, and external validity, we begin by emphasizing the...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1002/jeab.558

    authors: Levin JR,Kratochwill TR,Ferron JM

    更新日期:2019-11-01 00:00:00

  • Classical conditioning of courting behavior in the Japanese quail, Coturnix coturnix japonica.

    abstract::Male Japanese quail were classically conditioned to display courting behavior at the sound of a buzzer, a previously neutral stimulus. The buzzer (conditioned stimulus) was paired with the presentation of a female quail (unconditioned stimulus) for a number of trials. The courting display, invariably elicited from the...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1967.10-213

    authors: Farris HE

    更新日期:1967-03-01 00:00:00

  • Elicited responding in chain schedules.

    abstract::An omission procedure was employed to study elicited pecking in the first component of a two-component chain schedule. Both components were fixed-interval schedules correlated with colored keylights. The first response following the initial-link schedule produced a second fixed-interval schedule. We studied several fi...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1991.56-475

    authors: Dougherty DM,Lewis P

    更新日期:1991-11-01 00:00:00

  • Dimensional stimulus control following brief wavelength training.

    abstract::Pigeons with extensive training pecking a key illuminated by a white line then had brief training with the key illuminated by 555 nanometers. This was immediately followed by a wavelength generalization test in extinction. Dimensional stimulus control about the training wavelength increased with the duration and numbe...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1976.26-191

    authors: Weisman RG,Thio H

    更新日期:1976-09-01 00:00:00

  • Dynamic probability of reinforcement for cooperation: Random game termination in the centipede game.

    abstract::Experimental games have previously been used to study principles of human interaction. Many such games are characterized by iterated or repeated designs that model dynamic relationships, including reciprocal cooperation. To enable the study of infinite game repetitions and to avoid endgame effects of lower cooperation...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1002/jeab.320

    authors: Krockow EM,Colman AM,Pulford BD

    更新日期:2018-03-01 00:00:00