Effects of time between trials on rats' and pigeons' choices with probabilistic delayed reinforcers.

Abstract:

:Parallel experiments with rats and pigeons examined reasons for previous findings that in choices with probabilistic delayed reinforcers, rats' choices were affected by the time between trials whereas pigeons' choices were not. In both experiments, the animals chose between a standard alternative and an adjusting alternative. A choice of the standard alternative led to a short delay (1 s or 3 s), and then food might or might not be delivered. If food was not delivered, there was an "interlink interval," and then the animal was forced to continue to select the standard alternative until food was delivered. A choice of the adjusting alternative always led to food after a delay that was systematically increased and decreased over trials to estimate an indifference point--a delay at which the two alternatives were chosen about equally often. Under these conditions, the indifference points for both rats and pigeons increased as the interlink interval increased from 0 s to 20 s, indicating decreased preference for the probabilistic reinforcer with longer time between trials. The indifference points from both rats and pigeons were well described by the hyperbolic-decay model. In the last phase of each experiment, the animals were not forced to continue selecting the standard alternative if food was not delivered. Under these conditions, rats' choices were affected by the time between trials whereas pigeons' choices were not, replicating results of previous studies. The differences between the behavior of rats and pigeons appears to be the result of procedural details, not a fundamental difference in how these two species make choices with probabilistic delayed reinforcers.

journal_name

J Exp Anal Behav

authors

Mazur JE,Biondi DR

doi

10.1901/jeab.2011.95-41

subject

Has Abstract

pub_date

2011-01-01 00:00:00

pages

41-56

issue

1

eissn

0022-5002

issn

1938-3711

journal_volume

95

pub_type

杂志文章
  • Reinforcement magnitude and the inhibiting effect of reinforcement.

    abstract::In a two-key concurrent variable-interval schedule (using pigeons), if the reinforcement frequency for one response is held constant while that for the other is increased, the rate of response on the constant key decreases. The immediate reinforcement for key pecking can usually be conceptualized as the change from a ...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1979.32-265

    authors: Michael JL

    更新日期:1979-09-01 00:00:00

  • Immobility as an avoidance response, and its disruption by drugs.

    abstract::Much of the available literature on avoidance behavior is based on responses which require the animal to run, lever-press, or to make some active response to avoid noxious stimulation. The purpose of Experiment I reported in this paper was to determine whether animals can learn to sit or stand motionless in order to e...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1963.6-213

    authors: BINDRA D,ANCHEL H

    更新日期:1963-04-01 00:00:00

  • On the classic and modern theories of matching.

    abstract::Classic matching theory, which is based on Herrnstein's (1961) original matching equation and includes the well-known quantitative law of effect, is almost certainly false. The theory is logically inconsistent with known experimental findings, and experiments have shown that its central constant-k assumption is not te...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.2005.59-04

    authors: McDowell JJ

    更新日期:2005-07-01 00:00:00

  • Alternative reinforcement increases resistance to change: Pavlovian or operant contingencies?

    abstract::Two multiple-schedule experiments with pigeons examined the effect of adding food reinforcement from an alternative source on the resistance of the reinforced response (target response) to the decremental effects of satiation and extinction. In Experiment 1, key pecks were reinforced by food in two components accordin...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1990.53-359

    authors: Nevin JA,Tota ME,Torquato RD,Shull RL

    更新日期:1990-05-01 00:00:00

  • A test of the reinforcing properties of stimuli correlated with nonreinforcement.

    abstract::The information hypothesis of conditioned reinforcement predicts that a stimulus that "reduces uncertainty" about the outcome of a trial will acquire reinforcing properties, even when the stimulus reliably predicts nonreinforcement. Four pigeons' key pecks produced one of two 5-sec stimuli with 0.50 probability accord...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1976.26-45

    authors: Katz HN

    更新日期:1976-07-01 00:00:00

  • Choice between response units: The rate constancy model.

    abstract::In a conjoint schedule, reinforcement is available simultaneously on two or more schedules for the same response. The present experiments provided food for key pecking on both a random-interval and a differential-reinforcement-of-low-rate (DRL) schedule. Experiment 1 involved ordinary DRL schedules; Experiment 2 added...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1983.39-275

    authors: Zeiler MD,Blakely TF

    更新日期:1983-03-01 00:00:00

  • The effect of a pre-shock signal on a free-operant avoidance response.

    abstract::After 25 free-operant avoidance training sessions, a 1-min signal followed by a brief shock was presented on the average of once every 4 min. During the signal, the avoidance schedule was suspended (20 sessions). Response rates during the signal were markedly reduced. Shock rates during non-signalled periods increased...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1970.14-331

    authors: Roberts AE,Hurwitz HM

    更新日期:1970-11-01 00:00:00

  • Inhibiting function of reinforcement: magnitude effects on variable-interval schedules.

    abstract::In two experiments, the performance of rats under constant-probability and arithmetic variable-interval schedules respectively was compared when the concentration of a liquid reinforcer was varied within sessions; in other sessions, half of the reinforcers were randomly omitted. When the discriminative function of the...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1978.30-1

    authors: Harzem P,Lowe CF,Priddle-Higson PJ

    更新日期:1978-07-01 00:00:00

  • Nodal structure and the partitioning of equivalence classes.

    abstract::By definition, all of the stimuli in an equivalence class have to be functionally interchangeable with each other. The present experiment, however, demonstrated that this was not the case when using post-class-formation dual-option response transfer tests. With college students, two 4-node 6-member equivalence classes...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.2008-89-359

    authors: Fields L,Watanabe-Rose M

    更新日期:2008-05-01 00:00:00

  • Stock optimizing: maximizing reinforcers per session on a variable-interval schedule.

    abstract::In Experiment 1, 2 monkeys earned their daily food ration by pressing a key that delivered food according to a variable-interval 3-min schedule. In Phases 1 and 4, sessions ended after 3 hr. In Phases 2 and 3, sessions ended after a fixed number of responses that reduced food intake and body weights from levels during...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1993.59-389

    authors: Silberberg A,Bauman R,Hursh S

    更新日期:1993-03-01 00:00:00

  • A cluster analysis of text message users based on their demand for text messaging: A behavioral economic approach.

    abstract::The goal of this study was to determine whether cluster analysis could be used to identify distinct subgroups of text message users based on behavioral economic indices of demand for text messaging. Cluster analysis is an analytic technique that attempts to categorize cases based on similarities across selected variab...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1002/jeab.554

    authors: Hayashi Y,Friedel JE,Foreman AM,Wirth O

    更新日期:2019-11-01 00:00:00

  • Background activities, induction, and behavioral allocation in operant performance.

    abstract::In experiments on operant behavior, other activities, called "background" activities, compete with the operant activities. Herrnstein's (1970) formulation of the matching law included background reinforcers in the form of a parameter rO, but remained vague about the activities (BO) that produce rO. To gain more unders...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1002/jeab.100

    authors: Baum WM,Davison M

    更新日期:2014-09-01 00:00:00

  • Pilocarpine seizures cause age-dependent impairment in auditory location discrimination.

    abstract::Children who have status epilepticus have continuous or rapidly repeating seizures that may be life-threatening and may cause life-long changes in brain and behavior. The extent to which status epilepticus causes deficits in auditory discrimination is unknown. A naturalistic auditory location discrimination method was...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.2005.84-04

    authors: Neill JC,Liu Z,Mikati M,Holmes GL

    更新日期:2005-11-01 00:00:00

  • Effect of reinforcement duration on fixed-interval responding.

    abstract::Five different reinforcement durations occurred randomly within each session on fixed interval 60-sec. Postreinforcement pause was directly related (and "running" rate inversely related) to the duration of reinforcement initiating each fixed interval. ...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1970.13-9

    authors: Staddon JE

    更新日期:1970-01-01 00:00:00

  • A comparison of ratio and interval reinforcement schedules with comparable interreinforcement times.

    abstract::Pigeons were trained to peck keys on fixed-ratio and fixed-interval schedules of food reinforcement. Both schedules produced a pattern of behavior characterized as pause and run, but the relation of pausing to time between reinforcers differed for the two schedules even when mean time between reinforcers was the same....

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1980.34-61

    authors: Capehart GW,Eckerman DA,Guilkey M,Shull RL

    更新日期:1980-07-01 00:00:00

  • Choosing among multiple alternatives: Relative and overall reinforcer rates.

    abstract::Choice behavior among two alternatives has been widely researched, but fewer studies have examined the effect of multiple (more than two) alternatives on choice. Two experiments investigated whether changing the overall reinforcer rate affected preference among three and four concurrently scheduled alternatives. Exper...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1002/jeab.269

    authors: Beeby E,Alsop B

    更新日期:2017-09-01 00:00:00

  • Sex differences in adolescent ethanol drinking to behavioral intoxication.

    abstract::Rodent models have been especially useful for investigating adolescent ethanol exposure. However, there is a paucity of studies examining sex differences in behavioral intoxication from adolescent ethanol drinking. Here, we used an ethanol drinking model to investigate if adolescent rats of both sexes readily drink et...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1002/jeab.440

    authors: Westbrook SR,Kang M,Sherrill LK,O'Hearn D,Krishnamani T,Gulley JM

    更新日期:2018-07-01 00:00:00

  • Repeated acquisition in the analysis of rule-governed behavior.

    abstract::Five children, ranging in age from 3(1/2) years to 5(1/2) years, were taught various four-response chains using conditioned reinforcement. Experiment 1 investigated the effects of presenting "instruction" stimuli-a sequence of lights over the correct response buttons-to assess their role in facilitating the acquisitio...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1985.44-175

    authors: Vaughan ME

    更新日期:1985-09-01 00:00:00

  • Schedules of electric shock presentation in the behavioral control of imprinted ducklings.

    abstract::The behavioral effects of various schedules of electric shock presentation were investigated during and after the imprinting of Peking ducklings to moving stimuli. The behavior of following a moving imprinted stimulus was differentially controlled by a multiple schedule of punishment and avoidance that respectively su...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1972.18-305

    authors: Barrett JE

    更新日期:1972-09-01 00:00:00

  • Effects of reinforcer magnitude on responding under differential-reinforcement-of-low-rate schedules of rats and pigeons.

    abstract::Experiment I investigated the effects of reinforcer magnitude on differential-reinforcement-of-low-rate (DRL) schedule performance in three phases. In Phase 1, two groups of rats (n = 6 and 5) responded under a DRI. 72-s schedule with reinforcer magnitudes of either 30 or 300 microl of water. After acquisition, the wa...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.2002.78-17

    authors: Doughty AH,Richards JB

    更新日期:2002-07-01 00:00:00

  • Comparing rapid assessments of delay discounting with real and hypothetical rewards in children.

    abstract::Recent advances in assessment methodology have resulted in a highly efficient procedure for obtaining delay discounting rates for adults: a 5-trial adjusting delay task (ADT-5) examining intertemporal choice for hypothetical rewards. The low participant burden of this task makes it potentially useful for children, wit...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1002/jeab.493

    authors: Miller JR

    更新日期:2019-01-01 00:00:00

  • Effects of reinforcement magnitude on pigeons' preference for different fixed-ratio schedules of reinforcement.

    abstract::In concurrent, two-member chains, the completion of one or the other of two initial percentage fixed-interval 90-sec links produced a terminal link in which the completion of a fixed ratio produced food reinforcement. The fixed ratios and the duration of reinforcement in the terminal links were varied. Relative respon...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1969.12-253

    authors: Schwartz B

    更新日期:1969-03-01 00:00:00

  • Combining stimuli signalling response-dependent food and shock.

    abstract::Three rats were exposed to a multiple schedule in which separate presentations of light and tone alternated with periods during which light and tone were absent. In Phase 1, light and tone each signalled identical variable-interval schedules of food delivery. In Phase 2, light and tone signalled separate but concurren...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1974.22-363

    authors: Wiltz RA

    更新日期:1974-09-01 00:00:00

  • The magnitude-of-reinforcement function in closed and open economies.

    abstract::It has been hypothesized that the magnitude-of-reinforcement effect may differ in closed and open experimental economies. We determined the relationship between magnitude of reinforcement and response rate in three feeding conditions: a closed economy in which total intake was unrestricted, a closed economy in which t...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 临床试验,杂志文章

    doi:10.1901/jeab.1992.57-81

    authors: Collier G,Johnson DF,Morgan C

    更新日期:1992-01-01 00:00:00

  • Classical avoidance without a warning stimulus.

    abstract::White rats were scheduled to be shocked every 15 sec; but they were given a limited time interval between shocks when they could prevent the next scheduled shock from occurring if they pressed a lever. The duration of this limited avoidance period was varied, as was its location within the interval between scheduled s...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1962.5-97

    authors: SIDMAN M

    更新日期:1962-01-01 00:00:00

  • Response rate correlates with indifference points in a delay-discounting procedure.

    abstract::To study how effort affects reward value, we replicated Fortes, Vasconcelos and Machado's (2015) study using an adjusting-delay task. Nine pigeons chose between a standard alternative that gave access to 4 s of food, after a 10 s delay, and an adjusting-delay alternative that gave access to 12 s of food after a delay ...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1002/jeab.548

    authors: García-Leal Ó,Barrón E,Camarena-Pérez H,Vílchez Z

    更新日期:2019-09-01 00:00:00

  • An evaluation of a visual-visual successive matching-to-sample procedure to establish equivalence classes in adults.

    abstract::Traditionally, behavior analysts have studied stimulus equivalence using a matching-to-sample (MTS) preparation. Although researchers have shown the utility of MTS to yield equivalence classes, the procedure requires several prerequisite skills for a learner to accurately respond. Previous research with humans and non...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1002/jeab.326

    authors: Lantaya CA,Miguel CF,Howland TG,LaFrance DL,Page SV

    更新日期:2018-05-01 00:00:00

  • Effects of required rates of responding upon choice.

    abstract::Pigeons' responses in the presence of two concurrently available (initial-link) stimuli produced one of two different (terminal-link) stimuli according to identical but independent variable-interval schedules. Responses in the presence of each terminal-link stimulus produced equal frequencies of food reinforcement, bu...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1968.11-15

    authors: Fantino E

    更新日期:1968-01-01 00:00:00

  • Punished and unpunished responding in multiple variable-interval schedules.

    abstract::The performance of rats trained on multiple variable-interval schedules was examined before, during, and after punishment. The same linear function related relative response rates to relative density of reinforcement both in the presence and absence of punishment. Equal relative suppression was seen in both the high a...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1968.11-147

    authors: Tullis C,Walters G

    更新日期:1968-03-01 00:00:00

  • The dynamics of the law of effect: a comparison of models.

    abstract::Dynamical models based on three steady-state equations for the law of effect were constructed under the assumption that behavior changes in proportion to the difference between current behavior and the equilibrium implied by current reinforcer rates. A comparison of dynamical models showed that a model based on Navaka...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.2010.93-91

    authors: Navakatikyan MA,Davison M

    更新日期:2010-01-01 00:00:00