Response rate correlates with indifference points in a delay-discounting procedure.

Abstract:

:To study how effort affects reward value, we replicated Fortes, Vasconcelos and Machado's (2015) study using an adjusting-delay task. Nine pigeons chose between a standard alternative that gave access to 4 s of food, after a 10 s delay, and an adjusting-delay alternative that gave access to 12 s of food after a delay that changed dynamically with the pigeons' choices, decreasing when they preferred the standard alternative, and increasing when they preferred the adjusting alternative. The delay value at which preference stabilized defined the indifference point, a measure of reward value. To manipulate effort across phases, we varied the response rate required during the delay of the standard alternative. Results showed that a) the indifference point increased in the higher-response-rate phases, suggesting that reward value decreased with effort, and b) in the higher-response-rate phases, response rate in the standard alternative was linearly related to the indifference point. We advance several conceptions of how effort may change perceived delay or amount and thereby affect reward value.

journal_name

J Exp Anal Behav

authors

García-Leal Ó,Barrón E,Camarena-Pérez H,Vílchez Z

doi

10.1002/jeab.548

subject

Has Abstract

pub_date

2019-09-01 00:00:00

pages

167-176

issue

2

eissn

0022-5002

issn

1938-3711

journal_volume

112

pub_type

杂志文章
  • Accuracy of discrimination, rate of responding, and resistance to change.

    abstract::Pigeons were trained on multiple schedules in which responding on a center key produced matching-to-sample trials according to the same variable-interval 30-s schedules in both components. Matching trials consisted of a vertical or tilted line sample on the center key followed by vertical and tilted comparisons on the...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.2003.79-307

    authors: Nevin JA,Milo J,Odum AL,Shahan TA

    更新日期:2003-05-01 00:00:00

  • Behavioral adaptation to fixed-interval and fixed-time food delivery in golden hamsters.

    abstract::Food-deprived golden hamsters in a large enclosure received food every 30 sec contingent on lever pressing, or free while their behavior was continuously recorded in terms of an exhaustive classification of motor patterns. As with other species in other situations, behavior became organized into two main classes. One ...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1977.27-33

    authors: Anderson MC,Shettleworth SJ

    更新日期:1977-01-01 00:00:00

  • The natural mathematics of behavior analysis.

    abstract::Models that generate event records have very general scope regarding the dimensions of the target behavior that we measure. From a set of predicted event records, we can generate predictions for any dependent variable that we could compute from the event records of our subjects. In this sense, models that generate eve...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1002/jeab.330

    authors: Li D,Hautus MJ,Elliffe D

    更新日期:2018-05-01 00:00:00

  • Reinforcement of variability facilitates learning in humans.

    abstract::Studies with rats and pigeons showed that reinforcement of response variability improved learning of difficult response sequences. The results suggested that concurrent reinforcement of variability might be a helpful tool when educators or therapists attempt to teach individuals with learning difficulties. However, si...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1002/jeab.475

    authors: Hansson J,Neuringer A

    更新日期:2018-11-01 00:00:00

  • Effects of discrete-trial and free-operant procedures on the acquisition and maintenance of successive discrimination in rats.

    abstract::Rats were trained on a successive discrete-trial discrimination between two tonal stimuli to examine the effects of availability of a lever during intertrial intervals. In the discrete-trial condition, in which a lever was removed from the chamber during intertrial intervals, 10-s trials were initiated by the presenta...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1991.55-3

    authors: Hachiya S,Ito M

    更新日期:1991-01-01 00:00:00

  • Concept learning set-size functions for Clark's nutcrackers.

    abstract::Same/Different abstract-concept learning by Clark's nutcrackers (Nucifraga columbiana) was tested with novel stimuli following learning of training set expansion (8, 16, 32, 64, 128, 256, 512, and 1024 picture items). The resulting set-size function was compared to those from rhesus monkeys (Macaca mulatta), capuchin ...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1002/jeab.174

    authors: Wright AA,Magnotti JF,Katz JS,Leonard K,Kelly DM

    更新日期:2016-01-01 00:00:00

  • Non-spatial delayed alternation by the pigeon.

    abstract::Pigeons were trained on a non-spatial delayed alternation task in which the color not pecked on the previous trial was correct. When varying delays were interposed between trials, alternation accuracy decreased as a function of delay, but remained greater than chance with a 45-sec delay. Successful alternation on the ...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1971.16-15

    authors: Williams BA

    更新日期:1971-07-01 00:00:00

  • Inhibiting function of reinforcement: magnitude effects on variable-interval schedules.

    abstract::In two experiments, the performance of rats under constant-probability and arithmetic variable-interval schedules respectively was compared when the concentration of a liquid reinforcer was varied within sessions; in other sessions, half of the reinforcers were randomly omitted. When the discriminative function of the...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1978.30-1

    authors: Harzem P,Lowe CF,Priddle-Higson PJ

    更新日期:1978-07-01 00:00:00

  • The effects of amount of training per reversal on successive reversals of a color discrimination.

    abstract::Three groups of pigeons were trained on a red-green discrimination in which the stimuli were alternately presented in a multiple schedule of reinforcement. The discrimination was reversed 24 times. Groups were given 1, 2, or 4 hr of training on each discrimination. Increasing the length of training had two principal e...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1970.14-345

    authors: Beale IL

    更新日期:1970-11-01 00:00:00

  • Secondary reinforcement and number of primary reinforcements.

    abstract::Pigeons' pecks on either of two concurrently available response keys produced secondary reinforcers according to independent one-minute variable-interval schedules. Different secondary reinforcers, in the presence of which the rates of primary reinforcement were equal, were associated with each key. The rate of peckin...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1968.11-9

    authors: Fantino E,Herrnstein RJ

    更新日期:1968-01-01 00:00:00

  • Allocation of complex, sequential operants on multiple and concurrent schedules of reinforcement.

    abstract::Pigeons could produce food by pecking exactly four times on each of two keys, in any order. In the first experiment, these response sequences were reinforced on a series of multiple schedules of variable-interval reinforcement. In the second experiment, these response sequences were reinforced on a series of concurren...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1986.45-283

    authors: Schwartz B

    更新日期:1986-05-01 00:00:00

  • Resistance to reinforcement change in multiple and concurrent schedules assessed in transition and at steady state.

    abstract::Behavioral momentum theory relates resistance to change of responding in a multiple-schedule component to the total reinforcement obtained in that component, regardless of how the reinforcers are produced. Four pigeons responded in a series of multiple-schedule conditions in which a variable-interval 40-s schedule arr...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1995.63-1

    authors: McLean AP,Blampied NM

    更新日期:1995-01-01 00:00:00

  • The stay/switch model of concurrent choice.

    abstract::This experiment compared descriptions of concurrent choice by the stay/switch model, which says choice is a function of the reinforcers obtained for staying at and for switching from each alternative, and the generalized matching law, which says choice is a function of the total reinforcers obtained at each alternativ...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.2009.91-21

    authors: MacDonall JS

    更新日期:2009-01-01 00:00:00

  • Responding for sucrose and wheel-running reinforcement: effects of sucrose concentration and wheel-running reinforcer duration.

    abstract::Six male albino rats were placed in running wheels and exposed to a fixed-interval 30-s schedule of lever pressing that produced either a drop of sucrose solution or the opportunity to run for a fixed duration as reinforcers. Each reinforcer type was signaled by a different stimulus. In Experiment 1, the duration of r...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.2003.79-243

    authors: Belke TW,Hancock SD

    更新日期:2003-03-01 00:00:00

  • Human observing: maintained by negative informative stimuli only if correlated with improvement in response efficiency.

    abstract::Two experiments investigated the effect of observing responses that enabled college students to emit more efficient distributions of reinforced responses. In Experiment 1, the gains of response efficiency enabled by observing were minimized through use of identical low-effort response requirements in two alternating v...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1985.43-289

    authors: Case DA,Fantino E,Wixted J

    更新日期:1985-05-01 00:00:00

  • Fixed-interval limited-hold avoidance with and without signalled reinforcement.

    abstract::Rats trained to lever press on a fixed-interval limited-hold avoidance schedule maintained a pattern of responding similar to that maintained by fixed-interval limited-hold schedules of positive reinforcement. But this positively accelerated pattern of behavior was maintained only when the occurrence of reinforcement ...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1972.17-75

    authors: Black RE,Walters GC,Webster CD

    更新日期:1972-01-01 00:00:00

  • Stimulus control acquired by components of two color-form compound stimuli.

    abstract::Four pigeons were trained to respond on one of two keys in the presence of one color-form display, and on the other key when a second color-form display was present. Both responses were maintained on a 2-min variable-internal schedule of reinforcement. Subsequently, stimulus control acquired by components of the compo...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1969.12-437

    authors: Born DG,Peterson JL

    更新日期:1969-05-01 00:00:00

  • Rate dependency, behavioral mechanisms, and behavioral pharmacology.

    abstract::Behavioral pharmacology has become increasingly independent of the experimental analysis of behavior. At its beginning, behavioral pharmacology was closely related to the experimental analysis of behavior, with developments in each field aiding the other. Early attempts to systematize data in behavioral pharmacology c...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1984.42-511

    authors: Branch MN

    更新日期:1984-11-01 00:00:00

  • Deprivation and satiation: The interrelations between food and wheel running.

    abstract::Two experiments were designed to assess whether depriving rats of food would increase the reinforcement effectiveness of wheel running (Experiment 1) and whether satiation for wheel running would decrease the reinforcement effectiveness of food (Experiment 2). In Experiment 1, a progressive-ratio schedule was used to ...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1986.46-199

    authors: Pierce WD,Epling WF,Boer DP

    更新日期:1986-09-01 00:00:00

  • Interresponse-time shaping by variable-interval-like interresponse-time reinforcement contingencies.

    abstract::The interresponse-time reinforcement contingencies and distributions of interreinforcement intervals characteristic of certain variable-interval schedules were mimicked by reinforcing each key peck with a probability equal to the duration of the interresponse time it terminated, divided by the scheduled mean interrein...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1979.31-3

    authors: Platt JR

    更新日期:1979-01-01 00:00:00

  • Concurrent fixed-interval variable-ratio schedules and the matching relation.

    abstract::Five rats responded under concurrent fixed-interval variable-ratio schedules of food reinforcement. Fixed-interval values ranged from 50-seconds to 300-seconds and variable-ratio values ranged from 30 to 360; a five-second changeover delay was in effect throughout the experiment. The relations between reinforcement ra...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1981.36-317

    authors: Rider DP

    更新日期:1981-11-01 00:00:00

  • Concurrent random-interval schedules and the matching law.

    abstract::In Experiment I, a group of eight pigeons performed on concurrent random-interval schedules constructed by holding probability equal and varying cycle time to produce ratios of reinforcer densities of 1:1, 3:1, and 5:1 for key pecking. Schedules for a second group of seven were constructed with equal cycle times and u...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1978.30-301

    authors: Rodewald HK

    更新日期:1978-11-01 00:00:00

  • An evaluation of a visual-visual successive matching-to-sample procedure to establish equivalence classes in adults.

    abstract::Traditionally, behavior analysts have studied stimulus equivalence using a matching-to-sample (MTS) preparation. Although researchers have shown the utility of MTS to yield equivalence classes, the procedure requires several prerequisite skills for a learner to accurately respond. Previous research with humans and non...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1002/jeab.326

    authors: Lantaya CA,Miguel CF,Howland TG,LaFrance DL,Page SV

    更新日期:2018-05-01 00:00:00

  • Concurrent schedule control of human visual target fixations.

    abstract::Operant conditioning techniques were applied to the study of how target fixations are controlled by the probability of signal occurrence. In a standard vigilance setting, gaze at three illuminable volt meters was monitored by a Mackworth television eye camera with automatic recording capability. Gaze at a given meter ...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1973.20-411

    authors: Rosenberger PB

    更新日期:1973-11-01 00:00:00

  • Some conditions affecting the choice to cooperate or compete.

    abstract::Three experiments investigated conditions affecting the choice to cooperate or compete. Experiment I compared the effects first of an individual activity, then of a competitive task as an alternative to cooperation. For both comparisons, subjects could earn more by cooperating. Choice of competition, but not individua...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1976.25-165

    authors: Schmitt DR

    更新日期:1976-03-01 00:00:00

  • Food-avoidance in hungry pigeons, and other perplexities.

    abstract::Twenty-three pigeons were subjected to a series of procedures in which the key-peck's effects ranged from immediate, differential food reinforcement, through delayed reinforcement, the production of stimulus changes with and without probable secondary reinforcement, the prevention of food presentation ("food-avoidance...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1972.18-369

    authors: Herrnstein RJ,Loveland DH

    更新日期:1972-11-01 00:00:00

  • Effects of relative reinforcer frequency on complex color detection.

    abstract::Pigeons were trained under a discrete-trials detection procedure in which one of a set of color stimuli was presented on the center key and a single response turned off the stimulus and illuminated two side keys. Single responses to one or the other side key produced occasional reinforcers depending on the value of th...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1989.51-291

    authors: Davison M,McCarthy D

    更新日期:1989-05-01 00:00:00

  • A multivariate rate equation for variable-interval performance.

    abstract::A value-like parameter is introduced into a rate equation for describing variable-interval performance. The equation, derived solely from formal considerations, expresses rate of responding as a joint function of rate of reinforcement and "reinforcer power." Preliminary tests of the rate equation show that it handles ...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1979.31-267

    authors: McDowell JJ,Kessel R

    更新日期:1979-03-01 00:00:00

  • Experience with dynamic reinforcement rates decreases resistance to extinction.

    abstract::The ability of organisms to detect reinforcer-rate changes in choice preparations is positively related to two factors: the magnitude of the change in rate and the frequency with which rates change. Gallistel (2012) suggested similar rate-detection processes are responsible for decreases in responding during operant e...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1002/jeab.196

    authors: Craig AR,Shahan TA

    更新日期:2016-03-01 00:00:00

  • The local organization of behavior: dissociations between a pigeon's behavior and self-reports of that behavior.

    abstract::The purpose of the experiment was to study the relation between what an organism does in a setting that demands temporal patterning of behavior and what it reports it has done. More specifically, a pigeon produced two classes, shorter and longer, of temporal patterns of key pecks (interresponse times) on a center key....

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1983.39-61

    authors: Shimp CP

    更新日期:1983-01-01 00:00:00