Response duration is sensitive to both immediate and delayed reinforcement.

Abstract:

:We investigated the duration of lever pressing by rats when the delivery of appetitive reinforcers was contingent upon response duration. In the first experiment, response durations increased when duration requirements were imposed, and they decreased when duration requirements were removed. This effect occurred whether reinforcers were immediate or delayed by 8 s. In order to maintain the integrity of the delay intervals, reinforcer delivery was dependent upon both lever depression and release. In a second experiment, lever depression only and a response duration of at least 4 s were required for reinforcer delivery. Compared to immediate reinforcement conditions, delayed reinforcers increased both variability and the length of the maximum response durations. In a third experiment, immediate reinforcers were delivered contingent upon lever depression and release under a variety of duration requirements. Median lever-press durations tracked the contingencies rapidly. Across all three experiments, rats emitted numerous response durations that were too short to satisfy the reinforcer requirements, and bimodal distributions similar to those produced by differential reinforcement of low rate schedules were evident for most rats. In many aspects, response duration responds to reinforcement parameters in a fashion similar to rate of discrete responding, but an examination of this continuous dimension of behavior may provide additional information about environment-behavior relationships.

journal_name

J Exp Anal Behav

authors

Byrne T,Sarno B

doi

10.1002/jeab.491

subject

Has Abstract

pub_date

2019-01-01 00:00:00

pages

94-115

issue

1

eissn

0022-5002

issn

1938-3711

journal_volume

111

pub_type

杂志文章
  • Social reinforcement of operant behavior in rats: a methodological note.

    abstract::An apparatus was developed to study social reinforcement in the rat. Four Long-Evans female rats were trained to press a lever via shaping, with the reinforcer being access to a castrated male rat. Responding under a fixed-ratio schedule and in extinction was also observed. Social access was found to be an effective r...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1994.62-149

    authors: Evans MJ,Duvel A,Funk ML,Lehman B,Sparrow J,Watson NT,Neuringer A

    更新日期:1994-07-01 00:00:00

  • Children's preference for mixed- versus fixed-ratio schedules of reinforcement: A translational study of risky choice.

    abstract::Laboratory research has shown that when subjects are given a choice between fixed-ratio and bi-valued mixed-ratio schedules of reinforcement, preference typically emerges for the mixed-ratio schedule even with a larger ratio requirement. The current study sought to replicate and extend these findings to children's mat...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1002/jeab.234

    authors: Mullane MP,Martens BK,Baxter EL,Steeg DV

    更新日期:2017-01-01 00:00:00

  • Magnitude and duration of the effects of cocaine on conditioned and adjunctive behaviors in the chimpanzee.

    abstract::Characteristic patterns of conditioned key-pressing were maintained in the chimpanzee under a multiple 30-response fixed-ratio, 10-minute fixed-interval schedule of food presentation. Adjunctive drinking occurred with regularity during the fixed-interval schedule and, with less frequency, during 1-minute timeout perio...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1980.33-131

    authors: Byrd LD

    更新日期:1980-01-01 00:00:00

  • Resistance to reinforcement change in multiple and concurrent schedules assessed in transition and at steady state.

    abstract::Behavioral momentum theory relates resistance to change of responding in a multiple-schedule component to the total reinforcement obtained in that component, regardless of how the reinforcers are produced. Four pigeons responded in a series of multiple-schedule conditions in which a variable-interval 40-s schedule arr...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1995.63-1

    authors: McLean AP,Blampied NM

    更新日期:1995-01-01 00:00:00

  • Emergent stimulus relations depend on stimulus correlation and not on reinforcement contingencies.

    abstract::We aimed to investigate whether novel stimulus relations would emerge from stimulus correlations when those relations explicitly conflicted with reinforced relations. In a symbolic matching-to-sample task using kanji characters as stimuli, we arranged class-specific incorrect comparison stimuli in each of three classe...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.2011.95-327

    authors: Minster ST,Elliffe D,Muthukumaraswamy SD

    更新日期:2011-05-01 00:00:00

  • Impulse control in pigeons.

    abstract::Pigeons were given a small, immediate food reinforcement for pecking a key, and a larger, delayed reinforcement for not pecking this key. Most subjects pecked the key on more than 95% of trials. However, when pecking a differently colored key at an earlier time prevented this option from becoming available, three of 1...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1974.21-485

    authors: Ainslie GW

    更新日期:1974-05-01 00:00:00

  • Elicitation and punishment of intraspecies aggression by the same stimulus.

    abstract::Fighting responses were elicited in pairs of rats by shocks over a period of 46 days. During certain blocks of these days, "punishing" shocks were made contingent on the shock-elicited fights. Fighting frequency was reduced as a direct function of the intensity of the contingent shocks. Fighting frequency recovered co...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1971.15-193

    authors: Roberts CL,Blase K

    更新日期:1971-03-01 00:00:00

  • Effects of relative reinforcer frequency on complex color detection.

    abstract::Pigeons were trained under a discrete-trials detection procedure in which one of a set of color stimuli was presented on the center key and a single response turned off the stimulus and illuminated two side keys. Single responses to one or the other side key produced occasional reinforcers depending on the value of th...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1989.51-291

    authors: Davison M,McCarthy D

    更新日期:1989-05-01 00:00:00

  • Dynamic probability of reinforcement for cooperation: Random game termination in the centipede game.

    abstract::Experimental games have previously been used to study principles of human interaction. Many such games are characterized by iterated or repeated designs that model dynamic relationships, including reciprocal cooperation. To enable the study of infinite game repetitions and to avoid endgame effects of lower cooperation...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1002/jeab.320

    authors: Krockow EM,Colman AM,Pulford BD

    更新日期:2018-03-01 00:00:00

  • Autoshaping, random control, and omission training in the rat.

    abstract::The role of the stimulus-reinforcer contingency in the development and maintenance of lever contact responding was studied in hooded rats. In Experiment I, three groups of experimentally naive rats were trained either on autoshaping, omission training, or a random-control procedure. Subjects trained by the autoshaping...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1976.26-451

    authors: Locurto C,Terrace HS,Gibbon J

    更新日期:1976-11-01 00:00:00

  • On the effects of signaling reinforcer probability and magnitude in delayed matching to sample.

    abstract::Two experiments examined whether postsample signals of reinforcer probability or magnitude affected the accuracy of delayed matching to sample in pigeons. On each trial, red or green choice responses that matched red or green stimuli seen shortly before a variable retention interval were reinforced with wheat access. ...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.2005.94-03

    authors: Brown GS,White KG

    更新日期:2005-03-01 00:00:00

  • Comparison of variance and covariance patterns in parallel and serial theories of timing.

    abstract::Parallel and serial timing processes are analyzed for their account of the dynamics of intertrial responding in the peak procedure. A strictly serial model, such as the behavioral theory of timing (Killeen & Fetterman, 1988), does not fit the dynamic correlation pattern in the location and duration of the middle high-...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1992.57-393

    authors: Gibbon J,Church RM

    更新日期:1992-05-01 00:00:00

  • Effects of a concurrent task on fixed-interval responding in humans.

    abstract::Subjects pressed a telegraph key to illuminate a meter dial on which pointer deflections appeared at fixed intervals. Upon detecting a deflection they were required to press another key to reset the pointer to zero. This detecting and resetting operation reinforced the behavior of pressing the light-flashing key (i.e....

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1963.6-431

    authors: Laties VG,Weiss B

    更新日期:1963-07-01 00:00:00

  • Behavioral adaptation to fixed-interval and fixed-time food delivery in golden hamsters.

    abstract::Food-deprived golden hamsters in a large enclosure received food every 30 sec contingent on lever pressing, or free while their behavior was continuously recorded in terms of an exhaustive classification of motor patterns. As with other species in other situations, behavior became organized into two main classes. One ...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1977.27-33

    authors: Anderson MC,Shettleworth SJ

    更新日期:1977-01-01 00:00:00

  • Secondary reinforcement and number of primary reinforcements.

    abstract::Pigeons' pecks on either of two concurrently available response keys produced secondary reinforcers according to independent one-minute variable-interval schedules. Different secondary reinforcers, in the presence of which the rates of primary reinforcement were equal, were associated with each key. The rate of peckin...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1968.11-9

    authors: Fantino E,Herrnstein RJ

    更新日期:1968-01-01 00:00:00

  • Leaving patches: Effects of travel requirements.

    abstract::Five pigeons were trained in an analogue foraging procedure in which, by completing a travel requirement, they entered a "patch" in which a reinforcer might be available after an unpredictable time. They also had the opportunity, by emitting a defined response, to exit the patch and travel to another patch. Prey avail...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1994.62-185

    authors: McCarthy D,Voss P,Davison M

    更新日期:1994-09-01 00:00:00

  • On the classic and modern theories of matching.

    abstract::Classic matching theory, which is based on Herrnstein's (1961) original matching equation and includes the well-known quantitative law of effect, is almost certainly false. The theory is logically inconsistent with known experimental findings, and experiments have shown that its central constant-k assumption is not te...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.2005.59-04

    authors: McDowell JJ

    更新日期:2005-07-01 00:00:00

  • Drug effects on fixed-interval responding with pause requirements for food presentation.

    abstract::In pigeons performing under a multiple schedule of food presentation, low key-pecking rates (0.18 to 0.29 responses per second) were maintained during 3-min fixed-interval components by requiring a 4-, 5-, or 6-sec pause preceding the food-delivery response (tandem DRL), while higher rates (0.70 to 1.37 responses per ...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1977.27-51

    authors: Stitzer M,McKearney JW

    更新日期:1977-01-01 00:00:00

  • Simple and conditional visual discrimination with wheel running as reinforcement in rats.

    abstract::Three experiments explored whether access to wheel running is sufficient as reinforcement to establish and maintain simple and conditional visual discriminations in nondeprived rats. In Experiment 1, 2 rats learned to press a lit key to produce access to running; responding was virtually absent when the key was dark, ...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1998.70-103

    authors: Iversen IH

    更新日期:1998-09-01 00:00:00

  • Successive reversals of a classically conditioned heart-rate discrimination.

    abstract::Rats were trained to criterion in successive reversals of a classically conditioned heart-rate discrimination. Criterion was attained more rapidly in the later reversals in the series than in the early reversals and the inter-problem learning curve was of the same general form as that found with successive instrumenta...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1968.11-199

    authors: Tighe TJ,Graves DM,Riley CA

    更新日期:1968-03-01 00:00:00

  • Classical conditioning of courting behavior in the Japanese quail, Coturnix coturnix japonica.

    abstract::Male Japanese quail were classically conditioned to display courting behavior at the sound of a buzzer, a previously neutral stimulus. The buzzer (conditioned stimulus) was paired with the presentation of a female quail (unconditioned stimulus) for a number of trials. The courting display, invariably elicited from the...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1967.10-213

    authors: Farris HE

    更新日期:1967-03-01 00:00:00

  • Interresponse-time shaping by variable-interval-like interresponse-time reinforcement contingencies.

    abstract::The interresponse-time reinforcement contingencies and distributions of interreinforcement intervals characteristic of certain variable-interval schedules were mimicked by reinforcing each key peck with a probability equal to the duration of the interresponse time it terminated, divided by the scheduled mean interrein...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1979.31-3

    authors: Platt JR

    更新日期:1979-01-01 00:00:00

  • Behavioral control of visual fixation of the rhesus monkey.

    abstract::A paradigm for the control of visual fixation of the macaque monkey in vision experiments was described. Using a Maxwellian view, the procedure permits the placement of discrete test-light stimuli in a specific area of the retina as the monkey fixates a primary target. This procedure holds foveal fixation as other beh...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1976.25-113

    authors: Crawford ML

    更新日期:1976-01-01 00:00:00

  • Naming and categorization in young children: III. Vocal tact training and transfer of function.

    abstract::Following pretraining with everyday objects, 10 children aged from 1 to 4 years were given common vocal tact training with a set of three pairs of arbitrary stimuli of differing shapes; Set 1. Nine children learned to tact one stimulus as "zog" and the other as "vek" in each pair, and all passed subsequent pairwise te...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.2005.31-04

    authors: Lowe CF,Horne PJ,Hughes JC

    更新日期:2005-01-01 00:00:00

  • A theory of attending, remembering, and reinforcement in delayed matching to sample.

    abstract::A theory of attending and reinforcement in conditional discriminations is extended to working memory in delayed matching to sample by adding terms for disruption of attending during the retention interval. Like its predecessor, the theory assumes that reinforcers and disruptors affect the independent probabilities of ...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.2007.88-285

    authors: Nevin JA,Davison M,Odum AL,Shahan TA

    更新日期:2007-09-01 00:00:00

  • A theory of attending and reinforcement in conditional discriminations.

    abstract::A model of conditional discrimination performance (Davison & Nevin, 1999) is combined with the notion that unmeasured attending to the sample and comparison stimuli, in the steady state and during disruption, depends on reinforcement in the same way as predicted for overt free-operant responding by behavioral momentum...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.2005.97-04

    authors: Nevin JA,Davison M,Shahan TA

    更新日期:2005-09-01 00:00:00

  • Controls for and constraints on auto-shaping.

    abstract::Auto-shaping the pigeon's key-peck response was examined as a respondent conditioning procedure with the use of Rescorla's truly-random control procedure. In the first experiment, pigeons received presentations of brief light on the response key and brief presentations of food where the light and the food were indepen...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1973.20-323

    authors: Bilbrey J,Winokur S

    更新日期:1973-11-01 00:00:00

  • Concurrent schedules of interresponse time reinforcement: probability of reinforcement and the lower bounds of the reinforced interresponse time intervals.

    abstract::Data were obtained with rats on the effects of interresponse time contingent reinforcement of the lever press response using schedules in which interresponse times falling within either of two temporal intervals could be reinforced. Some of the findings were (a) the mode of the interresponse time distribution generall...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1966.9-317

    authors: Malott RW,Cumming WW

    更新日期:1966-07-01 00:00:00

  • Nodal structure and the partitioning of equivalence classes.

    abstract::By definition, all of the stimuli in an equivalence class have to be functionally interchangeable with each other. The present experiment, however, demonstrated that this was not the case when using post-class-formation dual-option response transfer tests. With college students, two 4-node 6-member equivalence classes...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.2008-89-359

    authors: Fields L,Watanabe-Rose M

    更新日期:2008-05-01 00:00:00

  • Behavioral effects of pairing an S-D with a decreasing limited-hold reinforcement schedule.

    abstract::Four pigeons were trained on a multiple reinforcement schedule consisting of two limited-hold schedules, one in which a discriminative stimulus (S(D)) accompanied the periodic reinforcement contingency, and one in which the discriminative stimulus was omitted. The duration of the limited-hold in each component of the ...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1963.6-265

    authors: WEISSMAN A

    更新日期:1963-04-01 00:00:00