Choice and delay of reinforcement: Effects of terminal-link stimulus and response conditions.

Abstract:

:In two experiments, pigeons were exposed to concurrent-chains schedules in which a single initial-link variable-interval schedule led to access to terminal links composed of fixed-interval or fixed-delay schedules. In Experiment 1, an 8-s (or 16-s) delay to reinforcement was associated with the standard key, while reinforcer delay values associated with the experimental key were varied from 4 to 32 s. The results of Experiment 1 showed undermatching of response ratios to delay ratios with terminal-link fixed-delay schedules, whereas in some pigeons matching or overmatching was evident with the fixed-interval schedules. In Experiment 2, one pair of reinforcer delay values, either 8 versus 16 s or 16 versus 32 s, was used. In the first condition of Experiment 2, different delays were associated with different keylight stimuli (cued condition). In the second condition, different terminal-link delays were associated with the same stimulus, either a blackout (uncued-blackout condition) or a white key (uncued-white condition). To examine the role of responses emitted during delays, the keys were retracted during a delay (key-absent condition) in the third condition and responses were required by a fixed-interval schedule in the fourth condition. Experiment 2 demonstrated that the choice proportions for the shorter delay were more extreme in the cued condition than in the uncued-blackout condition, and that the response requirement imposed by the fixed-interval schedules did not affect choice of the shorter delay, nor did the key-absent and key-present conditions. These results indicate that the keylight-stimulus conditions affected preference for the shorter of two delays and that the findings obtained in Experiment 1 depended mainly on the keylight-stimulus conditions of the terminal links (i.e., the conditioned reinforcing value of the terminal-link stimuli).

journal_name

J Exp Anal Behav

authors

Omino T,Ito M

doi

10.1901/jeab.1993.59-361

subject

Has Abstract

pub_date

1993-03-01 00:00:00

pages

361-71

issue

2

eissn

0022-5002

issn

1938-3711

journal_volume

59

pub_type

杂志文章
  • Testing response-stimulus equivalence relations using differential responses as a sample.

    abstract::This study tested the notion that an equivalence relation may include a response when differential responses are paired with stimuli presented during training. Eight normal adults learned three kinds of computer mouse movements as differential response topographies (R1, R2, and R3). Next, in matching-to-sample trainin...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.2006.04-03

    authors: Shimizu H

    更新日期:2006-09-01 00:00:00

  • Negative reinforcement as shock-frequency reduction.

    abstract::Is a conditioned aversive stimulus necessary in avoidance conditioning? Or is a reduction in the rate of aversive stimulation alone sufficient to generate and maintain an avoidance response? Rats were subjected to an avoidance procedure in which shocks occurred randomly in time, but a response could reduce the overall...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1966.9-421

    authors: Herrnstein RJ,Hineline PN

    更新日期:1966-07-01 00:00:00

  • Response rate correlates with indifference points in a delay-discounting procedure.

    abstract::To study how effort affects reward value, we replicated Fortes, Vasconcelos and Machado's (2015) study using an adjusting-delay task. Nine pigeons chose between a standard alternative that gave access to 4 s of food, after a 10 s delay, and an adjusting-delay alternative that gave access to 12 s of food after a delay ...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1002/jeab.548

    authors: García-Leal Ó,Barrón E,Camarena-Pérez H,Vílchez Z

    更新日期:2019-09-01 00:00:00

  • Effects of prompting and reinforcement of one response pattern upon imitation of a different modeled pattern.

    abstract::Twelve preschool children participated in a study of the effects of explicit training on the imitation of modeled behavior. The responses trained involved a marble-dropping pattern that differed from the modeled pattern. Training consisted of physical prompts and verbal praise during a single session. No prompts or pr...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1982.37-135

    authors: Bondy AS

    更新日期:1982-01-01 00:00:00

  • Steady-state assessment of impulsive choice in Lewis and Fischer 344 rats: between-condition delay manipulations.

    abstract::Previous research has shown that Lewis rats make more impulsive choices than Fischer 344 rats. Such strain-related differences in choice are important as they may provide an avenue for exploring genetic and neurochemical contributions to impulsive choice. The present systematic replication was designed to determine if...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.2008.90-333

    authors: Madden GJ,Smith NG,Brewer AT,Pinkston JW,Johnson PS

    更新日期:2008-11-01 00:00:00

  • Effects of chlorpromazine on appetitive and aversive components of a multiple schedule.

    abstract::A multiple schedule having both an appetitive and an avoidance component was maintained in two dogs to create a complex behavioral base line for observing the effects of chlorpromazine. Both soluble and "Spansule" chlorpromazine generated similar functions relating drug dose to measures of behavioral output. Although ...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1962.5-259

    authors: WALLER MB,WALLER PF

    更新日期:1962-04-01 00:00:00

  • Increasing the variability of response sequences in pigeons by adjusting the frequency of switching between two keys.

    abstract::Three experiments compared the amounts of behavioral variability generated with two reinforcement rules. In Experiments 1 and 2 pigeons received food whenever they generated a sequence of eight pecks, distributed over two keys, provided that the sequence contained a certain number of change-overs between the keys. Alt...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1997.68-1

    authors: Machado A

    更新日期:1997-07-01 00:00:00

  • Uninstructed human responding: Sensitivity of low-rate performance to schedule contingencies.

    abstract::College students' presses on a telegraph key occasionally turned on a light in the presence of which button presses produced points later exchangeable for money. Initially, responding was maintained by low-rate contingencies superimposed on either random-interval or random-ratio schedules. Later, the low-rate continge...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1981.36-207

    authors: Shimoff E,Catania AC,Matthews BA

    更新日期:1981-09-01 00:00:00

  • FORCE GRADIENTS IN STIMULUS GENERALIZATION.

    abstract::Pigeons were trained to peck with differing force requirements on a key specially designed to measure and control force of pecking without changes in the mechanical threshold. Following training on a key illuminated by a single wavelength, a generalization test was given. Force and rate gradients were obtained. Force ...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1965.8-231

    authors: COLE JL

    更新日期:1965-07-01 00:00:00

  • Polydipsia induced in rats by second-order schedules of reinforcement.

    abstract::Three rats were exposed to a second-order schedule in which fixed-interval components ended either with food or with a brief stimulus that was never paired with food. Food and the brief stimulus occurred in a random sequence (variable-ratio 2 overall schedule). Another three rats were exposed to a similar second-order...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1977.27-265

    authors: Corfield-Sumner PK,Blackman DE,Stainer G

    更新日期:1977-03-01 00:00:00

  • Timeout postponement without increased reinforcement frequency.

    abstract::Three experiments were conducted to examine pigeons' postponement of signaled extinction periods (timeouts) from a schedule of food reinforcement when such responding neither decreased overall timeout frequency nor increased the overall frequency of food reinforcement. A discrete-trial procedure was used in which a re...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.2000.74-147

    authors: Pietras CJ,Hackenberg TD

    更新日期:2000-09-01 00:00:00

  • Tolerance to the effects of cocaine on performance under behavior-correlated reinforcement magnitude.

    abstract::Four pigeons responded under a fixed-interval 8-min schedule of food delivery in which the amount of food delivered at the end of each interval depended on performance during the interval (i.e., a correlated schedule). Specifically, duration of access to grain was contingent upon the number of responses made during th...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.2001.76-217

    authors: Miller ML,Brodkorb GW,Branch MN

    更新日期:2001-09-01 00:00:00

  • A re-examination of local contrast in multiple schedules.

    abstract::Pigeons were presented with multiple schedules of alternating 90-sec components. When components in which grain was never presented alternated with components in which grain was presented on a variable-interval schedule, the average rate of responding in the variable-interval components increased, showing overall posi...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1975.24-291

    authors: Buck SL,Rothstein B,Williams BA

    更新日期:1975-11-01 00:00:00

  • Analysis of fixed-ratio behavior maintained by drug reinforcers.

    abstract::Behavior maintained by intravenously delivered alfentanil, cocaine, or ketamine was assessed using a fixed-ratio schedule of reinforcement. As the dose of each drug was increased, rate of responding also increased up to a maximum. Further increases in dose resulted in decreased response rates (inverted U-shaped curve)...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1991.56-331

    authors: Skjoldager P,Winger G,Woods JH

    更新日期:1991-09-01 00:00:00

  • Criticisms of the satiety hypothesis as an explanation for within-session decreases in responding.

    abstract::The authors of four papers recently reported that satiation provides a better explanation than habituation for within-session decreases in conditioned responding. Several arguments question this conclusion. First, the contribution of habituation to within-session changes in responding seems clearly established. Inform...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.2000.74-347

    authors: McSweeney FK,Murphy ES

    更新日期:2000-11-01 00:00:00

  • Generalization peak shift for autoshaped and operant key pecks.

    abstract::Pigeons acquired discriminated key pecking between 528- and 540-nm stimuli by either a response-reinforcer (operant group) or a stimulus-reinforcer (autoshaped group) contingency, with other training-schedule parameters comparable over groups. For the birds in the operant group, key pecks intermittently produced grain...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1992.57-127

    authors: Weiss SJ,Weissman RD

    更新日期:1992-03-01 00:00:00

  • Teaching serial position sequences to monkeys with a delayed matching-to-sample procedure.

    abstract::Comparison was made of two methods for training monkeys to "observe" a two-member serial position sequence by pressing two consecutively lighted keys and then to "report" the sequence by pressing the same two keys in the same order but without the lights. A fading technique involving gradual elimination of brightness ...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1971.15-335

    authors: Mackay HA,Brown SM

    更新日期:1971-05-01 00:00:00

  • An update on the search for symmetry in nonhumans.

    abstract::Sidman et al.'s (1982) failure to find evidence for symmetry (bidirectional associations between stimuli) in monkeys and baboons set the stage for decades of work on emergent relations in nonhumans. They attributed the failure to the use of procedures that did not (1) promote stimulus control based on the relation bet...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1002/jeab.647

    authors: Lionello-DeNolf KM

    更新日期:2021-01-01 00:00:00

  • Controls for and constraints on auto-shaping.

    abstract::Auto-shaping the pigeon's key-peck response was examined as a respondent conditioning procedure with the use of Rescorla's truly-random control procedure. In the first experiment, pigeons received presentations of brief light on the response key and brief presentations of food where the light and the food were indepen...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1973.20-323

    authors: Bilbrey J,Winokur S

    更新日期:1973-11-01 00:00:00

  • The effect of a pre-shock signal on a free-operant avoidance response.

    abstract::After 25 free-operant avoidance training sessions, a 1-min signal followed by a brief shock was presented on the average of once every 4 min. During the signal, the avoidance schedule was suspended (20 sessions). Response rates during the signal were markedly reduced. Shock rates during non-signalled periods increased...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1970.14-331

    authors: Roberts AE,Hurwitz HM

    更新日期:1970-11-01 00:00:00

  • Associative concept learning in animals.

    abstract::Nonhuman animals show evidence for three types of concept learning: perceptual or similarity-based in which objects/stimuli are categorized based on physical similarity; relational in which one object/stimulus is categorized relative to another (e.g., same/different); and associative in which arbitrary stimuli become ...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章,评审

    doi:10.1002/jeab.55

    authors: Zentall TR,Wasserman EA,Urcuioli PJ

    更新日期:2014-01-01 00:00:00

  • Choosing among multiple alternatives: Relative and overall reinforcer rates.

    abstract::Choice behavior among two alternatives has been widely researched, but fewer studies have examined the effect of multiple (more than two) alternatives on choice. Two experiments investigated whether changing the overall reinforcer rate affected preference among three and four concurrently scheduled alternatives. Exper...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1002/jeab.269

    authors: Beeby E,Alsop B

    更新日期:2017-09-01 00:00:00

  • Superior-subordinate dyads: Dependence of leader effectiveness on mutual reinforcement contingencies.

    abstract::Task contingencies were modeled from bureaucratic organizations in which vague job descriptions provide incomplete contingency specifications. Response rates within dyads were examined using two nonsocial, two social, and two control contingencies. In the first social contingency, responses by the superior produced mo...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1991.56-105

    authors: Rao RK,Mawhinney TC

    更新日期:1991-07-01 00:00:00

  • A multivariate assessment of the rapidly changing procedure with McDowell's Evolutionary Theory of Behavior Dynamics.

    abstract::A multivariate analysis is concerned with more than one dependent variable simultaneously. Models that generate event records have a privileged status in a multivariate analysis. From a model that generates event records, we may compute predictions for any dependent variable associated with those event records. Howeve...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1002/jeab.478

    authors: Li D,Elliffe D,Hautus MJ

    更新日期:2018-11-01 00:00:00

  • The stay/switch model of concurrent choice.

    abstract::This experiment compared descriptions of concurrent choice by the stay/switch model, which says choice is a function of the reinforcers obtained for staying at and for switching from each alternative, and the generalized matching law, which says choice is a function of the total reinforcers obtained at each alternativ...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.2009.91-21

    authors: MacDonall JS

    更新日期:2009-01-01 00:00:00

  • Choice, foraging, and reinforcer duration.

    abstract::Pigeons were exposed to a foraging schedule characterized by three different states, beginning with a search state in which completion of a variable interval on a white key led to a choice state. In the choice state the subject could, by appropriate responding on a fixed ratio of three, either accept or reject the sch...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1986.46-93

    authors: Ito M,Fantino E

    更新日期:1986-07-01 00:00:00

  • Effects of reinforcer magnitude on responding under differential-reinforcement-of-low-rate schedules of rats and pigeons.

    abstract::Experiment I investigated the effects of reinforcer magnitude on differential-reinforcement-of-low-rate (DRL) schedule performance in three phases. In Phase 1, two groups of rats (n = 6 and 5) responded under a DRI. 72-s schedule with reinforcer magnitudes of either 30 or 300 microl of water. After acquisition, the wa...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.2002.78-17

    authors: Doughty AH,Richards JB

    更新日期:2002-07-01 00:00:00

  • Classical conditioning of courting behavior in the Japanese quail, Coturnix coturnix japonica.

    abstract::Male Japanese quail were classically conditioned to display courting behavior at the sound of a buzzer, a previously neutral stimulus. The buzzer (conditioned stimulus) was paired with the presentation of a female quail (unconditioned stimulus) for a number of trials. The courting display, invariably elicited from the...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1967.10-213

    authors: Farris HE

    更新日期:1967-03-01 00:00:00

  • Observing responses and serial stimuli: searching for the reinforcing properties of the S-.

    abstract::The control exerted by a stimulus associated with an extinction component (S-) on observing responses was determined as a function of its temporal relation with the onset of the reinforcement component. Lever pressing by rats was reinforced on a mixed random-interval extinction schedule. Each press on a second lever p...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.2009.92-215

    authors: Escobar R,Bruner CA

    更新日期:2009-09-01 00:00:00

  • Simple and conditional visual discrimination with wheel running as reinforcement in rats.

    abstract::Three experiments explored whether access to wheel running is sufficient as reinforcement to establish and maintain simple and conditional visual discriminations in nondeprived rats. In Experiment 1, 2 rats learned to press a lit key to produce access to running; responding was virtually absent when the key was dark, ...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1998.70-103

    authors: Iversen IH

    更新日期:1998-09-01 00:00:00