Alternative reinforcement increases resistance to change: Pavlovian or operant contingencies?

Abstract:

:Two multiple-schedule experiments with pigeons examined the effect of adding food reinforcement from an alternative source on the resistance of the reinforced response (target response) to the decremental effects of satiation and extinction. In Experiment 1, key pecks were reinforced by food in two components according to variable-interval schedules and, in some conditions, food was delivered according to variable-time schedules in one of the components. The rate of key pecking in a component was negatively related to the proportion of reinforcers from the alternative (variable-time) source. Resistance to satiation and extinction, in contrast, was positively related to the overall rate of reinforcement in the component. Experiment 2 was conceptually similar except that the alternative reinforcers were contingent on a specific concurrent response. Again, the rate of the target response varied as a function of its relative reinforcement, but its resistance to satiation and extinction varied directly with the overall rate of reinforcement in the component stimulus regardless of its relative reinforcement. Together the results of the two experiments suggest that the relative reinforcement of a response (the operant contingency) determines its rate, whereas the stimulus-reinforcement contingency (a Pavlovian contingency) determines its resistance to change.

journal_name

J Exp Anal Behav

authors

Nevin JA,Tota ME,Torquato RD,Shull RL

doi

10.1901/jeab.1990.53-359

subject

Has Abstract

pub_date

1990-05-01 00:00:00

pages

359-79

issue

3

eissn

0022-5002

issn

1938-3711

journal_volume

53

pub_type

杂志文章
  • Multiple fixed-interval schedules: transient contrast and temporal inhibition.

    abstract::Pigeons were exposed to four cycles per session of a multiple schedule in which each cycle involved twelve 60-sec fixed intervals followed by four 180-sec intervals [(12 FI 60-sec)(4 FI 180-sec) schedule]. Post-reinforcement pauses were shorter during the first few short intervals of each cycle than during later short...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1969.12-583

    authors: Staddon JE

    更新日期:1969-07-01 00:00:00

  • Choice between response units: The rate constancy model.

    abstract::In a conjoint schedule, reinforcement is available simultaneously on two or more schedules for the same response. The present experiments provided food for key pecking on both a random-interval and a differential-reinforcement-of-low-rate (DRL) schedule. Experiment 1 involved ordinary DRL schedules; Experiment 2 added...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1983.39-275

    authors: Zeiler MD,Blakely TF

    更新日期:1983-03-01 00:00:00

  • On the classic and modern theories of matching.

    abstract::Classic matching theory, which is based on Herrnstein's (1961) original matching equation and includes the well-known quantitative law of effect, is almost certainly false. The theory is logically inconsistent with known experimental findings, and experiments have shown that its central constant-k assumption is not te...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.2005.59-04

    authors: McDowell JJ

    更新日期:2005-07-01 00:00:00

  • Reinforcement of variability facilitates learning in humans.

    abstract::Studies with rats and pigeons showed that reinforcement of response variability improved learning of difficult response sequences. The results suggested that concurrent reinforcement of variability might be a helpful tool when educators or therapists attempt to teach individuals with learning difficulties. However, si...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1002/jeab.475

    authors: Hansson J,Neuringer A

    更新日期:2018-11-01 00:00:00

  • The dynamics of the law of effect: a comparison of models.

    abstract::Dynamical models based on three steady-state equations for the law of effect were constructed under the assumption that behavior changes in proportion to the difference between current behavior and the equilibrium implied by current reinforcer rates. A comparison of dynamical models showed that a model based on Navaka...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.2010.93-91

    authors: Navakatikyan MA,Davison M

    更新日期:2010-01-01 00:00:00

  • A multivariate rate equation for variable-interval performance.

    abstract::A value-like parameter is introduced into a rate equation for describing variable-interval performance. The equation, derived solely from formal considerations, expresses rate of responding as a joint function of rate of reinforcement and "reinforcer power." Preliminary tests of the rate equation show that it handles ...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1979.31-267

    authors: McDowell JJ,Kessel R

    更新日期:1979-03-01 00:00:00

  • On the effects of signaling reinforcer probability and magnitude in delayed matching to sample.

    abstract::Two experiments examined whether postsample signals of reinforcer probability or magnitude affected the accuracy of delayed matching to sample in pigeons. On each trial, red or green choice responses that matched red or green stimuli seen shortly before a variable retention interval were reinforced with wheat access. ...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.2005.94-03

    authors: Brown GS,White KG

    更新日期:2005-03-01 00:00:00

  • An operant analysis of human altruistic responding.

    abstract::Human altruistic responding (called give responding), which delivered a reinforcer to someone other than the responder, was compared to responding where the responder was the recipient of the reinforcer (called earn responding). The same type of response (button pressing), the same reinforcer (a point representing a p...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1977.27-515

    authors: Weiner H

    更新日期:1977-05-01 00:00:00

  • Temporal framing and the hidden-zero effect: rate-dependent outcomes on delay discounting.

    abstract::Recent research suggests that presenting time intervals as units (e.g., days) or as specific dates, can modulate the degree to which humans discount delayed outcomes. Another framing effect involves explicitly stating that choosing a smaller-sooner reward is mutually exclusive to receiving a larger-later reward, thus ...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1002/jeab.328

    authors: Naudé GP,Kaplan BA,Reed DD,Henley AJ,DiGennaro Reed FD

    更新日期:2018-05-01 00:00:00

  • Aversive properties of the negative stimulus in a successive discrimination.

    abstract::Experiment I sought to determine if the stimulus correlated with extinction in a successive discrimination was an aversive stimulus. An escape response provided an index of aversive control. Two groups of pigeons were exposed to a multiple variable-interval 30-sec extinction schedule. For the experimental group, a sin...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1969.12-917

    authors: Rilling M,Askew HR,Ahlskog JE,Kramer TJ

    更新日期:1969-11-01 00:00:00

  • Negatively reinforced key pecking.

    abstract::A reinforcement-switching procedure was used to produce negatively reinforced key pecking in pigeons. First, key pecking on a chain schedule (fixed-interval 10-sec variable-interval 60-sec) was conditioned using grain reinforcement. Second, intermittent shock in the initial link was introduced at a low intensity and g...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1974.22-83

    authors: Lewis P,Lewin L,Stoyak M,Muehleisen P

    更新日期:1974-07-01 00:00:00

  • Fixed-interval behavior: effects of percentage reinforcement.

    abstract::The percentage of fixed intervals terminating with food presentation was varied parametrically. Intervals that did not end with food were terminated by a stimulus uncorrelated with food presentation (a timeout stimulus). In Experiment I, the pigeons' response rates were an inverted U-shaped function of the percentage ...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1972.17-177

    authors: Zeiler MD

    更新日期:1972-03-01 00:00:00

  • Signalled free-operant avoidance of shock by pigeons pecking a key.

    abstract::Two pigeons were trained to peck a key under a free-operant avoidance schedule. Then, changes in key color signalled the beginning (safe period) and the end (warning period) of the response-shock interval, with a response required to change the key color. Finally, a change in key color signalled the warning period and...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1977.27-281

    authors: De Moraes AB,Todorov JC

    更新日期:1977-03-01 00:00:00

  • Knowing before doing: discrimination by rats of a brief interruption of a tone.

    abstract::Eight rats' lever presses were reinforced after an interruption in a tone, provided the lever had not been pressed before the tone interruption. After a few sessions, long before the animals reliably refrained from lever pressing before the interruption, the latencies of postinterruption presses (time from the termina...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1984.41-329

    authors: Eisler H

    更新日期:1984-05-01 00:00:00

  • An eight-alternative concurrent schedule: foraging in a radial maze.

    abstract::In two experiments conducted in an eight-arm radial maze, food pellets were delivered when a photocell beam was broken at the end of each arm via a nose poke, according to either fixed-interval or random-interval schedules of reinforcement, with each arm providing a different frequency of reinforcement. The behavior o...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1994.61-331

    authors: Elsmore TF,McBride SA

    更新日期:1994-05-01 00:00:00

  • European starlings are capable of discriminating subtle size asymmetries in paired stimuli.

    abstract::Small deviations from bilateral symmetry (fluctuating asymmetries) are cues to fitness differences in some animals. Therefore, researchers have considered whether animals use these small asymmetries as visual cues to determine appropriate behavioral responses (e.g., mate preferences). However, there have been few syst...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.2007.103-05

    authors: Swaddle JP,Johnson CW

    更新日期:2007-01-01 00:00:00

  • Effects of point-loss punishers on human signal-detection performance.

    abstract::Three experiments using human participants varied the distribution of point-gain reinforcers or point-loss punishers in two-alternative signal-detection procedures. Experiment 1 varied the distribution of point-gain reinforcers for correct responses (Group A) and point-loss punishers for errors (Group B) across condit...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.2009.92-17

    authors: Lie C,Alsop B

    更新日期:2009-07-01 00:00:00

  • Magnitude and duration of the effects of cocaine on conditioned and adjunctive behaviors in the chimpanzee.

    abstract::Characteristic patterns of conditioned key-pressing were maintained in the chimpanzee under a multiple 30-response fixed-ratio, 10-minute fixed-interval schedule of food presentation. Adjunctive drinking occurred with regularity during the fixed-interval schedule and, with less frequency, during 1-minute timeout perio...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1980.33-131

    authors: Byrd LD

    更新日期:1980-01-01 00:00:00

  • Secondary reinforcement and number of primary reinforcements.

    abstract::Pigeons' pecks on either of two concurrently available response keys produced secondary reinforcers according to independent one-minute variable-interval schedules. Different secondary reinforcers, in the presence of which the rates of primary reinforcement were equal, were associated with each key. The rate of peckin...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1968.11-9

    authors: Fantino E,Herrnstein RJ

    更新日期:1968-01-01 00:00:00

  • Effects of time between trials on rats' and pigeons' choices with probabilistic delayed reinforcers.

    abstract::Parallel experiments with rats and pigeons examined reasons for previous findings that in choices with probabilistic delayed reinforcers, rats' choices were affected by the time between trials whereas pigeons' choices were not. In both experiments, the animals chose between a standard alternative and an adjusting alte...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.2011.95-41

    authors: Mazur JE,Biondi DR

    更新日期:2011-01-01 00:00:00

  • Roger T. Kelleher, behavior analyst.

    abstract::Roger T. Kelleher, rightly known as one of the foremost contributors to behavioral pharmacology, also made many important contributions to the experimental analysis of behavior. He participated significantly in the development of the discipline, through both his research and his editorial contributions to thisjournal....

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 传,历史文章,杂志文章

    doi:10.1901/jeab.2006.25-06

    authors: Branch MN

    更新日期:2006-11-01 00:00:00

  • The failure of stimulus control after presence-absence discrimination of click-rate.

    abstract::Pigeons were trained to discriminate a slow click-rate from its absence, or to discriminate it from a faster click-rate. Subsequent click-rate generalization tests produced the usual steepened gradients after the intradimensional discrimination but produced flat gradients after presence/absence discrimination. The occ...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1973.20-23

    authors: Williams BA

    更新日期:1973-07-01 00:00:00

  • Naming and categorization in young children: II. Listener behavior training.

    abstract::Following pretraining with everyday objects, 1- to 4-year-old children received listener training with three pairs of arbitrary stimuli of differing shapes. For each pair, 9 children were trained to select one stimulus in response to the spoken word /zog/ and the other to the spoken word /vek/. Next, in the look-at-sa...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.2004.81-267

    authors: Horne PJ,Lowe CF,Randle VR

    更新日期:2004-05-01 00:00:00

  • Rats' lever-press durations as psychophysical judgements of time.

    abstract::Hungry rats received food following lever-press durations exceeding a minimum value, which ranged from 0 to 6.4 sec. When no intertrial intervals separated successive presses, modal press durations remained at very short values as the minimum value required for food was increased. This was particularly true immediatel...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1973.19-239

    authors: Platt JR,Kuch DO,Bitgood SC

    更新日期:1973-03-01 00:00:00

  • Non-spatial delayed alternation by the pigeon.

    abstract::Pigeons were trained on a non-spatial delayed alternation task in which the color not pecked on the previous trial was correct. When varying delays were interposed between trials, alternation accuracy decreased as a function of delay, but remained greater than chance with a 45-sec delay. Successful alternation on the ...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1971.16-15

    authors: Williams BA

    更新日期:1971-07-01 00:00:00

  • Do adjusting-amount and adjusting-delay procedures produce equivalent estimates of subjective value in pigeons?

    abstract::The current experiment examined whether adjusting-amount and adjusting-delay procedures provide equivalent measures of discounting. Pigeons' discounting on the two procedures was compared using a within-subject yoking technique in which the indifference point (number of pellets or time until reinforcement) obtained wi...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.2007.37-06

    authors: Green L,Myerson J,Shah AK,Estle SJ,Holt DD

    更新日期:2007-05-01 00:00:00

  • Operant reinforcement of an autonomic response: two studies.

    abstract::Two successive studies were conducted to determine the possibility of operant reinforcement of nonspecific galvanic skin resistance responses. In the first study, with five experimental and three control subjects who served for 20 to 30 min a day for 10 days, all experimental subjects learned to emit more nonspecific ...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1967.10-119

    authors: Gavalas RJ

    更新日期:1967-01-01 00:00:00

  • Some effects of discriminative training with equated frequency of reinforcement.

    abstract::Pigeons were exposed to a multiple schedule which provided equally frequent reinforcement in the presence of two stimuli but which produced markedly different rates of key-pecking. Generalization gradients were displaced away from the stimulus associated with the lower rate of key-pecking. Another group of pigeons had...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1968.11-415

    authors: Yarczower M,Gollub LR,Dickson JF

    更新日期:1968-07-01 00:00:00

  • Concurrent schedule control of human visual target fixations.

    abstract::Operant conditioning techniques were applied to the study of how target fixations are controlled by the probability of signal occurrence. In a standard vigilance setting, gaze at three illuminable volt meters was monitored by a Mackworth television eye camera with automatic recording capability. Gaze at a given meter ...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1973.20-411

    authors: Rosenberger PB

    更新日期:1973-11-01 00:00:00

  • Time-place learning by pigeons, Columba livia.

    abstract::In each of two experiments, 2 pigeons received discrimination training in which food reinforcement for key pecking was conditional upon both spatial and temporal cues. In Experiment 1, food was available for periods of 30 s at each of three locations (pecking keys) during trials that lasted 90 s. In Experiment 2, food...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1992.57-145

    authors: Wilkie DM,Willson RJ

    更新日期:1992-03-01 00:00:00