Theories of probabilistic reinforcement.

Abstract:

:In three experiments, pigeons chose between two alternatives that differed in the probability of reinforcement and the delay to reinforcement. A peck at a red key led to a delay of 5 s and then a possible reinforcer. A peck at a green key led to an adjusting delay and then a certain reinforcer. This delay was adjusted over trials so as to estimate an indifference point, or a duration at which the two alternatives were chosen about equally often. In Experiments 1 and 2, the intertrial interval was varied across conditions, and these variations had no systematic effects on choice. In Experiment 3, the stimuli that followed a choice of the red key differed across conditions. In some conditions, a red houselight was presented for 5 s after each choice of the red key. In other conditions, the red houselight was present on reinforced trials but not on nonreinforced trials. Subjects exhibited greater preference for the red key in the latter case. The results were used to evaluate four different theories of probabilistic reinforcement. The results were most consistent with the view that the value or effectiveness of a probabilistic reinforcer is determined by the total time per reinforcer spent in the presence of stimuli associated with the probabilistic alternative. According to this view, probabilistic reinforcers are analogous to reinforcers that are delivered after variable delays.

journal_name

J Exp Anal Behav

authors

Mazur JE

doi

10.1901/jeab.1989.51-87

subject

Has Abstract

pub_date

1989-01-01 00:00:00

pages

87-99

issue

1

eissn

0022-5002

issn

1938-3711

journal_volume

51

pub_type

杂志文章
  • Stimulus equivalence and transitive associations: A methodological analysis.

    abstract::When a number of two-stimulus relations are established through training within a set of stimuli, other two-stimulus relations often emerge in the same set without direct training. These, termed "transitive stimulus relations," have been demonstrated with a variety of visual and auditory stimuli. The phenomenon has se...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1984.42-143

    authors: Fields L,Verhave T,Fath S

    更新日期:1984-07-01 00:00:00

  • Toward quantifying the abuse liability of ultraviolet tanning: A behavioral economic approach to tanning addiction.

    abstract::Many adults engage in ultraviolet indoor tanning despite evidence of its association with skin cancer. The constellation of behaviors associated with ultraviolet indoor tanning is analogous to that in other behavioral addictions. Despite a growing literature on ultraviolet indoor tanning as an addiction, there remains...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1002/jeab.216

    authors: Reed DD,Kaplan BA,Becirevic A,Roma PG,Hursh SR

    更新日期:2016-07-01 00:00:00

  • Conjunctive schedules of reinforcement II: response requirements and stimulus effects.

    abstract::Responding of three pigeons was maintained under conjunctive fixed-ratio, fixed-interval schedules where a key peck produced food after both schedule requirements were completed. The individual schedule requirements were then successively removed and reinstated with responding maintained under the following conditions...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1975.24-23

    authors: Barrett JE

    更新日期:1975-07-01 00:00:00

  • FORCE GRADIENTS IN STIMULUS GENERALIZATION.

    abstract::Pigeons were trained to peck with differing force requirements on a key specially designed to measure and control force of pecking without changes in the mechanical threshold. Following training on a key illuminated by a single wavelength, a generalization test was given. Force and rate gradients were obtained. Force ...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1965.8-231

    authors: COLE JL

    更新日期:1965-07-01 00:00:00

  • Knowing before doing: discrimination by rats of a brief interruption of a tone.

    abstract::Eight rats' lever presses were reinforced after an interruption in a tone, provided the lever had not been pressed before the tone interruption. After a few sessions, long before the animals reliably refrained from lever pressing before the interruption, the latencies of postinterruption presses (time from the termina...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1984.41-329

    authors: Eisler H

    更新日期:1984-05-01 00:00:00

  • Signal probability, reinforcement and signal detection.

    abstract::Five pigeons were trained to detect differences in light intensity. Two stimuli, S1 and S2, differing in intensity, were arranged on the center key of a three-key chamber according to set probabilities. A peck on the center key turned on the two side keys. When S1 was presented on the center key, a peck on the left ke...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1979.32-373

    authors: McCarthy D,Davison M

    更新日期:1979-11-01 00:00:00

  • Differential antagonism of cocaine self-administration and cocaine-induced disruptions of learning by haloperidol in rhesus monkeys.

    abstract::Six rhesus monkeys responding under a three-component multiple schedule were administered haloperidol to determine its effects on cocaine self-administration and on cocaine's disruptive effects on the repeated acquisition and performance of response chains. In the absence of haloperidol, 0.0032-0.032 mg/kg/infusion of...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.2008.89-225

    authors: Winsauer PJ,Moerschbaecher JM,Roussell AM

    更新日期:2008-03-01 00:00:00

  • Travel time and concurrent-schedule choice: retrospective versus prospective control.

    abstract::Six pigeons were trained on concurrent variable-interval schedules in which two different travel times between alternatives, 4.5 and 0.5 s, were randomly arranged. In Part 1, the next travel time was signaled while the subjects were responding on each alternative. Generalized matching analyses of performance in the pr...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.2000.73-65

    authors: Davison M,Elliffe D

    更新日期:2000-01-01 00:00:00

  • Operant reinforcement of an autonomic response: two studies.

    abstract::Two successive studies were conducted to determine the possibility of operant reinforcement of nonspecific galvanic skin resistance responses. In the first study, with five experimental and three control subjects who served for 20 to 30 min a day for 10 days, all experimental subjects learned to emit more nonspecific ...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1967.10-119

    authors: Gavalas RJ

    更新日期:1967-01-01 00:00:00

  • Fixed ratio and extinction performance of infants in the second year of life.

    abstract::Five 14(1/2)- to 19(1/2)-month-old infants were trained to lever press for snacks on small fixed ratio schedules of reinforcement. Within four to nine sessions, responding under FR 10 was established for four subjects and FR 15 for the other. Each subject's last session revealed behavioral patterns similar to animal a...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1966.9-105

    authors: Weisberg P,Fink E

    更新日期:1966-03-01 00:00:00

  • Responses and pauses: discrimination and a choice catastrophe.

    abstract::Pigeons produced a stimulus change either by responding or by not responding for a specified time period (by pausing). They then had to choose between two responses to obtain food. One choice was correct if the first component had been completed by a response; the other was correct if the component had been completed ...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1982.37-223

    authors: Zeiler MD,Solano JM

    更新日期:1982-03-01 00:00:00

  • Evidence of interaction between deprivation effects and stimulus control.

    abstract::Discriminative responding in pigeons was studied under multiple variable-interval extinction and variable-ratio extinction schedules, as deprivation was varied. Generally, the greater the accuracy of discrimination that developed during training, the smaller the effect of deprivation upon subsequent performance. This ...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1971.16-95

    authors: Powell RW

    更新日期:1971-07-01 00:00:00

  • Two parameters of a temporally defined schedule of negative reinforcement.

    abstract::Temporal schedules of negative reinforcement were derived in a manner analogous to those for positive reinforcement, and two parametric studies were carried out with two of the three defining variables. With some limiting values of the defining variables, escape schedules result and data obtained at these values were ...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1963.6-361

    authors: SIDLEY NA

    更新日期:1963-07-01 00:00:00

  • Equivalence class establishment, expansion, and modification in preschool children.

    abstract::Preschool children were taught four two-choice match-to-sample conditional discriminations with 10 arbitrary visual stimuli. For 6 participants, 2 of the 10 stimuli served as the sample, or conditional, stimuli in all discriminations. For 5 additional participants, the same pair of stimuli served as the discriminative...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1999.71-195

    authors: Saunders RR,Drake KM,Spradlin JE

    更新日期:1999-03-01 00:00:00

  • Food-avoidance in hungry pigeons, and other perplexities.

    abstract::Twenty-three pigeons were subjected to a series of procedures in which the key-peck's effects ranged from immediate, differential food reinforcement, through delayed reinforcement, the production of stimulus changes with and without probable secondary reinforcement, the prevention of food presentation ("food-avoidance...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1972.18-369

    authors: Herrnstein RJ,Loveland DH

    更新日期:1972-11-01 00:00:00

  • Symmetry in the pigeon with sample and comparison stimuli in different locations.

    abstract::Pigeons typically do not show evidence for symmetry in two-alternative matching-to-sample but do demonstrate this emergent relation in successive (go/no-go) matching-to-sample. Because the sample and comparison stimuli are presented in the same spatial location (viz., on one key) during successive matching training an...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1002/jeab.31

    authors: Swisher M,Urcuioli PJ

    更新日期:2013-07-01 00:00:00

  • Stock optimizing: maximizing reinforcers per session on a variable-interval schedule.

    abstract::In Experiment 1, 2 monkeys earned their daily food ration by pressing a key that delivered food according to a variable-interval 3-min schedule. In Phases 1 and 4, sessions ended after 3 hr. In Phases 2 and 3, sessions ended after a fixed number of responses that reduced food intake and body weights from levels during...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1993.59-389

    authors: Silberberg A,Bauman R,Hursh S

    更新日期:1993-03-01 00:00:00

  • Stimulus control in the experimental study of cooperation.

    abstract::The cooperative responses of pairs of human subjects were reinforced under several stimulus conditions in two settings designed to require a "social" response, i.e., where at least one of the two persons is responding to the behavior of the other. The first task, designed by Lindsley and Cohen, required individual res...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1968.11-571

    authors: Schmitt DR,Marwell G

    更新日期:1968-09-01 00:00:00

  • Context specificity of operant discriminative performance in pigeons: II. Necessary and sufficient conditions.

    abstract::Six experiments were performed to explore the necessary and sufficient conditions for producing context specificity of discriminative operant performance in pigeons. In Experiment 1, pigeons learned a successive discrimination (red S+/blue S-) in two chambers that had a particular odor present and between which they w...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1993.60-313

    authors: Thomas DR,Empedocles S,Morrison SK,Bing MN

    更新日期:1993-09-01 00:00:00

  • The nature of control by spoken words over visual stimulus selection.

    abstract::Eight retarded adolescents were trained to select one (a trained S+) of two visual stimuli in response to a spoken word (a trained word). Two different visual stimuli alternated randomly as the S-. To determine if the spoken work was merely a temporal discriminative stimulus for when to respond, or if it also specifie...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1977.27-433

    authors: Dixon LS

    更新日期:1977-05-01 00:00:00

  • An infrared system for the detection of a pigeon's pecks at alphanumeric characters on a TV screen: the dependency of letter detection on the predictability of one letter by another.

    abstract::Three pigeons pecked at letters of the alphabet and at the symbol "?" displayed on a computer-driven cathode ray screen. A 4 by 4 matrix of infrared emitting and detecting diodes and associated circuitry identified the location of a pigeon's responses to the screen. Responses at the target letter T were probabilistica...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1985.43-257

    authors: Clauson HD,Izatt EJ,Shimp CP

    更新日期:1985-03-01 00:00:00

  • Behavioral control of visual fixation of the rhesus monkey.

    abstract::A paradigm for the control of visual fixation of the macaque monkey in vision experiments was described. Using a Maxwellian view, the procedure permits the placement of discrete test-light stimuli in a specific area of the retina as the monkey fixates a primary target. This procedure holds foveal fixation as other beh...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1976.25-113

    authors: Crawford ML

    更新日期:1976-01-01 00:00:00

  • An operant analysis of human altruistic responding.

    abstract::Human altruistic responding (called give responding), which delivered a reinforcer to someone other than the responder, was compared to responding where the responder was the recipient of the reinforcer (called earn responding). The same type of response (button pressing), the same reinforcer (a point representing a p...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1977.27-515

    authors: Weiner H

    更新日期:1977-05-01 00:00:00

  • Early extinction effects following intermittent reinforcement: Little evidence of extinction bursts.

    abstract::The occurrence of extinction bursts-transient increases in response rate in excess of those observed in baseline during the period immediately following discontinuation of reinforcement of a response-was examined. In Experiment 1, key pecking of pigeons was reinforced according to a multiple schedule in which a variab...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1002/jeab.616

    authors: Lattal KA,Kuroda T,Cook JE

    更新日期:2020-07-01 00:00:00

  • On the law of effect.

    abstract::Experiments on single, multiple, and concurrent schedules of reinforcement find various correlations between the rate of responding and the rate or magnitude of reinforcement. For concurrent schedules (i.e., simultaneous choice procedures), there is matching between the relative frequencies of responding and reinforce...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1970.13-243

    authors: Herrnstein RJ

    更新日期:1970-03-01 00:00:00

  • Repeated acquisition in the analysis of rule-governed behavior.

    abstract::Five children, ranging in age from 3(1/2) years to 5(1/2) years, were taught various four-response chains using conditioned reinforcement. Experiment 1 investigated the effects of presenting "instruction" stimuli-a sequence of lights over the correct response buttons-to assess their role in facilitating the acquisitio...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1985.44-175

    authors: Vaughan ME

    更新日期:1985-09-01 00:00:00

  • Automaintenance without stimulus-change reinforcement: Temporal control of key pecks.

    abstract::Yoked pairs of experimentally naive pigeons were exposed to a modified autoshaping procedure in which key pecking by the leader birds postponed both keylight termination and access to grain for the leader and the follower bird. Key pecking developed and was maintained in all birds and continued through two reversals o...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1979.31-395

    authors: Myerson J,Myerson WA,Parker BK

    更新日期:1979-05-01 00:00:00

  • Effects of mesolimbic dopamine depletion on responding maintained by cocaine and food.

    abstract::The hypothesis that mesolimbic dopamine is selectively involved in cocaine reinforcement was investigated in the rat. Animals were trained under a multiple schedule in which responding was reinforced by intravenous cocaine (0.75 mg/kg/injection) or food (45-mg pellets) under fixed-ratio 15 schedule requirements in alt...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1994.61-213

    authors: Caine SB,Koob GF

    更新日期:1994-03-01 00:00:00

  • A multivariate rate equation for variable-interval performance.

    abstract::A value-like parameter is introduced into a rate equation for describing variable-interval performance. The equation, derived solely from formal considerations, expresses rate of responding as a joint function of rate of reinforcement and "reinforcer power." Preliminary tests of the rate equation show that it handles ...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1979.31-267

    authors: McDowell JJ,Kessel R

    更新日期:1979-03-01 00:00:00

  • Resistance to reinforcement change in multiple and concurrent schedules assessed in transition and at steady state.

    abstract::Behavioral momentum theory relates resistance to change of responding in a multiple-schedule component to the total reinforcement obtained in that component, regardless of how the reinforcers are produced. Four pigeons responded in a series of multiple-schedule conditions in which a variable-interval 40-s schedule arr...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1995.63-1

    authors: McLean AP,Blampied NM

    更新日期:1995-01-01 00:00:00