Increasing the variability of response sequences in pigeons by adjusting the frequency of switching between two keys.

Abstract:

:Three experiments compared the amounts of behavioral variability generated with two reinforcement rules. In Experiments 1 and 2 pigeons received food whenever they generated a sequence of eight pecks, distributed over two keys, provided that the sequence contained a certain number of change-overs between the keys. Although no variability was required-the birds could obtain all reinforcers by repeating the same sequence-the pigeons emitted a large number of different sequences. In Experiment 3 pigeons received food whenever they generated a sequence that had not occurred during the last 25 trials. After prolonged training, the birds showed more sequence variability than in the first two experiments. The analysis of the internal structure of the response sequences revealed that, in general, (a) the location of the first peck was highly stereotyped; (b) as the trial advanced, the probability of switching to the initially preferred key decreased whereas the probability of switching to the other key increased; and (c) a first-order Markov chain model with transition probabilities given by a logistic function accounted well for the internal structure of the birds' response sequences. These findings suggest that, to a large extent, the variability of response sequences is an indirect effect of adjustments in changeover frequency.

journal_name

J Exp Anal Behav

authors

Machado A

doi

10.1901/jeab.1997.68-1

subject

Has Abstract

pub_date

1997-07-01 00:00:00

pages

1-25

issue

1

eissn

0022-5002

issn

1938-3711

journal_volume

68

pub_type

杂志文章
  • The dynamics of the law of effect: a comparison of models.

    abstract::Dynamical models based on three steady-state equations for the law of effect were constructed under the assumption that behavior changes in proportion to the difference between current behavior and the equilibrium implied by current reinforcer rates. A comparison of dynamical models showed that a model based on Navaka...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.2010.93-91

    authors: Navakatikyan MA,Davison M

    更新日期:2010-01-01 00:00:00

  • Stimulus-food relations and free-operant postponement of timeout from response-independent food presentation.

    abstract::Grain was briefly presented to food-deprived pigeons intermittently and response-independently except during signaled timeouts. During Experiment 1, key pecks postponed the next timeout for a specified interval. Rates of pecking during time in were inversely related to the length of time pecking postponed the next tim...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1983.40-153

    authors: Galbicka G,Branch MN

    更新日期:1983-09-01 00:00:00

  • A multivariate rate equation for variable-interval performance.

    abstract::A value-like parameter is introduced into a rate equation for describing variable-interval performance. The equation, derived solely from formal considerations, expresses rate of responding as a joint function of rate of reinforcement and "reinforcer power." Preliminary tests of the rate equation show that it handles ...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1979.31-267

    authors: McDowell JJ,Kessel R

    更新日期:1979-03-01 00:00:00

  • Concurrent variable-interval variable-ratio schedules can provide only weak evidence for matching.

    abstract::Herrnstein and Heyman (1979) showed that when pigeons' pecking is reinforced on concurrent variable-interval variable-ratio schedules, (1) their behavior ratios match the ratio of the schedules' reinforcer frequencies, and (2) there is more responding on the variable interval. Since maximizing the reinforcement rate w...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1984.41-83

    authors: Ziriax JM,Silberberg A

    更新日期:1984-01-01 00:00:00

  • Choice between response units: The rate constancy model.

    abstract::In a conjoint schedule, reinforcement is available simultaneously on two or more schedules for the same response. The present experiments provided food for key pecking on both a random-interval and a differential-reinforcement-of-low-rate (DRL) schedule. Experiment 1 involved ordinary DRL schedules; Experiment 2 added...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1983.39-275

    authors: Zeiler MD,Blakely TF

    更新日期:1983-03-01 00:00:00

  • Some effects of discriminative training with equated frequency of reinforcement.

    abstract::Pigeons were exposed to a multiple schedule which provided equally frequent reinforcement in the presence of two stimuli but which produced markedly different rates of key-pecking. Generalization gradients were displaced away from the stimulus associated with the lower rate of key-pecking. Another group of pigeons had...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1968.11-415

    authors: Yarczower M,Gollub LR,Dickson JF

    更新日期:1968-07-01 00:00:00

  • The stay/switch model of concurrent choice.

    abstract::This experiment compared descriptions of concurrent choice by the stay/switch model, which says choice is a function of the reinforcers obtained for staying at and for switching from each alternative, and the generalized matching law, which says choice is a function of the total reinforcers obtained at each alternativ...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.2009.91-21

    authors: MacDonall JS

    更新日期:2009-01-01 00:00:00

  • Procrastination by pigeons with fixed-interval response requirements.

    abstract::Two experiments studied the phenomenon of procrastination, in which pigeons chose a larger, more delayed response requirement over a smaller, more immediate response requirement. The response requirements were fixed-interval schedules that did not lead to an immediate food reinforcer, but that interrupted a 55-s perio...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1998.69-185

    authors: Mazur JE

    更新日期:1998-03-01 00:00:00

  • A multivariate assessment of the rapidly changing procedure with McDowell's Evolutionary Theory of Behavior Dynamics.

    abstract::A multivariate analysis is concerned with more than one dependent variable simultaneously. Models that generate event records have a privileged status in a multivariate analysis. From a model that generates event records, we may compute predictions for any dependent variable associated with those event records. Howeve...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1002/jeab.478

    authors: Li D,Elliffe D,Hautus MJ

    更新日期:2018-11-01 00:00:00

  • Human performance on negative slope schedules of points exchangeable for money: a failure of molar maximization.

    abstract::Panel pressing was generated and maintained in 5 adult humans by schedules of points exchangeable for money. Following exposure to a variable-interval 30-s schedule and to a linear variable-interval 30-s schedule (which permitted points to accumulate in an unseen "store" in the absence of responding), subjects were ex...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.2000.73-241

    authors: Jacobs EA,Hackenberg TD

    更新日期:2000-05-01 00:00:00

  • Negatively reinforced key pecking.

    abstract::A reinforcement-switching procedure was used to produce negatively reinforced key pecking in pigeons. First, key pecking on a chain schedule (fixed-interval 10-sec variable-interval 60-sec) was conditioned using grain reinforcement. Second, intermittent shock in the initial link was introduced at a low intensity and g...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1974.22-83

    authors: Lewis P,Lewin L,Stoyak M,Muehleisen P

    更新日期:1974-07-01 00:00:00

  • Effects of time between trials on rats' and pigeons' choices with probabilistic delayed reinforcers.

    abstract::Parallel experiments with rats and pigeons examined reasons for previous findings that in choices with probabilistic delayed reinforcers, rats' choices were affected by the time between trials whereas pigeons' choices were not. In both experiments, the animals chose between a standard alternative and an adjusting alte...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.2011.95-41

    authors: Mazur JE,Biondi DR

    更新日期:2011-01-01 00:00:00

  • Effects of mesolimbic dopamine depletion on responding maintained by cocaine and food.

    abstract::The hypothesis that mesolimbic dopamine is selectively involved in cocaine reinforcement was investigated in the rat. Animals were trained under a multiple schedule in which responding was reinforced by intravenous cocaine (0.75 mg/kg/injection) or food (45-mg pellets) under fixed-ratio 15 schedule requirements in alt...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1994.61-213

    authors: Caine SB,Koob GF

    更新日期:1994-03-01 00:00:00

  • Magnitude and duration of the effects of cocaine on conditioned and adjunctive behaviors in the chimpanzee.

    abstract::Characteristic patterns of conditioned key-pressing were maintained in the chimpanzee under a multiple 30-response fixed-ratio, 10-minute fixed-interval schedule of food presentation. Adjunctive drinking occurred with regularity during the fixed-interval schedule and, with less frequency, during 1-minute timeout perio...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1980.33-131

    authors: Byrd LD

    更新日期:1980-01-01 00:00:00

  • Reinforcement magnitude and the inhibiting effect of reinforcement.

    abstract::In a two-key concurrent variable-interval schedule (using pigeons), if the reinforcement frequency for one response is held constant while that for the other is increased, the rate of response on the constant key decreases. The immediate reinforcement for key pecking can usually be conceptualized as the change from a ...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1979.32-265

    authors: Michael JL

    更新日期:1979-09-01 00:00:00

  • Toward a unified theory of decision criterion learning in perceptual categorization.

    abstract::Optimal decision criterion placement maximizes expected reward and requires sensitivity to the category base rates (prior probabilities) and payoffs (costs and benefits of incorrect and correct responding). When base rates are unequal, human decision criterion is nearly optimal, but when payoffs are unequal, suboptima...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章,评审

    doi:10.1901/jeab.2002.78-567

    authors: Maddox WT

    更新日期:2002-11-01 00:00:00

  • The influence of ultraviolet radiation on the pigeon's color discrimination.

    abstract::Two experiments demonstrated the pigeon's sensitivity to ultraviolet light. In Experiment I, pigeons' responses were reinforced on a multiple schedule with a variable-interval reinforcement schedule in one component and extinction in the other component. Response rates were quite different in the two components where ...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1972.17-325

    authors: Wright AA

    更新日期:1972-05-01 00:00:00

  • OPERANT CONTROL OF PREENING IN PIGEONS.

    abstract::Preening in four pigeons was observed and recorded during operant level determinations, continuous and variable interval reinforcement, and extinction. The rate at which preening responses occur seems to be controlled by reinforcement in the same way as other operant behavior. Preening during VI reinforcement and exti...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1964.7-351

    authors: HOGAN JA

    更新日期:1964-09-01 00:00:00

  • Concurrent schedule control of human visual target fixations.

    abstract::Operant conditioning techniques were applied to the study of how target fixations are controlled by the probability of signal occurrence. In a standard vigilance setting, gaze at three illuminable volt meters was monitored by a Mackworth television eye camera with automatic recording capability. Gaze at a given meter ...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1973.20-411

    authors: Rosenberger PB

    更新日期:1973-11-01 00:00:00

  • Punishment contras during free-operant avoidance.

    abstract::Punishment of bar-pressing responses of rhesus monkeys with electric shock in one component of a multiple free-operant avoidance schedule suppressed responding in that component. These decreases were concomitant with response rate increases in the unpunished component (punishment contrast). Response rates in both comp...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1972.18-509

    authors: Lattal KA,Griffin MA

    更新日期:1972-11-01 00:00:00

  • Contingency discriminability and peak shift in concurrent schedules.

    abstract::We investigated the effects of discriminative stimuli on choice in a highly variable environment using a procedure in which multiple two-key concurrent VI VI components changed every 10 reinforcers and were signaled by differential flashes of red and yellow keylights. Across conditions, five pigeons were exposed to a ...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.2006.11-05

    authors: Krägeloh CU,Elliffe DM,Davison M

    更新日期:2006-07-01 00:00:00

  • Reinforcement of variability facilitates learning in humans.

    abstract::Studies with rats and pigeons showed that reinforcement of response variability improved learning of difficult response sequences. The results suggested that concurrent reinforcement of variability might be a helpful tool when educators or therapists attempt to teach individuals with learning difficulties. However, si...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1002/jeab.475

    authors: Hansson J,Neuringer A

    更新日期:2018-11-01 00:00:00

  • TEMPORALLY SPACED RESPONDING BY PIGEONS: DEVELOPMENT AND EFFECTS OF DEPRIVATION AND EXTINCTION.

    abstract::In the first five or six sessions on a DRL 20-sec schedule of reinforcement there developed a stable performance characterized by a relatively constant conditional probability of occurrence (IRTs/op) of interresponse times (IRTs) of durations greater than 5 or 6 sec. Extinction and the level of deprivation changed bot...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1964.7-415

    authors: REYNOLDS GS

    更新日期:1964-11-01 00:00:00

  • CONTINUOUS OPPORTUNITY FOR REINFORCING BRAIN STIMULATION.

    abstract::The performance of a rat provided with continuous opportunity to obtain reinforcing brain stimulation over a 20-day period is described in detail. The animal averaged 29.2 responses per min during the entire time. Testing session was terminated by experimenters, but a day-by-day analysis of behavior provided no eviden...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1964.7-183

    authors: VALENSTEIN ES,BEER B

    更新日期:1964-03-01 00:00:00

  • Behavioral interactions and stimulus control during conditional discriminations.

    abstract::Two pigeons were exposed to factorial combinations of two values of line tilt and two frequencies of houselight flashes. During each of four baseline stages, key pecking in the presence of all four combinations was reinforced according to a variable-interval schedule. The baseline phases were followed by four differen...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1973.20-483

    authors: Wilkie DM

    更新日期:1973-11-01 00:00:00

  • The utility of verbal and behavioral assessments of value.

    abstract::Subjects lived in a laboratory apartment for up to 30 days, engaging in ordinary activities such as reading, sewing, and artwork. The amount of time devoted to each activity was recorded and compared with periodic verbal ratings of the amount of time devoted to the activities. The verbal and observational assessments ...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1990.54-173

    authors: Bernstein DJ,Michael RL

    更新日期:1990-11-01 00:00:00

  • The recurrence of negatively reinforced responding of humans.

    abstract::The recurrence of negatively reinforced responding of humans was studied in three experiments. In each experiment during Baseline, key-pressing produced 3-s timeouts from a requirement to exert finger pressure on a force cell according to variable- or fixed-ratio schedules of reinforcement. In Experiment 1, resurgence...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1002/jeab.178

    authors: Alessandri J,Lattal KA,Cançado CR

    更新日期:2015-11-01 00:00:00

  • The general matching law describes choice on concurrent variable-interval schedules of wheel-running reinforcement.

    abstract::Six male Wistar rats were exposed to concurrent variable-interval schedules of wheel-running reinforcement. The reinforcer associated with each alternative was the opportunity to run for 15 s, and the duration of the changeover delay was 1 s. Results suggested that time allocation was more sensitive to relative reinfo...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.2001.75-299

    authors: Belke TW,Belliveau J

    更新日期:2001-05-01 00:00:00

  • The effects of component duration on multiple-schedule performance in closed and open economies.

    abstract::Pigeons responded on multiple variable-interval variable-interval schedules of reinforcement in an open and a closed economy. Equal duration components were increased in duration while the component rates of reinforcement were held constant, the component schedules were reversed, and component duration was decreased. ...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1988.50-457

    authors: La Fiette MH,Fantino E

    更新日期:1988-11-01 00:00:00

  • A comparison of two types of extinction following fixed-ratio training.

    abstract::Five groups of pigeons were food reinforced on various schedules. Half of each group were extinguished in the normal manner; the others were presented with a stimulus change, previously paired with reinforcement, each time they completed their respective fixed ratios. Response rate in training was an increasing negati...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1966.9-41

    authors: Weissman NW,Crossman EK

    更新日期:1966-01-01 00:00:00