Stochastic choice models: A comparison between Bush-Mosteller and a source-independent reward-following model.

Abstract:

:Horner and Staddon (1987) argued that a class of reward-following processes defined by a property they termed ratio invariance is a better model for the probabilistic choice performance of pigeons than competing molecular accounts such as momentary maximizing, melioration, and the Bush-Mosteller model. The critical data were provided by choice distributions-distributions of a variable S, the proportion of Right choices, defined on a moving window typically 32 choices long-obtained under a frequency-dependent schedule. The schedule prescribed equal payoff probabilities, p(S), for both choices. p(S) was a maximum when S = 0.5 and declined linearly for S values above and below 0.5. Pigeons showed generally bimodal choice distributions with the modes at equal p(S) values. These data do not follow easily from melioration or momentary maximizing and are inconsistent with molar maximizing, but they may be consistent with Bush-Mosteller. We present here the results of computer simulations showing that the ratio-invariance model studied yields, as expected, choice modes at equal p(S) values, but that Bush-Mosteller, although capable of generating bimodal choice distributions, does not have choice modes at equal p(S) values.

journal_name

J Exp Anal Behav

authors

Staddon JE,Horner JM

doi

10.1901/jeab.1989.52-57

subject

Has Abstract

pub_date

1989-07-01 00:00:00

pages

57-64

issue

1

eissn

0022-5002

issn

1938-3711

journal_volume

52

pub_type

杂志文章
  • On conditioned reinforcing effects of negative discriminative stimuli.

    abstract::Observing responses by pigeons were studied during sessions in which a food key and an observing key were available continuously. A variable-interval schedule and extinction alternated randomly on the food key. In one condition, food-key pecking during extinction decreased reinforcement frequency during the next varia...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1989.52-335

    authors: Allen KD,Lattal KA

    更新日期:1989-11-01 00:00:00

  • Magnitude and duration of the effects of cocaine on conditioned and adjunctive behaviors in the chimpanzee.

    abstract::Characteristic patterns of conditioned key-pressing were maintained in the chimpanzee under a multiple 30-response fixed-ratio, 10-minute fixed-interval schedule of food presentation. Adjunctive drinking occurred with regularity during the fixed-interval schedule and, with less frequency, during 1-minute timeout perio...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1980.33-131

    authors: Byrd LD

    更新日期:1980-01-01 00:00:00

  • An experimental analysis of memory processing.

    abstract::Rhesus monkeys were trained and tested in visual and auditory list-memory tasks with sequences of four travel pictures or four natural/environmental sounds followed by single test items. Acquisitions of the visual list-memory task are presented. Visual recency (last item) memory diminished with retention delay, and pr...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.2007.88-405

    authors: Wright AA

    更新日期:2007-11-01 00:00:00

  • PARAMETERS AFFECTING THE ACQUISITION OF SIDMAN AVOIDANCE.

    abstract::Four studies were conducted to investigate the source of reinforcement of Sidman avoidance. First it was found that the acquisition of avoidance was seriously impaired if there was no immediate stimulus consequence of responding, i.e., proprioceptive and auditory feedback. The second study showed that if the shock-sho...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1964.7-315

    authors: BOLLES RC,POPP RJ Jr

    更新日期:1964-07-01 00:00:00

  • The nature of control by spoken words over visual stimulus selection.

    abstract::Eight retarded adolescents were trained to select one (a trained S+) of two visual stimuli in response to a spoken word (a trained word). Two different visual stimuli alternated randomly as the S-. To determine if the spoken work was merely a temporal discriminative stimulus for when to respond, or if it also specifie...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1977.27-433

    authors: Dixon LS

    更新日期:1977-05-01 00:00:00

  • An update on the search for symmetry in nonhumans.

    abstract::Sidman et al.'s (1982) failure to find evidence for symmetry (bidirectional associations between stimuli) in monkeys and baboons set the stage for decades of work on emergent relations in nonhumans. They attributed the failure to the use of procedures that did not (1) promote stimulus control based on the relation bet...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1002/jeab.647

    authors: Lionello-DeNolf KM

    更新日期:2021-01-01 00:00:00

  • Children's preference for mixed- versus fixed-ratio schedules of reinforcement: A translational study of risky choice.

    abstract::Laboratory research has shown that when subjects are given a choice between fixed-ratio and bi-valued mixed-ratio schedules of reinforcement, preference typically emerges for the mixed-ratio schedule even with a larger ratio requirement. The current study sought to replicate and extend these findings to children's mat...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1002/jeab.234

    authors: Mullane MP,Martens BK,Baxter EL,Steeg DV

    更新日期:2017-01-01 00:00:00

  • Effects of GABA modulators on the repeated acquisition of response sequences in squirrel monkeys.

    abstract::The present study investigated the effects of positive and negative GABA(A) modulators under three different baselines of repeated acquisition in squirrel monkeys in which the monkeys acquired a three-response sequence on three keys under a second-order fixed-ratio (FR) schedule of food reinforcement. In two of these ...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.2004.82-37

    authors: Campbell UC,Winsauer PJ,Stevenson MW,Moerschbaecher JM

    更新日期:2004-07-01 00:00:00

  • Social learning by following: an analysis.

    abstract::Learning by "following", probably a common means by which behaviors are socially transmitted from adults to young in many species, was analyzed. Pigeons first learned to eat from a human hand. When the hand then approached an operant key and pecked it, the pigeons followed and quickly learned to do the same, thereby d...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1977.27-127

    authors: Bullock D,Neuringer A

    更新日期:1977-01-01 00:00:00

  • Shaping behavioral patterns.

    abstract::Pigeons were rewarded for distributing eight pecks across two keys (L and R) in various patterns. The simplest pattern was at least one switch between the two keys (LR or RL) anywhere during the sequence; the next simplest was at least one instance of LLRR or RRLL anywhere during the sequence; the next was LLLRRR or R...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1002/jeab.22

    authors: Locey ML,Rachlin H

    更新日期:2013-05-01 00:00:00

  • Building blocks of self-control: increased tolerance for delay with bundled rewards.

    abstract::Impulsive choice can be defined as temporary preference for a smaller-sooner reward (SS) over a larger-later reward (LL). Hyperbolic discounting implies that impulsive choices will occur less when organisms choose between a series of SSs versus LLs all at once than when they choose between single SS versus LL pairs. E...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.2003.79-37

    authors: Ainslie G,Monterosso JR

    更新日期:2003-01-01 00:00:00

  • Effects of chlorpromazine on appetitive and aversive components of a multiple schedule.

    abstract::A multiple schedule having both an appetitive and an avoidance component was maintained in two dogs to create a complex behavioral base line for observing the effects of chlorpromazine. Both soluble and "Spansule" chlorpromazine generated similar functions relating drug dose to measures of behavioral output. Although ...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1962.5-259

    authors: WALLER MB,WALLER PF

    更新日期:1962-04-01 00:00:00

  • Experimental control of superstitious responding inhumans.

    abstract::Superstitions were demonstrated with human subjects when presses on one button were reinforced on a VI 30-sec schedule while presses on a second were never reinforced. Superstitious responding, on the second button, was often maintained because presses on that button were frequently followed by reinforcement for a sub...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1963.6-203

    authors: CATANIA AC,CUTTS D

    更新日期:1963-04-01 00:00:00

  • The effect of a pre-shock signal on a free-operant avoidance response.

    abstract::After 25 free-operant avoidance training sessions, a 1-min signal followed by a brief shock was presented on the average of once every 4 min. During the signal, the avoidance schedule was suspended (20 sessions). Response rates during the signal were markedly reduced. Shock rates during non-signalled periods increased...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1970.14-331

    authors: Roberts AE,Hurwitz HM

    更新日期:1970-11-01 00:00:00

  • Interlocking schedules of reinforcement.

    abstract::Four male pigmented rats were exposed to a procedure designed to investigate the relation between several performance measures and a schedule continuum ranging from FR 36 to FI 2 through four intermediate interlocking schedules. On all schedules, each subject developed a stable performance that was generally break-and...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1962.5-213

    authors: BERRYMAN R,NEVIN JA

    更新日期:1962-04-01 00:00:00

  • Evidence of interaction between deprivation effects and stimulus control.

    abstract::Discriminative responding in pigeons was studied under multiple variable-interval extinction and variable-ratio extinction schedules, as deprivation was varied. Generally, the greater the accuracy of discrimination that developed during training, the smaller the effect of deprivation upon subsequent performance. This ...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1971.16-95

    authors: Powell RW

    更新日期:1971-07-01 00:00:00

  • Signalled free-operant avoidance of shock by pigeons pecking a key.

    abstract::Two pigeons were trained to peck a key under a free-operant avoidance schedule. Then, changes in key color signalled the beginning (safe period) and the end (warning period) of the response-shock interval, with a response required to change the key color. Finally, a change in key color signalled the warning period and...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1977.27-281

    authors: De Moraes AB,Todorov JC

    更新日期:1977-03-01 00:00:00

  • When good news leads to bad choices.

    abstract::Pigeons and other animals sometimes deviate from optimal choice behavior when given informative signals for delayed outcomes. For example, when pigeons are given a choice between an alternative that always leads to food after a delay and an alternative that leads to food only half of the time after a delay, preference...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章,评审

    doi:10.1002/jeab.192

    authors: McDevitt MA,Dunn RM,Spetch ML,Ludvig EA

    更新日期:2016-01-01 00:00:00

  • Sample-duration effects on pigeons' delayed matching as a function of predictability of duration.

    abstract::Three experiments assessed the impact of sample duration on pigeons' delayed matching as a function of whether or not the samples themselves signaled how long they would remain on. When duration was uncorrelated with the sample appearing on each matching trial, the typical effect of duration was observed: Choice accur...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1999.72-279

    authors: Urcuioli PJ,DeMarse TB,Lionello KM

    更新日期:1999-11-01 00:00:00

  • Negative behavioral contrast on multiple treadle-press schedules.

    abstract::Eight pigeons pressed treadles for food reinforcers delivered by several multiple variable-interval schedules. The rate of reinforcement for responding during one component schedule was held constant at 30 reinforcers per hour. The rate of reinforcement for responding during the other component varied from 0 to 120 or...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1978.29-463

    authors: McSweeney FK

    更新日期:1978-05-01 00:00:00

  • Social facilitation of responses during a stimulus paired with electric shock.

    abstract::Key-pecking responses of a pigeon were maintained by a variable-interval schedule of food reinforcement. The responses were suppressed during the occasional presentation of a warning stimulus paired with electric shock. The presence of a second pigeon emitting the same response for food reinforcement reduced the suppr...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1967.10-387

    authors: Hake DF,Laws DR

    更新日期:1967-07-01 00:00:00

  • Instructed versus shaped human verbal behavior: Interactions with nonverbal responding.

    abstract::Undergraduate students' presses on left and right buttons occasionally made available points exchangeable for money. Blue lights over the buttons were correlated with multiple random-ratio random-interval components; usually, the random-ratio schedule was assigned to the left button and the random-interval to the righ...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1982.38-233

    authors: Catania AC,Matthews BA,Shimoff E

    更新日期:1982-11-01 00:00:00

  • Alternative reinforcement effects on fixed-interval performance.

    abstract::Pigeons' key pecks were reinforced with food on a fixed-interval schedule. Food also was available at variable time periods either independently of responding or for not key pecking (a differential-reinforcement-of-other-behavior schedule). The latter condition arranged reinforcement following the first pause of t sec...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1980.34-285

    authors: Lattal KA,Boyer SS

    更新日期:1980-11-01 00:00:00

  • OPERANT CONTROL OF PREENING IN PIGEONS.

    abstract::Preening in four pigeons was observed and recorded during operant level determinations, continuous and variable interval reinforcement, and extinction. The rate at which preening responses occur seems to be controlled by reinforcement in the same way as other operant behavior. Preening during VI reinforcement and exti...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1964.7-351

    authors: HOGAN JA

    更新日期:1964-09-01 00:00:00

  • Reinforcement magnitude and the inhibiting effect of reinforcement.

    abstract::In a two-key concurrent variable-interval schedule (using pigeons), if the reinforcement frequency for one response is held constant while that for the other is increased, the rate of response on the constant key decreases. The immediate reinforcement for key pecking can usually be conceptualized as the change from a ...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1979.32-265

    authors: Michael JL

    更新日期:1979-09-01 00:00:00

  • A multivariate rate equation for variable-interval performance.

    abstract::A value-like parameter is introduced into a rate equation for describing variable-interval performance. The equation, derived solely from formal considerations, expresses rate of responding as a joint function of rate of reinforcement and "reinforcer power." Preliminary tests of the rate equation show that it handles ...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1979.31-267

    authors: McDowell JJ,Kessel R

    更新日期:1979-03-01 00:00:00

  • Increasing the variability of response sequences in pigeons by adjusting the frequency of switching between two keys.

    abstract::Three experiments compared the amounts of behavioral variability generated with two reinforcement rules. In Experiments 1 and 2 pigeons received food whenever they generated a sequence of eight pecks, distributed over two keys, provided that the sequence contained a certain number of change-overs between the keys. Alt...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1997.68-1

    authors: Machado A

    更新日期:1997-07-01 00:00:00

  • Brief-stimulus presentations on multiform tandem schedules.

    abstract::Three experiments examined the influence of a brief stimulus (a light) on the behavior of food-deprived rats whose lever pressing on tandem schedules comprising components of different schedule types resulted in food presentation. In Experiment 1, either a tandem variable-ratio variable-interval or a tandem variable-i...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1994.61-417

    authors: Reed P

    更新日期:1994-05-01 00:00:00

  • Operant reinforcement of an autonomic response: two studies.

    abstract::Two successive studies were conducted to determine the possibility of operant reinforcement of nonspecific galvanic skin resistance responses. In the first study, with five experimental and three control subjects who served for 20 to 30 min a day for 10 days, all experimental subjects learned to emit more nonspecific ...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1967.10-119

    authors: Gavalas RJ

    更新日期:1967-01-01 00:00:00

  • Relative versus absolute stimulus control in the temporal bisection task.

    abstract::When subjects learn to associate two sample durations with two comparison keys, do they learn to associate the keys with the short and long samples (relational hypothesis), or with the specific sample durations (absolute hypothesis)? We exposed 16 pigeons to an ABA design in which phases A and B corresponded to tasks ...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.2012.98-23

    authors: Pinheiro de Carvalho M,Machado A

    更新日期:2012-07-01 00:00:00