Dynamic probability of reinforcement for cooperation: Random game termination in the centipede game.

Abstract:

:Experimental games have previously been used to study principles of human interaction. Many such games are characterized by iterated or repeated designs that model dynamic relationships, including reciprocal cooperation. To enable the study of infinite game repetitions and to avoid endgame effects of lower cooperation toward the final game round, investigators have introduced random termination rules. This study extends previous research that has focused narrowly on repeated Prisoner's Dilemma games by conducting a controlled experiment of two-player, random termination Centipede games involving probabilistic reinforcement and characterized by the longest decision sequences reported in the empirical literature to date (24 decision nodes). Specifically, we assessed mean exit points and cooperation rates, and compared the effects of four different termination rules: no random game termination, random game termination with constant termination probability, random game termination with increasing termination probability, and random game termination with decreasing termination probability. We found that although mean exit points were lower for games with shorter expected game lengths, the subjects' cooperativeness was significantly reduced only in the most extreme condition with decreasing computer termination probability and an expected game length of two decision nodes.

journal_name

J Exp Anal Behav

authors

Krockow EM,Colman AM,Pulford BD

doi

10.1002/jeab.320

subject

Has Abstract

pub_date

2018-03-01 00:00:00

pages

349-364

issue

2

eissn

0022-5002

issn

1938-3711

journal_volume

109

pub_type

杂志文章
  • Automaintenance without stimulus-change reinforcement: Temporal control of key pecks.

    abstract::Yoked pairs of experimentally naive pigeons were exposed to a modified autoshaping procedure in which key pecking by the leader birds postponed both keylight termination and access to grain for the leader and the follower bird. Key pecking developed and was maintained in all birds and continued through two reversals o...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1979.31-395

    authors: Myerson J,Myerson WA,Parker BK

    更新日期:1979-05-01 00:00:00

  • Relations among acute and chronic nicotine administration, short-term memory, and tactics of data analysis.

    abstract::Emerging evidence suggests that nicotine may enhance short-term memory. Some of this evidence comes from nonhuman primate research using a procedure called delayed matching-to-sample, wherein the monkey is trained to select a comparison stimulus that matches some physical property of a previously presented sample stim...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.2012.98-155

    authors: Kangas BD,Branch MN

    更新日期:2012-09-01 00:00:00

  • Patterns of responding within sessions.

    abstract::Rates of responding changed systematically across sessions for rats pressing levers and keys and for pigeons pressing treadles and pecking keys. A bitonic function in which response rates increased and then decreased across sessions was the most common finding, although an increase in responding also occurred alone. T...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1992.58-19

    authors: McSweeney FK,Hinson JM

    更新日期:1992-07-01 00:00:00

  • Conditional discrimination learning: a critique and amplification.

    abstract::Carter and Werner recently reviewed the literature on conditional discrimination learning by pigeons, which consists of studies of matching-to-sample and oddity-from-sample. They also discussed three models of such learning: the "multiple-rule" model (learning of stimulus-specific relations), the "configuration" model...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1980.33-291

    authors: Schrier AM,Thompson CR

    更新日期:1980-03-01 00:00:00

  • An operant analysis of human altruistic responding.

    abstract::Human altruistic responding (called give responding), which delivered a reinforcer to someone other than the responder, was compared to responding where the responder was the recipient of the reinforcer (called earn responding). The same type of response (button pressing), the same reinforcer (a point representing a p...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1977.27-515

    authors: Weiner H

    更新日期:1977-05-01 00:00:00

  • Fixed-interval limited-hold avoidance with and without signalled reinforcement.

    abstract::Rats trained to lever press on a fixed-interval limited-hold avoidance schedule maintained a pattern of responding similar to that maintained by fixed-interval limited-hold schedules of positive reinforcement. But this positively accelerated pattern of behavior was maintained only when the occurrence of reinforcement ...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1972.17-75

    authors: Black RE,Walters GC,Webster CD

    更新日期:1972-01-01 00:00:00

  • Some effects of discriminative training with equated frequency of reinforcement.

    abstract::Pigeons were exposed to a multiple schedule which provided equally frequent reinforcement in the presence of two stimuli but which produced markedly different rates of key-pecking. Generalization gradients were displaced away from the stimulus associated with the lower rate of key-pecking. Another group of pigeons had...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1968.11-415

    authors: Yarczower M,Gollub LR,Dickson JF

    更新日期:1968-07-01 00:00:00

  • Arbitrary conditional discriminative functions of meaningful stimuli and enhanced equivalence class formation.

    abstract::Equivalence class formation by college students was influenced through the prior acquisition of conditional discriminative functions by one of the abstract stimuli (C) in the to-be-formed classes. Participants in the GR-0, GR-1, and GR-5 groups attempted to form classes under the simultaneous protocol, after mastering...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1002/jeab.141

    authors: Nedelcu RI,Fields L,Arntzen E

    更新日期:2015-03-01 00:00:00

  • Drug effects on fixed-interval responding with pause requirements for food presentation.

    abstract::In pigeons performing under a multiple schedule of food presentation, low key-pecking rates (0.18 to 0.29 responses per second) were maintained during 3-min fixed-interval components by requiring a 4-, 5-, or 6-sec pause preceding the food-delivery response (tandem DRL), while higher rates (0.70 to 1.37 responses per ...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1977.27-51

    authors: Stitzer M,McKearney JW

    更新日期:1977-01-01 00:00:00

  • Preference, resistance to change, and the cumulative decision model.

    abstract::According to behavioral momentum theory (Nevin & Grace, 2000a), preference in concurrent chains and resistance to change in multiple schedules are independent measures of a common construct representing reinforcement history. Here I review the original studies on preference and resistance to change in which reinforcem...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章,评审

    doi:10.1002/jeab.305

    authors: Grace RC

    更新日期:2018-01-01 00:00:00

  • Within-session transitions in choice: a structural and quantitative analysis.

    abstract::The present study used within-session transitions between two concurrent schedules to evaluate choice in transition. Eight female Long-Evans rats were trained to respond under concurrent schedules of reinforcement during experimental sessions that lasted 22 hr. The generalized matching equation was used to model stead...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.2009.91-319

    authors: Banna KM,Newland MC

    更新日期:2009-05-01 00:00:00

  • Rapid determinations of preference in multiple concurrent-chain schedules.

    abstract::With concurrent chains arranged for a pigeon's key pecks, pecks on two concurrently available initial-link keys (left and right) respectively produce separately operating terminal links (A and B). Preferences for terminal link A over terminal link B are usually calculated as deviations of relative initial-link respons...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1986.46-211

    authors: Cerutti DT,Catania AC

    更新日期:1986-09-01 00:00:00

  • REINFORCEMENT OF DRINKING BY RUNNING: EFFECT OF FIXED RATIO AND REINFORCEMENT TIME.

    abstract::Rats were required to complete varying numbers of licks (FR), ranging from 10 to 300, in order to free an activity wheel for predetermined times (CT) ranging from 2 to 20 sec. The reinforcement of drinking by running was shown both by an increased frequency of licking, and by changes in length of the burst of licking ...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1964.7-91

    authors: PREMACK D,SCHAEFFER RW,HUNDT A

    更新日期:1964-01-01 00:00:00

  • A test of the reinforcing properties of stimuli correlated with nonreinforcement.

    abstract::The information hypothesis of conditioned reinforcement predicts that a stimulus that "reduces uncertainty" about the outcome of a trial will acquire reinforcing properties, even when the stimulus reliably predicts nonreinforcement. Four pigeons' key pecks produced one of two 5-sec stimuli with 0.50 probability accord...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1976.26-45

    authors: Katz HN

    更新日期:1976-07-01 00:00:00

  • Theories of probabilistic reinforcement.

    abstract::In three experiments, pigeons chose between two alternatives that differed in the probability of reinforcement and the delay to reinforcement. A peck at a red key led to a delay of 5 s and then a possible reinforcer. A peck at a green key led to an adjusting delay and then a certain reinforcer. This delay was adjusted...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1989.51-87

    authors: Mazur JE

    更新日期:1989-01-01 00:00:00

  • Choice, foraging, and reinforcer duration.

    abstract::Pigeons were exposed to a foraging schedule characterized by three different states, beginning with a search state in which completion of a variable interval on a white key led to a choice state. In the choice state the subject could, by appropriate responding on a fixed ratio of three, either accept or reject the sch...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1986.46-93

    authors: Ito M,Fantino E

    更新日期:1986-07-01 00:00:00

  • Contingency discriminability and peak shift in concurrent schedules.

    abstract::We investigated the effects of discriminative stimuli on choice in a highly variable environment using a procedure in which multiple two-key concurrent VI VI components changed every 10 reinforcers and were signaled by differential flashes of red and yellow keylights. Across conditions, five pigeons were exposed to a ...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.2006.11-05

    authors: Krägeloh CU,Elliffe DM,Davison M

    更新日期:2006-07-01 00:00:00

  • OPERANT CONTROL OF PREENING IN PIGEONS.

    abstract::Preening in four pigeons was observed and recorded during operant level determinations, continuous and variable interval reinforcement, and extinction. The rate at which preening responses occur seems to be controlled by reinforcement in the same way as other operant behavior. Preening during VI reinforcement and exti...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1964.7-351

    authors: HOGAN JA

    更新日期:1964-09-01 00:00:00

  • Behavioral contrast with timeout, blackout, or extinction as the negative condition.

    abstract::When either a timeout period (darkening the response key) or a blackout period (darkening both chamber and response key) was alternated with a stimulus associated with variable-interval reinforcement, behavioral contrast was obtained. Either peck contrast or maintained contrast occurred, depending on whether or not re...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1973.19-499

    authors: Sadowsky S

    更新日期:1973-05-01 00:00:00

  • Behavioral control of visual fixation of the rhesus monkey.

    abstract::A paradigm for the control of visual fixation of the macaque monkey in vision experiments was described. Using a Maxwellian view, the procedure permits the placement of discrete test-light stimuli in a specific area of the retina as the monkey fixates a primary target. This procedure holds foveal fixation as other beh...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1976.25-113

    authors: Crawford ML

    更新日期:1976-01-01 00:00:00

  • Building blocks of self-control: increased tolerance for delay with bundled rewards.

    abstract::Impulsive choice can be defined as temporary preference for a smaller-sooner reward (SS) over a larger-later reward (LL). Hyperbolic discounting implies that impulsive choices will occur less when organisms choose between a series of SSs versus LLs all at once than when they choose between single SS versus LL pairs. E...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.2003.79-37

    authors: Ainslie G,Monterosso JR

    更新日期:2003-01-01 00:00:00

  • Punishment of elicited aggression.

    abstract::Aversive shocks are known to produce aggression when the shocks are not dependent on behavior and to suppress behavior when the shocks are arranged as a dependent punisher. These two processes were studied by presenting non-dependent shock to monkeys at regular intervals, thereby producing biting attacks on a pneumati...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1970.14-7

    authors: Azrin NH

    更新日期:1970-07-01 00:00:00

  • Two parameters of a temporally defined schedule of negative reinforcement.

    abstract::Temporal schedules of negative reinforcement were derived in a manner analogous to those for positive reinforcement, and two parametric studies were carried out with two of the three defining variables. With some limiting values of the defining variables, escape schedules result and data obtained at these values were ...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1963.6-361

    authors: SIDLEY NA

    更新日期:1963-07-01 00:00:00

  • Inhibiting function of reinforcement: magnitude effects on variable-interval schedules.

    abstract::In two experiments, the performance of rats under constant-probability and arithmetic variable-interval schedules respectively was compared when the concentration of a liquid reinforcer was varied within sessions; in other sessions, half of the reinforcers were randomly omitted. When the discriminative function of the...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1978.30-1

    authors: Harzem P,Lowe CF,Priddle-Higson PJ

    更新日期:1978-07-01 00:00:00

  • Delayed reinforcement versus reinforcement after a fixed interval.

    abstract::When interreinforcement intervals were equated, pigeons demonstrated little or no preference between reinforcement after a delay interval and reinforcement presented on a fixed-interval schedule. The small preferences sometimes found for the fixed interval (a) were considerably smaller than when the delay and fixed in...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1969.12-375

    authors: Neuringer AJ

    更新日期:1969-05-01 00:00:00

  • Rats' lever-press durations as psychophysical judgements of time.

    abstract::Hungry rats received food following lever-press durations exceeding a minimum value, which ranged from 0 to 6.4 sec. When no intertrial intervals separated successive presses, modal press durations remained at very short values as the minimum value required for food was increased. This was particularly true immediatel...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1973.19-239

    authors: Platt JR,Kuch DO,Bitgood SC

    更新日期:1973-03-01 00:00:00

  • CONTINUOUS OPPORTUNITY FOR REINFORCING BRAIN STIMULATION.

    abstract::The performance of a rat provided with continuous opportunity to obtain reinforcing brain stimulation over a 20-day period is described in detail. The animal averaged 29.2 responses per min during the entire time. Testing session was terminated by experimenters, but a day-by-day analysis of behavior provided no eviden...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1964.7-183

    authors: VALENSTEIN ES,BEER B

    更新日期:1964-03-01 00:00:00

  • Symmetry in the pigeon with sample and comparison stimuli in different locations.

    abstract::Pigeons typically do not show evidence for symmetry in two-alternative matching-to-sample but do demonstrate this emergent relation in successive (go/no-go) matching-to-sample. Because the sample and comparison stimuli are presented in the same spatial location (viz., on one key) during successive matching training an...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1002/jeab.31

    authors: Swisher M,Urcuioli PJ

    更新日期:2013-07-01 00:00:00

  • Interlocking schedules of reinforcement.

    abstract::Four male pigmented rats were exposed to a procedure designed to investigate the relation between several performance measures and a schedule continuum ranging from FR 36 to FI 2 through four intermediate interlocking schedules. On all schedules, each subject developed a stable performance that was generally break-and...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1962.5-213

    authors: BERRYMAN R,NEVIN JA

    更新日期:1962-04-01 00:00:00

  • Knowing before doing: discrimination by rats of a brief interruption of a tone.

    abstract::Eight rats' lever presses were reinforced after an interruption in a tone, provided the lever had not been pressed before the tone interruption. After a few sessions, long before the animals reliably refrained from lever pressing before the interruption, the latencies of postinterruption presses (time from the termina...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1984.41-329

    authors: Eisler H

    更新日期:1984-05-01 00:00:00