Prisoner's dilemma and the pigeon: Control by immediate consequences.

Abstract:

:In three experiments pigeons played (i.e., chose between two colored keys) iterated prisoner's dilemma and other 2 x 2 games (2 participants and 2 options) against response strategies programmed on a computer. Under the prisoner's dilemma pay-off matrix, the birds generally defected (i.e., pecked the color associated with not cooperating) against both a random response (.5 probability of either alternative) and a tit-for-tat strategy (on trial n the computer "chooses" the alternative that is the same as the one chosen by the subject on trial n - 1) played by the computer. They consistently defected in the tit-for-tat condition despite the fact that as a consequence they earned about one third of the food that they could have if they had cooperated (i.e., pecked the "cooperate" color) on all the trials. Manipulation of the values of the food pay-offs demonstrated that the defection and consequent loss of food under the tit-for-tat condition were not due to a lack of sensitivity to differences in pay-off values, nor to strict avoidance of a null pay-off (no food on a trial), nor to insensitivity to the local (current trial) reward contingencies. Rather, the birds markedly discounted future outcomes and thus made their response choices based on immediate outcomes available on the present trial rather than on long-term delayed outcomes over many trials. That is, the birds were impulsive, choosing smaller but more immediate rewards, and did not demonstrate self-control. Implications for the study of cooperation and competition in both humans and nonhumans are discussed.

journal_name

J Exp Anal Behav

authors

Green L,Price PC,Hamburger ME

doi

10.1901/jeab.1995.64-1

subject

Has Abstract

pub_date

1995-07-01 00:00:00

pages

1-17

issue

1

eissn

0022-5002

issn

1938-3711

journal_volume

64

pub_type

杂志文章
  • Recency, repeatability, and reinforcer retrenchment: an experimental analysis of resurgence.

    abstract::Four experiments were conducted with pigeons to assess the experimental conditions necessary for the occurrence of resurgence. The general procedure consisted of the following conditions: Condition 1--reinforcement of key pecking; Condition 2--reinforcement of treadle pressing and concurrent extinction of key pecking;...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.2003.80-217

    authors: Lieving GA,Lattal KA

    更新日期:2003-09-01 00:00:00

  • Choice of longer or stronger signalled shock over shorter or weaker unsignalled shock.

    abstract::Unsignalled, inescapable shocks were presented to four albino rats in one study and to six rats in a second study. By pressing a lever, subjects could change the condition to signalled shock for 3 min after which unsignalled shock was automatically reinstated. All subjects changed frequently to the signalled shock sch...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1973.19-25

    authors: Badia P,Culbertson S,Harsh J

    更新日期:1973-01-01 00:00:00

  • Combinations of response-reinforcer relations in periodic and aperiodic schedules.

    abstract::Key pecking of 4 pigeons was studied under a two-component multiple schedule in which food deliveries were arranged according to a fixed and a variable interfood interval. The percentage of response-dependent food in each component was varied, first in ascending (0, 10, 30, 70 and 100%) and then in descending orders, ...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1002/jeab.13

    authors: Kuroda T,Cançado CR,Lattal KA,Elcoro M,Dickson CA,Cook JE

    更新日期:2013-03-01 00:00:00

  • Hill-climbing by pigeons.

    abstract::Pigeons were exposed to two types of concurrent operant-reinforcement schedules in order to determine what choice rules determine behavior on these schedules. In the first set of experiments, concurrent variable-interval, variable-interval schedules, key-peck responses to either of two alternative schedules produced f...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1983.39-25

    authors: Hinson JM,Staddon JE

    更新日期:1983-01-01 00:00:00

  • A procedure for studying echoic control in verbal behavior.

    abstract::Male and female college students answered standard questions about the women's liberation movement on three occasions. A set of target words was embedded in the questions, with one set used in Sessions 1 and 3, and a synonymous, but different set used in Session 2. The relative frequencies of usage of a given target w...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1978.30-213

    authors: Boe R,Winokur S

    更新日期:1978-09-01 00:00:00

  • Relations among acute and chronic nicotine administration, short-term memory, and tactics of data analysis.

    abstract::Emerging evidence suggests that nicotine may enhance short-term memory. Some of this evidence comes from nonhuman primate research using a procedure called delayed matching-to-sample, wherein the monkey is trained to select a comparison stimulus that matches some physical property of a previously presented sample stim...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.2012.98-155

    authors: Kangas BD,Branch MN

    更新日期:2012-09-01 00:00:00

  • Rapid determinations of preference in multiple concurrent-chain schedules.

    abstract::With concurrent chains arranged for a pigeon's key pecks, pecks on two concurrently available initial-link keys (left and right) respectively produce separately operating terminal links (A and B). Preferences for terminal link A over terminal link B are usually calculated as deviations of relative initial-link respons...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1986.46-211

    authors: Cerutti DT,Catania AC

    更新日期:1986-09-01 00:00:00

  • Knowing before doing: discrimination by rats of a brief interruption of a tone.

    abstract::Eight rats' lever presses were reinforced after an interruption in a tone, provided the lever had not been pressed before the tone interruption. After a few sessions, long before the animals reliably refrained from lever pressing before the interruption, the latencies of postinterruption presses (time from the termina...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1984.41-329

    authors: Eisler H

    更新日期:1984-05-01 00:00:00

  • Naming and categorization in young children: II. Listener behavior training.

    abstract::Following pretraining with everyday objects, 1- to 4-year-old children received listener training with three pairs of arbitrary stimuli of differing shapes. For each pair, 9 children were trained to select one stimulus in response to the spoken word /zog/ and the other to the spoken word /vek/. Next, in the look-at-sa...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.2004.81-267

    authors: Horne PJ,Lowe CF,Randle VR

    更新日期:2004-05-01 00:00:00

  • Time-place learning by pigeons, Columba livia.

    abstract::In each of two experiments, 2 pigeons received discrimination training in which food reinforcement for key pecking was conditional upon both spatial and temporal cues. In Experiment 1, food was available for periods of 30 s at each of three locations (pecking keys) during trials that lasted 90 s. In Experiment 2, food...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1992.57-145

    authors: Wilkie DM,Willson RJ

    更新日期:1992-03-01 00:00:00

  • Dynamic response-by-response models of matching behavior in rhesus monkeys.

    abstract::We studied the choice behavior of 2 monkeys in a discrete-trial task with reinforcement contingencies similar to those Herrnstein (1961) used when he described the matching law. In each session, the monkeys experienced blocks of discrete trials at different relative-reinforcer frequencies or magnitudes with unsignalle...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.2005.110-04

    authors: Lau B,Glimcher PW

    更新日期:2005-11-01 00:00:00

  • A parametric evaluation of the hedonic and motoric effects of drugs: pimozide and amphetamine.

    abstract::This study uses a curve-fitting approach to evaluate the effects of drugs on reinforced responding in rats. The subjects obtained reinforcement according to a series of five different variable-interval schedules (a five-component multiple schedule). For each rat, pimozide, a neuroleptic, decreased response rate, and t...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1983.40-113

    authors: Heyman GM

    更新日期:1983-09-01 00:00:00

  • Training intraverbal naming to establish equivalence class performances.

    abstract::The purpose of this three-experiment study was to evaluate whether performance consistent with the formation of equivalence classes could be established after training adults to tact and intraverbally relate the names of visual stimuli. Fourteen participants were exposed to tact training, listener testing, and intrave...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1002/jeab.203

    authors: Ma ML,Miguel CF,Jennings AM

    更新日期:2016-05-01 00:00:00

  • Concurrent random-interval schedules and the matching law.

    abstract::In Experiment I, a group of eight pigeons performed on concurrent random-interval schedules constructed by holding probability equal and varying cycle time to produce ratios of reinforcer densities of 1:1, 3:1, and 5:1 for key pecking. Schedules for a second group of seven were constructed with equal cycle times and u...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1978.30-301

    authors: Rodewald HK

    更新日期:1978-11-01 00:00:00

  • Quantitative analysis.

    abstract::Quantitative analysis permits the isolation of invariant relations in the study of behavior. The parameters of these relations can serve as higher-order dependent variables in more extensive analyses. These points are illustrated by reference to quantitative descriptions of performance maintained by concurrent schedul...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1984.42-421

    authors: Nevin JA

    更新日期:1984-11-01 00:00:00

  • Observing behavior in squirrel monkeys under a multiple schedule of reinforcement availability.

    abstract::Observing behavior of two squirrel monkeys was examined under a multiple schedule of four components. Lever (observing) responses produced either a stimulus indicating the availability of food or another stimulus indicating food was not available. Key responses in the presence of the food-available stimulus produced f...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1971.16-167

    authors: De Lorge JO,Clark FC

    更新日期:1971-09-01 00:00:00

  • A retrospective 60-year review of Murray Sidman's Tactics of Scientific Research and some of its influence on behavior analysis.

    abstract::Murray Sidman's book, Tactics of Scientific Research: Evaluating Experimental Data in Psychology, published in 1960, has been called the bible of the experimental analysis of behavior and has been a major influence on basic as well as applied research in behavior analysis. The contents of the early reviews of the book...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1002/jeab.645

    authors: Holth P

    更新日期:2021-01-01 00:00:00

  • Signal probability, reinforcement and signal detection.

    abstract::Five pigeons were trained to detect differences in light intensity. Two stimuli, S1 and S2, differing in intensity, were arranged on the center key of a three-key chamber according to set probabilities. A peck on the center key turned on the two side keys. When S1 was presented on the center key, a peck on the left ke...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1979.32-373

    authors: McCarthy D,Davison M

    更新日期:1979-11-01 00:00:00

  • Effects of time between trials on rats' and pigeons' choices with probabilistic delayed reinforcers.

    abstract::Parallel experiments with rats and pigeons examined reasons for previous findings that in choices with probabilistic delayed reinforcers, rats' choices were affected by the time between trials whereas pigeons' choices were not. In both experiments, the animals chose between a standard alternative and an adjusting alte...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.2011.95-41

    authors: Mazur JE,Biondi DR

    更新日期:2011-01-01 00:00:00

  • An ecological analysis of knowing by wielding.

    abstract::The ecological approach to perception, as developed by James Gibson, is described and applied to how one knows, by means of the haptic perceptual system, various properties of hand-held objects. Four sets of experiments are reviewed in which subjects reported on the extent, orientation, shape, and fractional component...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1989.52-387

    authors: Turvey MT,Solomon HY,Burton G

    更新日期:1989-11-01 00:00:00

  • Simple and conditional visual discrimination with wheel running as reinforcement in rats.

    abstract::Three experiments explored whether access to wheel running is sufficient as reinforcement to establish and maintain simple and conditional visual discriminations in nondeprived rats. In Experiment 1, 2 rats learned to press a lit key to produce access to running; responding was virtually absent when the key was dark, ...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1998.70-103

    authors: Iversen IH

    更新日期:1998-09-01 00:00:00

  • Falsification of matching theory: changes in the asymptote of Herrnstein's hyperbola as a function of water deprivation.

    abstract::Five rats pressed levers on variable-interval schedules of water reinforcement at various levels of water deprivation. In one phase of the experiment, three deprivation conditions that replicated conditions in Heyman and Monaghan (1987) were arranged, along with three less extreme deprivation conditions. In a second p...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1999.72-251

    authors: McDowell JJ,Dallery J

    更新日期:1999-09-01 00:00:00

  • Controls for and constraints on auto-shaping.

    abstract::Auto-shaping the pigeon's key-peck response was examined as a respondent conditioning procedure with the use of Rescorla's truly-random control procedure. In the first experiment, pigeons received presentations of brief light on the response key and brief presentations of food where the light and the food were indepen...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1973.20-323

    authors: Bilbrey J,Winokur S

    更新日期:1973-11-01 00:00:00

  • The influence of ultraviolet radiation on the pigeon's color discrimination.

    abstract::Two experiments demonstrated the pigeon's sensitivity to ultraviolet light. In Experiment I, pigeons' responses were reinforced on a multiple schedule with a variable-interval reinforcement schedule in one component and extinction in the other component. Response rates were quite different in the two components where ...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1972.17-325

    authors: Wright AA

    更新日期:1972-05-01 00:00:00

  • Toward a unified theory of decision criterion learning in perceptual categorization.

    abstract::Optimal decision criterion placement maximizes expected reward and requires sensitivity to the category base rates (prior probabilities) and payoffs (costs and benefits of incorrect and correct responding). When base rates are unequal, human decision criterion is nearly optimal, but when payoffs are unequal, suboptima...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章,评审

    doi:10.1901/jeab.2002.78-567

    authors: Maddox WT

    更新日期:2002-11-01 00:00:00

  • Relative versus absolute stimulus control in the temporal bisection task.

    abstract::When subjects learn to associate two sample durations with two comparison keys, do they learn to associate the keys with the short and long samples (relational hypothesis), or with the specific sample durations (absolute hypothesis)? We exposed 16 pigeons to an ABA design in which phases A and B corresponded to tasks ...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.2012.98-23

    authors: Pinheiro de Carvalho M,Machado A

    更新日期:2012-07-01 00:00:00

  • Influences on cocaine tolerance assessed under a multiple conjunctive schedule of reinforcement.

    abstract::Under multiple schedules of reinforcement, previous research has generally observed tolerance to the rate-decreasing effects of cocaine that has been dependent on schedule-parameter size in the context of fixed-ratio (FR) schedules, but not under the context of fixed-interval (FI) schedules of reinforcement. The curre...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.2009.92-413

    authors: Yoon JH,Branch MN

    更新日期:2009-11-01 00:00:00

  • Negative reinforcement as shock-frequency reduction.

    abstract::Is a conditioned aversive stimulus necessary in avoidance conditioning? Or is a reduction in the rate of aversive stimulation alone sufficient to generate and maintain an avoidance response? Rats were subjected to an avoidance procedure in which shocks occurred randomly in time, but a response could reduce the overall...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1966.9-421

    authors: Herrnstein RJ,Hineline PN

    更新日期:1966-07-01 00:00:00

  • Shock-induced threat and biting by the turtle.

    abstract::Shock-induced biting and threat by the male painted turtle (Chrysemys picta marginata) were studied in three experiments. When restrained facing each other, the turtles threatened and bit other turtles in response to electric shock. Shock alone caused turtles to threaten an unshocked turtle; the movements of a shocked...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1971.16-349

    authors: Fraser D,Spigel IM

    更新日期:1971-11-01 00:00:00

  • Social facilitation of responses during a stimulus paired with electric shock.

    abstract::Key-pecking responses of a pigeon were maintained by a variable-interval schedule of food reinforcement. The responses were suppressed during the occasional presentation of a warning stimulus paired with electric shock. The presence of a second pigeon emitting the same response for food reinforcement reduced the suppr...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1967.10-387

    authors: Hake DF,Laws DR

    更新日期:1967-07-01 00:00:00