An implementation of punishment in the evolutionary theory of behavior dynamics.

Abstract:

:An implementation of punishment in the evolutionary theory of behavior dynamics is proposed, and is applied to responding on concurrent schedules of reinforcement with superimposed punishment. In this implementation, punishment causes behaviors to mutate, and to do so with a higher probability in a lean reinforcement context than in a rich one. Computational experiments were conducted in an attempt to replicate three findings from experiments with live organisms. These are (1) when punishment is superimposed on one component of a concurrent schedule, response rate decreases in the punished component and increases in the unpunished component, (2) when punishment is superimposed on both components at equal scheduled rates, preference increases over its no-punishment baseline, and (3) when punishment is superimposed on both components at rates that are proportional to the scheduled rates of reinforcement, preference remains unchanged from the baseline preference. Artificial organisms animated by the theory, and working on concurrent schedules with superimposed punishment, reproduced all of these findings. Given this outcome, it may be possible to discover a steady-state mathematical description of punished choice in live organisms by studying the punished choice behavior of artificial organisms animated by the evolutionary theory.

journal_name

J Exp Anal Behav

authors

McDowell JJ,Klapes B

doi

10.1002/jeab.543

subject

Has Abstract

pub_date

2019-09-01 00:00:00

pages

128-143

issue

2

eissn

0022-5002

issn

1938-3711

journal_volume

112

pub_type

杂志文章
  • Fixed ratio and extinction performance of infants in the second year of life.

    abstract::Five 14(1/2)- to 19(1/2)-month-old infants were trained to lever press for snacks on small fixed ratio schedules of reinforcement. Within four to nine sessions, responding under FR 10 was established for four subjects and FR 15 for the other. Each subject's last session revealed behavioral patterns similar to animal a...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1966.9-105

    authors: Weisberg P,Fink E

    更新日期:1966-03-01 00:00:00

  • Implicit sequence learning in ring-tailed lemurs (Lemur catta).

    abstract::Implicit learning involves picking up information from the environment without explicit instruction or conscious awareness of the learning process. In nonhuman animals, conscious awareness is impossible to assess, so we define implicit learning as occurring when animals acquire information beyond what is required for ...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1002/jeab.180

    authors: Drucker CB,Baghdoyan T,Brannon EM

    更新日期:2016-01-01 00:00:00

  • On the origins of naming and other symbolic behavior.

    abstract::We identify naming as the basic unit of verbal behavior, describe the conditions under which it is learned, and outline its crucial role in the development of stimulus classes and, hence, of symbolic behavior. Drawing upon B. F. Skinner's functional analysis and the theoretical work of G. H. Mead and L. S. Vygotsky, w...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1996.65-185

    authors: Horne PJ,Lowe CF

    更新日期:1996-01-01 00:00:00

  • Failure to observe untested derived stimulus relations in extinction: implications for understanding stimulus-equivalence formation.

    abstract::Wilson and Hayes (1996) and Doughty, Kastner, and Bismark (2011) observed resurgence of past equivalence relations when newer equivalence relations were punished or extinguished, respectively. Their findings support the notion that deriving stimulus relations is a form of operant behavior. Although there is consensus ...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1002/jeab.111

    authors: Doughty AH,Leake LW,Stoudemire ML

    更新日期:2014-11-01 00:00:00

  • Concurrent schedule control of human visual target fixations.

    abstract::Operant conditioning techniques were applied to the study of how target fixations are controlled by the probability of signal occurrence. In a standard vigilance setting, gaze at three illuminable volt meters was monitored by a Mackworth television eye camera with automatic recording capability. Gaze at a given meter ...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1973.20-411

    authors: Rosenberger PB

    更新日期:1973-11-01 00:00:00

  • PARAMETERS AFFECTING THE ACQUISITION OF SIDMAN AVOIDANCE.

    abstract::Four studies were conducted to investigate the source of reinforcement of Sidman avoidance. First it was found that the acquisition of avoidance was seriously impaired if there was no immediate stimulus consequence of responding, i.e., proprioceptive and auditory feedback. The second study showed that if the shock-sho...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1964.7-315

    authors: BOLLES RC,POPP RJ Jr

    更新日期:1964-07-01 00:00:00

  • Temporal framing and the hidden-zero effect: rate-dependent outcomes on delay discounting.

    abstract::Recent research suggests that presenting time intervals as units (e.g., days) or as specific dates, can modulate the degree to which humans discount delayed outcomes. Another framing effect involves explicitly stating that choosing a smaller-sooner reward is mutually exclusive to receiving a larger-later reward, thus ...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1002/jeab.328

    authors: Naudé GP,Kaplan BA,Reed DD,Henley AJ,DiGennaro Reed FD

    更新日期:2018-05-01 00:00:00

  • Deviations from matching as a measure of preference for alternatives in pigeons.

    abstract::Preferences for larger or smaller defined response classes were investigated in a concurrent schedule precedure. Twelve pigeons were run on a series of concurrent variable-interval reinforcement schedules, from which baseline matching functions were obtained. An experimental phase followed, in which a second response ...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1979.32-1

    authors: Leigland SM

    更新日期:1979-07-01 00:00:00

  • Effects of mesolimbic dopamine depletion on responding maintained by cocaine and food.

    abstract::The hypothesis that mesolimbic dopamine is selectively involved in cocaine reinforcement was investigated in the rat. Animals were trained under a multiple schedule in which responding was reinforced by intravenous cocaine (0.75 mg/kg/injection) or food (45-mg pellets) under fixed-ratio 15 schedule requirements in alt...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1994.61-213

    authors: Caine SB,Koob GF

    更新日期:1994-03-01 00:00:00

  • Effects of prompting and reinforcement of one response pattern upon imitation of a different modeled pattern.

    abstract::Twelve preschool children participated in a study of the effects of explicit training on the imitation of modeled behavior. The responses trained involved a marble-dropping pattern that differed from the modeled pattern. Training consisted of physical prompts and verbal praise during a single session. No prompts or pr...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1982.37-135

    authors: Bondy AS

    更新日期:1982-01-01 00:00:00

  • Schedules of electric shock presentation in the behavioral control of imprinted ducklings.

    abstract::The behavioral effects of various schedules of electric shock presentation were investigated during and after the imprinting of Peking ducklings to moving stimuli. The behavior of following a moving imprinted stimulus was differentially controlled by a multiple schedule of punishment and avoidance that respectively su...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1972.18-305

    authors: Barrett JE

    更新日期:1972-09-01 00:00:00

  • Randomization procedures in single-case intervention research contexts: (Some of) "the rest of the story".

    abstract::Following up on articles recently published in this journal, the present contribution tells (some of) "the rest of the story" about the value of randomization in single-case intervention research investigations. Invoking principles of internal, statistical-conclusion, and external validity, we begin by emphasizing the...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1002/jeab.558

    authors: Levin JR,Kratochwill TR,Ferron JM

    更新日期:2019-11-01 00:00:00

  • Combinations of response-reinforcer relations in periodic and aperiodic schedules.

    abstract::Key pecking of 4 pigeons was studied under a two-component multiple schedule in which food deliveries were arranged according to a fixed and a variable interfood interval. The percentage of response-dependent food in each component was varied, first in ascending (0, 10, 30, 70 and 100%) and then in descending orders, ...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1002/jeab.13

    authors: Kuroda T,Cançado CR,Lattal KA,Elcoro M,Dickson CA,Cook JE

    更新日期:2013-03-01 00:00:00

  • Teaching serial position sequences to monkeys with a delayed matching-to-sample procedure.

    abstract::Comparison was made of two methods for training monkeys to "observe" a two-member serial position sequence by pressing two consecutively lighted keys and then to "report" the sequence by pressing the same two keys in the same order but without the lights. A fading technique involving gradual elimination of brightness ...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1971.15-335

    authors: Mackay HA,Brown SM

    更新日期:1971-05-01 00:00:00

  • Aversive properties of the negative stimulus in a successive discrimination.

    abstract::Experiment I sought to determine if the stimulus correlated with extinction in a successive discrimination was an aversive stimulus. An escape response provided an index of aversive control. Two groups of pigeons were exposed to a multiple variable-interval 30-sec extinction schedule. For the experimental group, a sin...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1969.12-917

    authors: Rilling M,Askew HR,Ahlskog JE,Kramer TJ

    更新日期:1969-11-01 00:00:00

  • Within-session response rates when reinforcement rate is changed within each session.

    abstract::Three pigeons pecked keys and 5 rats pressed levers for food delivered on variable-interval schedules. During baseline conditions, subjects responded on a variable-interval 40-s schedule throughout the session. During experimental conditions, the programmed rate of reinforcement changed every 10 min in the 50-min sess...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1995.64-237

    authors: McSweeney FK,Weatherly JN,Swindell S

    更新日期:1995-09-01 00:00:00

  • The reinforcement value of schedule-induced drinking.

    abstract::The effect of food reinforcement schedules on the reinforcement value of drinking water was evaluated. Food-deprived rats were exposed to concurrent, identical variable-time schedules of food presentation, the food thus being delivered independently of the rats' behavior. When the relative amount of time spent in a sc...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1975.23-37

    authors: Cohen IL

    更新日期:1975-01-01 00:00:00

  • Dimensional stimulus control following brief wavelength training.

    abstract::Pigeons with extensive training pecking a key illuminated by a white line then had brief training with the key illuminated by 555 nanometers. This was immediately followed by a wavelength generalization test in extinction. Dimensional stimulus control about the training wavelength increased with the duration and numbe...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1976.26-191

    authors: Weisman RG,Thio H

    更新日期:1976-09-01 00:00:00

  • The failure of stimulus control after presence-absence discrimination of click-rate.

    abstract::Pigeons were trained to discriminate a slow click-rate from its absence, or to discriminate it from a faster click-rate. Subsequent click-rate generalization tests produced the usual steepened gradients after the intradimensional discrimination but produced flat gradients after presence/absence discrimination. The occ...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1973.20-23

    authors: Williams BA

    更新日期:1973-07-01 00:00:00

  • Concurrent variable-interval variable-ratio schedules can provide only weak evidence for matching.

    abstract::Herrnstein and Heyman (1979) showed that when pigeons' pecking is reinforced on concurrent variable-interval variable-ratio schedules, (1) their behavior ratios match the ratio of the schedules' reinforcer frequencies, and (2) there is more responding on the variable interval. Since maximizing the reinforcement rate w...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1984.41-83

    authors: Ziriax JM,Silberberg A

    更新日期:1984-01-01 00:00:00

  • Criticisms of the satiety hypothesis as an explanation for within-session decreases in responding.

    abstract::The authors of four papers recently reported that satiation provides a better explanation than habituation for within-session decreases in conditioned responding. Several arguments question this conclusion. First, the contribution of habituation to within-session changes in responding seems clearly established. Inform...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.2000.74-347

    authors: McSweeney FK,Murphy ES

    更新日期:2000-11-01 00:00:00

  • Stimulus generalization as a function of the delay between training and testing procedures: a reevaluation.

    abstract::Three groups of 12 pigeons each were trained to discriminate between lights of 550 mmu (S(D)), correlated with 1-min variable-interval reinforcement and 570 mmu (S(Delta)), correlated with extinction. Group A was tested for wavelength generalization in extinction 1 min after meeting the discrimination criterion; Group...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1969.12-105

    authors: Thomas DR,Burr DE

    更新日期:1969-01-01 00:00:00

  • TEMPORALLY SPACED RESPONDING BY PIGEONS: DEVELOPMENT AND EFFECTS OF DEPRIVATION AND EXTINCTION.

    abstract::In the first five or six sessions on a DRL 20-sec schedule of reinforcement there developed a stable performance characterized by a relatively constant conditional probability of occurrence (IRTs/op) of interresponse times (IRTs) of durations greater than 5 or 6 sec. Extinction and the level of deprivation changed bot...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1964.7-415

    authors: REYNOLDS GS

    更新日期:1964-11-01 00:00:00

  • On the classic and modern theories of matching.

    abstract::Classic matching theory, which is based on Herrnstein's (1961) original matching equation and includes the well-known quantitative law of effect, is almost certainly false. The theory is logically inconsistent with known experimental findings, and experiments have shown that its central constant-k assumption is not te...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.2005.59-04

    authors: McDowell JJ

    更新日期:2005-07-01 00:00:00

  • Reinforcement magnitude and the inhibiting effect of reinforcement.

    abstract::In a two-key concurrent variable-interval schedule (using pigeons), if the reinforcement frequency for one response is held constant while that for the other is increased, the rate of response on the constant key decreases. The immediate reinforcement for key pecking can usually be conceptualized as the change from a ...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1979.32-265

    authors: Michael JL

    更新日期:1979-09-01 00:00:00

  • An infrared system for the detection of a pigeon's pecks at alphanumeric characters on a TV screen: the dependency of letter detection on the predictability of one letter by another.

    abstract::Three pigeons pecked at letters of the alphabet and at the symbol "?" displayed on a computer-driven cathode ray screen. A 4 by 4 matrix of infrared emitting and detecting diodes and associated circuitry identified the location of a pigeon's responses to the screen. Responses at the target letter T were probabilistica...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1985.43-257

    authors: Clauson HD,Izatt EJ,Shimp CP

    更新日期:1985-03-01 00:00:00

  • Nodal structure and the partitioning of equivalence classes.

    abstract::By definition, all of the stimuli in an equivalence class have to be functionally interchangeable with each other. The present experiment, however, demonstrated that this was not the case when using post-class-formation dual-option response transfer tests. With college students, two 4-node 6-member equivalence classes...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.2008-89-359

    authors: Fields L,Watanabe-Rose M

    更新日期:2008-05-01 00:00:00

  • Delayed reinforcement versus reinforcement after a fixed interval.

    abstract::When interreinforcement intervals were equated, pigeons demonstrated little or no preference between reinforcement after a delay interval and reinforcement presented on a fixed-interval schedule. The small preferences sometimes found for the fixed interval (a) were considerably smaller than when the delay and fixed in...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1969.12-375

    authors: Neuringer AJ

    更新日期:1969-05-01 00:00:00

  • Social discounting and the prisoner's dilemma game.

    abstract::Altruistic behavior has been defined in economic terms as "…costly acts that confer economic benefits on other individuals" (Fehr & Fischbacher, 2003). In a prisoner's dilemma game, cooperation benefits the group but is costly to the individual (relative to defection), yet a significant number of players choose to coo...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1002/jeab.3

    authors: Locey ML,Safin V,Rachlin H

    更新日期:2013-01-01 00:00:00

  • Automaintenance without stimulus-change reinforcement: Temporal control of key pecks.

    abstract::Yoked pairs of experimentally naive pigeons were exposed to a modified autoshaping procedure in which key pecking by the leader birds postponed both keylight termination and access to grain for the leader and the follower bird. Key pecking developed and was maintained in all birds and continued through two reversals o...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1979.31-395

    authors: Myerson J,Myerson WA,Parker BK

    更新日期:1979-05-01 00:00:00