Abstract:
:An implementation of punishment in the evolutionary theory of behavior dynamics is proposed, and is applied to responding on concurrent schedules of reinforcement with superimposed punishment. In this implementation, punishment causes behaviors to mutate, and to do so with a higher probability in a lean reinforcement context than in a rich one. Computational experiments were conducted in an attempt to replicate three findings from experiments with live organisms. These are (1) when punishment is superimposed on one component of a concurrent schedule, response rate decreases in the punished component and increases in the unpunished component, (2) when punishment is superimposed on both components at equal scheduled rates, preference increases over its no-punishment baseline, and (3) when punishment is superimposed on both components at rates that are proportional to the scheduled rates of reinforcement, preference remains unchanged from the baseline preference. Artificial organisms animated by the theory, and working on concurrent schedules with superimposed punishment, reproduced all of these findings. Given this outcome, it may be possible to discover a steady-state mathematical description of punished choice in live organisms by studying the punished choice behavior of artificial organisms animated by the evolutionary theory.
journal_name
J Exp Anal Behavjournal_title
Journal of the experimental analysis of behaviorauthors
McDowell JJ,Klapes Bdoi
10.1002/jeab.543subject
Has Abstractpub_date
2019-09-01 00:00:00pages
128-143issue
2eissn
0022-5002issn
1938-3711journal_volume
112pub_type
杂志文章abstract::Five 14(1/2)- to 19(1/2)-month-old infants were trained to lever press for snacks on small fixed ratio schedules of reinforcement. Within four to nine sessions, responding under FR 10 was established for four subjects and FR 15 for the other. Each subject's last session revealed behavioral patterns similar to animal a...
journal_title:Journal of the experimental analysis of behavior
pub_type: 杂志文章
doi:10.1901/jeab.1966.9-105
更新日期:1966-03-01 00:00:00
abstract::Implicit learning involves picking up information from the environment without explicit instruction or conscious awareness of the learning process. In nonhuman animals, conscious awareness is impossible to assess, so we define implicit learning as occurring when animals acquire information beyond what is required for ...
journal_title:Journal of the experimental analysis of behavior
pub_type: 杂志文章
doi:10.1002/jeab.180
更新日期:2016-01-01 00:00:00
abstract::We identify naming as the basic unit of verbal behavior, describe the conditions under which it is learned, and outline its crucial role in the development of stimulus classes and, hence, of symbolic behavior. Drawing upon B. F. Skinner's functional analysis and the theoretical work of G. H. Mead and L. S. Vygotsky, w...
journal_title:Journal of the experimental analysis of behavior
pub_type: 杂志文章
doi:10.1901/jeab.1996.65-185
更新日期:1996-01-01 00:00:00
abstract::Wilson and Hayes (1996) and Doughty, Kastner, and Bismark (2011) observed resurgence of past equivalence relations when newer equivalence relations were punished or extinguished, respectively. Their findings support the notion that deriving stimulus relations is a form of operant behavior. Although there is consensus ...
journal_title:Journal of the experimental analysis of behavior
pub_type: 杂志文章
doi:10.1002/jeab.111
更新日期:2014-11-01 00:00:00
abstract::Operant conditioning techniques were applied to the study of how target fixations are controlled by the probability of signal occurrence. In a standard vigilance setting, gaze at three illuminable volt meters was monitored by a Mackworth television eye camera with automatic recording capability. Gaze at a given meter ...
journal_title:Journal of the experimental analysis of behavior
pub_type: 杂志文章
doi:10.1901/jeab.1973.20-411
更新日期:1973-11-01 00:00:00
abstract::Four studies were conducted to investigate the source of reinforcement of Sidman avoidance. First it was found that the acquisition of avoidance was seriously impaired if there was no immediate stimulus consequence of responding, i.e., proprioceptive and auditory feedback. The second study showed that if the shock-sho...
journal_title:Journal of the experimental analysis of behavior
pub_type: 杂志文章
doi:10.1901/jeab.1964.7-315
更新日期:1964-07-01 00:00:00
abstract::Recent research suggests that presenting time intervals as units (e.g., days) or as specific dates, can modulate the degree to which humans discount delayed outcomes. Another framing effect involves explicitly stating that choosing a smaller-sooner reward is mutually exclusive to receiving a larger-later reward, thus ...
journal_title:Journal of the experimental analysis of behavior
pub_type: 杂志文章
doi:10.1002/jeab.328
更新日期:2018-05-01 00:00:00
abstract::Preferences for larger or smaller defined response classes were investigated in a concurrent schedule precedure. Twelve pigeons were run on a series of concurrent variable-interval reinforcement schedules, from which baseline matching functions were obtained. An experimental phase followed, in which a second response ...
journal_title:Journal of the experimental analysis of behavior
pub_type: 杂志文章
doi:10.1901/jeab.1979.32-1
更新日期:1979-07-01 00:00:00
abstract::The hypothesis that mesolimbic dopamine is selectively involved in cocaine reinforcement was investigated in the rat. Animals were trained under a multiple schedule in which responding was reinforced by intravenous cocaine (0.75 mg/kg/injection) or food (45-mg pellets) under fixed-ratio 15 schedule requirements in alt...
journal_title:Journal of the experimental analysis of behavior
pub_type: 杂志文章
doi:10.1901/jeab.1994.61-213
更新日期:1994-03-01 00:00:00
abstract::Twelve preschool children participated in a study of the effects of explicit training on the imitation of modeled behavior. The responses trained involved a marble-dropping pattern that differed from the modeled pattern. Training consisted of physical prompts and verbal praise during a single session. No prompts or pr...
journal_title:Journal of the experimental analysis of behavior
pub_type: 杂志文章
doi:10.1901/jeab.1982.37-135
更新日期:1982-01-01 00:00:00
abstract::The behavioral effects of various schedules of electric shock presentation were investigated during and after the imprinting of Peking ducklings to moving stimuli. The behavior of following a moving imprinted stimulus was differentially controlled by a multiple schedule of punishment and avoidance that respectively su...
journal_title:Journal of the experimental analysis of behavior
pub_type: 杂志文章
doi:10.1901/jeab.1972.18-305
更新日期:1972-09-01 00:00:00
abstract::Following up on articles recently published in this journal, the present contribution tells (some of) "the rest of the story" about the value of randomization in single-case intervention research investigations. Invoking principles of internal, statistical-conclusion, and external validity, we begin by emphasizing the...
journal_title:Journal of the experimental analysis of behavior
pub_type: 杂志文章
doi:10.1002/jeab.558
更新日期:2019-11-01 00:00:00
abstract::Key pecking of 4 pigeons was studied under a two-component multiple schedule in which food deliveries were arranged according to a fixed and a variable interfood interval. The percentage of response-dependent food in each component was varied, first in ascending (0, 10, 30, 70 and 100%) and then in descending orders, ...
journal_title:Journal of the experimental analysis of behavior
pub_type: 杂志文章
doi:10.1002/jeab.13
更新日期:2013-03-01 00:00:00
abstract::Comparison was made of two methods for training monkeys to "observe" a two-member serial position sequence by pressing two consecutively lighted keys and then to "report" the sequence by pressing the same two keys in the same order but without the lights. A fading technique involving gradual elimination of brightness ...
journal_title:Journal of the experimental analysis of behavior
pub_type: 杂志文章
doi:10.1901/jeab.1971.15-335
更新日期:1971-05-01 00:00:00
abstract::Experiment I sought to determine if the stimulus correlated with extinction in a successive discrimination was an aversive stimulus. An escape response provided an index of aversive control. Two groups of pigeons were exposed to a multiple variable-interval 30-sec extinction schedule. For the experimental group, a sin...
journal_title:Journal of the experimental analysis of behavior
pub_type: 杂志文章
doi:10.1901/jeab.1969.12-917
更新日期:1969-11-01 00:00:00
abstract::Three pigeons pecked keys and 5 rats pressed levers for food delivered on variable-interval schedules. During baseline conditions, subjects responded on a variable-interval 40-s schedule throughout the session. During experimental conditions, the programmed rate of reinforcement changed every 10 min in the 50-min sess...
journal_title:Journal of the experimental analysis of behavior
pub_type: 杂志文章
doi:10.1901/jeab.1995.64-237
更新日期:1995-09-01 00:00:00
abstract::The effect of food reinforcement schedules on the reinforcement value of drinking water was evaluated. Food-deprived rats were exposed to concurrent, identical variable-time schedules of food presentation, the food thus being delivered independently of the rats' behavior. When the relative amount of time spent in a sc...
journal_title:Journal of the experimental analysis of behavior
pub_type: 杂志文章
doi:10.1901/jeab.1975.23-37
更新日期:1975-01-01 00:00:00
abstract::Pigeons with extensive training pecking a key illuminated by a white line then had brief training with the key illuminated by 555 nanometers. This was immediately followed by a wavelength generalization test in extinction. Dimensional stimulus control about the training wavelength increased with the duration and numbe...
journal_title:Journal of the experimental analysis of behavior
pub_type: 杂志文章
doi:10.1901/jeab.1976.26-191
更新日期:1976-09-01 00:00:00
abstract::Pigeons were trained to discriminate a slow click-rate from its absence, or to discriminate it from a faster click-rate. Subsequent click-rate generalization tests produced the usual steepened gradients after the intradimensional discrimination but produced flat gradients after presence/absence discrimination. The occ...
journal_title:Journal of the experimental analysis of behavior
pub_type: 杂志文章
doi:10.1901/jeab.1973.20-23
更新日期:1973-07-01 00:00:00
abstract::Herrnstein and Heyman (1979) showed that when pigeons' pecking is reinforced on concurrent variable-interval variable-ratio schedules, (1) their behavior ratios match the ratio of the schedules' reinforcer frequencies, and (2) there is more responding on the variable interval. Since maximizing the reinforcement rate w...
journal_title:Journal of the experimental analysis of behavior
pub_type: 杂志文章
doi:10.1901/jeab.1984.41-83
更新日期:1984-01-01 00:00:00
abstract::The authors of four papers recently reported that satiation provides a better explanation than habituation for within-session decreases in conditioned responding. Several arguments question this conclusion. First, the contribution of habituation to within-session changes in responding seems clearly established. Inform...
journal_title:Journal of the experimental analysis of behavior
pub_type: 杂志文章
doi:10.1901/jeab.2000.74-347
更新日期:2000-11-01 00:00:00
abstract::Three groups of 12 pigeons each were trained to discriminate between lights of 550 mmu (S(D)), correlated with 1-min variable-interval reinforcement and 570 mmu (S(Delta)), correlated with extinction. Group A was tested for wavelength generalization in extinction 1 min after meeting the discrimination criterion; Group...
journal_title:Journal of the experimental analysis of behavior
pub_type: 杂志文章
doi:10.1901/jeab.1969.12-105
更新日期:1969-01-01 00:00:00
abstract::In the first five or six sessions on a DRL 20-sec schedule of reinforcement there developed a stable performance characterized by a relatively constant conditional probability of occurrence (IRTs/op) of interresponse times (IRTs) of durations greater than 5 or 6 sec. Extinction and the level of deprivation changed bot...
journal_title:Journal of the experimental analysis of behavior
pub_type: 杂志文章
doi:10.1901/jeab.1964.7-415
更新日期:1964-11-01 00:00:00
abstract::Classic matching theory, which is based on Herrnstein's (1961) original matching equation and includes the well-known quantitative law of effect, is almost certainly false. The theory is logically inconsistent with known experimental findings, and experiments have shown that its central constant-k assumption is not te...
journal_title:Journal of the experimental analysis of behavior
pub_type: 杂志文章
doi:10.1901/jeab.2005.59-04
更新日期:2005-07-01 00:00:00
abstract::In a two-key concurrent variable-interval schedule (using pigeons), if the reinforcement frequency for one response is held constant while that for the other is increased, the rate of response on the constant key decreases. The immediate reinforcement for key pecking can usually be conceptualized as the change from a ...
journal_title:Journal of the experimental analysis of behavior
pub_type: 杂志文章
doi:10.1901/jeab.1979.32-265
更新日期:1979-09-01 00:00:00
abstract::Three pigeons pecked at letters of the alphabet and at the symbol "?" displayed on a computer-driven cathode ray screen. A 4 by 4 matrix of infrared emitting and detecting diodes and associated circuitry identified the location of a pigeon's responses to the screen. Responses at the target letter T were probabilistica...
journal_title:Journal of the experimental analysis of behavior
pub_type: 杂志文章
doi:10.1901/jeab.1985.43-257
更新日期:1985-03-01 00:00:00
abstract::By definition, all of the stimuli in an equivalence class have to be functionally interchangeable with each other. The present experiment, however, demonstrated that this was not the case when using post-class-formation dual-option response transfer tests. With college students, two 4-node 6-member equivalence classes...
journal_title:Journal of the experimental analysis of behavior
pub_type: 杂志文章
doi:10.1901/jeab.2008-89-359
更新日期:2008-05-01 00:00:00
abstract::When interreinforcement intervals were equated, pigeons demonstrated little or no preference between reinforcement after a delay interval and reinforcement presented on a fixed-interval schedule. The small preferences sometimes found for the fixed interval (a) were considerably smaller than when the delay and fixed in...
journal_title:Journal of the experimental analysis of behavior
pub_type: 杂志文章
doi:10.1901/jeab.1969.12-375
更新日期:1969-05-01 00:00:00
abstract::Altruistic behavior has been defined in economic terms as "…costly acts that confer economic benefits on other individuals" (Fehr & Fischbacher, 2003). In a prisoner's dilemma game, cooperation benefits the group but is costly to the individual (relative to defection), yet a significant number of players choose to coo...
journal_title:Journal of the experimental analysis of behavior
pub_type: 杂志文章
doi:10.1002/jeab.3
更新日期:2013-01-01 00:00:00
abstract::Yoked pairs of experimentally naive pigeons were exposed to a modified autoshaping procedure in which key pecking by the leader birds postponed both keylight termination and access to grain for the leader and the follower bird. Key pecking developed and was maintained in all birds and continued through two reversals o...
journal_title:Journal of the experimental analysis of behavior
pub_type: 杂志文章
doi:10.1901/jeab.1979.31-395
更新日期:1979-05-01 00:00:00