Abstract:
:The relationship between positive and negative reinforcement and the symmetry of Thorndike's law of effect are unresolved issues in operant psychology. Here we show that, for a given pattern of responding on variable interval (VI) schedules with the same programmed rate of food rewards (positive reinforcement VI) or electric shocks (negative reinforcement VI), there is a fundamental mathematical equivalence between reward gain and shock reduction. We also provide the first normative account of how animals should respond on a negative VI schedule, showing that it is better to space responses evenly than to respond with a variable interresponse time (IRT). Published data from rats, however, indicate that these animals respond irregularly, often with a burst of activity immediately following a shock. While this is irrational in the experimental setting, it may represent an appropriate response to the heterogeneity of stimuli commonly encountered in natural environments. We discuss the broader implications of our analysis for understanding how animals evaluate appetitive and aversive stimuli.
journal_name
J Exp Anal Behavjournal_title
Journal of the experimental analysis of behaviorauthors
Mallpress DE,Fawcett TW,McNamara JM,Houston AIdoi
10.1901/jeab.2012.98-355subject
Has Abstractpub_date
2012-11-01 00:00:00pages
355-67issue
3eissn
0022-5002issn
1938-3711journal_volume
98pub_type
杂志文章abstract::When subjects learn to associate two sample durations with two comparison keys, do they learn to associate the keys with the short and long samples (relational hypothesis), or with the specific sample durations (absolute hypothesis)? We exposed 16 pigeons to an ABA design in which phases A and B corresponded to tasks ...
journal_title:Journal of the experimental analysis of behavior
pub_type: 杂志文章
doi:10.1901/jeab.2012.98-23
更新日期:2012-07-01 00:00:00
abstract::This study examined the role of learning history on the acquisition of a matching-to-sample task. Twelve preschool children learned four stimulus classes through instructions, shaping, or imitation. After reaching criterion, the subjects were exposed to changed discrimination contingencies to determine how each learni...
journal_title:Journal of the experimental analysis of behavior
pub_type: 杂志文章
doi:10.1901/jeab.1991.56-155
更新日期:1991-07-01 00:00:00
abstract::Pigeons were provided with three keys. Pecking the center key produced grain on a schedule that alternated at unpredictable times between a variable-interval component and extinction. On concurrent variable-interval schedules, pecking either side key produced a stimulus associated with the variable-interval component ...
journal_title:Journal of the experimental analysis of behavior
pub_type: 杂志文章
doi:10.1901/jeab.1981.36-41
更新日期:1981-07-01 00:00:00
abstract::After 25 free-operant avoidance training sessions, a 1-min signal followed by a brief shock was presented on the average of once every 4 min. During the signal, the avoidance schedule was suspended (20 sessions). Response rates during the signal were markedly reduced. Shock rates during non-signalled periods increased...
journal_title:Journal of the experimental analysis of behavior
pub_type: 杂志文章
doi:10.1901/jeab.1970.14-331
更新日期:1970-11-01 00:00:00
abstract::Experiment 1 investigated whether training subjects to read words aloud would induce correct written spelling of the words even though spelling had no experimental consequences. Training in reading was followed by a weak increment in correct spelling. Experiment 2 investigated whether overtraining in reading would imp...
journal_title:Journal of the experimental analysis of behavior
pub_type: 杂志文章
doi:10.1901/jeab.1982.37-311
更新日期:1982-03-01 00:00:00
abstract::The purpose of this three-experiment study was to evaluate whether performance consistent with the formation of equivalence classes could be established after training adults to tact and intraverbally relate the names of visual stimuli. Fourteen participants were exposed to tact training, listener testing, and intrave...
journal_title:Journal of the experimental analysis of behavior
pub_type: 杂志文章
doi:10.1002/jeab.203
更新日期:2016-05-01 00:00:00
abstract::In pigeons performing under a multiple schedule of food presentation, low key-pecking rates (0.18 to 0.29 responses per second) were maintained during 3-min fixed-interval components by requiring a 4-, 5-, or 6-sec pause preceding the food-delivery response (tandem DRL), while higher rates (0.70 to 1.37 responses per ...
journal_title:Journal of the experimental analysis of behavior
pub_type: 杂志文章
doi:10.1901/jeab.1977.27-51
更新日期:1977-01-01 00:00:00
abstract::Behavior maintained by intravenously delivered alfentanil, cocaine, or ketamine was assessed using a fixed-ratio schedule of reinforcement. As the dose of each drug was increased, rate of responding also increased up to a maximum. Further increases in dose resulted in decreased response rates (inverted U-shaped curve)...
journal_title:Journal of the experimental analysis of behavior
pub_type: 杂志文章
doi:10.1901/jeab.1991.56-331
更新日期:1991-09-01 00:00:00
abstract::In Experiment 1, 3, adult females were taught with verbal instructions and contingencies to select, in sequence, three arbitrary visual stimuli from an array of five stimuli. After four different sequences were taught, match-to-sample tests assessed emergent conditional relations among all stimuli that had been select...
journal_title:Journal of the experimental analysis of behavior
pub_type: 杂志文章
doi:10.1901/jeab.1990.53-47
更新日期:1990-01-01 00:00:00
abstract::Four pigeons responded under a two-component multiple schedule of reinforcement. Responses were reinforced in one component under a variable-ratio schedule and in the other component under a variable-interval schedule. It was found that when rates of reinforcement were equal in the two components, the rate of response...
journal_title:Journal of the experimental analysis of behavior
pub_type: 杂志文章
doi:10.1901/jeab.1970.13-369
更新日期:1970-05-01 00:00:00
abstract::Temporal schedules of negative reinforcement were derived in a manner analogous to those for positive reinforcement, and two parametric studies were carried out with two of the three defining variables. With some limiting values of the defining variables, escape schedules result and data obtained at these values were ...
journal_title:Journal of the experimental analysis of behavior
pub_type: 杂志文章
doi:10.1901/jeab.1963.6-361
更新日期:1963-07-01 00:00:00
abstract::Four rats obtained food pellets by poking a key and 5-s presentations of the discriminative stimuli by pressing a lever. Every 1 or 2 min, the prevailing schedule of reinforcement for key poking alternated between rich (either variable-interval [VI] 30 s or VI 60 s) and lean (either VI 240 s, VI 480 s, or extinction) ...
journal_title:Journal of the experimental analysis of behavior
pub_type: 杂志文章
doi:10.1901/jeab.2002.77-171
更新日期:2002-03-01 00:00:00
abstract::Pigeons were presented with multiple schedules of alternating 90-sec components. When components in which grain was never presented alternated with components in which grain was presented on a variable-interval schedule, the average rate of responding in the variable-interval components increased, showing overall posi...
journal_title:Journal of the experimental analysis of behavior
pub_type: 杂志文章
doi:10.1901/jeab.1975.24-291
更新日期:1975-11-01 00:00:00
abstract::The present experiment investigated the effects of reinforcer magnitude on resistance to disruption of remembering and response rates. Pigeons were exposed to a variable-interval (VI), delayed-matching-to-sample (DMTS) procedure with two components (rich and lean, distinguished by differing discriminative stimuli and ...
journal_title:Journal of the experimental analysis of behavior
pub_type: 杂志文章
doi:10.1002/jeab.86
更新日期:2014-05-01 00:00:00
abstract::Three rats were exposed to a second-order schedule in which fixed-interval components ended either with food or with a brief stimulus that was never paired with food. Food and the brief stimulus occurred in a random sequence (variable-ratio 2 overall schedule). Another three rats were exposed to a similar second-order...
journal_title:Journal of the experimental analysis of behavior
pub_type: 杂志文章
doi:10.1901/jeab.1977.27-265
更新日期:1977-03-01 00:00:00
abstract::Recent advances in assessment methodology have resulted in a highly efficient procedure for obtaining delay discounting rates for adults: a 5-trial adjusting delay task (ADT-5) examining intertemporal choice for hypothetical rewards. The low participant burden of this task makes it potentially useful for children, wit...
journal_title:Journal of the experimental analysis of behavior
pub_type: 杂志文章
doi:10.1002/jeab.493
更新日期:2019-01-01 00:00:00
abstract::Pigeons were trained in a matching-to-sample procedure with retention intervals of 0, 2, 4, 6, and 8 s mixed within each session. In different conditions, reinforcement was delayed by 0, 1, 2, 4, 6, or 8 s from correct choice responses. Discriminability decreased with increasing retention-interval duration and with in...
journal_title:Journal of the experimental analysis of behavior
pub_type: 杂志文章
doi:10.1901/jeab.2003.80-77
更新日期:2003-07-01 00:00:00
abstract::Eight alligators were trained to escape heat by traversing an 8-ft runway containing right or left approaches to a water tank. All subjects were run until they had satisfied three criteria of stable response time, after which the predominant escape path was blocked, requiring discrimination reversal. Seven subjects ag...
journal_title:Journal of the experimental analysis of behavior
pub_type: 杂志文章
doi:10.1901/jeab.1966.9-671
更新日期:1966-11-01 00:00:00
abstract::The present study investigated the effects of positive and negative GABA(A) modulators under three different baselines of repeated acquisition in squirrel monkeys in which the monkeys acquired a three-response sequence on three keys under a second-order fixed-ratio (FR) schedule of food reinforcement. In two of these ...
journal_title:Journal of the experimental analysis of behavior
pub_type: 杂志文章
doi:10.1901/jeab.2004.82-37
更新日期:2004-07-01 00:00:00
abstract::Parallel and serial timing processes are analyzed for their account of the dynamics of intertrial responding in the peak procedure. A strictly serial model, such as the behavioral theory of timing (Killeen & Fetterman, 1988), does not fit the dynamic correlation pattern in the location and duration of the middle high-...
journal_title:Journal of the experimental analysis of behavior
pub_type: 杂志文章
doi:10.1901/jeab.1992.57-393
更新日期:1992-05-01 00:00:00
abstract::Pigeons pecked a key and rats pressed a lever for food reinforcement under large values of the differential-reinforcement-of-low-rate schedule. Each subject was tested under 10 different schedule values ranging from 1 to 45 min and was exposed to each schedule value at least twice. The mean interresponse time and mean...
journal_title:Journal of the experimental analysis of behavior
pub_type: 杂志文章
doi:10.1901/jeab.1974.22-121
更新日期:1974-07-01 00:00:00
abstract::Five pigeons were trained to detect differences in light intensity. Two stimuli, S1 and S2, differing in intensity, were arranged on the center key of a three-key chamber according to set probabilities. A peck on the center key turned on the two side keys. When S1 was presented on the center key, a peck on the left ke...
journal_title:Journal of the experimental analysis of behavior
pub_type: 杂志文章
doi:10.1901/jeab.1979.32-373
更新日期:1979-11-01 00:00:00
abstract::A new technique was developed to study the repeated acquisition of conditional discriminations. Using a discrete trial procedure, pigeons were required to learn during each session a different two-member chain of conditional discriminations. Key color and geometric forms were used as stimuli. After the pigeons had rea...
journal_title:Journal of the experimental analysis of behavior
pub_type: 杂志文章
doi:10.1901/jeab.1978.29-225
更新日期:1978-03-01 00:00:00
abstract::A multiple schedule having both an appetitive and an avoidance component was maintained in two dogs to create a complex behavioral base line for observing the effects of chlorpromazine. Both soluble and "Spansule" chlorpromazine generated similar functions relating drug dose to measures of behavioral output. Although ...
journal_title:Journal of the experimental analysis of behavior
pub_type: 杂志文章
doi:10.1901/jeab.1962.5-259
更新日期:1962-04-01 00:00:00
abstract::Two pigeons were exposed to factorial combinations of two values of line tilt and two frequencies of houselight flashes. During each of four baseline stages, key pecking in the presence of all four combinations was reinforced according to a variable-interval schedule. The baseline phases were followed by four differen...
journal_title:Journal of the experimental analysis of behavior
pub_type: 杂志文章
doi:10.1901/jeab.1973.20-483
更新日期:1973-11-01 00:00:00
abstract::Eight rats' lever presses were reinforced after an interruption in a tone, provided the lever had not been pressed before the tone interruption. After a few sessions, long before the animals reliably refrained from lever pressing before the interruption, the latencies of postinterruption presses (time from the termina...
journal_title:Journal of the experimental analysis of behavior
pub_type: 杂志文章
doi:10.1901/jeab.1984.41-329
更新日期:1984-05-01 00:00:00
abstract::Five rats responded under concurrent fixed-interval variable-ratio schedules of food reinforcement. Fixed-interval values ranged from 50-seconds to 300-seconds and variable-ratio values ranged from 30 to 360; a five-second changeover delay was in effect throughout the experiment. The relations between reinforcement ra...
journal_title:Journal of the experimental analysis of behavior
pub_type: 杂志文章
doi:10.1901/jeab.1981.36-317
更新日期:1981-11-01 00:00:00
abstract::Pigeons produced a stimulus change either by responding or by not responding for a specified time period (by pausing). They then had to choose between two responses to obtain food. One choice was correct if the first component had been completed by a response; the other was correct if the component had been completed ...
journal_title:Journal of the experimental analysis of behavior
pub_type: 杂志文章
doi:10.1901/jeab.1982.37-223
更新日期:1982-03-01 00:00:00
abstract::Undergraduate students' presses on left and right buttons occasionally made available points exchangeable for money. Blue lights over the buttons were correlated with multiple random-ratio random-interval components; usually, the random-ratio schedule was assigned to the left button and the random-interval to the righ...
journal_title:Journal of the experimental analysis of behavior
pub_type: 杂志文章
doi:10.1901/jeab.1982.38-233
更新日期:1982-11-01 00:00:00
abstract::Rats trained to lever press on a fixed-interval limited-hold avoidance schedule maintained a pattern of responding similar to that maintained by fixed-interval limited-hold schedules of positive reinforcement. But this positively accelerated pattern of behavior was maintained only when the occurrence of reinforcement ...
journal_title:Journal of the experimental analysis of behavior
pub_type: 杂志文章
doi:10.1901/jeab.1972.17-75
更新日期:1972-01-01 00:00:00