Comparing pleasure and pain: the fundamental mathematical equivalence of reward gain and shock reduction under variable interval schedules.

Abstract:

:The relationship between positive and negative reinforcement and the symmetry of Thorndike's law of effect are unresolved issues in operant psychology. Here we show that, for a given pattern of responding on variable interval (VI) schedules with the same programmed rate of food rewards (positive reinforcement VI) or electric shocks (negative reinforcement VI), there is a fundamental mathematical equivalence between reward gain and shock reduction. We also provide the first normative account of how animals should respond on a negative VI schedule, showing that it is better to space responses evenly than to respond with a variable interresponse time (IRT). Published data from rats, however, indicate that these animals respond irregularly, often with a burst of activity immediately following a shock. While this is irrational in the experimental setting, it may represent an appropriate response to the heterogeneity of stimuli commonly encountered in natural environments. We discuss the broader implications of our analysis for understanding how animals evaluate appetitive and aversive stimuli.

journal_name

J Exp Anal Behav

authors

Mallpress DE,Fawcett TW,McNamara JM,Houston AI

doi

10.1901/jeab.2012.98-355

subject

Has Abstract

pub_date

2012-11-01 00:00:00

pages

355-67

issue

3

eissn

0022-5002

issn

1938-3711

journal_volume

98

pub_type

杂志文章
  • Relative versus absolute stimulus control in the temporal bisection task.

    abstract::When subjects learn to associate two sample durations with two comparison keys, do they learn to associate the keys with the short and long samples (relational hypothesis), or with the specific sample durations (absolute hypothesis)? We exposed 16 pigeons to an ABA design in which phases A and B corresponded to tasks ...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.2012.98-23

    authors: Pinheiro de Carvalho M,Machado A

    更新日期:2012-07-01 00:00:00

  • Transient effects of acquisition history on generalization in a matching-to-sample task.

    abstract::This study examined the role of learning history on the acquisition of a matching-to-sample task. Twelve preschool children learned four stimulus classes through instructions, shaping, or imitation. After reaching criterion, the subjects were exposed to changed discrimination contingencies to determine how each learni...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1991.56-155

    authors: Michael RL,Bernstein DJ

    更新日期:1991-07-01 00:00:00

  • Conditioned reinforcement as a function of duration of stimulus.

    abstract::Pigeons were provided with three keys. Pecking the center key produced grain on a schedule that alternated at unpredictable times between a variable-interval component and extinction. On concurrent variable-interval schedules, pecking either side key produced a stimulus associated with the variable-interval component ...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1981.36-41

    authors: Dinsmoor JA,Mulvaney DE,Jwaideh AR

    更新日期:1981-07-01 00:00:00

  • The effect of a pre-shock signal on a free-operant avoidance response.

    abstract::After 25 free-operant avoidance training sessions, a 1-min signal followed by a brief shock was presented on the average of once every 4 min. During the signal, the avoidance schedule was suspended (20 sessions). Response rates during the signal were markedly reduced. Shock rates during non-signalled periods increased...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1970.14-331

    authors: Roberts AE,Hurwitz HM

    更新日期:1970-11-01 00:00:00

  • Effects on spelling of training children to read.

    abstract::Experiment 1 investigated whether training subjects to read words aloud would induce correct written spelling of the words even though spelling had no experimental consequences. Training in reading was followed by a weak increment in correct spelling. Experiment 2 investigated whether overtraining in reading would imp...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1982.37-311

    authors: Lee VL,Pegler AM

    更新日期:1982-03-01 00:00:00

  • Training intraverbal naming to establish equivalence class performances.

    abstract::The purpose of this three-experiment study was to evaluate whether performance consistent with the formation of equivalence classes could be established after training adults to tact and intraverbally relate the names of visual stimuli. Fourteen participants were exposed to tact training, listener testing, and intrave...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1002/jeab.203

    authors: Ma ML,Miguel CF,Jennings AM

    更新日期:2016-05-01 00:00:00

  • Drug effects on fixed-interval responding with pause requirements for food presentation.

    abstract::In pigeons performing under a multiple schedule of food presentation, low key-pecking rates (0.18 to 0.29 responses per second) were maintained during 3-min fixed-interval components by requiring a 4-, 5-, or 6-sec pause preceding the food-delivery response (tandem DRL), while higher rates (0.70 to 1.37 responses per ...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1977.27-51

    authors: Stitzer M,McKearney JW

    更新日期:1977-01-01 00:00:00

  • Analysis of fixed-ratio behavior maintained by drug reinforcers.

    abstract::Behavior maintained by intravenously delivered alfentanil, cocaine, or ketamine was assessed using a fixed-ratio schedule of reinforcement. As the dose of each drug was increased, rate of responding also increased up to a maximum. Further increases in dose resulted in decreased response rates (inverted U-shaped curve)...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1991.56-331

    authors: Skjoldager P,Winger G,Woods JH

    更新日期:1991-09-01 00:00:00

  • Equivalence classes generated by sequence training.

    abstract::In Experiment 1, 3, adult females were taught with verbal instructions and contingencies to select, in sequence, three arbitrary visual stimuli from an array of five stimuli. After four different sequences were taught, match-to-sample tests assessed emergent conditional relations among all stimuli that had been select...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1990.53-47

    authors: Sigurdardottir ZG,Green G,Saunders RR

    更新日期:1990-01-01 00:00:00

  • A comparison of variable-ratio and variable-interval schedules of reinforcement.

    abstract::Four pigeons responded under a two-component multiple schedule of reinforcement. Responses were reinforced in one component under a variable-ratio schedule and in the other component under a variable-interval schedule. It was found that when rates of reinforcement were equal in the two components, the rate of response...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1970.13-369

    authors: Zuriff GE

    更新日期:1970-05-01 00:00:00

  • Two parameters of a temporally defined schedule of negative reinforcement.

    abstract::Temporal schedules of negative reinforcement were derived in a manner analogous to those for positive reinforcement, and two parametric studies were carried out with two of the three defining variables. With some limiting values of the defining variables, escape schedules result and data obtained at these values were ...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1963.6-361

    authors: SIDLEY NA

    更新日期:1963-07-01 00:00:00

  • The generality of selective observing.

    abstract::Four rats obtained food pellets by poking a key and 5-s presentations of the discriminative stimuli by pressing a lever. Every 1 or 2 min, the prevailing schedule of reinforcement for key poking alternated between rich (either variable-interval [VI] 30 s or VI 60 s) and lean (either VI 240 s, VI 480 s, or extinction) ...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.2002.77-171

    authors: Gaynor ST,Shull RL

    更新日期:2002-03-01 00:00:00

  • A re-examination of local contrast in multiple schedules.

    abstract::Pigeons were presented with multiple schedules of alternating 90-sec components. When components in which grain was never presented alternated with components in which grain was presented on a variable-interval schedule, the average rate of responding in the variable-interval components increased, showing overall posi...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1975.24-291

    authors: Buck SL,Rothstein B,Williams BA

    更新日期:1975-11-01 00:00:00

  • Reinforcer magnitude and resistance to disruption of forgetting functions and response rates.

    abstract::The present experiment investigated the effects of reinforcer magnitude on resistance to disruption of remembering and response rates. Pigeons were exposed to a variable-interval (VI), delayed-matching-to-sample (DMTS) procedure with two components (rich and lean, distinguished by differing discriminative stimuli and ...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1002/jeab.86

    authors: Berry MS,Odum AL

    更新日期:2014-05-01 00:00:00

  • Polydipsia induced in rats by second-order schedules of reinforcement.

    abstract::Three rats were exposed to a second-order schedule in which fixed-interval components ended either with food or with a brief stimulus that was never paired with food. Food and the brief stimulus occurred in a random sequence (variable-ratio 2 overall schedule). Another three rats were exposed to a similar second-order...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1977.27-265

    authors: Corfield-Sumner PK,Blackman DE,Stainer G

    更新日期:1977-03-01 00:00:00

  • Comparing rapid assessments of delay discounting with real and hypothetical rewards in children.

    abstract::Recent advances in assessment methodology have resulted in a highly efficient procedure for obtaining delay discounting rates for adults: a 5-trial adjusting delay task (ADT-5) examining intertemporal choice for hypothetical rewards. The low participant burden of this task makes it potentially useful for children, wit...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1002/jeab.493

    authors: Miller JR

    更新日期:2019-01-01 00:00:00

  • The effect of reinforcer delays on the form of the forgetting function.

    abstract::Pigeons were trained in a matching-to-sample procedure with retention intervals of 0, 2, 4, 6, and 8 s mixed within each session. In different conditions, reinforcement was delayed by 0, 1, 2, 4, 6, or 8 s from correct choice responses. Discriminability decreased with increasing retention-interval duration and with in...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.2003.80-77

    authors: Sargisson RJ,White KG

    更新日期:2003-07-01 00:00:00

  • Operant stimulus control applied to maze behavior: heat escape conditioning and discrimination reversal in Alligator mississippiensis.

    abstract::Eight alligators were trained to escape heat by traversing an 8-ft runway containing right or left approaches to a water tank. All subjects were run until they had satisfied three criteria of stable response time, after which the predominant escape path was blocked, requiring discrimination reversal. Seven subjects ag...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1966.9-671

    authors: Davidson RS

    更新日期:1966-11-01 00:00:00

  • Effects of GABA modulators on the repeated acquisition of response sequences in squirrel monkeys.

    abstract::The present study investigated the effects of positive and negative GABA(A) modulators under three different baselines of repeated acquisition in squirrel monkeys in which the monkeys acquired a three-response sequence on three keys under a second-order fixed-ratio (FR) schedule of food reinforcement. In two of these ...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.2004.82-37

    authors: Campbell UC,Winsauer PJ,Stevenson MW,Moerschbaecher JM

    更新日期:2004-07-01 00:00:00

  • Comparison of variance and covariance patterns in parallel and serial theories of timing.

    abstract::Parallel and serial timing processes are analyzed for their account of the dynamics of intertrial responding in the peak procedure. A strictly serial model, such as the behavioral theory of timing (Killeen & Fetterman, 1988), does not fit the dynamic correlation pattern in the location and duration of the middle high-...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1992.57-393

    authors: Gibbon J,Church RM

    更新日期:1992-05-01 00:00:00

  • Behavior under large values of the differential-reinforcement-of-low-rate schedule.

    abstract::Pigeons pecked a key and rats pressed a lever for food reinforcement under large values of the differential-reinforcement-of-low-rate schedule. Each subject was tested under 10 different schedule values ranging from 1 to 45 min and was exposed to each schedule value at least twice. The mean interresponse time and mean...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1974.22-121

    authors: Richardson WK,Loughead TE

    更新日期:1974-07-01 00:00:00

  • Signal probability, reinforcement and signal detection.

    abstract::Five pigeons were trained to detect differences in light intensity. Two stimuli, S1 and S2, differing in intensity, were arranged on the center key of a three-key chamber according to set probabilities. A peck on the center key turned on the two side keys. When S1 was presented on the center key, a peck on the left ke...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1979.32-373

    authors: McCarthy D,Davison M

    更新日期:1979-11-01 00:00:00

  • Repeated acquisition of conditional discriminations.

    abstract::A new technique was developed to study the repeated acquisition of conditional discriminations. Using a discrete trial procedure, pigeons were required to learn during each session a different two-member chain of conditional discriminations. Key color and geometric forms were used as stimuli. After the pigeons had rea...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1978.29-225

    authors: Moerschbaecher JM,Boren JJ,Schrot J

    更新日期:1978-03-01 00:00:00

  • Effects of chlorpromazine on appetitive and aversive components of a multiple schedule.

    abstract::A multiple schedule having both an appetitive and an avoidance component was maintained in two dogs to create a complex behavioral base line for observing the effects of chlorpromazine. Both soluble and "Spansule" chlorpromazine generated similar functions relating drug dose to measures of behavioral output. Although ...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1962.5-259

    authors: WALLER MB,WALLER PF

    更新日期:1962-04-01 00:00:00

  • Behavioral interactions and stimulus control during conditional discriminations.

    abstract::Two pigeons were exposed to factorial combinations of two values of line tilt and two frequencies of houselight flashes. During each of four baseline stages, key pecking in the presence of all four combinations was reinforced according to a variable-interval schedule. The baseline phases were followed by four differen...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1973.20-483

    authors: Wilkie DM

    更新日期:1973-11-01 00:00:00

  • Knowing before doing: discrimination by rats of a brief interruption of a tone.

    abstract::Eight rats' lever presses were reinforced after an interruption in a tone, provided the lever had not been pressed before the tone interruption. After a few sessions, long before the animals reliably refrained from lever pressing before the interruption, the latencies of postinterruption presses (time from the termina...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1984.41-329

    authors: Eisler H

    更新日期:1984-05-01 00:00:00

  • Concurrent fixed-interval variable-ratio schedules and the matching relation.

    abstract::Five rats responded under concurrent fixed-interval variable-ratio schedules of food reinforcement. Fixed-interval values ranged from 50-seconds to 300-seconds and variable-ratio values ranged from 30 to 360; a five-second changeover delay was in effect throughout the experiment. The relations between reinforcement ra...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1981.36-317

    authors: Rider DP

    更新日期:1981-11-01 00:00:00

  • Responses and pauses: discrimination and a choice catastrophe.

    abstract::Pigeons produced a stimulus change either by responding or by not responding for a specified time period (by pausing). They then had to choose between two responses to obtain food. One choice was correct if the first component had been completed by a response; the other was correct if the component had been completed ...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1982.37-223

    authors: Zeiler MD,Solano JM

    更新日期:1982-03-01 00:00:00

  • Instructed versus shaped human verbal behavior: Interactions with nonverbal responding.

    abstract::Undergraduate students' presses on left and right buttons occasionally made available points exchangeable for money. Blue lights over the buttons were correlated with multiple random-ratio random-interval components; usually, the random-ratio schedule was assigned to the left button and the random-interval to the righ...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1982.38-233

    authors: Catania AC,Matthews BA,Shimoff E

    更新日期:1982-11-01 00:00:00

  • Fixed-interval limited-hold avoidance with and without signalled reinforcement.

    abstract::Rats trained to lever press on a fixed-interval limited-hold avoidance schedule maintained a pattern of responding similar to that maintained by fixed-interval limited-hold schedules of positive reinforcement. But this positively accelerated pattern of behavior was maintained only when the occurrence of reinforcement ...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1972.17-75

    authors: Black RE,Walters GC,Webster CD

    更新日期:1972-01-01 00:00:00