Negative reinforcement as shock-frequency reduction.

Abstract:

:Is a conditioned aversive stimulus necessary in avoidance conditioning? Or is a reduction in the rate of aversive stimulation alone sufficient to generate and maintain an avoidance response? Rats were subjected to an avoidance procedure in which shocks occurred randomly in time, but a response could reduce the overall rate of shock. Fifteen acquisition curves, obtained from 16 animals, showed both immediate and delayed, rapid and gradual increases in response rate; there was no representative acquisition curve. Response rates were directly related to the amount by which the response reduced shock frequency. In extinction, when shock rates were not affected by responding, the response total was inversely related to the amount by which the response had reduced shock frequency during prior conditioning, with as many as 20,000 extinction responses when the shock frequency reduction had been relatively small. Responding on this procedure shows that avoidance conditioning can occur without benefit of either classical exteroceptive stimuli or covert stimuli inferred from the temporal constancies of a procedure. It also shows that reduction in shock rate is alone sufficient to maintain avoidance.

journal_name

J Exp Anal Behav

authors

Herrnstein RJ,Hineline PN

doi

10.1901/jeab.1966.9-421

subject

Has Abstract

pub_date

1966-07-01 00:00:00

pages

421-30

issue

4

eissn

0022-5002

issn

1938-3711

journal_volume

9

pub_type

杂志文章
  • Behavioral control by an imprinted stimulus: long-term effects.

    abstract::Newly hatched ducklings were exposed to imprinting procedures and subsequently trained to peck a key by presenting the imprinting stimulus as the reinforcing (response-contingent) event. Individual ducklings then lived in the apparatus under an arrangement in which each peck produced a 15-sec stimulus presentation. Fo...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1967.10-495

    authors: Hoffman HS,Kozma F Jr

    更新日期:1967-09-01 00:00:00

  • Levels of aggregation: Relative time allocation in concurrent-schedule performance.

    abstract::The proportion of time allocated to one component of a concurrent variable-interval variable-interval schedule was computed for groups of interchangeover times (aggregates) within several intact time series. Variability in obtained proportions decreased as the number of interchangeover times within each aggregate incr...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1985.43-97

    authors: Real PG,Dreyfus LR

    更新日期:1985-01-01 00:00:00

  • Knowing before doing: discrimination by rats of a brief interruption of a tone.

    abstract::Eight rats' lever presses were reinforced after an interruption in a tone, provided the lever had not been pressed before the tone interruption. After a few sessions, long before the animals reliably refrained from lever pressing before the interruption, the latencies of postinterruption presses (time from the termina...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1984.41-329

    authors: Eisler H

    更新日期:1984-05-01 00:00:00

  • Schedules of electric shock presentation in the behavioral control of imprinted ducklings.

    abstract::The behavioral effects of various schedules of electric shock presentation were investigated during and after the imprinting of Peking ducklings to moving stimuli. The behavior of following a moving imprinted stimulus was differentially controlled by a multiple schedule of punishment and avoidance that respectively su...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1972.18-305

    authors: Barrett JE

    更新日期:1972-09-01 00:00:00

  • Substitution and caloric regulation in a closed economy.

    abstract::Three experiments were conducted to study the effect of an imperfect substitute for food on demand for food in a closed economy. In Experiments 1 and 2, rats pressed a lever for their entire daily food ration, and a fixed ratio of presses was required for each food pellet. In both experiments, the fixed ratio was held...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1996.65-401

    authors: Bauman RA,Raslear TG,Hursh SR,Shurtleff D,Simmons L

    更新日期:1996-03-01 00:00:00

  • An evaluation of a visual-visual successive matching-to-sample procedure to establish equivalence classes in adults.

    abstract::Traditionally, behavior analysts have studied stimulus equivalence using a matching-to-sample (MTS) preparation. Although researchers have shown the utility of MTS to yield equivalence classes, the procedure requires several prerequisite skills for a learner to accurately respond. Previous research with humans and non...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1002/jeab.326

    authors: Lantaya CA,Miguel CF,Howland TG,LaFrance DL,Page SV

    更新日期:2018-05-01 00:00:00

  • Social discounting and the prisoner's dilemma game.

    abstract::Altruistic behavior has been defined in economic terms as "…costly acts that confer economic benefits on other individuals" (Fehr & Fischbacher, 2003). In a prisoner's dilemma game, cooperation benefits the group but is costly to the individual (relative to defection), yet a significant number of players choose to coo...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1002/jeab.3

    authors: Locey ML,Safin V,Rachlin H

    更新日期:2013-01-01 00:00:00

  • Conjunctive schedules of reinforcement II: response requirements and stimulus effects.

    abstract::Responding of three pigeons was maintained under conjunctive fixed-ratio, fixed-interval schedules where a key peck produced food after both schedule requirements were completed. The individual schedule requirements were then successively removed and reinstated with responding maintained under the following conditions...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1975.24-23

    authors: Barrett JE

    更新日期:1975-07-01 00:00:00

  • The effect of a pre-shock signal on a free-operant avoidance response.

    abstract::After 25 free-operant avoidance training sessions, a 1-min signal followed by a brief shock was presented on the average of once every 4 min. During the signal, the avoidance schedule was suspended (20 sessions). Response rates during the signal were markedly reduced. Shock rates during non-signalled periods increased...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1970.14-331

    authors: Roberts AE,Hurwitz HM

    更新日期:1970-11-01 00:00:00

  • Relations among acute and chronic nicotine administration, short-term memory, and tactics of data analysis.

    abstract::Emerging evidence suggests that nicotine may enhance short-term memory. Some of this evidence comes from nonhuman primate research using a procedure called delayed matching-to-sample, wherein the monkey is trained to select a comparison stimulus that matches some physical property of a previously presented sample stim...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.2012.98-155

    authors: Kangas BD,Branch MN

    更新日期:2012-09-01 00:00:00

  • Effects of response preference on resistance to change.

    abstract::Treatments based on differential reinforcement of alternative behavior, such as functional communication training, are widely used. Research regarding the maintenance of related treatment effects is limited. Nevin and Wacker (2013) provided a conceptual framework, rooted in behavioral momentum theory, for the study of...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1002/jeab.308

    authors: Ringdahl JE,Berg WK,Wacker DP,Crook K,Molony MA,Vargo KK,Neurnberger JE,Zabala K,Taylor CJ

    更新日期:2018-01-01 00:00:00

  • A multivariate rate equation for variable-interval performance.

    abstract::A value-like parameter is introduced into a rate equation for describing variable-interval performance. The equation, derived solely from formal considerations, expresses rate of responding as a joint function of rate of reinforcement and "reinforcer power." Preliminary tests of the rate equation show that it handles ...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1979.31-267

    authors: McDowell JJ,Kessel R

    更新日期:1979-03-01 00:00:00

  • Conditioned reinforcement as a function of duration of stimulus.

    abstract::Pigeons were provided with three keys. Pecking the center key produced grain on a schedule that alternated at unpredictable times between a variable-interval component and extinction. On concurrent variable-interval schedules, pecking either side key produced a stimulus associated with the variable-interval component ...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1981.36-41

    authors: Dinsmoor JA,Mulvaney DE,Jwaideh AR

    更新日期:1981-07-01 00:00:00

  • Dynamic response-by-response models of matching behavior in rhesus monkeys.

    abstract::We studied the choice behavior of 2 monkeys in a discrete-trial task with reinforcement contingencies similar to those Herrnstein (1961) used when he described the matching law. In each session, the monkeys experienced blocks of discrete trials at different relative-reinforcer frequencies or magnitudes with unsignalle...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.2005.110-04

    authors: Lau B,Glimcher PW

    更新日期:2005-11-01 00:00:00

  • Human coffee drinking: manipulation of concentration and caffeine dose.

    abstract::In a residential research ward coffee drinking was studied in 9 volunteer human subjects with histories of heavy coffee drinking. A series of five experiments was undertaken to characterize adlibitum coffee consumption and to investigate the effects of manipulating coffee concentration, caffeine dose per cup, and caff...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 临床试验,杂志文章,随机对照试验

    doi:10.1901/jeab.1986.45-133

    authors: Griffiths RR,Bigelow GE,Liebson IA,O'Keeffe M,O'Leary D,Russ N

    更新日期:1986-03-01 00:00:00

  • Classical conditioning of courting behavior in the Japanese quail, Coturnix coturnix japonica.

    abstract::Male Japanese quail were classically conditioned to display courting behavior at the sound of a buzzer, a previously neutral stimulus. The buzzer (conditioned stimulus) was paired with the presentation of a female quail (unconditioned stimulus) for a number of trials. The courting display, invariably elicited from the...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1967.10-213

    authors: Farris HE

    更新日期:1967-03-01 00:00:00

  • Preference in rhesus monkeys given a choice between cocaine and d,l-cathinone.

    abstract::Previous experiments have shown that both cocaine and d,l-cathinone can function as positive reinforces when delivered intravenously to rhesus monkeys. However, the relative reinforcing efficacies of these compounds have not been established. In the present experiment, three rhesus monkeys were allowed to choose betwe...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1984.41-i35

    authors: Woolverton WL,Johanson CE

    更新日期:1984-01-01 00:00:00

  • Discrimination learning in a foraging situation.

    abstract::Rats were allowed to forage in a simulated natural environment made up of eight food sources (patches) each containing a fixed number of pellets. Two of the eight contained an extra supply of peanuts. The peanut patches were signaled by an olfactory/visual cue located at the bottom of the ladder leading to the patch. ...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1988.50-493

    authors: Mellgren RL,Brown SW

    更新日期:1988-11-01 00:00:00

  • Effects of signaled and unsignaled shock on schedule-controlled lever pressing and schedule-induced licking: Shock intensity and body weight.

    abstract::Schedule-controlled lever pressing and schedule-induced licking were studied in rats under a multiple fixed-interval fixed-interval schedule of food reinforcement. Following acquisition of stable rates of pressing and licking, a multiple variable-time variable-time schedule of electric-shock delivery was superimposed ...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1981.35-197

    authors: Hymowitz N

    更新日期:1981-03-01 00:00:00

  • Choosing among natural stimuli.

    abstract::Pigeons worked on concurrent variable-interval, variable-interval schedules with the alternatives signaled by slides either containing trees or not. The schedules were designed to hold both overall and relative rates of reinforcement within narrowly constrained limits, and slides were quasi-randomly ordered each day. ...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1987.47-5

    authors: Vaughan W,Herrnstein RJ

    更新日期:1987-01-01 00:00:00

  • Discrimination learning, the peak shift, and behavioral contrast.

    abstract::A discrimination between two successively alternating stimuli was trained under conditions that maintained equal frequencies of reinforcement in the presence of each of the discriminative stimuli (S1 and S2) but that also reduced the rate of responding to S2. These conditions included a multiple variable-interval diff...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1968.11-727

    authors: Terrace HS

    更新日期:1968-11-01 00:00:00

  • An operant analysis of human altruistic responding.

    abstract::Human altruistic responding (called give responding), which delivered a reinforcer to someone other than the responder, was compared to responding where the responder was the recipient of the reinforcer (called earn responding). The same type of response (button pressing), the same reinforcer (a point representing a p...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1977.27-515

    authors: Weiner H

    更新日期:1977-05-01 00:00:00

  • The effect of reinforcer delays on the form of the forgetting function.

    abstract::Pigeons were trained in a matching-to-sample procedure with retention intervals of 0, 2, 4, 6, and 8 s mixed within each session. In different conditions, reinforcement was delayed by 0, 1, 2, 4, 6, or 8 s from correct choice responses. Discriminability decreased with increasing retention-interval duration and with in...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.2003.80-77

    authors: Sargisson RJ,White KG

    更新日期:2003-07-01 00:00:00

  • Emergent stimulus relations depend on stimulus correlation and not on reinforcement contingencies.

    abstract::We aimed to investigate whether novel stimulus relations would emerge from stimulus correlations when those relations explicitly conflicted with reinforced relations. In a symbolic matching-to-sample task using kanji characters as stimuli, we arranged class-specific incorrect comparison stimuli in each of three classe...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.2011.95-327

    authors: Minster ST,Elliffe D,Muthukumaraswamy SD

    更新日期:2011-05-01 00:00:00

  • Early extinction effects following intermittent reinforcement: Little evidence of extinction bursts.

    abstract::The occurrence of extinction bursts-transient increases in response rate in excess of those observed in baseline during the period immediately following discontinuation of reinforcement of a response-was examined. In Experiment 1, key pecking of pigeons was reinforced according to a multiple schedule in which a variab...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1002/jeab.616

    authors: Lattal KA,Kuroda T,Cook JE

    更新日期:2020-07-01 00:00:00

  • An experimental analysis of memory processing.

    abstract::Rhesus monkeys were trained and tested in visual and auditory list-memory tasks with sequences of four travel pictures or four natural/environmental sounds followed by single test items. Acquisitions of the visual list-memory task are presented. Visual recency (last item) memory diminished with retention delay, and pr...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.2007.88-405

    authors: Wright AA

    更新日期:2007-11-01 00:00:00

  • Controls for and constraints on auto-shaping.

    abstract::Auto-shaping the pigeon's key-peck response was examined as a respondent conditioning procedure with the use of Rescorla's truly-random control procedure. In the first experiment, pigeons received presentations of brief light on the response key and brief presentations of food where the light and the food were indepen...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1973.20-323

    authors: Bilbrey J,Winokur S

    更新日期:1973-11-01 00:00:00

  • Elicitation and punishment of intraspecies aggression by the same stimulus.

    abstract::Fighting responses were elicited in pairs of rats by shocks over a period of 46 days. During certain blocks of these days, "punishing" shocks were made contingent on the shock-elicited fights. Fighting frequency was reduced as a direct function of the intensity of the contingent shocks. Fighting frequency recovered co...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1971.15-193

    authors: Roberts CL,Blase K

    更新日期:1971-03-01 00:00:00

  • Stock optimizing: maximizing reinforcers per session on a variable-interval schedule.

    abstract::In Experiment 1, 2 monkeys earned their daily food ration by pressing a key that delivered food according to a variable-interval 3-min schedule. In Phases 1 and 4, sessions ended after 3 hr. In Phases 2 and 3, sessions ended after a fixed number of responses that reduced food intake and body weights from levels during...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1993.59-389

    authors: Silberberg A,Bauman R,Hursh S

    更新日期:1993-03-01 00:00:00

  • Nicotine deprivation, temporal discounting and choice consistency in heavy smokers.

    abstract::The subjective value of rewards declines the longer rewards are delayed into the future ("delay discounting"). Discounting behavior varies both as a function of an individual's trait and current state. The degree of discounting has repeatedly been associated with relapse following treatment of addiction. Therefore, th...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1002/jeab.134

    authors: Roewer I,Wiehler A,Peters J

    更新日期:2015-01-01 00:00:00