Differential reinforcement of alternative behavior increases resistance to extinction: clinical demonstration, animal modeling, and clinical test of one solution.

Abstract:

:Basic research with pigeons on behavioral momentum suggests that differential reinforcement of alternative behavior (DRA) can increase the resistance of target behavior to change. This finding suggests that clinical applications of DRA may inadvertently increase the persistence of target behavior even as it decreases its frequency. We conducted three coordinated experiments to test whether DRA has persistence-strengthening effects on clinically significant target behavior and then tested the effectiveness of a possible solution to this problem in both a nonhuman and clinical study. Experiment 1 compared resistance to extinction following baseline rates of reinforcement versus higher DRA rates of reinforcement in a clinical study. Resistance to extinction was substantially greater following DRA. Experiment 2 tested a rat model of a possible solution to this problem. Training an alternative response in a context without reinforcement of the target response circumvented the persistence-strengthening effects of DRA. Experiment 3 translated the rat model into a novel clinical application of DRA. Training an alternative response with DRA in a separate context resulted in lower resistance to extinction than employing DRA in the context correlated with reinforcement of target behavior. The value of coordinated bidirectional translational research is discussed.

journal_name

J Exp Anal Behav

authors

Mace FC,McComas JJ,Mauro BC,Progar PR,Taylor B,Ervin R,Zangrillo AN

doi

10.1901/jeab.2010.93-349

subject

Has Abstract

pub_date

2010-05-01 00:00:00

pages

349-67

issue

3

eissn

0022-5002

issn

1938-3711

journal_volume

93

pub_type

杂志文章
  • Effects of reinforcement magnitude on interval and ratio schedules.

    abstract::Rats' lever pressing was studied on three schedules of reinforcement: fixed interval, response-initiated fixed interval, and fixed ratio. In testing, concentration of the milk reinforcer was varied within each session. On all schedules, duration of the postreinforcement pause was an increasing function of the concentr...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1974.22-553

    authors: Lowe CF,Davey GC,Harzem P

    更新日期:1974-11-01 00:00:00

  • Do adjusting-amount and adjusting-delay procedures produce equivalent estimates of subjective value in pigeons?

    abstract::The current experiment examined whether adjusting-amount and adjusting-delay procedures provide equivalent measures of discounting. Pigeons' discounting on the two procedures was compared using a within-subject yoking technique in which the indifference point (number of pellets or time until reinforcement) obtained wi...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.2007.37-06

    authors: Green L,Myerson J,Shah AK,Estle SJ,Holt DD

    更新日期:2007-05-01 00:00:00

  • An eight-alternative concurrent schedule: foraging in a radial maze.

    abstract::In two experiments conducted in an eight-arm radial maze, food pellets were delivered when a photocell beam was broken at the end of each arm via a nose poke, according to either fixed-interval or random-interval schedules of reinforcement, with each arm providing a different frequency of reinforcement. The behavior o...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1994.61-331

    authors: Elsmore TF,McBride SA

    更新日期:1994-05-01 00:00:00

  • Brief-stimulus presentations on multiform tandem schedules.

    abstract::Three experiments examined the influence of a brief stimulus (a light) on the behavior of food-deprived rats whose lever pressing on tandem schedules comprising components of different schedule types resulted in food presentation. In Experiment 1, either a tandem variable-ratio variable-interval or a tandem variable-i...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1994.61-417

    authors: Reed P

    更新日期:1994-05-01 00:00:00

  • Choice with frequently changing food rates and food ratios.

    abstract::In studies of operant choice, when one schedule of a concurrent pair is varied while the other is held constant, the constancy of the constant schedule may exert discriminative control over performance. In our earlier experiments, schedules varied reciprocally across components within sessions, so that while food rati...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1002/jeab.70

    authors: Baum WM,Davison M

    更新日期:2014-03-01 00:00:00

  • Preference for free or forced choice in Sumatran orangutans (Pongo abelii).

    abstract::Empirical investigations of humans, pigeons, rats, and monkeys have indicated that these species will select free over forced choice, even when faced with identical outcomes. However, the same has yet to be quantitatively confirmed in nonhuman great apes. This experiment is the first systematic investigation of prefer...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1002/jeab.584

    authors: Ritvo SE,MacDonald SE

    更新日期:2020-03-01 00:00:00

  • Delayed choice responding by pigeons when the correct response is not predictable from the sample stimulus.

    abstract::Food-deprived pigeons were presented with a row of four response keys situated above a grain hopper aperture. At the start of a trial, three of four keys were randomly selected and illuminated white for six seconds. After a variable blackout period, one of the three previously white keys and the previously dark key we...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1982.37-57

    authors: Smith JP,Attwood JC,Niedorowski L

    更新日期:1982-01-01 00:00:00

  • Rats' lever-press durations as psychophysical judgements of time.

    abstract::Hungry rats received food following lever-press durations exceeding a minimum value, which ranged from 0 to 6.4 sec. When no intertrial intervals separated successive presses, modal press durations remained at very short values as the minimum value required for food was increased. This was particularly true immediatel...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1973.19-239

    authors: Platt JR,Kuch DO,Bitgood SC

    更新日期:1973-03-01 00:00:00

  • Bouts of responding on variable-interval schedules: effects of deprivation level.

    abstract::Rats obtained food pellets on a variable-interval schedule of reinforcement by nose poking a lighted key. After training to establish baseline performance (with the mean variable interval set at either 60, 120, or 240 s), the rats were given free access to food during the hour just before their daily session. This sat...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.2004.81-155

    authors: Shull RL

    更新日期:2004-03-01 00:00:00

  • Assessing potential reinforcement-like effects of brief stimuli unrelated to food reinforcers.

    abstract::It is widely assumed that reinforcers are biologically relevant stimuli, or stimuli that have been associated with biologically relevant stimuli. However, brief, arbitrary stimuli have also been reported to have reinforcement-like effects, despite being unrelated to biologically relevant stimuli like food. The present...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1002/jeab.580

    authors: Bai JYH,Cowie S,Macaskill AC,Elliffe D,Podlesnik CA

    更新日期:2020-03-01 00:00:00

  • Stochastic choice models: A comparison between Bush-Mosteller and a source-independent reward-following model.

    abstract::Horner and Staddon (1987) argued that a class of reward-following processes defined by a property they termed ratio invariance is a better model for the probabilistic choice performance of pigeons than competing molecular accounts such as momentary maximizing, melioration, and the Bush-Mosteller model. The critical da...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1989.52-57

    authors: Staddon JE,Horner JM

    更新日期:1989-07-01 00:00:00

  • Factors influencing inhibitory stimulus control: differential reinforcement of other behavior during discrimination training.

    abstract::Pigeons were trained to respond on a multiple variable-interval 1-min variable-interval 1-min schedule, then switched to a multiple variable-interval 1-min differential-reinforcement-of-other-behavior discrimination training. The rate of reinforcement was held constant during the shift from non-differential reinforcem...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1970.14-87

    authors: Weisman RG

    更新日期:1970-07-01 00:00:00

  • An analysis of rats' drinking-tube contacts under tandem and fixed-interval schedules of food presentation.

    abstract::Rats' lever presses and drinking-tube contacts were studied under fixed-interval schedules of food presentation and under a tandem schedule composed of three fixed intervals. One group of rats was exposed first to the tandem schedule, next to fixed-interval schedules of comparable interpellet intervals, and once again...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1976.25-361

    authors: McLeod DR,Gollub LR

    更新日期:1976-05-01 00:00:00

  • Discrimination of methadone and cocaine by pigeons without explicit discrimination training.

    abstract::Pigeons were trained to peck a key on a variable-interval 2-min schedule of food reinforcement. Prior to each session, either 2.0 mg/kg methadone (n = 3), 3.0 mg/kg cocaine (n = 4), or 5.6 mg/kg cocaine (n = 2) was administered. When each pigeon's rate of pecking was stable, a range of doses of the training drug and s...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1996.66-193

    authors: Schaal DW,McDonald MP,Miller MA,Reilly MP

    更新日期:1996-09-01 00:00:00

  • Signal probability, reinforcement and signal detection.

    abstract::Five pigeons were trained to detect differences in light intensity. Two stimuli, S1 and S2, differing in intensity, were arranged on the center key of a three-key chamber according to set probabilities. A peck on the center key turned on the two side keys. When S1 was presented on the center key, a peck on the left ke...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1979.32-373

    authors: McCarthy D,Davison M

    更新日期:1979-11-01 00:00:00

  • Impulsivity, risk-taking, and distractibility in rats exhibiting robust conditioned orienting behaviors.

    abstract::When a neutral cue is followed by a significant event such as food delivery, some animals become engaged with the cue itself and acquire cue-directed behaviors. One type of cue-directed behavior is observed following insertion of a lever used as a conditioned stimulus (CS). Rats showing robust approach behavior to the...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1002/jeab.104

    authors: Olshavsky ME,Shumake J,Rosenthal AA,Kaddour-Djebbar A,Gonzalez-Lima F,Setlow B,Lee HJ

    更新日期:2014-09-01 00:00:00

  • Experimental control of superstitious responding inhumans.

    abstract::Superstitions were demonstrated with human subjects when presses on one button were reinforced on a VI 30-sec schedule while presses on a second were never reinforced. Superstitious responding, on the second button, was often maintained because presses on that button were frequently followed by reinforcement for a sub...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1963.6-203

    authors: CATANIA AC,CUTTS D

    更新日期:1963-04-01 00:00:00

  • Concurrent schedules of interresponse time reinforcement: probability of reinforcement and the lower bounds of the reinforced interresponse time intervals.

    abstract::Data were obtained with rats on the effects of interresponse time contingent reinforcement of the lever press response using schedules in which interresponse times falling within either of two temporal intervals could be reinforced. Some of the findings were (a) the mode of the interresponse time distribution generall...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1966.9-317

    authors: Malott RW,Cumming WW

    更新日期:1966-07-01 00:00:00

  • THE EFFECT OF MULTIPLE S-DELTA PERIODS ON RESPONDING ON A FIXED-INTERVAL SCHEDULE. II. IN A PRIMATE.

    abstract::A squirrel monkey was subjected to a fixed-interval pattern of reinforcement. During the course of each interval a bright white light was repeatedly presented. In the presence of the white light, a response was never immediately followed by food; the white light thus functioned as S(Delta). Responding was interrupted ...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1965.8-53

    authors: DEWS PB

    更新日期:1965-01-01 00:00:00

  • Behavioral interactions in multiple variable-interval schedules.

    abstract::In Experiment I, two groups of four pigeons each were exposed to multiple schedules in which one component was always a variable-interval schedule with a mean interreinforcement interval of 30 or 180 seconds. The other component was either an equal variable-interval schedule or extinction. Response rates in the unchan...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1974.22-471

    authors: Spealman RD,Gollub LR

    更新日期:1974-11-01 00:00:00

  • A comparison of ratio and interval reinforcement schedules with comparable interreinforcement times.

    abstract::Pigeons were trained to peck keys on fixed-ratio and fixed-interval schedules of food reinforcement. Both schedules produced a pattern of behavior characterized as pause and run, but the relation of pausing to time between reinforcers differed for the two schedules even when mean time between reinforcers was the same....

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1980.34-61

    authors: Capehart GW,Eckerman DA,Guilkey M,Shull RL

    更新日期:1980-07-01 00:00:00

  • Social learning by following: an analysis.

    abstract::Learning by "following", probably a common means by which behaviors are socially transmitted from adults to young in many species, was analyzed. Pigeons first learned to eat from a human hand. When the hand then approached an operant key and pecked it, the pigeons followed and quickly learned to do the same, thereby d...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1977.27-127

    authors: Bullock D,Neuringer A

    更新日期:1977-01-01 00:00:00

  • A re-examination of local contrast in multiple schedules.

    abstract::Pigeons were presented with multiple schedules of alternating 90-sec components. When components in which grain was never presented alternated with components in which grain was presented on a variable-interval schedule, the average rate of responding in the variable-interval components increased, showing overall posi...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1975.24-291

    authors: Buck SL,Rothstein B,Williams BA

    更新日期:1975-11-01 00:00:00

  • Key pecking in pigeons produced by pairing keylight with inaccessible grain.

    abstract::In Experiment I, keylight was paired with inaccessible grain delivery (under two conditions of keylight intensity) to determine if autoshaping would occur in the absence of primary reinforcement. In Experiment II, the procedure was repeated with accessible grain, for comparison. In Experiment III, the procedures were ...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1975.23-199

    authors: Zentall TR,Hogan DE

    更新日期:1975-03-01 00:00:00

  • The utility of verbal and behavioral assessments of value.

    abstract::Subjects lived in a laboratory apartment for up to 30 days, engaging in ordinary activities such as reading, sewing, and artwork. The amount of time devoted to each activity was recorded and compared with periodic verbal ratings of the amount of time devoted to the activities. The verbal and observational assessments ...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1990.54-173

    authors: Bernstein DJ,Michael RL

    更新日期:1990-11-01 00:00:00

  • OPERANT CONDITIONING OF GOATS.

    abstract::A procedure is described for establishing an operant response in goats. The operanda are two lucite panels which can be transilluminated. The goats press the panels with their muzzles and are reinforced with whole oats. All six subjects showed reliable and accurate performance in brightness discrimination, including c...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1964.7-263

    authors: WENZEL BM,BALDWIN BA,TSCHIRGI RD

    更新日期:1964-05-01 00:00:00

  • Analysis of fixed-ratio behavior maintained by drug reinforcers.

    abstract::Behavior maintained by intravenously delivered alfentanil, cocaine, or ketamine was assessed using a fixed-ratio schedule of reinforcement. As the dose of each drug was increased, rate of responding also increased up to a maximum. Further increases in dose resulted in decreased response rates (inverted U-shaped curve)...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1991.56-331

    authors: Skjoldager P,Winger G,Woods JH

    更新日期:1991-09-01 00:00:00

  • Delay discounting of different outcomes: Review and theory.

    abstract::Steep delay discounting is characterized by a preference for small immediate outcomes relative to larger delayed outcomes and is predictive of drug abuse, risky sexual behaviors, and other maladaptive behaviors. Nancy M. Petry was a pioneer in delay discounting research who demonstrated that people discount delayed mo...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1002/jeab.589

    authors: Odum AL,Becker RJ,Haynes JM,Galizio A,Frye CCJ,Downey H,Friedel JE,Perez DM

    更新日期:2020-05-01 00:00:00

  • Group behavior of rats under schedules of reinforcement.

    abstract::Groups of three rats were placed in a chamber containing one response lever and one water dispenser. A variety of schedule conditions were explored including fixed ratio, extinction, satiation, fixed interval, fixed time, differential reinforcement of low rates, and discrimination learning. Each group was treated as a...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1974.22-311

    authors: Grott R,Neuringer A

    更新日期:1974-09-01 00:00:00

  • Successive reversals of a classically conditioned heart-rate discrimination.

    abstract::Rats were trained to criterion in successive reversals of a classically conditioned heart-rate discrimination. Criterion was attained more rapidly in the later reversals in the series than in the early reversals and the inter-problem learning curve was of the same general form as that found with successive instrumenta...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1968.11-199

    authors: Tighe TJ,Graves DM,Riley CA

    更新日期:1968-03-01 00:00:00