Shaping behavioral patterns.

Abstract:

:Pigeons were rewarded for distributing eight pecks across two keys (L and R) in various patterns. The simplest pattern was at least one switch between the two keys (LR or RL) anywhere during the sequence; the next simplest was at least one instance of LLRR or RRLL anywhere during the sequence; the next was LLLRRR or RRRLLL; the most complex was LLLLRRRR or RRRRLLLL. Note that each more complex pattern contains the simpler ones within it. Initially, all patterns were reinforced but amount of reinforcement varied directly with complexity of pattern. The pigeons typically began the eight-peck sequence by pecking on their dispreferred key and then switched to their preferred key during the sequence. In subsequent conditions, simpler patterns were progressively unreinforced until finally only the most complex pattern (exactly four pecks on one key followed by exactly four pecks on the other) was reinforced. Three of the 4 pigeons tested maintained responding under this contingency; responding of the 4th pigeon extinguished. A second group of 4 pigeons was exposed immediately after training to extinction of all patterns except the most complex one. Three of the pigeons failed to maintain responding and the 4th maintained responding at a very low level. These results are evidence that response patterns can be shaped directly without building them up from a sequence of individually reinforced responses. The results may serve as a model of how self-controlled and altruistic behavior can arise through reinforcement.

journal_name

J Exp Anal Behav

authors

Locey ML,Rachlin H

doi

10.1002/jeab.22

subject

Has Abstract

pub_date

2013-05-01 00:00:00

pages

245-59

issue

3

eissn

0022-5002

issn

1938-3711

journal_volume

99

pub_type

杂志文章
  • A decision model for steady-state choice in concurrent chains.

    abstract::Grace and McLean (2006) proposed a decision model for acquisition of choice in concurrent chains which assumes that after reinforcement in a terminal link, subjects make a discrimination whether the preceding reinforcer delay was short or long relative to a criterion. Their model was subsequently extended by Christens...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.2010.94-227

    authors: Christensen DR,Grace RC

    更新日期:2010-09-01 00:00:00

  • The generality of selective observing.

    abstract::Four rats obtained food pellets by poking a key and 5-s presentations of the discriminative stimuli by pressing a lever. Every 1 or 2 min, the prevailing schedule of reinforcement for key poking alternated between rich (either variable-interval [VI] 30 s or VI 60 s) and lean (either VI 240 s, VI 480 s, or extinction) ...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.2002.77-171

    authors: Gaynor ST,Shull RL

    更新日期:2002-03-01 00:00:00

  • Effects of point-loss punishers on human signal-detection performance.

    abstract::Three experiments using human participants varied the distribution of point-gain reinforcers or point-loss punishers in two-alternative signal-detection procedures. Experiment 1 varied the distribution of point-gain reinforcers for correct responses (Group A) and point-loss punishers for errors (Group B) across condit...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.2009.92-17

    authors: Lie C,Alsop B

    更新日期:2009-07-01 00:00:00

  • Time reallocation in a multiresponse environment: Effects of restricting response classes.

    abstract::Four adult male rats were each placed for three hours daily into an apparatus that provided individual compartments for six separate location-defined responses. The available responses consisted of: (1) the opportunity to turn off room lighting, producing darkness; (2) the opportunity to view a female rat; (3) the opp...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1984.41-279

    authors: Lyons CA,Cheney CD

    更新日期:1984-05-01 00:00:00

  • Successive incrementing non-matching-to-samples in rats: An automated version of the odor span task.

    abstract::The odor span task is a procedure frequently used to study remembering of multiple stimuli in rodents. A large arena is used and odor stimuli are presented using scented cups. Selection of each odor is reinforced when first presented, but not on subsequent presentations; correct selections depend on remembering which ...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1002/jeab.619

    authors: Galizio M,Mason MG,Bruce K

    更新日期:2020-09-01 00:00:00

  • Transient effects of acquisition history on generalization in a matching-to-sample task.

    abstract::This study examined the role of learning history on the acquisition of a matching-to-sample task. Twelve preschool children learned four stimulus classes through instructions, shaping, or imitation. After reaching criterion, the subjects were exposed to changed discrimination contingencies to determine how each learni...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1991.56-155

    authors: Michael RL,Bernstein DJ

    更新日期:1991-07-01 00:00:00

  • Associative interaction: joint control of key pecking by stimulus-reinforcer and response-reinforcer relationships.

    abstract::The joint control of rate of key pecking in pigeons by stimulus-reinforcer and response-reinforcer relationships was studied in the context of a two-component multiple schedule of reinforcement. Food presentation was always associated with one component and extinction with the other. The stimulus-reinforcer relationsh...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1977.28-133

    authors: Woodruff G,Conner N,Gamzu E,Williams DR

    更新日期:1977-09-01 00:00:00

  • The magnitude-of-reinforcement function in closed and open economies.

    abstract::It has been hypothesized that the magnitude-of-reinforcement effect may differ in closed and open experimental economies. We determined the relationship between magnitude of reinforcement and response rate in three feeding conditions: a closed economy in which total intake was unrestricted, a closed economy in which t...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 临床试验,杂志文章

    doi:10.1901/jeab.1992.57-81

    authors: Collier G,Johnson DF,Morgan C

    更新日期:1992-01-01 00:00:00

  • A theory of attending and reinforcement in conditional discriminations.

    abstract::A model of conditional discrimination performance (Davison & Nevin, 1999) is combined with the notion that unmeasured attending to the sample and comparison stimuli, in the steady state and during disruption, depends on reinforcement in the same way as predicted for overt free-operant responding by behavioral momentum...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.2005.97-04

    authors: Nevin JA,Davison M,Shahan TA

    更新日期:2005-09-01 00:00:00

  • On the classic and modern theories of matching.

    abstract::Classic matching theory, which is based on Herrnstein's (1961) original matching equation and includes the well-known quantitative law of effect, is almost certainly false. The theory is logically inconsistent with known experimental findings, and experiments have shown that its central constant-k assumption is not te...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.2005.59-04

    authors: McDowell JJ

    更新日期:2005-07-01 00:00:00

  • Differential antagonism of cocaine self-administration and cocaine-induced disruptions of learning by haloperidol in rhesus monkeys.

    abstract::Six rhesus monkeys responding under a three-component multiple schedule were administered haloperidol to determine its effects on cocaine self-administration and on cocaine's disruptive effects on the repeated acquisition and performance of response chains. In the absence of haloperidol, 0.0032-0.032 mg/kg/infusion of...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.2008.89-225

    authors: Winsauer PJ,Moerschbaecher JM,Roussell AM

    更新日期:2008-03-01 00:00:00

  • Criticisms of the satiety hypothesis as an explanation for within-session decreases in responding.

    abstract::The authors of four papers recently reported that satiation provides a better explanation than habituation for within-session decreases in conditioned responding. Several arguments question this conclusion. First, the contribution of habituation to within-session changes in responding seems clearly established. Inform...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.2000.74-347

    authors: McSweeney FK,Murphy ES

    更新日期:2000-11-01 00:00:00

  • Arbitrary conditional discriminative functions of meaningful stimuli and enhanced equivalence class formation.

    abstract::Equivalence class formation by college students was influenced through the prior acquisition of conditional discriminative functions by one of the abstract stimuli (C) in the to-be-formed classes. Participants in the GR-0, GR-1, and GR-5 groups attempted to form classes under the simultaneous protocol, after mastering...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1002/jeab.141

    authors: Nedelcu RI,Fields L,Arntzen E

    更新日期:2015-03-01 00:00:00

  • Comparisons between one-key and two-key versions of the sinewave schedule for pigeons.

    abstract::When the rate of reinforcement for pigeons' key pecking varied over time following a sine waveform, performances were more consistent and reliable if a constant-rate reinforcement schedule was concurrently available on a second key than if only the sinewave-varying reinforcement schedule was available. In the two-key ...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1982.38-101

    authors: Johnson DF,Wheeler HP

    更新日期:1982-07-01 00:00:00

  • Patterns of responding within sessions.

    abstract::Rates of responding changed systematically across sessions for rats pressing levers and keys and for pigeons pressing treadles and pecking keys. A bitonic function in which response rates increased and then decreased across sessions was the most common finding, although an increase in responding also occurred alone. T...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1992.58-19

    authors: McSweeney FK,Hinson JM

    更新日期:1992-07-01 00:00:00

  • Symmetry in the pigeon with sample and comparison stimuli in different locations.

    abstract::Pigeons typically do not show evidence for symmetry in two-alternative matching-to-sample but do demonstrate this emergent relation in successive (go/no-go) matching-to-sample. Because the sample and comparison stimuli are presented in the same spatial location (viz., on one key) during successive matching training an...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1002/jeab.31

    authors: Swisher M,Urcuioli PJ

    更新日期:2013-07-01 00:00:00

  • On the origins of naming and other symbolic behavior.

    abstract::We identify naming as the basic unit of verbal behavior, describe the conditions under which it is learned, and outline its crucial role in the development of stimulus classes and, hence, of symbolic behavior. Drawing upon B. F. Skinner's functional analysis and the theoretical work of G. H. Mead and L. S. Vygotsky, w...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1996.65-185

    authors: Horne PJ,Lowe CF

    更新日期:1996-01-01 00:00:00

  • REINFORCEMENT OF DRINKING BY RUNNING: EFFECT OF FIXED RATIO AND REINFORCEMENT TIME.

    abstract::Rats were required to complete varying numbers of licks (FR), ranging from 10 to 300, in order to free an activity wheel for predetermined times (CT) ranging from 2 to 20 sec. The reinforcement of drinking by running was shown both by an increased frequency of licking, and by changes in length of the burst of licking ...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1964.7-91

    authors: PREMACK D,SCHAEFFER RW,HUNDT A

    更新日期:1964-01-01 00:00:00

  • Comparison of variance and covariance patterns in parallel and serial theories of timing.

    abstract::Parallel and serial timing processes are analyzed for their account of the dynamics of intertrial responding in the peak procedure. A strictly serial model, such as the behavioral theory of timing (Killeen & Fetterman, 1988), does not fit the dynamic correlation pattern in the location and duration of the middle high-...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1992.57-393

    authors: Gibbon J,Church RM

    更新日期:1992-05-01 00:00:00

  • Effects of reinforcer magnitude on responding under differential-reinforcement-of-low-rate schedules of rats and pigeons.

    abstract::Experiment I investigated the effects of reinforcer magnitude on differential-reinforcement-of-low-rate (DRL) schedule performance in three phases. In Phase 1, two groups of rats (n = 6 and 5) responded under a DRI. 72-s schedule with reinforcer magnitudes of either 30 or 300 microl of water. After acquisition, the wa...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.2002.78-17

    authors: Doughty AH,Richards JB

    更新日期:2002-07-01 00:00:00

  • An ecological analysis of knowing by wielding.

    abstract::The ecological approach to perception, as developed by James Gibson, is described and applied to how one knows, by means of the haptic perceptual system, various properties of hand-held objects. Four sets of experiments are reviewed in which subjects reported on the extent, orientation, shape, and fractional component...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1989.52-387

    authors: Turvey MT,Solomon HY,Burton G

    更新日期:1989-11-01 00:00:00

  • European starlings are capable of discriminating subtle size asymmetries in paired stimuli.

    abstract::Small deviations from bilateral symmetry (fluctuating asymmetries) are cues to fitness differences in some animals. Therefore, researchers have considered whether animals use these small asymmetries as visual cues to determine appropriate behavioral responses (e.g., mate preferences). However, there have been few syst...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.2007.103-05

    authors: Swaddle JP,Johnson CW

    更新日期:2007-01-01 00:00:00

  • Secondary reinforcement and number of primary reinforcements.

    abstract::Pigeons' pecks on either of two concurrently available response keys produced secondary reinforcers according to independent one-minute variable-interval schedules. Different secondary reinforcers, in the presence of which the rates of primary reinforcement were equal, were associated with each key. The rate of peckin...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1968.11-9

    authors: Fantino E,Herrnstein RJ

    更新日期:1968-01-01 00:00:00

  • OPERANT CONDITIONING OF GOATS.

    abstract::A procedure is described for establishing an operant response in goats. The operanda are two lucite panels which can be transilluminated. The goats press the panels with their muzzles and are reinforced with whole oats. All six subjects showed reliable and accurate performance in brightness discrimination, including c...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1964.7-263

    authors: WENZEL BM,BALDWIN BA,TSCHIRGI RD

    更新日期:1964-05-01 00:00:00

  • Choice of longer or stronger signalled shock over shorter or weaker unsignalled shock.

    abstract::Unsignalled, inescapable shocks were presented to four albino rats in one study and to six rats in a second study. By pressing a lever, subjects could change the condition to signalled shock for 3 min after which unsignalled shock was automatically reinstated. All subjects changed frequently to the signalled shock sch...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1973.19-25

    authors: Badia P,Culbertson S,Harsh J

    更新日期:1973-01-01 00:00:00

  • Impulsive choice and pre-exposure to delays: iv. effects of delay- and immediacy-exposure training relative to maturational changes in impulsivity.

    abstract::Impulsive choice describes preference for smaller, sooner rewards over larger, later rewards. Excessive delay discounting (i.e., rapid devaluation of delayed rewards) underlies some impulsive choices, and is observed in many maladaptive behaviors (e.g., substance abuse, gambling). Interventions designed to reduce dela...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1002/jeab.432

    authors: Renee Renda C,Rung JM,Hinnenkamp JE,Lenzini SN,Madden GJ

    更新日期:2018-05-01 00:00:00

  • Responses and pauses: discrimination and a choice catastrophe.

    abstract::Pigeons produced a stimulus change either by responding or by not responding for a specified time period (by pausing). They then had to choose between two responses to obtain food. One choice was correct if the first component had been completed by a response; the other was correct if the component had been completed ...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1982.37-223

    authors: Zeiler MD,Solano JM

    更新日期:1982-03-01 00:00:00

  • Concurrent fixed-interval variable-ratio schedules and the matching relation.

    abstract::Five rats responded under concurrent fixed-interval variable-ratio schedules of food reinforcement. Fixed-interval values ranged from 50-seconds to 300-seconds and variable-ratio values ranged from 30 to 360; a five-second changeover delay was in effect throughout the experiment. The relations between reinforcement ra...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1981.36-317

    authors: Rider DP

    更新日期:1981-11-01 00:00:00

  • Fixed ratio and extinction performance of infants in the second year of life.

    abstract::Five 14(1/2)- to 19(1/2)-month-old infants were trained to lever press for snacks on small fixed ratio schedules of reinforcement. Within four to nine sessions, responding under FR 10 was established for four subjects and FR 15 for the other. Each subject's last session revealed behavioral patterns similar to animal a...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1966.9-105

    authors: Weisberg P,Fink E

    更新日期:1966-03-01 00:00:00

  • Preference in rhesus monkeys given a choice between cocaine and d,l-cathinone.

    abstract::Previous experiments have shown that both cocaine and d,l-cathinone can function as positive reinforces when delivered intravenously to rhesus monkeys. However, the relative reinforcing efficacies of these compounds have not been established. In the present experiment, three rhesus monkeys were allowed to choose betwe...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1984.41-i35

    authors: Woolverton WL,Johanson CE

    更新日期:1984-01-01 00:00:00