The dynamics of the law of effect: a comparison of models.

Abstract:

:Dynamical models based on three steady-state equations for the law of effect were constructed under the assumption that behavior changes in proportion to the difference between current behavior and the equilibrium implied by current reinforcer rates. A comparison of dynamical models showed that a model based on Navakatikyan's (2007) two-component functions law-of-effect equations performed better than models based on Herrnstein's (1970) and Davison and Hunter's (1976) equations. Navakatikyan's model successfully described the behavioral dynamics in schedules with negative-slope feedback functions, concurrent variable-ratio schedules, Vaughan's (1981) melioration experiment, and experiments that arranged equal, and constant-ratio unequal, local reinforcer rates.

journal_name

J Exp Anal Behav

authors

Navakatikyan MA,Davison M

doi

10.1901/jeab.2010.93-91

subject

Has Abstract

pub_date

2010-01-01 00:00:00

pages

91-127

issue

1

eissn

0022-5002

issn

1938-3711

journal_volume

93

pub_type

杂志文章
  • A quantitative analysis of sensitivity to the conditioned reinforcing value of terminal-link stimuli in a concurrent-chains schedule.

    abstract::Pigeons were exposed to a concurrent-chains schedule in which a single variable-interval 30-s schedule was used in the initial links and fixed-time schedules were used in the terminal links. Three types of keylight conditions were used in the terminal links. In the first condition, different delays were associated wit...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1993.60-587

    authors: Omino T

    更新日期:1993-11-01 00:00:00

  • Naming and categorization in young children: III. Vocal tact training and transfer of function.

    abstract::Following pretraining with everyday objects, 10 children aged from 1 to 4 years were given common vocal tact training with a set of three pairs of arbitrary stimuli of differing shapes; Set 1. Nine children learned to tact one stimulus as "zog" and the other as "vek" in each pair, and all passed subsequent pairwise te...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.2005.31-04

    authors: Lowe CF,Horne PJ,Hughes JC

    更新日期:2005-01-01 00:00:00

  • Behavior analysis: thriving, but how about its future?

    abstract::Behavior analysis has been thriving by continuing to make important theoretical and empirical contributions to a wide array of problems, as well as by contributing to interdisciplinary research. Applied research in behavior analysis is flourishing. Despite these positive signs there may be an erosion of support for ba...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.2008.89-125

    authors: Fantino E

    更新日期:2008-01-01 00:00:00

  • Effects of prompting and reinforcement of one response pattern upon imitation of a different modeled pattern.

    abstract::Twelve preschool children participated in a study of the effects of explicit training on the imitation of modeled behavior. The responses trained involved a marble-dropping pattern that differed from the modeled pattern. Training consisted of physical prompts and verbal praise during a single session. No prompts or pr...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1982.37-135

    authors: Bondy AS

    更新日期:1982-01-01 00:00:00

  • Negative behavioral contrast on multiple treadle-press schedules.

    abstract::Eight pigeons pressed treadles for food reinforcers delivered by several multiple variable-interval schedules. The rate of reinforcement for responding during one component schedule was held constant at 30 reinforcers per hour. The rate of reinforcement for responding during the other component varied from 0 to 120 or...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1978.29-463

    authors: McSweeney FK

    更新日期:1978-05-01 00:00:00

  • Behavioral contrast with timeout, blackout, or extinction as the negative condition.

    abstract::When either a timeout period (darkening the response key) or a blackout period (darkening both chamber and response key) was alternated with a stimulus associated with variable-interval reinforcement, behavioral contrast was obtained. Either peck contrast or maintained contrast occurred, depending on whether or not re...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1973.19-499

    authors: Sadowsky S

    更新日期:1973-05-01 00:00:00

  • Effects of relative reinforcer frequency on complex color detection.

    abstract::Pigeons were trained under a discrete-trials detection procedure in which one of a set of color stimuli was presented on the center key and a single response turned off the stimulus and illuminated two side keys. Single responses to one or the other side key produced occasional reinforcers depending on the value of th...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1989.51-291

    authors: Davison M,McCarthy D

    更新日期:1989-05-01 00:00:00

  • The effects of component duration on multiple-schedule performance in closed and open economies.

    abstract::Pigeons responded on multiple variable-interval variable-interval schedules of reinforcement in an open and a closed economy. Equal duration components were increased in duration while the component rates of reinforcement were held constant, the component schedules were reversed, and component duration was decreased. ...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1988.50-457

    authors: La Fiette MH,Fantino E

    更新日期:1988-11-01 00:00:00

  • An analysis of rats' drinking-tube contacts under tandem and fixed-interval schedules of food presentation.

    abstract::Rats' lever presses and drinking-tube contacts were studied under fixed-interval schedules of food presentation and under a tandem schedule composed of three fixed intervals. One group of rats was exposed first to the tandem schedule, next to fixed-interval schedules of comparable interpellet intervals, and once again...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1976.25-361

    authors: McLeod DR,Gollub LR

    更新日期:1976-05-01 00:00:00

  • Immobility as an avoidance response, and its disruption by drugs.

    abstract::Much of the available literature on avoidance behavior is based on responses which require the animal to run, lever-press, or to make some active response to avoid noxious stimulation. The purpose of Experiment I reported in this paper was to determine whether animals can learn to sit or stand motionless in order to e...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1963.6-213

    authors: BINDRA D,ANCHEL H

    更新日期:1963-04-01 00:00:00

  • A procedure for studying echoic control in verbal behavior.

    abstract::Male and female college students answered standard questions about the women's liberation movement on three occasions. A set of target words was embedded in the questions, with one set used in Sessions 1 and 3, and a synonymous, but different set used in Session 2. The relative frequencies of usage of a given target w...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1978.30-213

    authors: Boe R,Winokur S

    更新日期:1978-09-01 00:00:00

  • Differential reinforcement of alternative behavior increases resistance to extinction: clinical demonstration, animal modeling, and clinical test of one solution.

    abstract::Basic research with pigeons on behavioral momentum suggests that differential reinforcement of alternative behavior (DRA) can increase the resistance of target behavior to change. This finding suggests that clinical applications of DRA may inadvertently increase the persistence of target behavior even as it decreases ...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.2010.93-349

    authors: Mace FC,McComas JJ,Mauro BC,Progar PR,Taylor B,Ervin R,Zangrillo AN

    更新日期:2010-05-01 00:00:00

  • Unit price and choice in a token-reinforcement context.

    abstract::Pigeons were exposed to multiple and concurrent second-order schedules of token reinforcement, with stimulus lights serving as token reinforcers. Tokens were produced and exchanged for food according to various fixed-ratio schedules, yielding equal and unequal unit prices (responses per unit food delivery). On one sch...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.2004.81-5

    authors: Foster TA,Hackenberg TD

    更新日期:2004-01-01 00:00:00

  • Roger T. Kelleher, behavior analyst.

    abstract::Roger T. Kelleher, rightly known as one of the foremost contributors to behavioral pharmacology, also made many important contributions to the experimental analysis of behavior. He participated significantly in the development of the discipline, through both his research and his editorial contributions to thisjournal....

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 传,历史文章,杂志文章

    doi:10.1901/jeab.2006.25-06

    authors: Branch MN

    更新日期:2006-11-01 00:00:00

  • CONTINUOUS OPPORTUNITY FOR REINFORCING BRAIN STIMULATION.

    abstract::The performance of a rat provided with continuous opportunity to obtain reinforcing brain stimulation over a 20-day period is described in detail. The animal averaged 29.2 responses per min during the entire time. Testing session was terminated by experimenters, but a day-by-day analysis of behavior provided no eviden...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1964.7-183

    authors: VALENSTEIN ES,BEER B

    更新日期:1964-03-01 00:00:00

  • Within-session transitions in choice: a structural and quantitative analysis.

    abstract::The present study used within-session transitions between two concurrent schedules to evaluate choice in transition. Eight female Long-Evans rats were trained to respond under concurrent schedules of reinforcement during experimental sessions that lasted 22 hr. The generalized matching equation was used to model stead...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.2009.91-319

    authors: Banna KM,Newland MC

    更新日期:2009-05-01 00:00:00

  • Behavioral control of visual fixation of the rhesus monkey.

    abstract::A paradigm for the control of visual fixation of the macaque monkey in vision experiments was described. Using a Maxwellian view, the procedure permits the placement of discrete test-light stimuli in a specific area of the retina as the monkey fixates a primary target. This procedure holds foveal fixation as other beh...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1976.25-113

    authors: Crawford ML

    更新日期:1976-01-01 00:00:00

  • Discrimination learning, the peak shift, and behavioral contrast.

    abstract::A discrimination between two successively alternating stimuli was trained under conditions that maintained equal frequencies of reinforcement in the presence of each of the discriminative stimuli (S1 and S2) but that also reduced the rate of responding to S2. These conditions included a multiple variable-interval diff...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1968.11-727

    authors: Terrace HS

    更新日期:1968-11-01 00:00:00

  • Patterns of responding within sessions.

    abstract::Rates of responding changed systematically across sessions for rats pressing levers and keys and for pigeons pressing treadles and pecking keys. A bitonic function in which response rates increased and then decreased across sessions was the most common finding, although an increase in responding also occurred alone. T...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1992.58-19

    authors: McSweeney FK,Hinson JM

    更新日期:1992-07-01 00:00:00

  • Inhibiting function of reinforcement: magnitude effects on variable-interval schedules.

    abstract::In two experiments, the performance of rats under constant-probability and arithmetic variable-interval schedules respectively was compared when the concentration of a liquid reinforcer was varied within sessions; in other sessions, half of the reinforcers were randomly omitted. When the discriminative function of the...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1978.30-1

    authors: Harzem P,Lowe CF,Priddle-Higson PJ

    更新日期:1978-07-01 00:00:00

  • Brief-stimulus presentations on multiform tandem schedules.

    abstract::Three experiments examined the influence of a brief stimulus (a light) on the behavior of food-deprived rats whose lever pressing on tandem schedules comprising components of different schedule types resulted in food presentation. In Experiment 1, either a tandem variable-ratio variable-interval or a tandem variable-i...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1994.61-417

    authors: Reed P

    更新日期:1994-05-01 00:00:00

  • Some temporal properties of behavioral contrast.

    abstract::Pigeons were rewarded on a variable time interval for pecking a translucent key illuminated with either a 45 degrees or a vertical line. The key illumination changed every 2 min during daily 1-hr sessions. When the rates of pecking were stable, reinforcement was omitted in the presence of the 45 degrees line. Respondi...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1967.10-159

    authors: Bloomfield TM

    更新日期:1967-03-01 00:00:00

  • Observational learning in monkeys.

    abstract::Observer monkeys were housed next to demonstrator monkeys that were conditioned to respond on a multiple reinforcement schedule whose components were fixed-ratio 32, variable-interval 3-min, and extinction 5-min followed by an additional 30 sec of extinction during which every response started a new 30-sec interval. A...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1970.14-225

    authors: Myers WA

    更新日期:1970-09-01 00:00:00

  • Interresponse-time shaping by variable-interval-like interresponse-time reinforcement contingencies.

    abstract::The interresponse-time reinforcement contingencies and distributions of interreinforcement intervals characteristic of certain variable-interval schedules were mimicked by reinforcing each key peck with a probability equal to the duration of the interresponse time it terminated, divided by the scheduled mean interrein...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1979.31-3

    authors: Platt JR

    更新日期:1979-01-01 00:00:00

  • The effect of reinforcer delays on the form of the forgetting function.

    abstract::Pigeons were trained in a matching-to-sample procedure with retention intervals of 0, 2, 4, 6, and 8 s mixed within each session. In different conditions, reinforcement was delayed by 0, 1, 2, 4, 6, or 8 s from correct choice responses. Discriminability decreased with increasing retention-interval duration and with in...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.2003.80-77

    authors: Sargisson RJ,White KG

    更新日期:2003-07-01 00:00:00

  • Autoshaping, random control, and omission training in the rat.

    abstract::The role of the stimulus-reinforcer contingency in the development and maintenance of lever contact responding was studied in hooded rats. In Experiment I, three groups of experimentally naive rats were trained either on autoshaping, omission training, or a random-control procedure. Subjects trained by the autoshaping...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1976.26-451

    authors: Locurto C,Terrace HS,Gibbon J

    更新日期:1976-11-01 00:00:00

  • Timeout postponement without increased reinforcement frequency.

    abstract::Three experiments were conducted to examine pigeons' postponement of signaled extinction periods (timeouts) from a schedule of food reinforcement when such responding neither decreased overall timeout frequency nor increased the overall frequency of food reinforcement. A discrete-trial procedure was used in which a re...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.2000.74-147

    authors: Pietras CJ,Hackenberg TD

    更新日期:2000-09-01 00:00:00

  • Choice and foraging.

    abstract::In Experiment 1, six naive pigeons were trained on a foraging schedule characterized by different states beginning with a search state in which completion of a fixed-interval on a white key led to a choice state. In the choice state the subject could, by appropriate responding on a fixed ratio of three, either accept ...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1982.38-117

    authors: Abarca N,Fantino E

    更新日期:1982-09-01 00:00:00

  • Comparing pleasure and pain: the fundamental mathematical equivalence of reward gain and shock reduction under variable interval schedules.

    abstract::The relationship between positive and negative reinforcement and the symmetry of Thorndike's law of effect are unresolved issues in operant psychology. Here we show that, for a given pattern of responding on variable interval (VI) schedules with the same programmed rate of food rewards (positive reinforcement VI) or e...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.2012.98-355

    authors: Mallpress DE,Fawcett TW,McNamara JM,Houston AI

    更新日期:2012-11-01 00:00:00

  • A functional-analytic model of analogy: a relational frame analysis.

    abstract::The aim of this study was to explore a behavior-analytic model of analogical reasoning, defined as the discrimination of formal similarity via equivalence-equivalence responding. In Experiment 1, adult humans were trained and tested for the formation of four three-member equivalence relations: A1-B1-C1, A2-B2-C2, A3-B...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.2002.78-375

    authors: Stewart I,Barnes-Holmes D,Roche B,Smeets PM

    更新日期:2002-11-01 00:00:00