Matching, maximizing, and hill-climbing.

Abstract:

:In simple situations, animals consistently choose the better of two alternatives. On concurrent variable-interval variable-interval and variable-interval variable-ratio schedules, they approximately match aggregate choice and reinforcement ratios. The matching law attempts to explain the latter result but does not address the former. Hill-climbing rules such as momentary maximizing can account for both. We show that momentary maximizing constrains molar choice to approximate matching; that molar choice covaries with pigeons' momentary-maximizing estimate; and that the "generalized matching law" follows from almost any hill-climbing rule.

journal_name

J Exp Anal Behav

authors

Hinson JM,Staddon JE

doi

10.1901/jeab.1983.40-321

subject

Has Abstract

pub_date

1983-11-01 00:00:00

pages

321-31

issue

3

eissn

0022-5002

issn

1938-3711

journal_volume

40

pub_type

杂志文章
  • A theory of attending, remembering, and reinforcement in delayed matching to sample.

    abstract::A theory of attending and reinforcement in conditional discriminations is extended to working memory in delayed matching to sample by adding terms for disruption of attending during the retention interval. Like its predecessor, the theory assumes that reinforcers and disruptors affect the independent probabilities of ...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.2007.88-285

    authors: Nevin JA,Davison M,Odum AL,Shahan TA

    更新日期:2007-09-01 00:00:00

  • Negative behavioral contrast on multiple treadle-press schedules.

    abstract::Eight pigeons pressed treadles for food reinforcers delivered by several multiple variable-interval schedules. The rate of reinforcement for responding during one component schedule was held constant at 30 reinforcers per hour. The rate of reinforcement for responding during the other component varied from 0 to 120 or...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1978.29-463

    authors: McSweeney FK

    更新日期:1978-05-01 00:00:00

  • Stimuli previously associated with reinforcement mitigate resurgence.

    abstract::Resurgence refers to the recurrence of an extinguished target behavior following subsequent suspension of alternative reinforcement. Delivery of reinforcers during extinction of alternative behavior has been shown to mitigate resurgence. The present experiment aimed to determine whether delivering stimuli associated w...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1002/jeab.278

    authors: Craig AR,Browning KO,Shahan TA

    更新日期:2017-09-01 00:00:00

  • Conditional discrimination learning: a critique and amplification.

    abstract::Carter and Werner recently reviewed the literature on conditional discrimination learning by pigeons, which consists of studies of matching-to-sample and oddity-from-sample. They also discussed three models of such learning: the "multiple-rule" model (learning of stimulus-specific relations), the "configuration" model...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1980.33-291

    authors: Schrier AM,Thompson CR

    更新日期:1980-03-01 00:00:00

  • Controls for and constraints on auto-shaping.

    abstract::Auto-shaping the pigeon's key-peck response was examined as a respondent conditioning procedure with the use of Rescorla's truly-random control procedure. In the first experiment, pigeons received presentations of brief light on the response key and brief presentations of food where the light and the food were indepen...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1973.20-323

    authors: Bilbrey J,Winokur S

    更新日期:1973-11-01 00:00:00

  • Allocation of complex, sequential operants on multiple and concurrent schedules of reinforcement.

    abstract::Pigeons could produce food by pecking exactly four times on each of two keys, in any order. In the first experiment, these response sequences were reinforced on a series of multiple schedules of variable-interval reinforcement. In the second experiment, these response sequences were reinforced on a series of concurren...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1986.45-283

    authors: Schwartz B

    更新日期:1986-05-01 00:00:00

  • Extending sequence-class membership with matching to sample.

    abstract::Three normal adults were first trained to point sequentially to each member of several pairs of visual stimuli. This baseline training established one class of stimuli to which subjects responded first, and another class of stimuli to which they responded second. Then, in a matching-to-sample procedure, baseline-seque...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1977.27-381

    authors: Lazar R

    更新日期:1977-03-01 00:00:00

  • Delayed discrimination and delayed matching in pigeons.

    abstract::Three pigeons were each trained to perform a discrimination problem and a matching problem. Following acquisition, delays of 1 to 7 sec were interposed after stimulus presentation on both problems. Accuracy of responding on these two types of delay procedures was observed to be a function of length of delay interval. ...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1967.10-529

    authors: Smith L

    更新日期:1967-11-01 00:00:00

  • Stimulus control in the experimental study of cooperation.

    abstract::The cooperative responses of pairs of human subjects were reinforced under several stimulus conditions in two settings designed to require a "social" response, i.e., where at least one of the two persons is responding to the behavior of the other. The first task, designed by Lindsley and Cohen, required individual res...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1968.11-571

    authors: Schmitt DR,Marwell G

    更新日期:1968-09-01 00:00:00

  • Effects of discrete-trial and free-operant procedures on the acquisition and maintenance of successive discrimination in rats.

    abstract::Rats were trained on a successive discrete-trial discrimination between two tonal stimuli to examine the effects of availability of a lever during intertrial intervals. In the discrete-trial condition, in which a lever was removed from the chamber during intertrial intervals, 10-s trials were initiated by the presenta...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1991.55-3

    authors: Hachiya S,Ito M

    更新日期:1991-01-01 00:00:00

  • Quantification of rats' behavior during reinforcement periods.

    abstract::What is treated as a single unit of reinforcement often involves what could be called a reinforcement period during which two or more acts of ingestion may occur, and each of these may have associated with it a series of responses, some reflexive, some learned, that lead up to ingestion. Food-tray presentation to a pi...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1983.39-457

    authors: Gunn KP

    更新日期:1983-05-01 00:00:00

  • On the effects of signaling reinforcer probability and magnitude in delayed matching to sample.

    abstract::Two experiments examined whether postsample signals of reinforcer probability or magnitude affected the accuracy of delayed matching to sample in pigeons. On each trial, red or green choice responses that matched red or green stimuli seen shortly before a variable retention interval were reinforced with wheat access. ...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.2005.94-03

    authors: Brown GS,White KG

    更新日期:2005-03-01 00:00:00

  • Punished and unpunished responding in multiple variable-interval schedules.

    abstract::The performance of rats trained on multiple variable-interval schedules was examined before, during, and after punishment. The same linear function related relative response rates to relative density of reinforcement both in the presence and absence of punishment. Equal relative suppression was seen in both the high a...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1968.11-147

    authors: Tullis C,Walters G

    更新日期:1968-03-01 00:00:00

  • Stock optimizing: maximizing reinforcers per session on a variable-interval schedule.

    abstract::In Experiment 1, 2 monkeys earned their daily food ration by pressing a key that delivered food according to a variable-interval 3-min schedule. In Phases 1 and 4, sessions ended after 3 hr. In Phases 2 and 3, sessions ended after a fixed number of responses that reduced food intake and body weights from levels during...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1993.59-389

    authors: Silberberg A,Bauman R,Hursh S

    更新日期:1993-03-01 00:00:00

  • Substitution and caloric regulation in a closed economy.

    abstract::Three experiments were conducted to study the effect of an imperfect substitute for food on demand for food in a closed economy. In Experiments 1 and 2, rats pressed a lever for their entire daily food ration, and a fixed ratio of presses was required for each food pellet. In both experiments, the fixed ratio was held...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1996.65-401

    authors: Bauman RA,Raslear TG,Hursh SR,Shurtleff D,Simmons L

    更新日期:1996-03-01 00:00:00

  • Equivalence relations and the reinforcement contingency.

    abstract::Where do equivalence relations come from? One possible answer is that they arise directly from the reinforcement contingency. That is to say, a reinforcement contingency produces two types of outcome: (a) 2-, 3-, 4-, 5-, or n-term units of analysis that are known, respectively, as operant reinforcement, simple discrim...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.2000.74-127

    authors: Sidman M

    更新日期:2000-07-01 00:00:00

  • The effects of amount of training per reversal on successive reversals of a color discrimination.

    abstract::Three groups of pigeons were trained on a red-green discrimination in which the stimuli were alternately presented in a multiple schedule of reinforcement. The discrimination was reversed 24 times. Groups were given 1, 2, or 4 hr of training on each discrimination. Increasing the length of training had two principal e...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1970.14-345

    authors: Beale IL

    更新日期:1970-11-01 00:00:00

  • Uncertainty reduction, conditioned reinforcement, and observing.

    abstract::In a concurrent-chains procedure, pigeons chose between equivalent mixed and multiple fixed-interval schedules of reinforcement. In the first experiment, preference for the multiple schedule was higher when the probability of the shorter fixed interval was less than .50 than for complementary points, an outcome consis...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1980.33-3

    authors: Fantino E,Moore J

    更新日期:1980-01-01 00:00:00

  • An ecological analysis of knowing by wielding.

    abstract::The ecological approach to perception, as developed by James Gibson, is described and applied to how one knows, by means of the haptic perceptual system, various properties of hand-held objects. Four sets of experiments are reviewed in which subjects reported on the extent, orientation, shape, and fractional component...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1989.52-387

    authors: Turvey MT,Solomon HY,Burton G

    更新日期:1989-11-01 00:00:00

  • Early extinction effects following intermittent reinforcement: Little evidence of extinction bursts.

    abstract::The occurrence of extinction bursts-transient increases in response rate in excess of those observed in baseline during the period immediately following discontinuation of reinforcement of a response-was examined. In Experiment 1, key pecking of pigeons was reinforced according to a multiple schedule in which a variab...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1002/jeab.616

    authors: Lattal KA,Kuroda T,Cook JE

    更新日期:2020-07-01 00:00:00

  • Preratio pausing: effects of an alternative reinforcer on fixed- and variable-ratio responding.

    abstract::Seven rats responding under fixed-ratio or variable-ratio schedules of food reinforcement had continuous access to a drinking tube inserted into the operant chamber. Under different conditions they could drink either tap water or one of two saccharin solutions. In a baseline condition, the drinking bottle was empty. P...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.2002.77-273

    authors: Derenne A,Baron A

    更新日期:2002-05-01 00:00:00

  • Stimulus control and auditory discrimination learning sets in the bottlenose dolphin.

    abstract::The learning efficiency of an Atlantic bottlenose dolphin was evaluated using auditory discrimination learning-set tasks. Efficiency, as measured by the probability of a correct response on Trial 2 of a new discrete-trial, two-choice auditory discrimination problem, reached levels comparable to those attained by advan...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1973.19-379

    authors: Herman LM,Arbeit WR

    更新日期:1973-05-01 00:00:00

  • An interresponse time analysis of variable-ratio punishment.

    abstract::An interresponse time analysis was used to study the effects of variable-ratio punishment schedules on the temporal pattern of reinforced responding. Twelve pigeons responded on a baseline variable-interval schedule of food reinforcement. A variable-ratio ten schedule of electric shock punishment was then introduced. ...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1981.35-55

    authors: Lande SD

    更新日期:1981-01-01 00:00:00

  • Discrimination of methadone and cocaine by pigeons without explicit discrimination training.

    abstract::Pigeons were trained to peck a key on a variable-interval 2-min schedule of food reinforcement. Prior to each session, either 2.0 mg/kg methadone (n = 3), 3.0 mg/kg cocaine (n = 4), or 5.6 mg/kg cocaine (n = 2) was administered. When each pigeon's rate of pecking was stable, a range of doses of the training drug and s...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1996.66-193

    authors: Schaal DW,McDonald MP,Miller MA,Reilly MP

    更新日期:1996-09-01 00:00:00

  • The magnitude-of-reinforcement function in closed and open economies.

    abstract::It has been hypothesized that the magnitude-of-reinforcement effect may differ in closed and open experimental economies. We determined the relationship between magnitude of reinforcement and response rate in three feeding conditions: a closed economy in which total intake was unrestricted, a closed economy in which t...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 临床试验,杂志文章

    doi:10.1901/jeab.1992.57-81

    authors: Collier G,Johnson DF,Morgan C

    更新日期:1992-01-01 00:00:00

  • Fixed-interval behavior: effects of percentage reinforcement.

    abstract::The percentage of fixed intervals terminating with food presentation was varied parametrically. Intervals that did not end with food were terminated by a stimulus uncorrelated with food presentation (a timeout stimulus). In Experiment I, the pigeons' response rates were an inverted U-shaped function of the percentage ...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1972.17-177

    authors: Zeiler MD

    更新日期:1972-03-01 00:00:00

  • Effects of response preference on resistance to change.

    abstract::Treatments based on differential reinforcement of alternative behavior, such as functional communication training, are widely used. Research regarding the maintenance of related treatment effects is limited. Nevin and Wacker (2013) provided a conceptual framework, rooted in behavioral momentum theory, for the study of...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1002/jeab.308

    authors: Ringdahl JE,Berg WK,Wacker DP,Crook K,Molony MA,Vargo KK,Neurnberger JE,Zabala K,Taylor CJ

    更新日期:2018-01-01 00:00:00

  • Key pecking as a function of response-shock and shock-shock intervals in unsignalled avoidance.

    abstract::Five pigeons were exposed to an unsignalled avoidance procedure where key pecks were maintained through shock postponement. Functions obtained showed an inverse relationship between rate of responding and length of the response-shock interval, while changes in the shock-shock interval had no systematic effect on respo...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1974.22-215

    authors: Todorov JC,Ferrari EA,De Souza DG

    更新日期:1974-07-01 00:00:00

  • Molecular contingencies in schedules of intermittent punishment.

    abstract::In two experiments, key pecking of pigeons was maintained by a variable-interval 180-s schedule of food presentation. Conjointly, a second schedule delivered response-dependent electric shock. In the first experiment, shocks were presented according to either a variable-interval or a nondifferential interval-percentil...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1992.58-361

    authors: Arbuckle JL,Lattal KA

    更新日期:1992-09-01 00:00:00

  • On immediate function.

    abstract::Behavior is a property of living organisms, not of inanimate matter. The problems of physical science are to understand how a phenomenon works; biological science adds the questions of what a phenomenon does and how something that does such things came to be. Exclusive dedication to cause-effect explanations ignores h...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1992.57-417

    authors: Zeiler MD

    更新日期:1992-05-01 00:00:00