A decision model for steady-state choice in concurrent chains.

Abstract:

:Grace and McLean (2006) proposed a decision model for acquisition of choice in concurrent chains which assumes that after reinforcement in a terminal link, subjects make a discrimination whether the preceding reinforcer delay was short or long relative to a criterion. Their model was subsequently extended by Christensen and Grace (2008, 2009a, 2009b) to include effects of initial- and terminal-link duration on choice. We show that an expression for steady-state responding can be derived from the decision model, which enables a model for choice that provides an account of archival data that is equal or superior to the contextual choice model (Grace, 1994) and hyperbolic value-added model (Mazur, 2001) in terms of goodness of fit, parsimony, and parameter invariance. The success of the steady-state decision model validates the strategy of understanding acquisition phenomena as a bridge toward explaining choice at the molar level.

journal_name

J Exp Anal Behav

authors

Christensen DR,Grace RC

doi

10.1901/jeab.2010.94-227

subject

Has Abstract

pub_date

2010-09-01 00:00:00

pages

227-40

issue

2

eissn

0022-5002

issn

1938-3711

journal_volume

94

pub_type

杂志文章
  • Effects of required rates of responding upon choice.

    abstract::Pigeons' responses in the presence of two concurrently available (initial-link) stimuli produced one of two different (terminal-link) stimuli according to identical but independent variable-interval schedules. Responses in the presence of each terminal-link stimulus produced equal frequencies of food reinforcement, bu...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1968.11-15

    authors: Fantino E

    更新日期:1968-01-01 00:00:00

  • Extending sequence-class membership with matching to sample.

    abstract::Three normal adults were first trained to point sequentially to each member of several pairs of visual stimuli. This baseline training established one class of stimuli to which subjects responded first, and another class of stimuli to which they responded second. Then, in a matching-to-sample procedure, baseline-seque...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1977.27-381

    authors: Lazar R

    更新日期:1977-03-01 00:00:00

  • Elicitation and punishment of intraspecies aggression by the same stimulus.

    abstract::Fighting responses were elicited in pairs of rats by shocks over a period of 46 days. During certain blocks of these days, "punishing" shocks were made contingent on the shock-elicited fights. Fighting frequency was reduced as a direct function of the intensity of the contingent shocks. Fighting frequency recovered co...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1971.15-193

    authors: Roberts CL,Blase K

    更新日期:1971-03-01 00:00:00

  • Transient effects of acquisition history on generalization in a matching-to-sample task.

    abstract::This study examined the role of learning history on the acquisition of a matching-to-sample task. Twelve preschool children learned four stimulus classes through instructions, shaping, or imitation. After reaching criterion, the subjects were exposed to changed discrimination contingencies to determine how each learni...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1991.56-155

    authors: Michael RL,Bernstein DJ

    更新日期:1991-07-01 00:00:00

  • Choice for signalled over unsignalled shock as a function of shock intensity.

    abstract::Choice between a signalled shock schedule and an unsignalled one was examined at various shock intensities. Three rats were given the opportunity to change from the unsignalled schedule to the signalled one at intensity values between 0.15 mA and 1.0 mA. Steps were usually 0.15 mA and both ascending and descending ser...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1975.23-349

    authors: Harsh J,Badia P

    更新日期:1975-05-01 00:00:00

  • Response rate correlates with indifference points in a delay-discounting procedure.

    abstract::To study how effort affects reward value, we replicated Fortes, Vasconcelos and Machado's (2015) study using an adjusting-delay task. Nine pigeons chose between a standard alternative that gave access to 4 s of food, after a 10 s delay, and an adjusting-delay alternative that gave access to 12 s of food after a delay ...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1002/jeab.548

    authors: García-Leal Ó,Barrón E,Camarena-Pérez H,Vílchez Z

    更新日期:2019-09-01 00:00:00

  • The dynamics of the law of effect: a comparison of models.

    abstract::Dynamical models based on three steady-state equations for the law of effect were constructed under the assumption that behavior changes in proportion to the difference between current behavior and the equilibrium implied by current reinforcer rates. A comparison of dynamical models showed that a model based on Navaka...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.2010.93-91

    authors: Navakatikyan MA,Davison M

    更新日期:2010-01-01 00:00:00

  • Criticisms of the satiety hypothesis as an explanation for within-session decreases in responding.

    abstract::The authors of four papers recently reported that satiation provides a better explanation than habituation for within-session decreases in conditioned responding. Several arguments question this conclusion. First, the contribution of habituation to within-session changes in responding seems clearly established. Inform...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.2000.74-347

    authors: McSweeney FK,Murphy ES

    更新日期:2000-11-01 00:00:00

  • Concurrent schedule control of human visual target fixations.

    abstract::Operant conditioning techniques were applied to the study of how target fixations are controlled by the probability of signal occurrence. In a standard vigilance setting, gaze at three illuminable volt meters was monitored by a Mackworth television eye camera with automatic recording capability. Gaze at a given meter ...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1973.20-411

    authors: Rosenberger PB

    更新日期:1973-11-01 00:00:00

  • Choice with frequently changing food rates and food ratios.

    abstract::In studies of operant choice, when one schedule of a concurrent pair is varied while the other is held constant, the constancy of the constant schedule may exert discriminative control over performance. In our earlier experiments, schedules varied reciprocally across components within sessions, so that while food rati...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1002/jeab.70

    authors: Baum WM,Davison M

    更新日期:2014-03-01 00:00:00

  • Social discounting and the prisoner's dilemma game.

    abstract::Altruistic behavior has been defined in economic terms as "…costly acts that confer economic benefits on other individuals" (Fehr & Fischbacher, 2003). In a prisoner's dilemma game, cooperation benefits the group but is costly to the individual (relative to defection), yet a significant number of players choose to coo...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1002/jeab.3

    authors: Locey ML,Safin V,Rachlin H

    更新日期:2013-01-01 00:00:00

  • Building blocks of self-control: increased tolerance for delay with bundled rewards.

    abstract::Impulsive choice can be defined as temporary preference for a smaller-sooner reward (SS) over a larger-later reward (LL). Hyperbolic discounting implies that impulsive choices will occur less when organisms choose between a series of SSs versus LLs all at once than when they choose between single SS versus LL pairs. E...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.2003.79-37

    authors: Ainslie G,Monterosso JR

    更新日期:2003-01-01 00:00:00

  • On the effects of signaling reinforcer probability and magnitude in delayed matching to sample.

    abstract::Two experiments examined whether postsample signals of reinforcer probability or magnitude affected the accuracy of delayed matching to sample in pigeons. On each trial, red or green choice responses that matched red or green stimuli seen shortly before a variable retention interval were reinforced with wheat access. ...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.2005.94-03

    authors: Brown GS,White KG

    更新日期:2005-03-01 00:00:00

  • A retrospective 60-year review of Murray Sidman's Tactics of Scientific Research and some of its influence on behavior analysis.

    abstract::Murray Sidman's book, Tactics of Scientific Research: Evaluating Experimental Data in Psychology, published in 1960, has been called the bible of the experimental analysis of behavior and has been a major influence on basic as well as applied research in behavior analysis. The contents of the early reviews of the book...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1002/jeab.645

    authors: Holth P

    更新日期:2021-01-01 00:00:00

  • Behavioral control of visual fixation of the rhesus monkey.

    abstract::A paradigm for the control of visual fixation of the macaque monkey in vision experiments was described. Using a Maxwellian view, the procedure permits the placement of discrete test-light stimuli in a specific area of the retina as the monkey fixates a primary target. This procedure holds foveal fixation as other beh...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1976.25-113

    authors: Crawford ML

    更新日期:1976-01-01 00:00:00

  • Conjunctive schedules of reinforcement II: response requirements and stimulus effects.

    abstract::Responding of three pigeons was maintained under conjunctive fixed-ratio, fixed-interval schedules where a key peck produced food after both schedule requirements were completed. The individual schedule requirements were then successively removed and reinstated with responding maintained under the following conditions...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1975.24-23

    authors: Barrett JE

    更新日期:1975-07-01 00:00:00

  • Responding under sequence schedules of electric shock presentation.

    abstract::Lever pressing by squirrel monkeys was examined under second-order schedules of electric shock presentation in which different discriminative stimuli were associated with consecutive components (sequence schedules). Components were always two-minute fixed-interval schedules, and three different overall schedules were ...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1981.35-323

    authors: Gardner ML,Malagodi EF

    更新日期:1981-05-01 00:00:00

  • Instructed versus shaped human verbal behavior: Interactions with nonverbal responding.

    abstract::Undergraduate students' presses on left and right buttons occasionally made available points exchangeable for money. Blue lights over the buttons were correlated with multiple random-ratio random-interval components; usually, the random-ratio schedule was assigned to the left button and the random-interval to the righ...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1982.38-233

    authors: Catania AC,Matthews BA,Shimoff E

    更新日期:1982-11-01 00:00:00

  • Equivalence relations and the reinforcement contingency.

    abstract::Where do equivalence relations come from? One possible answer is that they arise directly from the reinforcement contingency. That is to say, a reinforcement contingency produces two types of outcome: (a) 2-, 3-, 4-, 5-, or n-term units of analysis that are known, respectively, as operant reinforcement, simple discrim...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.2000.74-127

    authors: Sidman M

    更新日期:2000-07-01 00:00:00

  • Effects of a concurrent task on fixed-interval responding in humans.

    abstract::Subjects pressed a telegraph key to illuminate a meter dial on which pointer deflections appeared at fixed intervals. Upon detecting a deflection they were required to press another key to reset the pointer to zero. This detecting and resetting operation reinforced the behavior of pressing the light-flashing key (i.e....

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1963.6-431

    authors: Laties VG,Weiss B

    更新日期:1963-07-01 00:00:00

  • About Skinner and time: behavior-analytic contributions to research on animal timing.

    abstract::The article discusses two important influences of B. F. Skinner, and later workers in the behavior-analytic tradition, on the study of animal timing. The first influence is methodological, and is traced from the invention of schedules imposing temporal constraints or periodicities on animals in The Behavior of Organis...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章,评审

    doi:10.1901/jeab.2006.85.04

    authors: Lejeune H,Richelle M,Wearden JH

    更新日期:2006-01-01 00:00:00

  • Some effects of response cost upon human operant behavior.

    abstract::Three experiments are reported which investigated the effects of cost (point loss per response) upon human-observer responses maintained by VI and FI schedules of reinforcement (acquisition of points via critical-signal detections). (I) Cost attenuated VI response rates without substantially disturbing the constancy o...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1962.5-201

    authors: WEINER H

    更新日期:1962-04-01 00:00:00

  • The control of responding by sounds: unusual effect of reinforcement.

    abstract::Naive rats were trained to respond on one lever in the presence of noise bursts from one speaker and on a second lever in the presence of noise bursts from a second speaker. The speakers were mounted behind the levers. When responding on the lever adjacent to the sounding speaker was reinforced, control developed with...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1979.32-167

    authors: Harrison JM

    更新日期:1979-09-01 00:00:00

  • Short-component multiple schedules: effects of relative reinforcement duration.

    abstract::Pigeons were exposed to multiple variable-interval 2-min variable-interval 2-min schedules of food presentation in which relative duration of food presentation was manipulated. When components alternated every 5 sec and were scheduled on separate response keys, relative response rates closely matched relative reinforc...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1975.24-183

    authors: Merigan WH,Miller JS,Gollub LR

    更新日期:1975-09-01 00:00:00

  • Stimulus functions in chained fixed-interval schedules.

    abstract::Pigeons were required to complete three successive fixed-interval components to obtain food. When the same exteroceptive stimulus was correlated with the three components, responding was positively accelerated between food deliveries. When different exteroceptive stimuli were correlated with each component in a fixed ...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1962.5-167

    authors: KELLEHER RT,FRY WT

    更新日期:1962-04-01 00:00:00

  • Concurrent schedules of interresponse time reinforcement: probability of reinforcement and the lower bounds of the reinforced interresponse time intervals.

    abstract::Data were obtained with rats on the effects of interresponse time contingent reinforcement of the lever press response using schedules in which interresponse times falling within either of two temporal intervals could be reinforced. Some of the findings were (a) the mode of the interresponse time distribution generall...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1966.9-317

    authors: Malott RW,Cumming WW

    更新日期:1966-07-01 00:00:00

  • An ecological analysis of knowing by wielding.

    abstract::The ecological approach to perception, as developed by James Gibson, is described and applied to how one knows, by means of the haptic perceptual system, various properties of hand-held objects. Four sets of experiments are reviewed in which subjects reported on the extent, orientation, shape, and fractional component...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1989.52-387

    authors: Turvey MT,Solomon HY,Burton G

    更新日期:1989-11-01 00:00:00

  • Early extinction effects following intermittent reinforcement: Little evidence of extinction bursts.

    abstract::The occurrence of extinction bursts-transient increases in response rate in excess of those observed in baseline during the period immediately following discontinuation of reinforcement of a response-was examined. In Experiment 1, key pecking of pigeons was reinforced according to a multiple schedule in which a variab...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1002/jeab.616

    authors: Lattal KA,Kuroda T,Cook JE

    更新日期:2020-07-01 00:00:00

  • Levels of aggregation: Relative time allocation in concurrent-schedule performance.

    abstract::The proportion of time allocated to one component of a concurrent variable-interval variable-interval schedule was computed for groups of interchangeover times (aggregates) within several intact time series. Variability in obtained proportions decreased as the number of interchangeover times within each aggregate incr...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1985.43-97

    authors: Real PG,Dreyfus LR

    更新日期:1985-01-01 00:00:00

  • A multivariate rate equation for variable-interval performance.

    abstract::A value-like parameter is introduced into a rate equation for describing variable-interval performance. The equation, derived solely from formal considerations, expresses rate of responding as a joint function of rate of reinforcement and "reinforcer power." Preliminary tests of the rate equation show that it handles ...

    journal_title:Journal of the experimental analysis of behavior

    pub_type: 杂志文章

    doi:10.1901/jeab.1979.31-267

    authors: McDowell JJ,Kessel R

    更新日期:1979-03-01 00:00:00