Enhancing "self-control": The paradoxical effect of delay of reinforcement.

Abstract:

:Delay of reinforcement is generally thought to be inversely correlated with speed of acquisition. However, in the case of simultaneous discrimination learning, in which choice results in immediate reinforcement, delay of reinforcement can improve acquisition. For example, in the ephemeral reward task, animals are given a choice between two alternatives, A and B. Choice of A provides reinforcement, and the trial is over. Choice of B provides reinforcement and access to alternative A (thus, two reinforcements). Many animals appear unable to learn to choose B consistently, but inserting a 20-s delay between choice and outcome has been shown to facilitate optimal choice. Similarly, pigeons given a choice between a signal for one pellet and a signal for two pellets (each occurring without a delay) have difficulty learning to choose the two-pellet alternative, unless the reinforcement is delayed. In a version of object permanence, food is placed in one of two containers, and the pigeon must choose the container with the food. Pigeons have difficulty reliably choosing the correct container unless a brief delay is inserted between baiting and choice. Finally, pigeons have been shown to prefer a suboptimal alternative (a 20% chance of getting a cue for reinforcement) over an optimal alternative (a 100% chance of getting a cue for 50% reinforcement). However, if pigeons are forced to wait 20 s following their choice to receive the cues, no preference for the suboptimal alternative is found. Thus, impulsive choice may be reduced by delaying the consequence of that choice.

journal_name

Learn Behav

journal_title

Learning & behavior

authors

Zentall TR

doi

10.3758/s13420-019-00407-3

subject

Has Abstract

pub_date

2020-03-01 00:00:00

pages

165-172

issue

1

eissn

1543-4494

issn

1543-4508

pii

10.3758/s13420-019-00407-3

journal_volume

48

pub_type

杂志文章
  • Competence and performance in causal learning.

    abstract::The dominant theoretical approach to causal learning postulates the acquisition of associative weights between cues and outcomes. This reduction of causal induction to associative learning implies that learners are insensitive to important characteristics of causality, such as the inherent directionality between cause...

    journal_title:Learning & behavior

    pub_type: 杂志文章

    doi:10.3758/bf03196064

    authors: Waldmann MR,Walker JM

    更新日期:2005-05-01 00:00:00

  • An analysis of visual oddity concept learning in a California sea lion (Zalophus californianus).

    abstract::We tested a California sea lion for visual oddity learning by presentingproblems composed ofthree two-dimensional black-and-white stimuli, two identical (S-) and one different (S+). In the first experimental stage, a single problem per session was presented until learning criterion was reached. In the second experimen...

    journal_title:Learning & behavior

    pub_type: 杂志文章

    doi:10.3758/bf03193190

    authors: Hille P,Dehnhardt G,Mauck B

    更新日期:2006-05-01 00:00:00

  • The influences of guiding cues on motor skill autonomy in rats.

    abstract::How does the effectiveness of guiding cues influence the development of motor skill autonomy? We utilized two sets of guiding cues (lights vs. reversed-lights conditions) that differed in their effectiveness to control a left-right leverpress sequence in rats. We separately measured the development of stimulus control...

    journal_title:Learning & behavior

    pub_type: 杂志文章

    doi:10.3758/s13420-013-0121-y

    authors: Reid AK,Demarco G,Smith K,Fort T,Cousins E

    更新日期:2013-12-01 00:00:00

  • Ultimate and proximate mechanisms of reciprocal altruism in rats.

    abstract::The reciprocal exchange of goods and services among social partners is a conundrum in evolutionary biology because of its proneness to cheating, but also the behavioral and cognitive mechanisms involved in such mutual cooperation are hotly debated. Extreme viewpoints range from the assumption that, at the proximate le...

    journal_title:Learning & behavior

    pub_type: 杂志文章

    doi:10.3758/s13420-016-0236-z

    authors: Dolivo V,Rutte C,Taborsky M

    更新日期:2016-09-01 00:00:00

  • Discrimination learning in humans: role of number and complexity of rules.

    abstract::Various types of discrimination learning tasks, such as so-called nonconditional, conditional, and biconditional tasks, are generally held to differ in complexity and to require different amounts of training. However, rather than a difference in rule complexity, between-task performance differences may reflect a diffe...

    journal_title:Learning & behavior

    pub_type: 杂志文章

    doi:10.3758/bf03206428

    authors: Maes JH,Eling PA

    更新日期:2007-11-01 00:00:00

  • Competition between ethanol-induced reward and aversion in place conditioning.

    abstract::Previous place conditioning studies in mice have shown that injection of ethanol immediately before a conditioned stimulus (CS+) produces conditioned preference, whereas injection of ethanol immediately after CS+ produces conditioned aversion. In the present experiments, we examined the learning that occurs when ethan...

    journal_title:Learning & behavior

    pub_type: 杂志文章

    doi:10.3758/bf03195988

    authors: Cunningham CL,Smith R,McMullin C

    更新日期:2003-08-01 00:00:00

  • Appetitive conditioning task in a shuttle box and its comparison with the active avoidance paradigm.

    abstract::The main features of the Shuttle Box Active Avoidance paradigm (e.g., the use of simple locomotor response as an operant and electrical current as a primary reinforcer) make this task easily automated. However, learning in this paradigm cannot be easily separated from the specificity of fear motivation. Punishment and...

    journal_title:Learning & behavior

    pub_type: 杂志文章

    doi:10.3758/s13420-020-00422-9

    authors: Berezhnoy DS,Zamorina TA,Inozemtsev AN

    更新日期:2020-09-01 00:00:00

  • Discrimination blocking: acquisition versus performance deficits in human contingency learning.

    abstract::We compared acquisition and performance accounts of human contingency learning. After solving a discrimination in Phase 1, in which Cue A predicted the occurrence of the outcome and Cue B predicted its nonoccurrence (A+/B-), a new discrimination (X+/Y-) was superimposed in Phase 2 (AX+/BY-). The participants were fina...

    journal_title:Learning & behavior

    pub_type: 杂志文章

    doi:10.3758/bf03193050

    authors: Castro L,Wasserman EA

    更新日期:2007-08-01 00:00:00

  • Time-course of control by specific stimulus features and relational cues during same-different discrimination training.

    abstract::We trained 7 pigeons to discriminate visual displays of 16 same items from displays of 16 different items. The specific stimulus features of the items and the relations among the items could serve as discriminative stimuli. Unlike in most studies of same-different discrimination behavior, we gave a small number of pro...

    journal_title:Learning & behavior

    pub_type: 杂志文章

    doi:10.3758/bf03196019

    authors: Gibson BM,Wasserman EA

    更新日期:2004-05-01 00:00:00

  • The push and pull of dopamine in cue-reward learning.

    abstract::A recent study by Saunders, Richard, Margolis, and Janak (2018) shows that there is a great deal left to learn about what different mesotelencephalic dopamine circuits contribute to learning about the motivational significance of reward-related cues. Their findings suggest that nigrostriatal and mesolimbic dopamine pa...

    journal_title:Learning & behavior

    pub_type: 杂志文章

    doi:10.3758/s13420-018-0370-x

    authors: Ostlund SB

    更新日期:2019-12-01 00:00:00

  • Impact of brief or extended extinction of a taste aversion on inhibitory associations: evidence from summation, retardation, and preference tests.

    abstract::In five conditioned taste aversion experiments with rats, summation, retardation, and preference tests were used to assess the effects of extinguishing a conditioned saccharin aversion for three or nine trials. In Experiment 1, a summation test showed that saccharin aversion extinguished over nine trials reduced the a...

    journal_title:Learning & behavior

    pub_type: 杂志文章

    doi:10.3758/bf03195971

    authors: Brooks DC,Bowker JL,Anderson JE,Palmatier MI

    更新日期:2003-02-01 00:00:00

  • A new approach to understanding canine social cognition.

    abstract::Domestic dogs have become well known for their socio-cognitive successes, so what does it mean when domestic dogs fail to cooperate? A new study by Marshall-Pescini, Schwarz, Kostelnik, Virányi, and Range (PNAS, 114(44) 11793-11798, 2017) highlights the importance of considering socioecological context, learning, and ...

    journal_title:Learning & behavior

    pub_type: 评论,杂志文章

    doi:10.3758/s13420-018-0334-1

    authors: Udell MAR

    更新日期:2018-12-01 00:00:00

  • The paradoxical performance by different species on the ephemeral reward task.

    abstract::The ephemeral reward task consists of giving an animal a choice between two distinctive stimuli, A and B (e.g., black and white), on each of which is placed a bit of food. If the animal chooses the food on A, it gets that reinforcer, but the other stimulus, B, is removed, and the trial is over. If it chooses the food ...

    journal_title:Learning & behavior

    pub_type: 杂志文章

    doi:10.3758/s13420-020-00429-2

    authors: Zentall TR

    更新日期:2020-06-24 00:00:00

  • What makes a landmark effective in adolescent and adult rats? Sex and age differences in a navigation task.

    abstract::In three experiments, rats of different ages were trained in a circular pool to find a hidden platform whose location was defined in terms of a single landmark, a cylinder outside the pool. Following training, two main components of the landmark, its shape and pattern, were tested individually. Experiment 1 was perfor...

    journal_title:Learning & behavior

    pub_type: 杂志文章

    doi:10.3758/s13420-018-0364-8

    authors: Chamizo VD,Torres MN,Rodríguez CA,Mackintosh NJ

    更新日期:2019-06-01 00:00:00

  • Addition and subtraction by honeybees.

    abstract::Howard, Avargues-Weber, Garcia, Greentree, and Dyer (Science Advances, 5,1-6, 2019) report experiments in which honeybees initially shown a number of shapes could subsequently choose a pattern that added or subtracted one from that number. Further, the operations of addition and subtraction were cued by the colors of ...

    journal_title:Learning & behavior

    pub_type: 评论,杂志文章

    doi:10.3758/s13420-019-00382-9

    authors: Roberts WA

    更新日期:2020-06-01 00:00:00

  • Exploring a latent cause theory of classical conditioning.

    abstract::We frame behavior in classical conditioning experiments as the product of normative statistical inference. According to this theory, animals learn an internal model of their environment from experience. The basic building blocks of this internal model are latent causes-explanatory constructs inferred by the animal tha...

    journal_title:Learning & behavior

    pub_type: 杂志文章

    doi:10.3758/s13420-012-0080-8

    authors: Gershman SJ,Niv Y

    更新日期:2012-09-01 00:00:00

  • Stimuli with identical contextual functions taught independently become functionally equivalent.

    abstract::A novel learning process that does not require stimulus associations was explored in humans. The hypothesis was that two contextual stimuli taught in separate settings, with different stimuli, become equivalent if they accomplish identical functions with regard to the relations between the stimuli presented with them....

    journal_title:Learning & behavior

    pub_type: 杂志文章

    doi:10.3758/s13420-014-0166-6

    authors: Pérez-González LA,Díaz E,Fernández-García S,Baizán C

    更新日期:2015-06-01 00:00:00

  • How comparative psychology can shed light on human evolution: Response to Beran et al.'s discussion of "Cognitive capacities for cooking in chimpanzees".

    abstract::We recently reported a study (Warneken & Rosati Proceedings of the Royal Society B, 282, 20150229, 2015) examining whether chimpanzees possess several cognitive capacities that are critical to engage in cooking. In a subsequent commentary, Beran, Hopper, de Waal, Sayers, and Brosnan Learning & Behavior (2015) asserted...

    journal_title:Learning & behavior

    pub_type: 杂志文章

    doi:10.3758/s13420-016-0220-7

    authors: Rosati AG,Warneken F

    更新日期:2016-06-01 00:00:00

  • Decision making by humans in a behavioral task: do humans, like pigeons, show suboptimal choice?

    abstract::Consistent with human gambling behavior but contrary to optimal foraging theory, pigeons show a strong preference for an alternative with low probability and high payoff (a gambling-like alternative) over an alternative with a greater net payoff (Zentall & Stagner, Proceedings of the Royal Society B, 278, 1203-1208, 2...

    journal_title:Learning & behavior

    pub_type: 杂志文章,随机对照试验

    doi:10.3758/s13420-012-0065-7

    authors: Molet M,Miller HC,Laude JR,Kirk C,Manning B,Zentall TR

    更新日期:2012-12-01 00:00:00

  • Behavioral and associative effects of differential outcomes in discrimination learning.

    abstract::The role of the reinforcer in instrumental discriminations has often been viewed as that of facilitating associative learning between a reinforced response and the discriminative stimulus that occasions it. The differential-outcome paradigm introduced by Trapold (1970), however, has provided compelling evidence that r...

    journal_title:Learning & behavior

    pub_type: 杂志文章

    doi:10.3758/bf03196047

    authors: Urcuioli PJ

    更新日期:2005-02-01 00:00:00

  • Conserving and managing animals that learn socially and share cultures.

    abstract::Socially learned behavior can be a crucial factor in how animals interact with their environment and, thus, in conservation and management. For species in which social learning and culture are important determinants of behavior, several factors complicate conservation and management. These include the rapid spread of ...

    journal_title:Learning & behavior

    pub_type: 杂志文章

    doi:10.3758/LB.38.3.329

    authors: Whitehead H

    更新日期:2010-08-01 00:00:00

  • Training reinforcement rates, resistance to extinction, and the role of context in reinstatement.

    abstract::Behavior reduced as a consequence of extinction or intervention can relapse. According to behavioral momentum theory, the extent to which behavior persists and relapses once it has been eliminated depends on the relative training reinforcement rate among discriminative stimuli. In addition, studies of context renewal ...

    journal_title:Learning & behavior

    pub_type: 杂志文章

    doi:10.3758/s13420-015-0188-8

    authors: Miranda-Dukoski L,Bensemann J,Podlesnik CA

    更新日期:2016-03-01 00:00:00

  • Proactive interference of open field on consummatory successive negative contrast.

    abstract::Reactivity to a reward is affected by prior experience with the different reinforcer values of that reward, a phenomenon known as incentive relativity, which can be studied using the consummatory succesive negative contrast (cSNC) paradigm, in which the performance of animals that receive a 4 % sucrose solution after ...

    journal_title:Learning & behavior

    pub_type: 杂志文章

    doi:10.3758/s13420-013-0124-8

    authors: Justel N,Pautassi R,Mustaca A

    更新日期:2014-03-01 00:00:00

  • Revisiting the role of within-compound associations in cue-interaction phenomena.

    abstract::Although it is thought that within-compound associations are necessary for the occurrence of both backward blocking and unovershadowing, it is not known whether this variable plays a similar role in mediating the two phenomena. Similarly, the roles of within-compound associations in forward blocking and in reduced ove...

    journal_title:Learning & behavior

    pub_type: 杂志文章

    doi:10.3758/s13420-012-0085-3

    authors: Luque D,Flores A,Vadillo MA

    更新日期:2013-03-01 00:00:00

  • Domestic pigeons (Columba livia) discriminate between photographs of individual pigeons.

    abstract::In two experiments, we examined the discrimination of photographs of individual pigeons by pigeons, using go/no-go discrimination procedures. In Experiments 1A and 1B, the pigeons were trained to discriminate 4 photographs of one pigeon from those of a number of pigeons. The subjects learned the discrimination, but th...

    journal_title:Learning & behavior

    pub_type: 杂志文章

    doi:10.3758/bf03195993

    authors: Nakamura T,Croft DB,Westbrook RF

    更新日期:2003-11-01 00:00:00

  • Roles of context in acquisition of human instrumental learning: Implications for the understanding of the mechanisms underlying context-switch effects.

    abstract::Four experiments in human instrumental learning explored the associations involving the context that develop after three trials of training on simple discriminations. Experiments 1 and 4 found a deleterious effect of switching the learning context that cannot be explained by the context-outcome binary associations com...

    journal_title:Learning & behavior

    pub_type: 杂志文章

    doi:10.3758/s13420-016-0256-8

    authors: Gámez AM,León SP,Rosas JM

    更新日期:2017-09-01 00:00:00

  • Grid-like units help deep learning agent to navigate.

    abstract::An artificial-intelligence model based on deep learning developed units in a hidden layer that resembled mammalian grid cells in the hippocampus when the agent was taught to integrate paths. The full model performed sophisticated navigational tasks-in some cases even better than a human. ...

    journal_title:Learning & behavior

    pub_type: 评论,杂志文章

    doi:10.3758/s13420-018-0329-y

    authors: Cheng K

    更新日期:2019-03-01 00:00:00

  • Is symmetry inference an essential component of language?

    abstract::Symmetry inference-that is, spontaneously deriving the stimulus association B-A from A-B-was recently reported in preverbal infants (Kabdebon & Dehaene-Lambertz, 2019, Proceedings of the National Academy of Sciences of the United States of America, 116[12], 5805-5810) and regarded as a "building block for human cognit...

    journal_title:Learning & behavior

    pub_type: 评论,杂志文章

    doi:10.3758/s13420-019-00405-5

    authors: Chartier TF,Rey A

    更新日期:2020-09-01 00:00:00

  • Differences in taste-potentiated odor aversions with O+/OT+ versus OT+/O+ conditioning: Implications for configural associations.

    abstract::The present research demonstrates a conditioning order effect difference: Odor-aversion conditioning is stronger following OT+/O+ conditioning than following O+/OT+ conditioning with specific odor (O) and taste (T) cues. When a weak odor cue was used in Experiments 1A and 1B, OT+/O+ conditioning produced significantly...

    journal_title:Learning & behavior

    pub_type: 杂志文章

    doi:10.3758/LB.36.4.267

    authors: Batson JD,Watkins JH,Doyle K,Batsell WR Jr

    更新日期:2008-11-01 00:00:00

  • Protection from extinction provided by a conditioned inhibitor.

    abstract::Three conditioned suppression experiments with rats as subjects investigated the influence of higher order associations in determining the response potential of a target stimulus. In these experiments, a Pavlovian conditioned inhibitor was compounded with the target cue during extinction treatment. In Experiment 1, st...

    journal_title:Learning & behavior

    pub_type: 杂志文章

    doi:10.3758/LB.38.1.68

    authors: McConnell BL,Miller RR

    更新日期:2010-02-01 00:00:00