The paradoxical performance by different species on the ephemeral reward task.

Abstract:

:The ephemeral reward task consists of giving an animal a choice between two distinctive stimuli, A and B (e.g., black and white), on each of which is placed a bit of food. If the animal chooses the food on A, it gets that reinforcer, but the other stimulus, B, is removed, and the trial is over. If it chooses the food on B, however, it gets that food and the stimulus A remains, so it can have that food as well. Thus, choice of stimulus B gives the animal two reinforcers rather than one. Wrasse (cleaner fish) easily learn to choose optimally, whereas surprisingly, most non-human primates do not. Parrots, however, appear to learn this task as easily as the fish. To test the hypothesis that animals that choose with their mouth can learn it, we tested pigeons and found that they show no evidence of optimal learning with this task (with either the manual presentation of the stimuli or the operant presentation of the stimuli). Similarly, rats show no evidence of optimal learning. However, if a 20-s delay (fixed-interval schedule) is inserted between stimulus choice and reinforcement, both pigeons and rats learn to perform optimally. The ephemeral reward task appears to promote impulsive choice in several species, but with this task (and others), inserting a delay between choice and reinforcement promotes more careful choice, leading to optimal performance.

journal_name

Learn Behav

journal_title

Learning & behavior

authors

Zentall TR

doi

10.3758/s13420-020-00429-2

subject

Has Abstract

pub_date

2020-06-24 00:00:00

eissn

1543-4494

issn

1543-4508

pii

10.3758/s13420-020-00429-2

pub_type

杂志文章
  • Associative foundation of causal learning in rats.

    abstract::Are humans unique in their ability to interpret exogenous events as causes? We addressed this question by observing the behavior of rats for indications of causal learning. Within an operant motor-sensory preconditioning paradigm, associative surgical techniques revealed that rats attempted to control an outcome (i.e....

    journal_title:Learning & behavior

    pub_type: 杂志文章

    doi:10.3758/s13420-012-0075-5

    authors: Polack CW,McConnell BL,Miller RR

    更新日期:2013-03-01 00:00:00

  • More but not less uncertainty makes adult humans' tool selections more similar to those reported with crows.

    abstract::In this study, we examined whether adult humans' tool selections in a stick-and-tube problem might resemble previously published results of crows' selections if people had more experience solving the problem or were presented with a more ambiguous problem. In Experiments 1a and 1b, when given multiple opportunities to...

    journal_title:Learning & behavior

    pub_type: 杂志文章

    doi:10.3758/s13420-012-0069-3

    authors: Silva FJ,Silva KM

    更新日期:2012-12-01 00:00:00

  • Protection from extinction provided by a conditioned inhibitor.

    abstract::Three conditioned suppression experiments with rats as subjects investigated the influence of higher order associations in determining the response potential of a target stimulus. In these experiments, a Pavlovian conditioned inhibitor was compounded with the target cue during extinction treatment. In Experiment 1, st...

    journal_title:Learning & behavior

    pub_type: 杂志文章

    doi:10.3758/LB.38.1.68

    authors: McConnell BL,Miller RR

    更新日期:2010-02-01 00:00:00

  • A new approach to understanding canine social cognition.

    abstract::Domestic dogs have become well known for their socio-cognitive successes, so what does it mean when domestic dogs fail to cooperate? A new study by Marshall-Pescini, Schwarz, Kostelnik, Virányi, and Range (PNAS, 114(44) 11793-11798, 2017) highlights the importance of considering socioecological context, learning, and ...

    journal_title:Learning & behavior

    pub_type: 评论,杂志文章

    doi:10.3758/s13420-018-0334-1

    authors: Udell MAR

    更新日期:2018-12-01 00:00:00

  • Memories of emotional expressions in horses.

    abstract::Proops, Grounds, Smith, and McComb (2018) suggest that horses remember previous emotional expressions of specific humans, and use these memories to adjust their behavior in future social interactions. Despite some methodological shortcomings, this study raises important questions on the complexity of social interactio...

    journal_title:Learning & behavior

    pub_type: 杂志文章

    doi:10.3758/s13420-018-0363-9

    authors: Amici F

    更新日期:2019-09-01 00:00:00

  • Selective reinstatement of instrumental performance depends on the discriminative stimulus properties of the mediating outcome.

    abstract::We conducted three experiments to investigate the associative structure underlying the reinstatement of instrumental performance after extinction. In each experiment, rats were initially rewarded on two responses with different outcomes. At test, both responses were extinguished in order to assess the impact of a sing...

    journal_title:Learning & behavior

    pub_type: 杂志文章

    doi:10.3758/bf03196073

    authors: Ostlund SB,Balline BW

    更新日期:2007-02-01 00:00:00

  • Generalization of causal efficacy judgments after evaluative learning.

    abstract::In three experiments, we examined the effect of response-outcome relations on human ratings of causal efficacy and demonstrated that such efficacy ratings transfer to novel situations through derived stimulus relations. Causal efficacy ratings were higher, and probability of an outcome given a response was lower, for ...

    journal_title:Learning & behavior

    pub_type: 杂志文章

    doi:10.3758/LB.37.4.336

    authors: Dack C,McHugh L,Reed P

    更新日期:2009-11-01 00:00:00

  • The influences of guiding cues on motor skill autonomy in rats.

    abstract::How does the effectiveness of guiding cues influence the development of motor skill autonomy? We utilized two sets of guiding cues (lights vs. reversed-lights conditions) that differed in their effectiveness to control a left-right leverpress sequence in rats. We separately measured the development of stimulus control...

    journal_title:Learning & behavior

    pub_type: 杂志文章

    doi:10.3758/s13420-013-0121-y

    authors: Reid AK,Demarco G,Smith K,Fort T,Cousins E

    更新日期:2013-12-01 00:00:00

  • Development of point following behaviors in shelter dogs.

    abstract::Pet dogs are known to be responsive to human pointing gestures, but shelter dogs have repeatedly demonstrated poor abilities to follow human pointing, although they can be explicitly trained quickly. This study evaluated the time course in which shelter dogs learn to follow points without explicit training, when given...

    journal_title:Learning & behavior

    pub_type: 杂志文章

    doi:10.3758/s13420-020-00415-8

    authors: Jarvis T,Hall NJ

    更新日期:2020-09-01 00:00:00

  • Proactive interference of open field on consummatory successive negative contrast.

    abstract::Reactivity to a reward is affected by prior experience with the different reinforcer values of that reward, a phenomenon known as incentive relativity, which can be studied using the consummatory succesive negative contrast (cSNC) paradigm, in which the performance of animals that receive a 4 % sucrose solution after ...

    journal_title:Learning & behavior

    pub_type: 杂志文章

    doi:10.3758/s13420-013-0124-8

    authors: Justel N,Pautassi R,Mustaca A

    更新日期:2014-03-01 00:00:00

  • Decision making by humans in a behavioral task: do humans, like pigeons, show suboptimal choice?

    abstract::Consistent with human gambling behavior but contrary to optimal foraging theory, pigeons show a strong preference for an alternative with low probability and high payoff (a gambling-like alternative) over an alternative with a greater net payoff (Zentall & Stagner, Proceedings of the Royal Society B, 278, 1203-1208, 2...

    journal_title:Learning & behavior

    pub_type: 杂志文章,随机对照试验

    doi:10.3758/s13420-012-0065-7

    authors: Molet M,Miller HC,Laude JR,Kirk C,Manning B,Zentall TR

    更新日期:2012-12-01 00:00:00

  • Differences in taste-potentiated odor aversions with O+/OT+ versus OT+/O+ conditioning: Implications for configural associations.

    abstract::The present research demonstrates a conditioning order effect difference: Odor-aversion conditioning is stronger following OT+/O+ conditioning than following O+/OT+ conditioning with specific odor (O) and taste (T) cues. When a weak odor cue was used in Experiments 1A and 1B, OT+/O+ conditioning produced significantly...

    journal_title:Learning & behavior

    pub_type: 杂志文章

    doi:10.3758/LB.36.4.267

    authors: Batson JD,Watkins JH,Doyle K,Batsell WR Jr

    更新日期:2008-11-01 00:00:00

  • Discriminative stimuli that follow the absence of reinforcement are preferred by pigeons over those that follow reinforcement.

    abstract::Clement, Feltus, Kaiser, and Zentall (2000) found that when pigeons have to work to obtain a discriminative stimulus that is followed by reinforcement, they prefer a discriminative stimulus that requires greater effort over one that requires less effort. The authors suggested that such a preference results from the gr...

    journal_title:Learning & behavior

    pub_type: 杂志文章

    doi:10.3758/bf03192862

    authors: Friedrich AM,Clement TS,Zentall TR

    更新日期:2005-08-01 00:00:00

  • Domestic pigeons (Columba livia) discriminate between photographs of individual pigeons.

    abstract::In two experiments, we examined the discrimination of photographs of individual pigeons by pigeons, using go/no-go discrimination procedures. In Experiments 1A and 1B, the pigeons were trained to discriminate 4 photographs of one pigeon from those of a number of pigeons. The subjects learned the discrimination, but th...

    journal_title:Learning & behavior

    pub_type: 杂志文章

    doi:10.3758/bf03195993

    authors: Nakamura T,Croft DB,Westbrook RF

    更新日期:2003-11-01 00:00:00

  • How comparative psychology can shed light on human evolution: Response to Beran et al.'s discussion of "Cognitive capacities for cooking in chimpanzees".

    abstract::We recently reported a study (Warneken & Rosati Proceedings of the Royal Society B, 282, 20150229, 2015) examining whether chimpanzees possess several cognitive capacities that are critical to engage in cooking. In a subsequent commentary, Beran, Hopper, de Waal, Sayers, and Brosnan Learning & Behavior (2015) asserted...

    journal_title:Learning & behavior

    pub_type: 杂志文章

    doi:10.3758/s13420-016-0220-7

    authors: Rosati AG,Warneken F

    更新日期:2016-06-01 00:00:00

  • Learning in Cnidaria: A systematic review.

    abstract::Using the database Web of Science, a systematic search for literature on learning in Cnidaria, both non-associative and associative, was conducted. Cnidaria comprise hydras, box jellies, (true) jellyfish, corals, and sea anemones, a group of animals possessing diffuse networks of nerves known as nerve nets or neural n...

    journal_title:Learning & behavior

    pub_type: 杂志文章,评审

    doi:10.3758/s13420-020-00452-3

    authors: Cheng K

    更新日期:2021-01-13 00:00:00

  • Competence and performance in causal learning.

    abstract::The dominant theoretical approach to causal learning postulates the acquisition of associative weights between cues and outcomes. This reduction of causal induction to associative learning implies that learners are insensitive to important characteristics of causality, such as the inherent directionality between cause...

    journal_title:Learning & behavior

    pub_type: 杂志文章

    doi:10.3758/bf03196064

    authors: Waldmann MR,Walker JM

    更新日期:2005-05-01 00:00:00

  • Training reinforcement rates, resistance to extinction, and the role of context in reinstatement.

    abstract::Behavior reduced as a consequence of extinction or intervention can relapse. According to behavioral momentum theory, the extent to which behavior persists and relapses once it has been eliminated depends on the relative training reinforcement rate among discriminative stimuli. In addition, studies of context renewal ...

    journal_title:Learning & behavior

    pub_type: 杂志文章

    doi:10.3758/s13420-015-0188-8

    authors: Miranda-Dukoski L,Bensemann J,Podlesnik CA

    更新日期:2016-03-01 00:00:00

  • Social learning in New Caledonian crows.

    abstract::New Caledonian (NC) crows are the most sophisticated tool manufacturers other than humans. The diversification and geographical distribution of their three Pandanus tool designs that differ in complexity, as well as the lack of ecological correlates, suggest that cumulative technological change has taken place. To inv...

    journal_title:Learning & behavior

    pub_type: 杂志文章

    doi:10.3758/LB.38.3.206

    authors: Holzhaider JC,Hunt GR,Gray RD

    更新日期:2010-08-01 00:00:00

  • Can squirrel monkeys (Saimiri sciureus) plan for the future? Studies of temporal myopia in food choice.

    abstract::In seven experiments, 2 squirrel monkeys were given choices between arrays of food that varied in the quantity offered. In Experiments 1-5, the monkeys were offered choices between quantities of the same food that varied in a 2:1 ratio. The squirrel monkeys failed to show the temporal myopia effect or a decrease in pr...

    journal_title:Learning & behavior

    pub_type: 杂志文章

    doi:10.3758/bf03196035

    authors: McKenzie T,Cherman T,Bird LR,Naqshbandi M,Roberts WA

    更新日期:2004-11-01 00:00:00

  • Response of male and female domestic chicks to change in the number (quantity) of imprinting objects.

    abstract::When facing two sets of imprinting objects of different numerousness, domestic chicks prefer to approach the larger one. Given that choice for familiar and novel stimuli in imprinting situations is known to be affected by the sex of the animals, we investigated how male and female domestic chicks divide the time spent...

    journal_title:Learning & behavior

    pub_type: 杂志文章

    doi:10.3758/s13420-020-00446-1

    authors: Lemaire BS,Rugani R,Regolin L,Vallortigara G

    更新日期:2020-10-06 00:00:00

  • Does satiation close the open economy?

    abstract::Pigeons responded on fixed-interval and fixed-ratio food schedules during sessions of extended duration. Pause lengths from the beginning of the session, when the subjects were hungry, resembled those found in open economies, whereas pause lengths from the end of the sessions, when the subjects were close to satiation...

    journal_title:Learning & behavior

    pub_type: 杂志文章

    doi:10.3758/bf03193178

    authors: Posadas-Sánchez D,Killeen PR

    更新日期:2005-11-01 00:00:00

  • Addition and subtraction by honeybees.

    abstract::Howard, Avargues-Weber, Garcia, Greentree, and Dyer (Science Advances, 5,1-6, 2019) report experiments in which honeybees initially shown a number of shapes could subsequently choose a pattern that added or subtracted one from that number. Further, the operations of addition and subtraction were cued by the colors of ...

    journal_title:Learning & behavior

    pub_type: 评论,杂志文章

    doi:10.3758/s13420-019-00382-9

    authors: Roberts WA

    更新日期:2020-06-01 00:00:00

  • The fate of redundant cues: Further analysis of the redundancy effect.

    abstract::Pearce, Dopson, Haselgrove, and Esber (Journal of Experimental Psychology: Animal Behavior Processes, 38, 167-179, 2012) conducted a series of experiments with rats and pigeons in which the conditioned responding elicited by two types of redundant cue was compared. One of these redundant cues was a blocked cue X from ...

    journal_title:Learning & behavior

    pub_type: 杂志文章

    doi:10.3758/s13420-014-0162-x

    authors: Jones PM,Pearce JM

    更新日期:2015-03-01 00:00:00

  • Chimpanzees, cooking, and a more comparative psychology.

    abstract::A recent report suggested that chimpanzees demonstrate the cognitive capacities necessary to understand cooking (Warneken & Rosati, 2015). We offered alternative explanations and mechanisms that could account for the behavioral responses of those chimpanzees, and questioned the manner in which the data were used to ex...

    journal_title:Learning & behavior

    pub_type: 杂志文章

    doi:10.3758/s13420-016-0224-3

    authors: Beran MJ,Hopper LM,de Waal FB,Brosnan SF,Sayers K

    更新日期:2016-06-01 00:00:00

  • The psychological significance of play with imaginary companions in early childhood.

    abstract::Although social play is common to many species, humans are unique in their ability to extract some of the benefits of social play through imagination. For example, in play with imaginary companions (ICs), children often practice skills that might be useful for later adaptive social, relational, and emotional functioni...

    journal_title:Learning & behavior

    pub_type: 杂志文章

    doi:10.3758/s13420-017-0284-z

    authors: Gleason TR

    更新日期:2017-12-01 00:00:00

  • Stimuli with identical contextual functions taught independently become functionally equivalent.

    abstract::A novel learning process that does not require stimulus associations was explored in humans. The hypothesis was that two contextual stimuli taught in separate settings, with different stimuli, become equivalent if they accomplish identical functions with regard to the relations between the stimuli presented with them....

    journal_title:Learning & behavior

    pub_type: 杂志文章

    doi:10.3758/s13420-014-0166-6

    authors: Pérez-González LA,Díaz E,Fernández-García S,Baizán C

    更新日期:2015-06-01 00:00:00

  • The push and pull of dopamine in cue-reward learning.

    abstract::A recent study by Saunders, Richard, Margolis, and Janak (2018) shows that there is a great deal left to learn about what different mesotelencephalic dopamine circuits contribute to learning about the motivational significance of reward-related cues. Their findings suggest that nigrostriatal and mesolimbic dopamine pa...

    journal_title:Learning & behavior

    pub_type: 杂志文章

    doi:10.3758/s13420-018-0370-x

    authors: Ostlund SB

    更新日期:2019-12-01 00:00:00

  • Jumping spiders: An exceptional group for comparative cognition studies.

    abstract::Several non-mutually exclusive hypotheses have been proposed to explain the evolution of cognition in animals. Broadly, these hypotheses fall under two categories: those that pertain to the selective pressures exerted either by sociality or by the ecological niche in which animals live. We review these ideas and then ...

    journal_title:Learning & behavior

    pub_type: 杂志文章,评审

    doi:10.3758/s13420-020-00445-2

    authors: Aguilar-Arguello S,Nelson XJ

    更新日期:2021-01-14 00:00:00

  • Appetitive conditioning task in a shuttle box and its comparison with the active avoidance paradigm.

    abstract::The main features of the Shuttle Box Active Avoidance paradigm (e.g., the use of simple locomotor response as an operant and electrical current as a primary reinforcer) make this task easily automated. However, learning in this paradigm cannot be easily separated from the specificity of fear motivation. Punishment and...

    journal_title:Learning & behavior

    pub_type: 杂志文章

    doi:10.3758/s13420-020-00422-9

    authors: Berezhnoy DS,Zamorina TA,Inozemtsev AN

    更新日期:2020-09-01 00:00:00