Behavioral and associative effects of differential outcomes in discrimination learning.

Abstract:

:The role of the reinforcer in instrumental discriminations has often been viewed as that of facilitating associative learning between a reinforced response and the discriminative stimulus that occasions it. The differential-outcome paradigm introduced by Trapold (1970), however, has provided compelling evidence that reinforcers are also part of what is learned in discrimination tasks. Specifically, when the availability of different reinforcing outcomes is signaled by different discriminative stimuli, the conditioned anticipation of those outcomes can provide another source of stimulus control over responding. This article reviews how such control develops and how it can be revealed, its impact on behavior, and different possible mechanisms that could mediate the behavioral effects. The main conclusion is that differential-outcome effects are almost entirely explicable in terms of the cue properties of outcome expectancies-namely, that conditioned expectancies acquire discriminative control just like any other discriminative or conditional stimulus in instrumental learning.

journal_name

Learn Behav

journal_title

Learning & behavior

authors

Urcuioli PJ

doi

10.3758/bf03196047

keywords:

subject

Has Abstract

pub_date

2005-02-01 00:00:00

pages

1-21

issue

1

eissn

1543-4494

issn

1543-4508

journal_volume

33

pub_type

杂志文章
  • Apes track false beliefs but might not understand them.

    abstract::Apes can correctly determine how to help a person with a false belief. But they may not need a concept of belief to do so. ...

    journal_title:Learning & behavior

    pub_type: 评论,杂志文章

    doi:10.3758/s13420-017-0288-8

    authors: Andrews K

    更新日期:2018-03-01 00:00:00

  • Animal procrastination: Pigeons choose to defer experiencing an aversive gap or a peck requirement.

    abstract::When humans procrastinate, they delay completing a required relatively aversive task. In the present experiments with pigeons, we considered the possibility that completing the task close to the deadline results in the formation of a stronger conditioned reinforcer. In Experiment 1, pigeons were given a choice between...

    journal_title:Learning & behavior

    pub_type: 杂志文章

    doi:10.3758/s13420-019-00397-2

    authors: Zentall TR,Peng D,House D,Halloran M

    更新日期:2020-06-01 00:00:00

  • Discrimination learning in humans: role of number and complexity of rules.

    abstract::Various types of discrimination learning tasks, such as so-called nonconditional, conditional, and biconditional tasks, are generally held to differ in complexity and to require different amounts of training. However, rather than a difference in rule complexity, between-task performance differences may reflect a diffe...

    journal_title:Learning & behavior

    pub_type: 杂志文章

    doi:10.3758/bf03206428

    authors: Maes JH,Eling PA

    更新日期:2007-11-01 00:00:00

  • Perceptual learning in human and nonhuman animals: a search for common ground.

    abstract::Perceptual learning has been extensively studied in both human and nonhuman animals, but the two lines of research have, for the most part, developed independently, addressing seemingly rather different issues by rather different methods. It has been argued, however, that analysis of the disparate phenomena studied in...

    journal_title:Learning & behavior

    pub_type: 杂志文章

    doi:10.3758/LB.37.2.133

    authors: Hall G

    更新日期:2009-05-01 00:00:00

  • Revisiting the role of within-compound associations in cue-interaction phenomena.

    abstract::Although it is thought that within-compound associations are necessary for the occurrence of both backward blocking and unovershadowing, it is not known whether this variable plays a similar role in mediating the two phenomena. Similarly, the roles of within-compound associations in forward blocking and in reduced ove...

    journal_title:Learning & behavior

    pub_type: 杂志文章

    doi:10.3758/s13420-012-0085-3

    authors: Luque D,Flores A,Vadillo MA

    更新日期:2013-03-01 00:00:00

  • Specificity and flexibility of social influence on spatial choice.

    abstract::Rats searched for food in a situation that allowed them to determine which locations contained food after searching a small number of them, but not which of the baited locations contained more-preferred food rather than a less-preferred food. During some experimental trials, the latter information was available from t...

    journal_title:Learning & behavior

    pub_type: 杂志文章

    doi:10.3758/s13420-018-0322-5

    authors: Brown MF,Saxon ME,Heslin KA

    更新日期:2019-03-01 00:00:00

  • Protection from extinction provided by a conditioned inhibitor.

    abstract::Three conditioned suppression experiments with rats as subjects investigated the influence of higher order associations in determining the response potential of a target stimulus. In these experiments, a Pavlovian conditioned inhibitor was compounded with the target cue during extinction treatment. In Experiment 1, st...

    journal_title:Learning & behavior

    pub_type: 杂志文章

    doi:10.3758/LB.38.1.68

    authors: McConnell BL,Miller RR

    更新日期:2010-02-01 00:00:00

  • How comparative psychology can shed light on human evolution: Response to Beran et al.'s discussion of "Cognitive capacities for cooking in chimpanzees".

    abstract::We recently reported a study (Warneken & Rosati Proceedings of the Royal Society B, 282, 20150229, 2015) examining whether chimpanzees possess several cognitive capacities that are critical to engage in cooking. In a subsequent commentary, Beran, Hopper, de Waal, Sayers, and Brosnan Learning & Behavior (2015) asserted...

    journal_title:Learning & behavior

    pub_type: 杂志文章

    doi:10.3758/s13420-016-0220-7

    authors: Rosati AG,Warneken F

    更新日期:2016-06-01 00:00:00

  • Discrimination blocking: acquisition versus performance deficits in human contingency learning.

    abstract::We compared acquisition and performance accounts of human contingency learning. After solving a discrimination in Phase 1, in which Cue A predicted the occurrence of the outcome and Cue B predicted its nonoccurrence (A+/B-), a new discrimination (X+/Y-) was superimposed in Phase 2 (AX+/BY-). The participants were fina...

    journal_title:Learning & behavior

    pub_type: 杂志文章

    doi:10.3758/bf03193050

    authors: Castro L,Wasserman EA

    更新日期:2007-08-01 00:00:00

  • Time-course of control by specific stimulus features and relational cues during same-different discrimination training.

    abstract::We trained 7 pigeons to discriminate visual displays of 16 same items from displays of 16 different items. The specific stimulus features of the items and the relations among the items could serve as discriminative stimuli. Unlike in most studies of same-different discrimination behavior, we gave a small number of pro...

    journal_title:Learning & behavior

    pub_type: 杂志文章

    doi:10.3758/bf03196019

    authors: Gibson BM,Wasserman EA

    更新日期:2004-05-01 00:00:00

  • Attention as an acquisition and performance variable (AAPV).

    abstract::This article introduces a new model of Pavlovian conditioning, attention as an acquisition and performance variable (AAPV), which, like several other so-called attentional models, emphasizes the role of variation of cue salience, together with associative strength, in accounting for conditioning phenomena. AAPV is pri...

    journal_title:Learning & behavior

    pub_type: 杂志文章

    doi:10.3758/s13420-013-0131-9

    authors: Craddock P,Miller RR

    更新日期:2014-06-01 00:00:00

  • Differences in taste-potentiated odor aversions with O+/OT+ versus OT+/O+ conditioning: Implications for configural associations.

    abstract::The present research demonstrates a conditioning order effect difference: Odor-aversion conditioning is stronger following OT+/O+ conditioning than following O+/OT+ conditioning with specific odor (O) and taste (T) cues. When a weak odor cue was used in Experiments 1A and 1B, OT+/O+ conditioning produced significantly...

    journal_title:Learning & behavior

    pub_type: 杂志文章

    doi:10.3758/LB.36.4.267

    authors: Batson JD,Watkins JH,Doyle K,Batsell WR Jr

    更新日期:2008-11-01 00:00:00

  • Domestic pigeons (Columba livia) discriminate between photographs of individual pigeons.

    abstract::In two experiments, we examined the discrimination of photographs of individual pigeons by pigeons, using go/no-go discrimination procedures. In Experiments 1A and 1B, the pigeons were trained to discriminate 4 photographs of one pigeon from those of a number of pigeons. The subjects learned the discrimination, but th...

    journal_title:Learning & behavior

    pub_type: 杂志文章

    doi:10.3758/bf03195993

    authors: Nakamura T,Croft DB,Westbrook RF

    更新日期:2003-11-01 00:00:00

  • The influences of guiding cues on motor skill autonomy in rats.

    abstract::How does the effectiveness of guiding cues influence the development of motor skill autonomy? We utilized two sets of guiding cues (lights vs. reversed-lights conditions) that differed in their effectiveness to control a left-right leverpress sequence in rats. We separately measured the development of stimulus control...

    journal_title:Learning & behavior

    pub_type: 杂志文章

    doi:10.3758/s13420-013-0121-y

    authors: Reid AK,Demarco G,Smith K,Fort T,Cousins E

    更新日期:2013-12-01 00:00:00

  • The psychological significance of play with imaginary companions in early childhood.

    abstract::Although social play is common to many species, humans are unique in their ability to extract some of the benefits of social play through imagination. For example, in play with imaginary companions (ICs), children often practice skills that might be useful for later adaptive social, relational, and emotional functioni...

    journal_title:Learning & behavior

    pub_type: 杂志文章

    doi:10.3758/s13420-017-0284-z

    authors: Gleason TR

    更新日期:2017-12-01 00:00:00

  • The push and pull of dopamine in cue-reward learning.

    abstract::A recent study by Saunders, Richard, Margolis, and Janak (2018) shows that there is a great deal left to learn about what different mesotelencephalic dopamine circuits contribute to learning about the motivational significance of reward-related cues. Their findings suggest that nigrostriatal and mesolimbic dopamine pa...

    journal_title:Learning & behavior

    pub_type: 杂志文章

    doi:10.3758/s13420-018-0370-x

    authors: Ostlund SB

    更新日期:2019-12-01 00:00:00

  • Associations and hallucinations in mice and men.

    abstract::Powers et al. (2017, Science, 357(6351), 596-600) report that Pavlovian conditioning can result in the perception of a stimulus in its absence, and that this effect is related to hallucinations outside the laboratory. Considered alongside similar studies in animals, this suggests that associatively produced perceptual...

    journal_title:Learning & behavior

    pub_type: 评论,杂志文章

    doi:10.3758/s13420-017-0309-7

    authors: Dwyer DM

    更新日期:2018-09-01 00:00:00

  • Extinction and blocking of conditioned inhibition in human causal learning.

    abstract::Two experiments investigated extinction and blocking of a conditioned inhibitor in a human contingency-learning task. Lotz and Lachnit (2009) and Melchers, Wolff, and Lachnit (2006) reported extinction of inhibition only when participants experienced outcome levels lower than those used in training. In Experiment 1, w...

    journal_title:Learning & behavior

    pub_type: 杂志文章

    doi:10.3758/LB.38.4.394

    authors: Baetu I,Baker AG

    更新日期:2010-11-01 00:00:00

  • Retention period differentially attenuates win-shift/lose-stay relative to win-stay/lose-shift performance in the rat.

    abstract::Hungry rats were trained in a two-lever conditioning chamber to earn food reinforcement according to either a win-shift/lose-stay or a win-stay/lose-shift contingency. Performance on the two contingencies was similar when there was little delay between the initial, information part of the trial (i.e., win or lose) and...

    journal_title:Learning & behavior

    pub_type: 杂志文章

    doi:10.3758/s13420-017-0289-7

    authors: Reed P

    更新日期:2018-03-01 00:00:00

  • Proactive interference of open field on consummatory successive negative contrast.

    abstract::Reactivity to a reward is affected by prior experience with the different reinforcer values of that reward, a phenomenon known as incentive relativity, which can be studied using the consummatory succesive negative contrast (cSNC) paradigm, in which the performance of animals that receive a 4 % sucrose solution after ...

    journal_title:Learning & behavior

    pub_type: 杂志文章

    doi:10.3758/s13420-013-0124-8

    authors: Justel N,Pautassi R,Mustaca A

    更新日期:2014-03-01 00:00:00

  • Exploring a latent cause theory of classical conditioning.

    abstract::We frame behavior in classical conditioning experiments as the product of normative statistical inference. According to this theory, animals learn an internal model of their environment from experience. The basic building blocks of this internal model are latent causes-explanatory constructs inferred by the animal tha...

    journal_title:Learning & behavior

    pub_type: 杂志文章

    doi:10.3758/s13420-012-0080-8

    authors: Gershman SJ,Niv Y

    更新日期:2012-09-01 00:00:00

  • Roles of context in acquisition of human instrumental learning: Implications for the understanding of the mechanisms underlying context-switch effects.

    abstract::Four experiments in human instrumental learning explored the associations involving the context that develop after three trials of training on simple discriminations. Experiments 1 and 4 found a deleterious effect of switching the learning context that cannot be explained by the context-outcome binary associations com...

    journal_title:Learning & behavior

    pub_type: 杂志文章

    doi:10.3758/s13420-016-0256-8

    authors: Gámez AM,León SP,Rosas JM

    更新日期:2017-09-01 00:00:00

  • Transfer of judgments of control to a target stimulus and to novel stimuli through derived relations.

    abstract::Three experiments examined the effect of response-outcome contingencies on human ratings of causal efficacy and demonstrated that such ratings transfer to novel situations through derived stimulus relations. Efficacy ratings generally followed the delta probability rule when positive response-outcome contingencies wer...

    journal_title:Learning & behavior

    pub_type: 杂志文章,随机对照试验

    doi:10.3758/s13420-012-0066-6

    authors: Dack C,McHugh L,Reed P

    更新日期:2012-12-01 00:00:00

  • Aversive, appetitive and flavour avoidance responses in the presence of contextual cues.

    abstract::Appetitive, aversive and avoidance responses to a flavoured solution in distinct contexts were examined. Rats placed in either a white or black box were given access to saccharin. Consumption was followed by an injection of a toxin in one but not the other box. Rats showed more aversive responses in anticipation of an...

    journal_title:Learning & behavior

    pub_type: 杂志文章

    doi:10.3758/s13420-010-0008-0

    authors: Brown AR,Penney AM,Skinner DM,Martin GM

    更新日期:2011-05-01 00:00:00

  • The paradoxical performance by different species on the ephemeral reward task.

    abstract::The ephemeral reward task consists of giving an animal a choice between two distinctive stimuli, A and B (e.g., black and white), on each of which is placed a bit of food. If the animal chooses the food on A, it gets that reinforcer, but the other stimulus, B, is removed, and the trial is over. If it chooses the food ...

    journal_title:Learning & behavior

    pub_type: 杂志文章

    doi:10.3758/s13420-020-00429-2

    authors: Zentall TR

    更新日期:2020-06-24 00:00:00

  • Approaches to the study of traditional behaviors of free-living animals.

    abstract::I review literature on four different approaches to the study of traditions in animals: observation of free-living animals, laboratory experiment, armchair analysis, and field experiment. Because, by definition, a tradition entails social learning of some kind, it is difficult, perhaps impossible, to establish that a ...

    journal_title:Learning & behavior

    pub_type: 杂志文章,评审

    doi:10.3758/bf03196006

    authors: Galef BG Jr

    更新日期:2004-02-01 00:00:00

  • Conserving and managing animals that learn socially and share cultures.

    abstract::Socially learned behavior can be a crucial factor in how animals interact with their environment and, thus, in conservation and management. For species in which social learning and culture are important determinants of behavior, several factors complicate conservation and management. These include the rapid spread of ...

    journal_title:Learning & behavior

    pub_type: 杂志文章

    doi:10.3758/LB.38.3.329

    authors: Whitehead H

    更新日期:2010-08-01 00:00:00

  • Competence and performance in causal learning.

    abstract::The dominant theoretical approach to causal learning postulates the acquisition of associative weights between cues and outcomes. This reduction of causal induction to associative learning implies that learners are insensitive to important characteristics of causality, such as the inherent directionality between cause...

    journal_title:Learning & behavior

    pub_type: 杂志文章

    doi:10.3758/bf03196064

    authors: Waldmann MR,Walker JM

    更新日期:2005-05-01 00:00:00

  • Decision making by humans in a behavioral task: do humans, like pigeons, show suboptimal choice?

    abstract::Consistent with human gambling behavior but contrary to optimal foraging theory, pigeons show a strong preference for an alternative with low probability and high payoff (a gambling-like alternative) over an alternative with a greater net payoff (Zentall & Stagner, Proceedings of the Royal Society B, 278, 1203-1208, 2...

    journal_title:Learning & behavior

    pub_type: 杂志文章,随机对照试验

    doi:10.3758/s13420-012-0065-7

    authors: Molet M,Miller HC,Laude JR,Kirk C,Manning B,Zentall TR

    更新日期:2012-12-01 00:00:00

  • A new approach to understanding canine social cognition.

    abstract::Domestic dogs have become well known for their socio-cognitive successes, so what does it mean when domestic dogs fail to cooperate? A new study by Marshall-Pescini, Schwarz, Kostelnik, Virányi, and Range (PNAS, 114(44) 11793-11798, 2017) highlights the importance of considering socioecological context, learning, and ...

    journal_title:Learning & behavior

    pub_type: 评论,杂志文章

    doi:10.3758/s13420-018-0334-1

    authors: Udell MAR

    更新日期:2018-12-01 00:00:00