Incentive salience attribution under reward uncertainty: A Pavlovian model.

Abstract:

:There is a vast literature on the behavioural effects of partial reinforcement in Pavlovian conditioning. Compared with animals receiving continuous reinforcement, partially rewarded animals typically show (a) a slower development of the conditioned response (CR) early in training and (b) a higher asymptotic level of the CR later in training. This phenomenon is known as the partial reinforcement acquisition effect (PRAE). Learning models of Pavlovian conditioning fail to account for it. In accordance with the incentive salience hypothesis, it is here argued that incentive motivation (or 'wanting') plays a more direct role in controlling behaviour than does learning, and reward uncertainty is shown to have an excitatory effect on incentive motivation. The psychological origin of that effect is discussed and a computational model integrating this new interpretation is developed. Many features of CRs under partial reinforcement emerge from this model.

journal_name

Behav Processes

journal_title

Behavioural processes

authors

Anselme P

doi

10.1016/j.beproc.2014.10.016

subject

Has Abstract

pub_date

2015-02-01 00:00:00

pages

6-18

eissn

0376-6357

issn

1872-8308

pii

S0376-6357(14)00257-5

journal_volume

111

pub_type

杂志文章,评审
  • Defensive behaviour and its inheritance in the anabantoid fish, Macropodus opercularis and Macropodus opercularis concolor.

    abstract::In this preliminary study defense behaviour patterns (fear responses) are described in two closely related, behaviourally different inbred labyrinth fish subspecies and in their F1 generation. The subspecies M. opercularis (characterized briefly by "active escape") and M. opercularis concolor (characterized by "passiv...

    journal_title:Behavioural processes

    pub_type: 杂志文章

    doi:10.1016/0376-6357(78)90038-4

    authors: Vadász C,Kiss B,Csányi V

    更新日期:1978-07-01 00:00:00

  • Do ewes recognize their lambs within the first day postpartum without the help of olfactory cues?

    abstract::Two studies were carried out to test the ability of Préalpes du Sud x Lacaune (Study 1) and Rambouillet ewes (Study 2) to recognize their lambs during the first 24 h postpartum. Ewes were given the choice between their own and an alien lamb of approximately the same age, in a triangular pen of 10 m×10 m×10 m. A lamb w...

    journal_title:Behavioural processes

    pub_type: 杂志文章

    doi:10.1016/s0376-6357(99)00045-5

    authors: Terrazas A,Ferreira G,Lévy F,Nowak R,Serafin N,Orgeur P,Soto R,Poindron P

    更新日期:1999-08-01 00:00:00

  • Fear reactions of ewes to photographic images.

    abstract::The aim of this study was to analyse fear reactions of 18 adult Romanov ewes individually confronted with 3 visual stimuli, namely pictures of a human, of a sheep or of a traffic cone (control). These pictures were projected in real size on a wall of the test pen by means of a slide projector. Twenty-six behavioural i...

    journal_title:Behavioural processes

    pub_type: 杂志文章

    doi:10.1016/0376-6357(94)90024-8

    authors: Vandenheede M,Bouissou MF

    更新日期:1994-06-01 00:00:00

  • Multimodal communication, mismatched messages and the effects of turbidity on the antipredator behavior of the Barton Springs salamander, Eurycea sosorum.

    abstract::Prey may use multiple sensory channels to detect predators, whose cues may differ in altered sensory environments, such as turbid conditions. Depending on the environment, prey may use cues in an additive/complementary manner or in a compensatory manner. First, to determine whether the purely aquatic Barton Springs sa...

    journal_title:Behavioural processes

    pub_type: 杂志文章

    doi:10.1016/j.beproc.2016.06.016

    authors: Zabierek KC,Gabor CR

    更新日期:2016-09-01 00:00:00

  • Mr. right versus Mr. right now: A discounting-based approach to promiscuity.

    abstract::Research has begun to examine how individuals discount delayed sex. However, these tasks have not evaluated the dimension of sexual behavior associated with promiscuity (i.e., choices between partners). The current study assessed choices between hypothetical sexual partners within a delay discounting paradigm. Partici...

    journal_title:Behavioural processes

    pub_type: 杂志文章

    doi:10.1016/j.beproc.2015.03.005

    authors: Jarmolowicz DP,Lemley SM,Asmussen L,Reed DD

    更新日期:2015-06-01 00:00:00

  • Working memory in children assessed with serial chaining and Simon tasks.

    abstract::In the serial chaining task, participants are required to produce a sequence of responses to stimuli in the correct order, and sometimes must determine the sequence at trial outset if stimuli are masked after the first response is made. Similarly, the Simon memory span task presents a participant with a sequence of co...

    journal_title:Behavioural processes

    pub_type: 杂志文章

    doi:10.1016/j.beproc.2018.06.005

    authors: Parrish AE,Perdue BM,Kelly AJ,Beran MJ

    更新日期:2018-12-01 00:00:00

  • The choice and handling of supplemental food by red squirrels in an urban park.

    abstract::One of the main factors that allow the red squirrel (Sciurus vulgaris) to live in cities may be the availability of supplemental food provided by people. In this article, preferences of red squirrels in relation to supplemental food, how it is handled, and whether change seasonally, is investigated. A cafeteria test w...

    journal_title:Behavioural processes

    pub_type: 杂志文章

    doi:10.1016/j.beproc.2020.104153

    authors: Kostrzewa A,Krauze-Gryz D

    更新日期:2020-09-01 00:00:00

  • Hoarding without reward: rodent responses to repeated episodes of complete cache loss.

    abstract::For food-hoarding strategies to be maintained in a population, the benefits of hoarding must outweigh the costs. If rewards are too low to offset the costs of hoarding, hoarders might be expected to abandon hoarding and/or shift to an alternative storing strategy (e.g., increase food consumption). However the ability ...

    journal_title:Behavioural processes

    pub_type: 杂志文章

    doi:10.1016/j.beproc.2014.04.005

    authors: Luo Y,Yang Z,Steele MA,Zhang Z,Stratford JA,Zhang H

    更新日期:2014-07-01 00:00:00

  • Frequency difference limens and auditory cue trading in CBA/CaJ mice (Mus musculus).

    abstract::Mice are emerging as an important behavioral model for studies of auditory perception and acoustic communication. These mammals frequently produce ultrasonic vocalizations, although the details of how these vocalizations are used for communication are not entirely understood. An important step in determining how they ...

    journal_title:Behavioural processes

    pub_type: 杂志文章

    doi:10.1016/j.beproc.2014.04.016

    authors: Radziwon KE,Dent ML

    更新日期:2014-07-01 00:00:00

  • Resurgence: the role of extinction.

    abstract::Three hens were trained to door push and three were trained to head bob using food as the reinforcer (Behaviour 1 training). A period of extinction followed. Each hen was then trained to perform the other behaviour (Behaviour 2) and this was followed by seven sessions of extinction. This whole sequence was repeated si...

    journal_title:Behavioural processes

    pub_type: 杂志文章

    doi:10.1016/s0376-6357(00)00131-5

    authors: Cleland BS,Foster TM,Temple W

    更新日期:2000-12-07 00:00:00

  • Allosuckling in reindeer (Rangifer tarandus): milk-theft, mismothering or kin selection?

    abstract::Allosuckling, the suckling of offspring from females other than their own mother, has been reported in a number of mammalian species, including reindeer. The causes and function of this behaviour are still being investigated. We monitored 25 doe-calf pairs of semi-domestic reindeer Rangifer tarandus over 10 weeks to t...

    journal_title:Behavioural processes

    pub_type: 杂志文章

    doi:10.1016/j.beproc.2014.08.013

    authors: Engelhardt SC,Weladji RB,Holand Ø,de Rioja CM,Ehmann RK,Nieminen M

    更新日期:2014-09-01 00:00:00

  • Multiple exposures to adult males and reproductive activation of virgin female Microtus Ochrogaster.

    abstract::Virgin female Microtus ochrogaster living in family groups were reproductively activated by twelve 1-hr exposures over a 3-day period to unrelated sexually experienced males. Reproductive activation among virgin females receiving six or eight exposures over a 2- or 3-day period did not differ significantly from that o...

    journal_title:Behavioural processes

    pub_type: 杂志文章

    doi:10.1016/0376-6357(88)90050-2

    authors: Hofmann JE,Getz LL

    更新日期:1988-07-01 00:00:00

  • Competition for associative strength between a punctate signal and contextual stimuli: Effect of signal preexposure versus context preexposure.

    abstract::Preexposures to a punctate stimulus or to an external context were examined for their effect on the competition for associative strength between context and stimulus in subsequent aversive classical conditioning. Using rats as subjects and freezing as the index of conditioned responding, Experiment 1 showed that preex...

    journal_title:Behavioural processes

    pub_type: 杂志文章

    doi:10.1016/0376-6357(93)90010-O

    authors: Maes JH,Vossen JM

    更新日期:1993-08-01 00:00:00

  • Face processing limitation to own species in primates: a comparative study in brown capuchins, Tonkean macaques and humans.

    abstract::Most primates live in social groups which survival and stability depend on individuals' abilities to create strong social relationships with other group members. The existence of those groups requires to identify individuals and to assign to each of them a social status. Individual recognition can be achieved through ...

    journal_title:Behavioural processes

    pub_type: 杂志文章

    doi:10.1016/j.beproc.2006.04.006

    authors: Dufour V,Pascalis O,Petit O

    更新日期:2006-07-01 00:00:00

  • Adduction of untested derived stimulus relations depends on environmental complexity.

    abstract::The present research assessed adduction involving derived stimulus relations as a function of environmental complexity. In Group CA, four college students were trained with arbitrary-matching-to-sample discriminations that could have established four, 3-member stimulus classes. In Group EA, four other students were tr...

    journal_title:Behavioural processes

    pub_type: 杂志文章

    doi:10.1016/j.beproc.2017.07.008

    authors: Rippy SM,Doughty AH

    更新日期:2017-10-01 00:00:00

  • Time-sharing in pigeons: Independent effects of gap duration, position and discriminability from the timed signal.

    abstract::Previous data suggest that in a peak-interval procedure with gaps, memory for the pre-gap interval varies with the discriminability of the gap from the to-be-timed signal. Here we extend this finding by manipulating the pre-gap and gap intervals as well as the visual contrast between the gap and the to-be-timed signal...

    journal_title:Behavioural processes

    pub_type: 杂志文章

    doi:10.1016/j.beproc.2005.10.006

    authors: Buhusi CV,Paskalis JP,Cerutti DT

    更新日期:2006-02-28 00:00:00

  • Referential learning of French and Czech labels in African grey parrots (Psittacus erithacus): different methods yield contrasting results.

    abstract::Some African grey parrots (Psittacus erithacus), the most famous being Pepperberg's parrot Alex, are able to imitate human speech and produce labels referentially. In this study, the aim was to teach ten African grey parrots from two laboratories to label items. Training three parrots from the first laboratory for sev...

    journal_title:Behavioural processes

    pub_type: 杂志文章

    doi:10.1016/j.beproc.2010.06.010

    authors: Giret N,Péron F,Lindová J,Tichotová L,Nagle L,Kreutzer M,Tymr F,Bovet D

    更新日期:2010-10-01 00:00:00

  • Song performance and elaboration as potential indicators of male quality in Java sparrows.

    abstract::Bird songs have evolved under sexual selection pressure. Songs include multiple features that are subject to female preference, but recent comparative research has indicated evolutionary tradeoffs between song performance and complexity in some species. Trill, a repetition of the same sound, is a performance-related s...

    journal_title:Behavioural processes

    pub_type: 杂志文章

    doi:10.1016/j.beproc.2013.07.012

    authors: Kagawa H,Soma M

    更新日期:2013-10-01 00:00:00

  • Effects of rearing environment and population origin on responses to repeated behavioural trials in cane toads (Rhinella marina).

    abstract::Behavioural responses to repeated trials in captivity can be driven by many factors including rearing environment, population of origin, habituation to captivity/trial conditions and an individual's behavioural type (e.g., bold versus shy). We tested the effect of rearing environment (captive raised common-garden vers...

    journal_title:Behavioural processes

    pub_type: 杂志文章

    doi:10.1016/j.beproc.2018.05.001

    authors: Gruber J,Whiting MJ,Brown G,Shine R

    更新日期:2018-08-01 00:00:00

  • Cooperation due to cultural norms, not individual reputation.

    abstract::Increased cooperation in groups that are allowed to communicate (engage in "cheap talk") has been attributed to reputation-building and to cultural norms or culturally normal behavior. We tested these two theories by exposing groups of undergraduates to a public-goods social dilemma. Five groups were permitted to comm...

    journal_title:Behavioural processes

    pub_type: 杂志文章

    doi:10.1016/j.beproc.2012.06.001

    authors: Baum WM,Paciotti B,Richerson P,Lubell M,McElreath R

    更新日期:2012-09-01 00:00:00

  • Psychological distance to reward: equating the number of stimulus and response segments.

    abstract::Psychological distance to reward, or the segmentation effect, refers to the preference for a terminal link of a concurrent-chains schedule consisting of a simple reinforcement schedule (e.g. fixed interval [FI] 30s) relative to its chained-schedule counterpart (e.g. chained FI 15s FI 15s). This experiment was conducte...

    journal_title:Behavioural processes

    pub_type: 杂志文章

    doi:10.1016/j.beproc.2004.01.003

    authors: Doughty AH,Meginley ME,Doughty SS,Lattal KA

    更新日期:2004-05-31 00:00:00

  • Song syllable variation tolerance and motor theory of song perception: the territorial reaction of cirl bunting Emberiza cirlus to homologue syllables.

    abstract::The extent of syllable variation tolerance was tested using synthetic homologue syllables. A synthetic copy of a common syllable type of cirl bunting Emberiza cirlus song was used as control. Homologue syllables, in the same frequency range but shorter or longer, were created by multiplying (2/3, 5/3, 7/3) the time sc...

    journal_title:Behavioural processes

    pub_type: 杂志文章

    doi:10.1016/0376-6357(91)90005-K

    authors: Kreutzer ML

    更新日期:1991-08-01 00:00:00

  • On the time course of rapid and repeatable response induction.

    abstract::As reinforcers are delivered for a particular response, that response increases. Other similar responses also increase, with the extent to which this increase is seen being positively related to the similarity between the responses. This process, called induction, is pronounced during initial response acquisition, and...

    journal_title:Behavioural processes

    pub_type: 杂志文章

    doi:10.1016/j.beproc.2015.08.010

    authors: Jarmolowicz DP,Hudnall JL,Darden AC,Lemley SM,Sofis MJ

    更新日期:2015-11-01 00:00:00

  • Evaluation of the confusion matrix method in the validation of an automated system for measuring feeding behaviour of cattle.

    abstract::The aim of the present study was to evaluate empirically confusion matrices in device validation. We compared the confusion matrix method to linear regression and error indices in the validation of a device measuring feeding behaviour of dairy cattle. In addition, we studied how to extract additional information on cl...

    journal_title:Behavioural processes

    pub_type: 杂志文章

    doi:10.1016/j.beproc.2018.01.004

    authors: Ruuska S,Hämäläinen W,Kajava S,Mughal M,Matilainen P,Mononen J

    更新日期:2018-03-01 00:00:00

  • Ontogeny has a phylogeny: background to adjunctive behaviors in pigeons and budgerigars.

    abstract::Animals coping with operant conditioning tasks often show behaviors that are not recorded by keys, levers and similar response transducers. Nevertheless, these adjunctive behaviors should not be disposed of by classifying them as incidental. Often they are found to be at least partially influenced by the experimentall...

    journal_title:Behavioural processes

    pub_type: 杂志文章

    doi:10.1016/s0376-6357(02)00187-0

    authors: Cleaveland JM,Jäger R,Rössner P,Delius JD

    更新日期:2003-03-31 00:00:00

  • Imitation and local enhancement: detrimental effects of consensus definitions on analyses of social learning in animals.

    abstract::Development of a widely accepted vocabulary referring to various types of social learning has made important contributions to decades of progress in analyzing the role of socially acquired information in the development of behavioral repertoires. It is argued here that emergence of a consensus vocabulary, while facili...

    journal_title:Behavioural processes

    pub_type: 杂志文章,评审

    doi:10.1016/j.beproc.2013.07.026

    authors: Galef BG

    更新日期:2013-11-01 00:00:00

  • Dialects in the alarm calls of black- tailed prairie dogs (Cynomys ludovicianus): A case of cultural diffusion?

    abstract::Prairie dogs (Cynomys spp.) produce an alarm call when a predator appears. Gunnison's prairie dogs (Cynomys gunnisoni) produce calls that vary in spectral structure according to predator type and specific characteristics unique to the individual predator, such as color and shape. These calls vary depending on geograph...

    journal_title:Behavioural processes

    pub_type: 杂志文章

    doi:10.1016/j.beproc.2020.104243

    authors: Dennis P,Shuster SM,Slobodchikoff CN

    更新日期:2020-12-01 00:00:00

  • Effect of chronic exposure to a magnetic field on two forms of murine aggression.

    abstract::The effect of continuous exposure to a relatively strong magnetic field for about 3-4 weeks were evaluated on social (inter-male) aggression in isolated males and on maternal attack by lactating female mice. This study revealed that exposure to intense fields produced a significant reduction in social and maternal agg...

    journal_title:Behavioural processes

    pub_type: 杂志文章

    doi:10.1016/0376-6357(92)90173-B

    authors: Al-Maliki SJ,Al-Rawi F

    更新日期:1992-01-01 00:00:00

  • Association between increased behavioral persistence and stereotypy in the pet dog.

    abstract::The aim of the present study was to evaluate whether dogs that exhibit stereotypy also show higher behavioral persistence in an extinction-learning task. Thirteen pet dogs with stereotypy and 13 breed-matched control dogs were assessed on a resistance to extinction test. Each dog was trained for 40 trials using a food...

    journal_title:Behavioural processes

    pub_type: 杂志文章

    doi:10.1016/j.beproc.2014.04.009

    authors: Protopopova A,Hall NJ,Wynne CD

    更新日期:2014-07-01 00:00:00

  • Concurrent recall of serially learned visual discrimination problems in dwarf goats (Capra hircus).

    abstract::Studies of cognitive ability in farm animals are valuable, not only because they provide indicators of the commonality of comparative influence, but understanding farm animal cognition may also aid in management and treatment procedures. Here, eight dwarf goats (Capra hircus) learned a series of 10 visual four-choice ...

    journal_title:Behavioural processes

    pub_type: 杂志文章

    doi:10.1016/j.beproc.2008.07.004

    authors: Langbein J,Siebert K,Nuernberg G

    更新日期:2008-11-01 00:00:00