Extinction of Pavlovian conditioning: The influence of trial number and reinforcement history.

Abstract:

:Pavlovian conditioning is sensitive to the temporal relationship between the conditioned stimulus (CS) and the unconditioned stimulus (US). This has motivated models that describe learning as a process that continuously updates associative strength during the trial or specifically encodes the CS-US interval. These models predict that extinction of responding is also continuous, such that response loss is proportional to the cumulative duration of exposure to the CS without the US. We review evidence showing that this prediction is incorrect, and that extinction is trial-based rather than time-based. We also present two experiments that test the importance of trials versus time on the Partial Reinforcement Extinction Effect (PREE), in which responding extinguishes more slowly for a CS that was inconsistently reinforced with the US than for a consistently reinforced one. We show that increasing the number of extinction trials of the partially reinforced CS, relative to the consistently reinforced CS, overcomes the PREE. However, increasing the duration of extinction trials by the same amount does not overcome the PREE. We conclude that animals learn about the likelihood of the US per trial during conditioning, and learn trial-by-trial about the absence of the US during extinction. Moreover, what they learn about the likelihood of the US during conditioning affects how sensitive they are to the absence of the US during extinction.

journal_name

Behav Processes

journal_title

Behavioural processes

authors

Chan CKJ,Harris JA

doi

10.1016/j.beproc.2017.04.017

subject

Has Abstract

pub_date

2017-08-01 00:00:00

pages

19-25

issue

Pt 1

eissn

0376-6357

issn

1872-8308

pii

S0376-6357(17)30196-1

journal_volume

141

pub_type

杂志文章,评审
  • Aspects of "fear" in Japanese quail chicks (coturnix coturnix Japonica) genetically selected for different levels of locomotor activity.

    abstract::Domestic chicks selected for high and low locomotor activity in a novel environment have low and high levels of fearfulness, respectively. Using four commonly employed methods of estimating fear, namely emergence, open-field, response to a bell and tonic immobility tests, we found a similar effect in lines of Japanese...

    journal_title:Behavioural processes

    pub_type: 杂志文章

    doi:10.1016/0376-6357(82)90035-3

    authors: Jones RB,Bessei W,Faure JM

    更新日期:1982-09-01 00:00:00

  • Distress of mice induces approach behavior but has an aversive property for conspecifics.

    abstract::In the first experiment, approach/avoidance behavior of mice to a restrained cage mate was examined. The mice explored the restrained mates but they did not stay longer at the restrained mates in comparison to free moving mates. Conditioned Place Preference (CPP) training in the presence of a restrained mate did not r...

    journal_title:Behavioural processes

    pub_type: 杂志文章

    doi:10.1016/j.beproc.2012.01.001

    authors: Watanabe S

    更新日期:2012-06-01 00:00:00

  • Intensity of giraffe locomotor activity is shaped by solar and lunar zeitgebers.

    abstract::Natural cycles of light and darkness shift the balance of risks and gains for animals across space and time. Entrainment to photic cycles allows animals to spatiotemporally adapt their behavioural and physiological processes in line with interplaying ecological factors, such as temperature, foraging efficiency and pre...

    journal_title:Behavioural processes

    pub_type: 杂志文章

    doi:10.1016/j.beproc.2020.104178

    authors: Hart EE,Fennessy J,Hauenstein S,Ciuti S

    更新日期:2020-09-01 00:00:00

  • Simulation of habituation to simple and multiple stimuli.

    abstract::Within the psychological literature there are a number of models that reproduce the defining properties of habituation to a single stimulus. However, most of them do not reproduce the phenomenon of dishabituation shown in empirical studies, consisting in the recovery of a stimulus previously habituated upon the appear...

    journal_title:Behavioural processes

    pub_type: 杂志文章

    doi:10.1016/j.beproc.2006.06.007

    authors: del Rosal E,Alonso L,Moreno R,Vázquez M,Santacreu J

    更新日期:2006-11-01 00:00:00

  • Aggressive behavior variation and experience effects in three families of juvenile Chinese mitten crab (Eriocheir sinensis).

    abstract::To assess how variable is the aggressive behavior among families (A, B, and C) and the experience effect of fighting among juvenile Chinese mitten crab (Eriocheir sinensis), we performed a total of 36 pairs of intrafamily and interfamily contests between three families of Eriocheir sinensis, qualifying and quantifying...

    journal_title:Behavioural processes

    pub_type: 杂志文章

    doi:10.1016/j.beproc.2019.06.002

    authors: Li Y,Jiang Q,Fan S,Sun N,Li XD,Zheng Y

    更新日期:2019-08-01 00:00:00

  • On the time course of rapid and repeatable response induction.

    abstract::As reinforcers are delivered for a particular response, that response increases. Other similar responses also increase, with the extent to which this increase is seen being positively related to the similarity between the responses. This process, called induction, is pronounced during initial response acquisition, and...

    journal_title:Behavioural processes

    pub_type: 杂志文章

    doi:10.1016/j.beproc.2015.08.010

    authors: Jarmolowicz DP,Hudnall JL,Darden AC,Lemley SM,Sofis MJ

    更新日期:2015-11-01 00:00:00

  • Pigeon visual short-term memory directly compared to primates.

    abstract::Three pigeons were trained to remember arrays of 2-6 colored squares and detect which of two squares had changed color to test their visual short-term memory. Procedures (e.g., stimuli, displays, viewing times, delays) were similar to those used to test monkeys and humans. Following extensive training, pigeons perform...

    journal_title:Behavioural processes

    pub_type: 杂志文章

    doi:10.1016/j.beproc.2015.09.002

    authors: Wright AA,Elmore LC

    更新日期:2016-02-01 00:00:00

  • Female preference and filial cannibalism in Aidablennius sphynx (Teleostei, Blenniidae); a combined field and laboratory study.

    abstract::In the fish Aidablennius sphynx, in which males continuously care for up to 7000 eggs throughout the breeding season, females prefer to mate with males that already guard eggs. The present study shows that this preference appears to be adaptive because the probability of eggs being cannibalized decreased with brood si...

    journal_title:Behavioural processes

    pub_type: 杂志文章

    doi:10.1016/0376-6357(95)00019-4

    authors: Kraak SB

    更新日期:1996-02-01 00:00:00

  • Pathways to cognitive design.

    abstract::Despite a shared recognition that the design of the human mind and the design of human culture are tightly linked, researchers in the evolutionary social sciences tend to specialize in understanding one at the expense of the other. The disciplinary boundaries roughly correspond to research traditions that focus more o...

    journal_title:Behavioural processes

    pub_type: 杂志文章,评审

    doi:10.1016/j.beproc.2018.05.013

    authors: Wertz AE,Moya C

    更新日期:2019-04-01 00:00:00

  • Motivation and timing: clues for modeling the reward system.

    abstract::There is growing evidence that a change in reward magnitude or value alters interval timing, indicating that motivation and timing are not independent processes as was previously believed. The present paper reviews several recent studies, as well as presenting some new evidence with further manipulations of reward val...

    journal_title:Behavioural processes

    pub_type: 杂志文章,评审

    doi:10.1016/j.beproc.2012.02.014

    authors: Galtress T,Marshall AT,Kirkpatrick K

    更新日期:2012-05-01 00:00:00

  • The problem with categorical thinking by psychologists.

    abstract::Continua abound in the natural world, but the treatment of these continua in the psychological study of behavior is often categorical. Four practices and their consequences are considered: limited sampling of a continuum, turning continuous predictors into categories through dichotomization and similar practices, trea...

    journal_title:Behavioural processes

    pub_type: 杂志文章

    doi:10.1016/j.beproc.2015.09.009

    authors: Young ME

    更新日期:2016-02-01 00:00:00

  • Use of a barbed tool by an adult and a juvenile woodpecker finch (Cactospiza pallida).

    abstract::Here we describe the modification and use of a new tool type in the woodpecker finch (Cactospiza pallida). This species is known to habitually use twigs or cactus spines to extract arthropods out of tree holes. We observed an adult and a juvenile bird using several barbed twigs from introduced blackberry bushes (Rubus...

    journal_title:Behavioural processes

    pub_type: 杂志文章

    doi:10.1016/j.beproc.2011.10.016

    authors: Sabine T,Irmgard T,Erica C,Sophia S

    更新日期:2012-02-01 00:00:00

  • Mr. right versus Mr. right now: A discounting-based approach to promiscuity.

    abstract::Research has begun to examine how individuals discount delayed sex. However, these tasks have not evaluated the dimension of sexual behavior associated with promiscuity (i.e., choices between partners). The current study assessed choices between hypothetical sexual partners within a delay discounting paradigm. Partici...

    journal_title:Behavioural processes

    pub_type: 杂志文章

    doi:10.1016/j.beproc.2015.03.005

    authors: Jarmolowicz DP,Lemley SM,Asmussen L,Reed DD

    更新日期:2015-06-01 00:00:00

  • Lateral asymmetries during responses to novel-coloured objects in the domestic chick: A developmental study.

    abstract::Chicks were trained to peck on a small coloured (red or green) box for food reinforcement. They were then presented with one box identical to that used during training (familiar) and one of a different colour (unfamiliar). Food reinforcement was delivered for pecking either box, and the right-left position of the two ...

    journal_title:Behavioural processes

    pub_type: 杂志文章

    doi:10.1016/0376-6357(95)00076-3

    authors: Regolin L,Vallortigara G

    更新日期:1996-08-01 00:00:00

  • Does intraspecific competition among Allenby's gerbils lead to an Ideal Free Distribution across foraging patches?

    abstract::Employing the Ideal Free Distribution (IFD) principle as a tool, we investigated how Allenby's gerbils (Gerbillus andersoni allenbyi) utilized food patches within and moved between connected quadrants (i.e., 'habitats') in a large outdoor semi-natural enclosure. These habitats differed in initial forager densities, bu...

    journal_title:Behavioural processes

    pub_type: 杂志文章

    doi:10.1016/j.beproc.2019.103922

    authors: Makin DF,Kotler BP

    更新日期:2019-10-01 00:00:00

  • Assessment of domestic cat personality, as perceived by 416 owners, suggests six dimensions.

    abstract::Understanding individual behavioral differences in domestic cats could lead to improved selection when potential cat owners choose a pet with whom to share their lives, along with consequent improvements in cat welfare. Yet very few attempts have been made to elicit cat personality dimensions using the trait-based exp...

    journal_title:Behavioural processes

    pub_type: 杂志文章

    doi:10.1016/j.beproc.2017.02.020

    authors: Bennett PC,Rutter NJ,Woodhead JK,Howell TJ

    更新日期:2017-08-01 00:00:00

  • Early weaning disrupts feeding patterns in female juvenile rats through 5HT-system modulations.

    abstract::Convergent evidence in literature shows that rapid disruption of maternal care and breastfeeding due to an early weaning protocol changes the development of several neurobehavioral patterns in rodents, including the circadian pattern of feeding. The serotoninergic system has been associated with the control of feeding...

    journal_title:Behavioural processes

    pub_type: 杂志文章

    doi:10.1016/j.beproc.2019.103981

    authors: Tavares GA,Almeida LCDA,de Souza JA,Braz GRF,da Silva MC,Lagranha CJ,do Nascimento E,de Souza SL

    更新日期:2020-01-01 00:00:00

  • The effect of economy type on reinforcer value.

    abstract::This article reviews studies investigating the effect of economy type on reinforcer value. In a closed economy, consumption of the reinforcer depends entirely on the subject's behavior, whereas in an open economy it does not, due, for example, to the provision of free reinforcers after the session. In theory, reinforc...

    journal_title:Behavioural processes

    pub_type: 杂志文章,评审

    doi:10.1016/j.beproc.2019.01.008

    authors: Kearns DN

    更新日期:2019-05-01 00:00:00

  • Caution for using ventilatory frequency as an indicator of stress in fish.

    abstract::This study tested the use of ventilatory frequency (VF) as an indicator of stress in the Nile tilapia, Oreochromis niloticus (L.). Firstly, we tested the relationship between VF and plasma cortisol after confinement. Confined fish showed higher VF and plasma cortisol levels, but the latter continued to increase signif...

    journal_title:Behavioural processes

    pub_type: 杂志文章

    doi:10.1016/j.beproc.2004.01.001

    authors: Barreto RE,Volpato GL

    更新日期:2004-04-30 00:00:00

  • Schedules of reinforcement as regulators of dispersion patterns.

    abstract::An eight-rat eight-station operant conditioning arena was used to study the spatial structure and temporal stability of foraging dispersion patterns. Food was obtained by bar pressing as the population was exposed to an ascending series of the fixed and variable aspects of ratio and interval schedules of reinforcement...

    journal_title:Behavioural processes

    pub_type: 杂志文章

    doi:10.1016/0376-6357(89)90021-1

    authors: Goldstein SR,Johnson P,Ward G

    更新日期:1989-12-01 00:00:00

  • Learning to stop or reset the internal clock.

    abstract::In the present experiments, after training rats in a standard fixed interval (FI) 30s schedule, we induced a change in the strategy employed during gap trials, by presenting during FI with gaps training, 9-s interruptions of the FI discriminative stimulus in 40% of the trials; in one type of interruption, after the di...

    journal_title:Behavioural processes

    pub_type: 杂志文章

    doi:10.1016/j.beproc.2011.08.014

    authors: Orduña V,Bouzas A

    更新日期:2011-11-01 00:00:00

  • Social play behaviour in young rhesus monkeys Macaca mulatta at three different ages: from the 3rd to the 6th month of life.

    abstract::Social play behaviours were investigated in 17 young rhesus monkeys Macaca mulatta, belonging to a large captive group, at three ages: 3/4, 4/5 and 5/6 months. Play initiatives were recorded (TO/BY) and the infants' partners were divided into five age groups (mothers, adults, similar-age infants, 1-yr-old infants and ...

    journal_title:Behavioural processes

    pub_type: 杂志文章

    doi:10.1016/0376-6357(91)90074-A

    authors: Tartabini A

    更新日期:1991-11-01 00:00:00

  • Prey-handling behaviour of Octopus vulgaris (Mollusca, Cephalopoda) on Bivalve preys.

    abstract::This study examines the ability of Octopus vulgaris to prey on bivalve molluscs showing that octopuses exhibited the same behavioural pattern irrespective of the prey species. When the initial pulling method did not result efficient octopuses skipped to drilling accompanied by an increase in the handling time. A compl...

    journal_title:Behavioural processes

    pub_type: 杂志文章

    doi:10.1016/S0376-6357(99)00020-0

    authors: Fiorito G,Gherardi F

    更新日期:1999-05-03 00:00:00

  • Do ewes recognize their lambs within the first day postpartum without the help of olfactory cues?

    abstract::Two studies were carried out to test the ability of Préalpes du Sud x Lacaune (Study 1) and Rambouillet ewes (Study 2) to recognize their lambs during the first 24 h postpartum. Ewes were given the choice between their own and an alien lamb of approximately the same age, in a triangular pen of 10 m×10 m×10 m. A lamb w...

    journal_title:Behavioural processes

    pub_type: 杂志文章

    doi:10.1016/s0376-6357(99)00045-5

    authors: Terrazas A,Ferreira G,Lévy F,Nowak R,Serafin N,Orgeur P,Soto R,Poindron P

    更新日期:1999-08-01 00:00:00

  • Corvids exhibit dynamic risk assessment during escape.

    abstract::It is widely accepted that stationary prey are able to carefully assess the risk levels associated with an approaching predator to make informative decisions on when to escape. However, little is known about subsequent decision-making process. We set out to compare whether escape durations of three species of corvids ...

    journal_title:Behavioural processes

    pub_type: 杂志文章

    doi:10.1016/j.beproc.2019.104017

    authors: Tätte K,Møller AP,Mänd R

    更新日期:2020-01-01 00:00:00

  • Examining delay of gratification in healthy aging.

    abstract::Delay of gratification (DofG) refers to the capacity to forego an immediate reward in order to receive a more desirable reward later. As a core executive function, it might be expected that DofG would follow the standard pattern of age-related decline observed in older adults for other executive tasks. However, there ...

    journal_title:Behavioural processes

    pub_type: 杂志文章

    doi:10.1016/j.beproc.2020.104125

    authors: Lamichhane B,Di Rosa E,Green L,Myerson J,Braver TS

    更新日期:2020-07-01 00:00:00

  • Early postnatal handling and environmental enrichment improve the behavioral responses of 17-month-old 3xTg-AD and non-transgenic mice in the Forced Swim Test in a gender-dependent manner.

    abstract::Forced Swimming Test (FST) models behavioural despair in animals by loss of motivation to respond or the refusal to escape. The present study was aimed at characterizing genetic (genotype and gender) and environmental factors (age/stage of disease and rearing conditions: C, standard; H, early postnatal handling; EE, e...

    journal_title:Behavioural processes

    pub_type: 杂志文章

    doi:10.1016/j.beproc.2015.09.011

    authors: Torres-Lista V,Giménez-Llort L

    更新日期:2015-11-01 00:00:00

  • The role of hen's weight and recent experience on dyadic conflict outcome.

    abstract::This study simultaneously varied experiences of recent victory or defeat, 2-h familiarity with the meeting place, and hen weight in order to understand their combined effects on the establishment of dyadic dominance relationships between hens not previously acquainted with each other. Three kinds of encounters were ar...

    journal_title:Behavioural processes

    pub_type: 杂志文章

    doi:10.1016/s0376-6357(97)00040-5

    authors: Martin F,Beaugrand JP,Laguë PC

    更新日期:1997-11-01 00:00:00

  • A new version of the Monty Hall Dilemma with unequal probabilities.

    abstract::In the Monty Hall Dilemma (MHD), a contestant makes a guess as to which door conceals a prize. The host then reveals the contents of an unchosen, incorrect door, and then gives the contestant a choice of sticking with the initial guess or switching to the remaining door. Given certain crucial assumptions, the rational...

    journal_title:Behavioural processes

    pub_type: 杂志文章

    doi:10.1016/s0376-6357(99)00066-2

    authors: Granberg D

    更新日期:1999-11-01 00:00:00

  • Inter-individual variation and temperature-dependent antipredator behavior in the snake Tomodon dorsatus (Dipsadidae).

    abstract::Although many studies assessed the influence of temperature on the behavior of ectotermic vertebrates, little attention has been given to interindividual variation in the defensive responses of reptiles. In the present study we investigated the defensive behavior of the snake Tomodon dorsatus, in order to test the hyp...

    journal_title:Behavioural processes

    pub_type: 杂志文章

    doi:10.1016/j.beproc.2013.03.008

    authors: Citadini JM,Navas CA

    更新日期:2013-07-01 00:00:00