When theory and biology differ: The relationship between reward prediction errors and expectancy.

Abstract:

:Comparisons between expectations and outcomes are critical for learning. Termed prediction errors, the violations of expectancy that occur when outcomes differ from expectations are used to modify value and shape behaviour. In the present study, we examined how a wide range of expectancy violations impacted neural signals associated with feedback processing. Participants performed a time estimation task in which they had to guess the duration of one second while their electroencephalogram was recorded. In a key manipulation, we varied task difficulty across the experiment to create a range of different feedback expectancies - reward feedback was either very expected, expected, 50/50, unexpected, or very unexpected. As predicted, the amplitude of the reward positivity, a component of the human event-related brain potential associated with feedback processing, scaled inversely with expectancy (e.g., unexpected feedback yielded a larger reward positivity than expected feedback). Interestingly, the scaling of the reward positivity to outcome expectancy was not linear as would be predicted by some theoretical models. Specifically, we found that the amplitude of the reward positivity was about equivalent for very expected and expected feedback, and for very unexpected and unexpected feedback. As such, our results demonstrate a sigmoidal relationship between reward expectancy and the amplitude of the reward positivity, with interesting implications for theories of reinforcement learning.

journal_name

Biol Psychol

journal_title

Biological psychology

authors

Williams CC,Hassall CD,Trska R,Holroyd CB,Krigolson OE

doi

10.1016/j.biopsycho.2017.09.007

subject

Has Abstract

pub_date

2017-10-01 00:00:00

pages

265-272

eissn

0301-0511

issn

1873-6246

pii

S0301-0511(17)30242-9

journal_volume

129

pub_type

杂志文章
  • Cardiac, respiratory and metabolic changes during static exercise and voluntary heart rate acceleration.

    abstract::Various ventilatory and metabolic parameters were monitored in 12 subjects while they performed each of three tasks: Voluntary cardiac acceleration with the aid of continuous heart rate feedback; a static hand-grip exercise at 1/3 maximum voluntary contraction; and a combined task involving both voluntary acceleration...

    journal_title:Biological psychology

    pub_type: 杂志文章

    doi:10.1016/0301-0511(83)90012-1

    authors: Carroll D,McGovern M

    更新日期:1983-09-01 00:00:00

  • Cardiovascular recovery from stress predicts longitudinal changes in blood pressure.

    abstract::Cardiovascular reactivity and recovery were examined as predictors of blood pressure changes over 3 years. Blood pressure and heart rate readings were obtained from 73 men and women aged 18-20 years during cold pressor, mental arithmetic, tourniquet ischemia, cycle exercise and step exercise tasks. Regression analyses...

    journal_title:Biological psychology

    pub_type: 杂志文章

    doi:10.1016/s0301-0511(01)00105-3

    authors: Stewart JC,France CR

    更新日期:2001-11-01 00:00:00

  • Neuro-cognitive activity during a self-paced visuospatial task: comparative EEG profiles in marksmen and novice shooters.

    abstract::Log-transformed EEG power spectral estimates (6-7, 9,10-11,18-22, and 36-44 Hz), obtained from skilled marksmen and novice shooters at sites F3, F4, C3, C4,T3, T4, P3, P4, O1, and O2 during the aiming period (6 s) of a target shooting task for each of 40 trials up to the moment of trigger pull, were contrasted to dete...

    journal_title:Biological psychology

    pub_type: 杂志文章

    doi:10.1016/s0301-0511(00)00047-8

    authors: Haufler AJ,Spalding TW,Santa Maria DL,Hatfield BD

    更新日期:2000-07-01 00:00:00

  • "Initial-" and "change-orienting reactions": an analysis based on visual single-trial event-related potentials.

    abstract::The present study was concerned with brain potentials elicited by, respectively, the first of a series of stimuli ("initial-orienting reaction", I-OR), and infrequent deviants ("change-orienting reaction", C-OR). Single-trial event-related potentials (ERPs) to visual stimuli were estimated from recordings at Oz, Pz, C...

    journal_title:Biological psychology

    pub_type: 杂志文章

    doi:10.1016/0301-0511(89)90001-x

    authors: Kenemans JL,Verbaten MN,Roelofs JW,Slangen JL

    更新日期:1989-06-01 00:00:00

  • Using minute ventilation for ambulatory estimation of additional heart rate.

    abstract::Both physical activity and emotion produce physiological activation. The emotional component of heart rate (HR) can be estimated as the additional HR (aHR) above that predicted by O2 consumption. Our innovation was to substitute minute ventilation (V) for O2 consumption, calculating aHR from individual relations betwe...

    journal_title:Biological psychology

    pub_type: 临床试验,杂志文章

    doi:10.1016/s0301-0511(98)00032-5

    authors: Wilhelm FH,Roth WT

    更新日期:1998-09-01 00:00:00

  • The impact of unemployment on heart rate variability: the evidence from the Czech Republic.

    abstract::We examined the relationship between unemployment and heart rate variability (HRV) in a region of high unemployment in the Czech Republic. The study involved 21 involuntarily unemployed and 21 employed men and women aged 30-49 years, matched on number of potentially confounding factors, including age, gender, type of ...

    journal_title:Biological psychology

    pub_type: 杂志文章

    doi:10.1016/j.biopsycho.2012.07.002

    authors: Jandackova VK,Paulik K,Steptoe A

    更新日期:2012-10-01 00:00:00

  • Hemodynamic profile and compensation deficit in African and European Americans during physical and mental stress.

    abstract::Increased vascular reactivity to stress has been suggested to contribute to the greater risk for developing hypertension in African Americans. Here, we examined the way (hemodynamic profile) and the extent to which (compensation deficit) cardiac output and total peripheral resistance compensate for each other in deter...

    journal_title:Biological psychology

    pub_type: 杂志文章

    doi:10.1016/j.biopsycho.2018.12.003

    authors: Carnevali L,Ottaviani C,Williams DP,Kapuku G,Thayer JF,Hill LK

    更新日期:2019-02-01 00:00:00

  • Psychophysiological support of increasing attentional reserve during the development of a motor skill.

    abstract::The aim of this study was to determine the relationship between motor skill and attentional reserve. Participants practiced a reaching task with the dominant upper extremity, to which a distortion of the visual feedback was applied, while a control group performed the same task without distortion. Event-related brain ...

    journal_title:Biological psychology

    pub_type: 杂志文章,随机对照试验

    doi:10.1016/j.biopsycho.2014.10.008

    authors: Rietschel JC,McDonald CG,Goodman RN,Miller MW,Jones-Lush LM,Wittenberg GF,Hatfield BD

    更新日期:2014-12-01 00:00:00

  • Filters for optimal smoothing of acoustic and electric blink reflex EMG responses to determine blink response magnitude.

    abstract::The functional (i.e., kinematic) aspects of the blink reflex depend on the size of the integrated orbicularis oculi EMG response. Peak amplitude of smoothed rectified EMG is often used as an approximation of integrated EMG. A comparison was made between the outputs of 24 different smoothing filters, correlating peak a...

    journal_title:Biological psychology

    pub_type: 杂志文章

    doi:10.1016/j.biopsycho.2010.07.017

    authors: van Boxtel A

    更新日期:2010-10-01 00:00:00

  • Is auditory distraction by changing-state and deviant sounds underpinned by the same mechanism? Evidence from pupillometry.

    abstract::The mere presence of task-irrelevant auditory stimuli is known to interfere with cognitive functioning. Disruption can be caused by changing auditory distractors (the changing-state effect) or by a sound that deviates from the auditory background (the deviation effect). The unitary account of auditory distraction expl...

    journal_title:Biological psychology

    pub_type: 杂志文章

    doi:10.1016/j.biopsycho.2019.01.002

    authors: Marois A,Marsh JE,Vachon F

    更新日期:2019-02-01 00:00:00

  • Inverse relation between cortisol and anger and their relation to performance and explicit memory.

    abstract::Cortisol has been found to increase in response to social evaluative threat. However, little is known about the cortisol response to induced anger. Thus, in the present study, we investigated the cortisol response to anger induction and its effects on performance and explicit memory. A variant of the Montreal Stress I...

    journal_title:Biological psychology

    pub_type: 杂志文章

    doi:10.1016/j.biopsycho.2012.05.006

    authors: Kazén M,Kuenne T,Frankenberg H,Quirin M

    更新日期:2012-09-01 00:00:00

  • Test-retest reproducibility of a combined physical and cognitive stressor.

    abstract::When studying the factors which influence stress reactivity in within-subject designs, test-retest reproducibility data is needed to estimate power and sample size. We report such data regarding a new experimental stress protocol, based on simultaneous application of the socially evaluated, bilateral feet Cold Pressor...

    journal_title:Biological psychology

    pub_type: 杂志文章

    doi:10.1016/j.biopsycho.2019.107729

    authors: Bachmann P,Finke JB,Rebeck D,Zhang X,Larra MF,Koch KP,Turner JD,Schächinger H

    更新日期:2019-11-01 00:00:00

  • Visual reminders of death enhance nociceptive-related cortical responses and event-related alpha desynchronisation.

    abstract::Previous research suggests that prompting individuals to think on their own mortality affects their perception of painful somatic stimuli and related brain activity. Grounded on the assumption that reminders of mortality may recruit threat-defence mechanisms similar to the ones activated by painful nociceptive stimuli...

    journal_title:Biological psychology

    pub_type: 杂志文章

    doi:10.1016/j.biopsycho.2017.08.055

    authors: Valentini E,Nicolardi V,Aglioti SM

    更新日期:2017-10-01 00:00:00

  • Prefrontal, parietal and basal activation associated with the reordering of a two-element list held in working memory.

    abstract::A functional specialization in the prefrontal cortex along a dorsal-ventral gradient according to the type of processing in working memory, i.e. manipulation vs. maintenance, has been proposed based on previous neuroimaging studies. This seems particularly important for the further understanding of the functional arch...

    journal_title:Biological psychology

    pub_type: 杂志文章

    doi:10.1016/j.biopsycho.2010.06.005

    authors: Van Hecke J,Gladwin TE,Coremans J,Destoop M,Hulstijn W,Sabbe B

    更新日期:2010-09-01 00:00:00

  • Evoked potential correlates of human information processing.

    abstract::The late positive component (P3) of the feedback evoked potential was investigated in two tasks: the detection of near-threshold auditory stimuli, and the estimation of 1 s time intervals. When the intensity or probability of the threshold stimuli was varied in the detection task, it became apparent that the feedback ...

    journal_title:Biological psychology

    pub_type: 杂志文章

    doi:10.1016/0301-0511(79)90004-8

    authors: Campbell KB,Courchesne E,Picton TW,Squires KC

    更新日期:1979-02-01 00:00:00

  • Nasal airflow asymmetries and human performance.

    abstract::Recent studies of the nasal cycle and forced uni-nostril breathing have demonstrated that integrated EEG amplitudes are greater over the hemisphere contralateral to the dominant (less congested) or unblocked nostril. Two experiments were designed to determine if asymmetries in nasal airflow, occurring naturally as a r...

    journal_title:Biological psychology

    pub_type: 杂志文章

    doi:10.1016/0301-0511(86)90077-3

    authors: Klein R,Pilon D,Prosser S,Shannahoff-Khalsa D

    更新日期:1986-10-01 00:00:00

  • Pupil dilation reveals top-down attentional load during spatial monitoring.

    abstract::It has long been known that the diameter of human pupil enlarges with increasing effort during the execution of a task. This has been observed not only for purely mechanical effort but also for mental effort, as for example the computation of arithmetic problems with different levels of difficulty. Here we show that p...

    journal_title:Biological psychology

    pub_type: 杂志文章

    doi:10.1016/j.biopsycho.2015.10.002

    authors: Lisi M,Bonato M,Zorzi M

    更新日期:2015-12-01 00:00:00

  • Schizophrenia patients show impaired response switching in saccade tasks.

    abstract::Action control deficits of schizophrenia patients result from frontostriatal brain abnormalities and presumably reflect an impairment of selective cognitive processes. This study aimed at dissociating two different levels of action control in saccades toward and away from visual stimuli (pro- and antisaccades). Result...

    journal_title:Biological psychology

    pub_type: 杂志文章

    doi:10.1016/j.biopsycho.2007.06.006

    authors: Franke C,Reuter B,Schulz L,Kathmann N

    更新日期:2007-09-01 00:00:00

  • Detrimental noise effects on brain's speech functions.

    abstract::Background noise has become part of our everyday life in modern societies. Its presence affects both the ability to concentrate and communicate. Some individuals, like children, the elderly, and non-native speakers have pronounced problems in noisy environments. Here we review evidence suggesting that background noise...

    journal_title:Biological psychology

    pub_type: 杂志文章,评审

    doi:10.1016/j.biopsycho.2009.03.010

    authors: Kujala T,Brattico E

    更新日期:2009-07-01 00:00:00

  • Nothing is safe: Intolerance of uncertainty is associated with compromised fear extinction learning.

    abstract::Extinction-resistant fear is considered to be a central feature of pathological anxiety. Here we sought to determine if individual differences in Intolerance of Uncertainty (IU), a potential risk factor for anxiety disorders, underlies compromised fear extinction. We tested this hypothesis by recording electrodermal a...

    journal_title:Biological psychology

    pub_type: 杂志文章

    doi:10.1016/j.biopsycho.2016.05.001

    authors: Morriss J,Christakou A,van Reekum CM

    更新日期:2016-12-01 00:00:00

  • Increases in lipids and immune cells in response to exercise and mental stress in patients with suspected coronary artery disease: effects of adjustment for shifts in plasma volume.

    abstract::This study examined the role of shifts in plasma volume on lipid and immune reactions to stress. Lipid, immune, rheological, and cardiovascular reactions to exercise and mental stress in 51 patients with suspected coronary artery disease were determined. Blood pressure and heart rate were measured during and blood sam...

    journal_title:Biological psychology

    pub_type: 杂志文章

    doi:10.1016/s0301-0511(03)00113-3

    authors: Bacon SL,Ring C,Lip GY,Carroll D

    更新日期:2004-02-01 00:00:00

  • Adiposity, leptin and stress reactivity in humans.

    abstract::Evidence suggests that individuals who are more obese may be more responsive to stress. Stress activates the sympathetic nervous system (SNS) and the adipose-tissue cytokine leptin stimulates SNS activity in animals. We examined the relationship between adiposity, leptin and physiological responses to acute laboratory...

    journal_title:Biological psychology

    pub_type: 杂志文章

    doi:10.1016/j.biopsycho.2010.02.010

    authors: Brydon L

    更新日期:2011-02-01 00:00:00

  • The congruence of interoceptive predictions and hippocampal-related memory.

    abstract::Interoceptive deficits are associated with medial temporal lobe (MTL) lesions, and especially the hippocampus, which may relate to interoception's reliance upon predictive coding and hence on mnemonic processes. Here, we develop a new task to assess interoceptive predictions and assess their dependence upon MTL memory...

    journal_title:Biological psychology

    pub_type: 杂志文章

    doi:10.1016/j.biopsycho.2020.107929

    authors: Edwards-Duric J,Stevenson RJ,Francis HM

    更新日期:2020-09-01 00:00:00

  • The interaction between state and dispositional emotions in decision making: An ERP study.

    abstract::In this study, to investigate the influence of incidental emotions on decision making in high-anxious individuals, participants were required to perform a monetary gambling task. Behavioral and electroencephalography responses were recorded to explore the stages of option assessment and outcome evaluation during decis...

    journal_title:Biological psychology

    pub_type: 杂志文章

    doi:10.1016/j.biopsycho.2016.11.009

    authors: Wang Y,Gu R,Luo YJ,Zhou C

    更新日期:2017-02-01 00:00:00

  • Predictability and probability modulate the neural responses to other's pain: An event-related potential investigation.

    abstract::Two ERP experiments were designed to explore the effect of predictability (Exp1) and probability (Exp2) on the perception of others' pain, respectively. In Exp1, we compared the ERP responses to painful and non-painful pictures when they were fully predictable and fully unpredictable. Results revealed that when the va...

    journal_title:Biological psychology

    pub_type: 杂志文章

    doi:10.1016/j.biopsycho.2018.08.002

    authors: Liao C,Wu H,Guan Q,Luo Y,Cui F

    更新日期:2018-10-01 00:00:00

  • Creativity and cortical activation during creative, intellectual and EEG feedback tasks.

    abstract::Thirty-two male subjects were divided into four groups based on their performance on the remote associates test and alternate uses test, two measures of creativity. Right EEG alpha presence was monitored under basal conditions, while subjects took tests of creativity and intelligence, and while they attempted to enhan...

    journal_title:Biological psychology

    pub_type: 杂志文章

    doi:10.1016/0301-0511(75)90011-3

    authors: Martindale C,Hines D

    更新日期:1975-09-01 00:00:00

  • Task-switching preparation across semantic and spatial domains: An event-related potential study.

    abstract::Previous event-related potential (ERP) studies have identified the specific electrophysiological markers of advance preparation in cued task-switching paradigms. However, it is not yet completely clear whether there is a single task-independent preparatory mechanism for task-switching or whether preparation for a swit...

    journal_title:Biological psychology

    pub_type: 杂志文章

    doi:10.1016/j.biopsycho.2015.06.011

    authors: Capizzi M,Fehér K,Penolazzi B,Vallesi A

    更新日期:2015-09-01 00:00:00

  • Increased HPA axis response to psychosocial stress in remitted depression: the influence of coping style.

    abstract::The aim of the study was to examine the modulating effects of coping style on the response to psychosocial stress in remitted major depression (MD) and healthy controls. Thirty-three participants with a lifetime history of MD, who were in remission, and 32 age- and gender-matched healthy controls were recruited from a...

    journal_title:Biological psychology

    pub_type: 杂志文章

    doi:10.1016/j.biopsycho.2014.09.008

    authors: Höhne N,Poidinger M,Merz F,Pfister H,Brückl T,Zimmermann P,Uhr M,Holsboer F,Ising M

    更新日期:2014-12-01 00:00:00

  • Use of noninvasive bioelectric impedance to predict cardiac output in open heart recovery.

    abstract::Cardiac outputs (CO) measured by bioelectric impedance (Z) and thermodilution (TD) were compared in ten stable, non-ventilated male coronary artery bypass patients (mean age 59 +/- 12 years) in an open heart recovery unit. The measurements were obtained blindly in three sequential body positions (supine, 45 degrees, f...

    journal_title:Biological psychology

    pub_type: 杂志文章

    doi:10.1016/0301-0511(93)90077-l

    authors: Demeter RJ,Parr KL,Toth PD,Woods JR

    更新日期:1993-08-01 00:00:00

  • Inferring native language from early bio-electrical activity.

    abstract::Early semantic effects (<200 ms) for single word processing have been reported inconsistently, though not rarely, in the ERP literature. It may be hypothesized that the frequently reported later lexical effects are related to the lengthy processing of long/scarcely familiar words or task factors. In this paper, we hav...

    journal_title:Biological psychology

    pub_type: 杂志文章

    doi:10.1016/j.biopsycho.2008.02.006

    authors: Proverbio AM,Adorni R,Zani A

    更新日期:2009-01-01 00:00:00