Slips of Action and Sequential Decisions: A Cross-Validation Study of Tasks Assessing Habitual and Goal-Directed Action Control.

Abstract:

:Instrumental learning and decision-making rely on two parallel systems: a goal-directed and a habitual system. In the past decade, several paradigms have been developed to study these systems in animals and humans by means of e.g., overtraining, devaluation procedures and sequential decision-making. These different paradigms are thought to measure the same constructs, but cross-validation has rarely been investigated. In this study we compared two widely used paradigms that assess aspects of goal-directed and habitual behavior. We correlated parameters from a two-step sequential decision-making task that assesses model-based (MB) and model-free (MF) learning with a slips-of-action paradigm that assesses the ability to suppress cue-triggered, learnt responses when the outcome has been devalued and is therefore no longer desirable. MB control during the two-step task showed a very moderately positive correlation with goal-directed devaluation sensitivity, whereas MF control did not show any associations. Interestingly, parameter estimates of MB and goal-directed behavior in the two tasks were positively correlated with higher-order cognitive measures (e.g., visual short-term memory). These cognitive measures seemed to (at least partly) mediate the association between MB control during sequential decision-making and goal-directed behavior after instructed devaluation. This study provides moderate support for a common framework to describe the propensity towards goal-directed behavior as measured with two frequently used tasks. However, we have to caution that the amount of shared variance between the goal-directed and MB system in both tasks was rather low, suggesting that each task does also pick up distinct aspects of goal-directed behavior. Further investigation of the commonalities and differences between the MF and habit systems as measured with these, and other, tasks is needed. Also, a follow-up cross-validation on the neural systems driving these constructs across different paradigms would promote the definition and operationalization of measures of instrumental learning and decision-making in humans.

journal_name

Front Behav Neurosci

authors

Sjoerds Z,Dietrich A,Deserno L,de Wit S,Villringer A,Heinze HJ,Schlagenhauf F,Horstmann A

doi

10.3389/fnbeh.2016.00234

subject

Has Abstract

pub_date

2016-12-20 00:00:00

pages

234

issn

1662-5153

journal_volume

10

pub_type

杂志文章
  • Effects of Subchronic Phencyclidine (PCP) Treatment on Social Behaviors, and Operant Discrimination and Reversal Learning in C57BL/6J Mice.

    abstract::Subchronic treatment with the psychotomimetic phencyclidine (PCP) has been proposed as a rodent model of the negative and cognitive/executive symptoms of schizophrenia. There has, however, been a paucity of studies on this model in mice, despite the growing use of the mouse as a subject in genetic and molecular studie...

    journal_title:Frontiers in behavioral neuroscience

    pub_type: 杂志文章

    doi:10.3389/neuro.08.002.2009

    authors: Brigman JL,Ihne J,Saksida LM,Bussey TJ,Holmes A

    更新日期:2009-02-23 00:00:00

  • Goal Achievement Failure Drives Corticospinal Modulation in Promotion and Prevention Contexts.

    abstract::When making decisions, people are typically differently sensitive to gains and losses according to the motivational context in which the choice is performed. As hypothesized by Regulatory Focus Theory (RFT), indeed, goals are supposed to change in relation to the set of possible outcomes. In particular, in a promotion...

    journal_title:Frontiers in behavioral neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnbeh.2018.00071

    authors: Lo Gerfo E,Pisoni A,Ottone S,Ponzano F,Zarri L,Vergallito A,Varoli E,Fedeli D,Romero Lauro LJ

    更新日期:2018-04-24 00:00:00

  • Adult mouse basal forebrain harbors two distinct cholinergic populations defined by their electrophysiology.

    abstract::We performed whole-cell recordings from basal forebrain (BF) cholinergic neurons in transgenic mice expressing enhanced green fluorescent protein (eGFP) under the control of the choline acetyltransferase promoter. BF cholinergic neurons can be differentiated into two electrophysiologically identifiable subtypes: early...

    journal_title:Frontiers in behavioral neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnbeh.2012.00021

    authors: Unal CT,Golowasch JP,Zaborszky L

    更新日期:2012-05-08 00:00:00

  • Corrigendum: The Influence of Chronic Pain and Cognitive Function on Spatial-Numerical Processing.

    abstract::[This corrects the article DOI: 10.3389/fnbeh.2018.00165.]. ...

    journal_title:Frontiers in behavioral neuroscience

    pub_type: 杂志文章,已发布勘误

    doi:10.3389/fnbeh.2019.00029

    authors: Spindler M,Koch K,Borisov E,Özyurt J,Sörös P,Thiel C,Bantel C

    更新日期:2019-02-19 00:00:00

  • The intralaminar thalamus-an expressway linking visual stimuli to circuits determining agency and action selection.

    abstract::Anatomical investigations have revealed connections between the intralaminar thalamic nuclei and areas such as the superior colliculus (SC) that receive short latency input from visual and auditory primary sensory areas. The intralaminar nuclei in turn project to the major input nucleus of the basal ganglia, the stria...

    journal_title:Frontiers in behavioral neuroscience

    pub_type: 杂志文章,评审

    doi:10.3389/fnbeh.2014.00115

    authors: Fisher SD,Reynolds JN

    更新日期:2014-04-02 00:00:00

  • Chronic Stress Alters Behavior in the Forced Swim Test and Underlying Neural Activity in Animals Exposed to Alcohol Prenatally: Sex- and Time-Dependent Effects.

    abstract::Dysregulation of the hypothalamic-pituitary-adrenal (HPA) stress response has been suggested to play a role in vulnerability to stress-related disorders, such as depression. Prenatal alcohol exposure (PAE) may result in HPA dysregulation, which in turn may predispose individuals to the effects of stress exposure throu...

    journal_title:Frontiers in behavioral neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnbeh.2018.00042

    authors: Lam VYY,Raineki C,Takeuchi LE,Ellis L,Woodward TS,Weinberg J

    更新日期:2018-03-09 00:00:00

  • Nigral proteasome inhibition in mice leads to motor and non-motor deficits and increased expression of Ser129 phosphorylated α-synuclein.

    abstract::Parkinson's disease is a neurodegenerative disorder characterized by motor and non-motor disturbances. Various pathogenic pathways drive disease progression including oxidative stress, mitochondrial dysfunction, α-synuclein aggregation and impairment of protein degradation systems. Dysfunction of the ubiquitin-proteas...

    journal_title:Frontiers in behavioral neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnbeh.2015.00068

    authors: Bentea E,Van der Perren A,Van Liefferinge J,El Arfani A,Albertini G,Demuyser T,Merckx E,Michotte Y,Smolders I,Baekelandt V,Massie A

    更新日期:2015-03-31 00:00:00

  • Exposure to Hedione Increases Reciprocity in Humans.

    abstract::Cooperation among unrelated humans is frequently regarded as a defining feature in the evolutionary success of our species. Whereas, much research has addressed the strategic and cognitive mechanisms that underlie cooperation, investigations into chemosensory processes have received very limited research attention. To...

    journal_title:Frontiers in behavioral neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnbeh.2017.00079

    authors: Berger S,Hatt H,Ockenfels A

    更新日期:2017-05-02 00:00:00

  • Genetic and Psychosocial Predictors of Aggression: Variable Selection and Model Building With Component-Wise Gradient Boosting.

    abstract::Rationale: Given datasets with a large or diverse set of predictors of aggression, machine learning (ML) provides efficient tools for identifying the most salient variables and building a parsimonious statistical model. ML techniques permit efficient exploration of data, have not been widely used in aggression researc...

    journal_title:Frontiers in behavioral neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnbeh.2018.00089

    authors: Suchting R,Gowin JL,Green CE,Walss-Bass C,Lane SD

    更新日期:2018-05-07 00:00:00

  • Ethanol Sensitization during Adolescence or Adulthood Induces Different Patterns of Ethanol Consumption without Affecting Ethanol Metabolism.

    abstract::In previous study, we demonstrated that ethanol preexposure may increase ethanol consumption in both adolescent and adult mice, in a two-bottle choice model. We now questioned if ethanol exposure during adolescence results in changes of consumption pattern using a three-bottle choice procedure, considering drinking-in...

    journal_title:Frontiers in behavioral neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnbeh.2017.00046

    authors: Carrara-Nascimento PF,Hoffmann LB,Contó MB,Marcourakis T,Camarini R

    更新日期:2017-03-23 00:00:00

  • Sensory Substitution: The Spatial Updating of Auditory Scenes "Mimics" the Spatial Updating of Visual Scenes.

    abstract::Visual-to-auditory sensory substitution is used to convey visual information through audition, and it was initially created to compensate for blindness; it consists of software converting the visual images captured by a video-camera into the equivalent auditory images, or "soundscapes". Here, it was used by blindfolde...

    journal_title:Frontiers in behavioral neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnbeh.2016.00079

    authors: Pasqualotto A,Esenkaya T

    更新日期:2016-04-21 00:00:00

  • EEG-microstate dependent emergence of perceptual awareness.

    abstract::We investigated whether the differences in perceptual awareness for stimuli at the threshold of awareness can arise from different global brain states before stimulus onset indexed by the EEG microstate. We used a metacontrast backward masking paradigm in which subjects had to discriminate between two weak stimuli and...

    journal_title:Frontiers in behavioral neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnbeh.2014.00163

    authors: Britz J,Díaz Hernàndez L,Ro T,Michel CM

    更新日期:2014-05-14 00:00:00

  • Embodying an outgroup: the role of racial bias and the effect of multisensory processing in somatosensory remapping.

    abstract::We come to understand other people's physical and mental states by re-mapping their bodily states onto our sensorimotor system. This process, also called somatosensory resonance, is an essential ability for social cognition and is stronger when observing ingroup than outgroup members. Here we investigated, first, whet...

    journal_title:Frontiers in behavioral neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnbeh.2013.00165

    authors: Fini C,Cardini F,Tajadura-Jiménez A,Serino A,Tsakiris M

    更新日期:2013-11-18 00:00:00

  • The Role of Estrogen Receptor β (ERβ) in the Establishment of Hierarchical Social Relationships in Male Mice.

    abstract::Acquisition of social dominance is important for social species including mice, for preferential access to foods and mates. Male mice establish social rank through agonistic behaviors, which are regulated by gonadal steroid hormone, testosterone, as its original form and aromatized form. It is well known that estrogen...

    journal_title:Frontiers in behavioral neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnbeh.2018.00245

    authors: Nakata M,Ågmo A,Sagoshi S,Ogawa S

    更新日期:2018-10-22 00:00:00

  • Neural Dynamics of Emotional Salience Processing in Response to Voices during the Stages of Sleep.

    abstract::Sleep has been related to emotional functioning. However, the extent to which emotional salience is processed during sleep is unknown. To address this concern, we investigated night sleep in healthy adults regarding brain reactivity to the emotionally (happily, fearfully) spoken meaningless syllables dada, along with ...

    journal_title:Frontiers in behavioral neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnbeh.2016.00117

    authors: Chen C,Sung JY,Cheng Y

    更新日期:2016-06-14 00:00:00

  • Behavioral Plasticity of Audiovisual Perception: Rapid Recalibration of Temporal Sensitivity but Not Perceptual Binding Following Adult-Onset Hearing Loss.

    abstract::The ability to accurately integrate or bind stimuli from more than one sensory modality is highly dependent on the features of the stimuli, such as their intensity and relative timing. Previous studies have demonstrated that the ability to perceptually bind stimuli is impaired in various clinical conditions such as au...

    journal_title:Frontiers in behavioral neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnbeh.2018.00256

    authors: Schormans AL,Allman BL

    更新日期:2018-10-31 00:00:00

  • Optogenetic silencing of locus coeruleus activity in mice impairs cognitive flexibility in an attentional set-shifting task.

    abstract::The locus coeruleus (LC) is the sole source of noradrenergic projections to the cortex and essential for attention-dependent cognitive processes. In this study we used unilateral optogenetic silencing of the LC in an attentional set-shifting task (ASST) to evaluate the influence of the LC on prefrontal cortex-dependen...

    journal_title:Frontiers in behavioral neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnbeh.2015.00286

    authors: Janitzky K,Lippert MT,Engelhorn A,Tegtmeier J,Goldschmidt J,Heinze HJ,Ohl FW

    更新日期:2015-11-04 00:00:00

  • Memory Performance Correlates of Hippocampal Subfield Volume in Mild Cognitive Impairment Subtype.

    abstract::The increased understanding that neuropathology begins decades before symptom onset, has led to the conceptualization and widespread utilization of Mild Cognitive Impairment (MCI) as an important transitional state between healthy aging and dementia. Further subcategorization to MCI subtype has led to more distinct pr...

    journal_title:Frontiers in behavioral neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnbeh.2019.00259

    authors: Broadhouse KM,Mowszowski L,Duffy S,Leung I,Cross N,Valenzuela MJ,Naismith SL

    更新日期:2019-11-21 00:00:00

  • Acute Depletion of D2 Receptors from the Rat Substantia Nigra Alters Dopamine Kinetics in the Dorsal Striatum and Drug Responsivity.

    abstract::Recent studies have used conditional knockout mice to selectively delete the D2 autoreceptor; however, these approaches result in global deletion of D2 autoreceptors early in development. The present study takes a different approach using RNA interference (RNAi) to knockdown the expression of the D2 receptors (D2R) in...

    journal_title:Frontiers in behavioral neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnbeh.2016.00248

    authors: Budygin EA,Oleson EB,Lee YB,Blume LC,Bruno MJ,Howlett AC,Thompson AC,Bass CE

    更新日期:2017-01-19 00:00:00

  • Evidence for a functional subdivision of Premotor Ear-Eye Field (Area 8B).

    abstract::The Supplementary Eye Field (SEF) and the Frontal Eye Field (FEF) have been described as participating in gaze shift control. Recent evidence suggests, however, that other areas of the dorsomedial prefrontal cortex also influence gaze shift. Herein, we have investigated electrically evoked ear- and eye movements from ...

    journal_title:Frontiers in behavioral neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnbeh.2014.00454

    authors: Lanzilotto M,Perciavalle V,Lucchetti C

    更新日期:2015-01-30 00:00:00

  • Pain-related stress during the Neonatal Intensive Care Unit stay and SLC6A4 methylation in very preterm infants.

    abstract::Very preterm (VPT) infants need long-lasting hospitalization in the Neonatal Intensive Care Unit (NICU) during which they are daily exposed to pain-related stress. Alterations of DNA methylation at the promoter region of the SLC6A4 have been associated with early adverse experiences in infants. The main aim of the pre...

    journal_title:Frontiers in behavioral neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnbeh.2015.00099

    authors: Provenzi L,Fumagalli M,Sirgiovanni I,Giorda R,Pozzoli U,Morandi F,Beri S,Menozzi G,Mosca F,Borgatti R,Montirosso R

    更新日期:2015-04-21 00:00:00

  • Acetaldehyde as a drug of abuse: insight into AM281 administration on operant-conflict paradigm in rats.

    abstract::Increasing evidence focuses on acetaldehyde (ACD) as the mediator of the rewarding and motivational properties of ethanol. Indeed, ACD stimulates dopamine release in the nucleus accumbens and it is self-administered under different conditions. Besides the dopaminergic transmission, the endocannabinoid system has been ...

    journal_title:Frontiers in behavioral neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnbeh.2013.00064

    authors: Plescia F,Brancato A,Marino RA,Cannizzaro C

    更新日期:2013-06-11 00:00:00

  • Exergames Inherently Contain Cognitive Elements as Indicated by Cortical Processing.

    abstract::Exergames are increasingly used to train both physical and cognitive functioning, but direct evidence whether and how exergames affect cortical activity is lacking. Although portable electroencephalography (EEG) can be used while exergaming, it is unknown whether brain activity will be obscured by movement artifacts. ...

    journal_title:Frontiers in behavioral neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnbeh.2018.00102

    authors: Anders P,Lehmann T,Müller H,Grønvik KB,Skjæret-Maroni N,Baumeister J,Vereijken B

    更新日期:2018-05-18 00:00:00

  • The endocannabinoid transport inhibitor AM404 differentially modulates recognition memory in rats depending on environmental aversiveness.

    abstract::Cannabinoid compounds may influence both emotional and cognitive processes depending on the level of environmental aversiveness at the time of drug administration. However, the mechanisms responsible for these responses remain to be elucidated. The present experiments investigated the effects induced by the endocannab...

    journal_title:Frontiers in behavioral neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnbeh.2012.00011

    authors: Campolongo P,Ratano P,Manduca A,Scattoni ML,Palmery M,Trezza V,Cuomo V

    更新日期:2012-03-20 00:00:00

  • A Rat Drinking in the Dark Model for Studying Ethanol and Sucrose Consumption.

    abstract::Background: The intermittent access 2-bottle choice (IA2BC) and drinking in the dark (DID) models were developed for studying rodent binge-like consumption. Traditionally, IA2BC was used with rats and DID with mice. Recently, IA2BC was adapted to study mouse ethanol consumption. However, it is unknown whether DID is s...

    journal_title:Frontiers in behavioral neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnbeh.2017.00029

    authors: Holgate JY,Shariff M,Mu EW,Bartlett S

    更新日期:2017-02-22 00:00:00

  • To Act or Not to Act: Endocannabinoid/Dopamine Interactions in Decision-Making.

    abstract::Decision-making is an ethologically adaptive construct that is impaired in multiple psychiatric disorders. Activity within the mesocorticolimbic dopamine system has been traditionally associated with decision-making. The endocannabinoid system through its actions on inhibitory and excitatory synapses modulates dopamin...

    journal_title:Frontiers in behavioral neuroscience

    pub_type: 杂志文章,评审

    doi:10.3389/fnbeh.2015.00336

    authors: Hernandez G,Cheer JF

    更新日期:2015-12-17 00:00:00

  • Prefronto-striatal physiology is associated with schizotypy and is modulated by a functional variant of DRD2.

    abstract::"Schizotypy" is a latent organization of personality related to the genetic risk for schizophrenia. Some evidence suggests that schizophrenia and schizotypy share some biological features, including a link to dopaminergic D2 receptor signaling. A polymorphism in the D2 gene (DRD2 rs1076560, guanine > thymine (G > T)) ...

    journal_title:Frontiers in behavioral neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnbeh.2014.00235

    authors: Taurisano P,Romano R,Mancini M,Giorgio AD,Antonucci LA,Fazio L,Rampino A,Quarto T,Gelao B,Porcelli A,Papazacharias A,Ursini G,Caforio G,Masellis R,Niccoli-Asabella A,Todarello O,Popolizio T,Rubini G,Blasi G,Bertolin

    更新日期:2014-07-09 00:00:00

  • Perception of biological motion in visual agnosia.

    abstract::Over the past 25 years, visual processing has been discussed in the context of the dual stream hypothesis consisting of a ventral ("what") and a dorsal ("where") visual information processing pathway. Patients with brain damage of the ventral pathway typically present with signs of visual agnosia, the inability to ide...

    journal_title:Frontiers in behavioral neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnbeh.2012.00056

    authors: Huberle E,Rupek P,Lappe M,Karnath HO

    更新日期:2012-08-28 00:00:00

  • Maladaptive Decision Making in Adults with a History of Adolescent Alcohol use, in a Preclinical Model, Is Attributable to the Compromised Assignment of Incentive Value during Stimulus-Reward Learning.

    abstract::According to recent WHO reports, alcohol remains the number one substance used and abused by adolescents, despite public health efforts to curb its use. Adolescence is a critical period of biological maturation where brain development, particularly the mesocorticolimbic dopamine system, undergoes substantial remodelin...

    journal_title:Frontiers in behavioral neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnbeh.2017.00134

    authors: Kruse LC,Schindler AG,Williams RG,Weber SJ,Clark JJ

    更新日期:2017-07-25 00:00:00

  • Individual Vulnerability to Stress Is Associated With Increased Demand for Intravenous Heroin Self-administration in Rats.

    abstract::Opioid use is a widespread epidemic, and traumatic stress exposure is a critical risk factor in opioid use and relapse. There is a significant gap in our understanding of how stress contributes to heroin use, and there are limited studies investigating individual differences underlying stress reactivity and subsequent...

    journal_title:Frontiers in behavioral neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnbeh.2019.00134

    authors: Stafford NP,Kazan TN,Donovan CM,Hart EE,Drugan RC,Charntikov S

    更新日期:2019-06-25 00:00:00