Does temporal discounting explain unhealthy behavior? A systematic review and reinforcement learning perspective.

Abstract:

:The tendency to make unhealthy choices is hypothesized to be related to an individual's temporal discount rate, the theoretical rate at which they devalue delayed rewards. Furthermore, a particular form of temporal discounting, hyperbolic discounting, has been proposed to explain why unhealthy behavior can occur despite healthy intentions. We examine these two hypotheses in turn. We first systematically review studies which investigate whether discount rates can predict unhealthy behavior. These studies reveal that high discount rates for money (and in some instances food or drug rewards) are associated with several unhealthy behaviors and markers of health status, establishing discounting as a promising predictive measure. We secondly examine whether intention-incongruent unhealthy actions are consistent with hyperbolic discounting. We conclude that intention-incongruent actions are often triggered by environmental cues or changes in motivational state, whose effects are not parameterized by hyperbolic discounting. We propose a framework for understanding these state-based effects in terms of the interplay of two distinct reinforcement learning mechanisms: a "model-based" (or goal-directed) system and a "model-free" (or habitual) system. Under this framework, while discounting of delayed health may contribute to the initiation of unhealthy behavior, with repetition, many unhealthy behaviors become habitual; if health goals then change, habitual behavior can still arise in response to environmental cues. We propose that the burgeoning development of computational models of these processes will permit further identification of health decision-making phenotypes.

journal_name

Front Behav Neurosci

authors

Story GW,Vlaev I,Seymour B,Darzi A,Dolan RJ

doi

10.3389/fnbeh.2014.00076

subject

Has Abstract

pub_date

2014-03-12 00:00:00

pages

76

issn

1662-5153

journal_volume

8

pub_type

杂志文章,评审
  • Ethanol Sensitization during Adolescence or Adulthood Induces Different Patterns of Ethanol Consumption without Affecting Ethanol Metabolism.

    abstract::In previous study, we demonstrated that ethanol preexposure may increase ethanol consumption in both adolescent and adult mice, in a two-bottle choice model. We now questioned if ethanol exposure during adolescence results in changes of consumption pattern using a three-bottle choice procedure, considering drinking-in...

    journal_title:Frontiers in behavioral neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnbeh.2017.00046

    authors: Carrara-Nascimento PF,Hoffmann LB,Contó MB,Marcourakis T,Camarini R

    更新日期:2017-03-23 00:00:00

  • The Interplay of Achievement Motive-Goal Incongruence and State and Trait Self-Control: A Pilot Study Considering Cortical Correlates of Self-Control.

    abstract::Objective: This study utilized different theoretical perspectives to better understand motor performance. We refered to concepts of achievement motive-goal incongruence and assessed cortical correlates of self-control. We assumed that more self-control is required when people act in conformance with an incongruent goa...

    journal_title:Frontiers in behavioral neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnbeh.2019.00235

    authors: Schüler J,Hofstetter J,Wolff W

    更新日期:2019-10-04 00:00:00

  • Pain-related stress during the Neonatal Intensive Care Unit stay and SLC6A4 methylation in very preterm infants.

    abstract::Very preterm (VPT) infants need long-lasting hospitalization in the Neonatal Intensive Care Unit (NICU) during which they are daily exposed to pain-related stress. Alterations of DNA methylation at the promoter region of the SLC6A4 have been associated with early adverse experiences in infants. The main aim of the pre...

    journal_title:Frontiers in behavioral neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnbeh.2015.00099

    authors: Provenzi L,Fumagalli M,Sirgiovanni I,Giorda R,Pozzoli U,Morandi F,Beri S,Menozzi G,Mosca F,Borgatti R,Montirosso R

    更新日期:2015-04-21 00:00:00

  • Peritraumatic startle response predicts the vulnerability to develop PTSD-like behaviors in rats: a model for peritraumatic dissociation.

    abstract::Peritraumatic dissociation, a state characterized by alteration in perception and reduced awareness of surroundings, is considered to be a risk factor for the development of post-traumatic stress disorder (PTSD). However, the predictive ability of peritraumatic dissociation is questioned for the inconsistent results i...

    journal_title:Frontiers in behavioral neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnbeh.2014.00014

    authors: Dong X,Li Y

    更新日期:2014-01-28 00:00:00

  • The Neurotransmitters Involved in Drosophila Alcohol-Induced Behaviors.

    abstract::Alcohol is a widely used and abused substance with numerous negative consequences for human health and safety. Historically, alcohol's widespread, non-specific neurobiological effects have made it a challenge to study in humans. Therefore, model organisms are a critical tool for unraveling the mechanisms of alcohol ac...

    journal_title:Frontiers in behavioral neuroscience

    pub_type: 杂志文章,评审

    doi:10.3389/fnbeh.2020.607700

    authors: Chvilicek MM,Titos I,Rothenfluh A

    更新日期:2020-12-15 00:00:00

  • The intralaminar thalamus-an expressway linking visual stimuli to circuits determining agency and action selection.

    abstract::Anatomical investigations have revealed connections between the intralaminar thalamic nuclei and areas such as the superior colliculus (SC) that receive short latency input from visual and auditory primary sensory areas. The intralaminar nuclei in turn project to the major input nucleus of the basal ganglia, the stria...

    journal_title:Frontiers in behavioral neuroscience

    pub_type: 杂志文章,评审

    doi:10.3389/fnbeh.2014.00115

    authors: Fisher SD,Reynolds JN

    更新日期:2014-04-02 00:00:00

  • Whisker encoding of mechanical events during active tactile exploration.

    abstract::Rats use their whiskers to extract a wealth of information about their immediate environment, such as the shape, position or texture of an object. The information is conveyed to mechanoreceptors located within the whisker follicle in the form of a sequence of whisker deflections induced by the whisker/object contact i...

    journal_title:Frontiers in behavioral neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnbeh.2012.00074

    authors: Boubenec Y,Shulz DE,Debrégeas G

    更新日期:2012-11-06 00:00:00

  • Aberrant neural synchrony in the maternal immune activation model: using translatable measures to explore targeted interventions.

    abstract::Maternal exposure to infection occurring mid-gestation produces a three-fold increase in the risk of schizophrenia in the offspring. The critical initiating factor appears to be the maternal immune activation (MIA) that follows infection. This process can be induced in rodents by exposure of pregnant dams to the viral...

    journal_title:Frontiers in behavioral neuroscience

    pub_type: 杂志文章,评审

    doi:10.3389/fnbeh.2013.00217

    authors: Dickerson DD,Bilkey DK

    更新日期:2013-12-27 00:00:00

  • Endocannabinoids Interact With the Dopaminergic System to Increase Sexual Motivation: Lessons From the Sexual Satiety Phenomenon.

    abstract::In male rats, copulation to satiety induces a long-lasting sexual inhibitory state, considered to rely on a decreased sexual motivation. Dopaminergic transmission at the mesolimbic system plays a central role in the regulation of male sexual motivation. Endocannabinoids (eCBs) modulate the activity of the mesolimbic s...

    journal_title:Frontiers in behavioral neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnbeh.2019.00184

    authors: Canseco-Alba A,Rodríguez-Manzo G

    更新日期:2019-08-14 00:00:00

  • An Additional Prior Retrieval Alters the Effects of a Retrieval-Extinction Procedure on Recent and Remote Fear Memory.

    abstract::Several studies have shown that the isolated retrieval of a consolidated fear memory can induce a labile phase, during which extinction training can prevent the reinstatement, a form of relapse in which fear response to a fear-provoking context returns when a mild shock is presented. However, fear memory retrieval may...

    journal_title:Frontiers in behavioral neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnbeh.2017.00259

    authors: An X,Yang P,Chen S,Zhang F,Yu D

    更新日期:2018-01-08 00:00:00

  • Audiovisual Temporal Processing and Synchrony Perception in the Rat.

    abstract::Extensive research on humans has improved our understanding of how the brain integrates information from our different senses, and has begun to uncover the brain regions and large-scale neural activity that contributes to an observer's ability to perceive the relative timing of auditory and visual stimuli. In the pres...

    journal_title:Frontiers in behavioral neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnbeh.2016.00246

    authors: Schormans AL,Scott KE,Vo AM,Tyker A,Typlt M,Stolzberg D,Allman BL

    更新日期:2017-01-10 00:00:00

  • Should animals navigating over short distances switch to a magnetic compass sense?

    abstract::Magnetoreception can play a substantial role in long distance navigation by animals. I hypothesize that locomotion guided by a magnetic compass sense could also play a role in short distance navigation. Animals identify mates, prey, or other short distance navigational goals using different sensory modalities (olfacti...

    journal_title:Frontiers in behavioral neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnbeh.2010.00042

    authors: Wyeth RC

    更新日期:2010-07-30 00:00:00

  • Quantitative and Discrete Evolutionary Changes in the Egg-Laying Behavior of Single Drosophila Females.

    abstract::How a nervous system assembles and coordinates a suite of elementary behavioral steps into a complex behavior is not well understood. While often presented as a stereotyped sequence of events, even extensively studied behaviors such as fly courtship are rarely a strict repetition of the same steps in a predetermined s...

    journal_title:Frontiers in behavioral neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnbeh.2019.00118

    authors: Bräcker LB,Schmid CA,Bolini VA,Holz CA,Prud'homme B,Sirota A,Gompel N

    更新日期:2019-05-29 00:00:00

  • Prophylactic Effects of Bifidobacterium adolescentis on Anxiety and Depression-Like Phenotypes After Chronic Stress: A Role of the Gut Microbiota-Inflammation Axis.

    abstract::Stress disturbs the balance of the gut microbiota and stimulates inflammation-to-brain mechanisms. Moreover, stress leads to anxiety and depressive disorders. Bifidobacterium adolescentis displays distinct anti-inflammatory effects. However, no report has focused on the anxiolytic and antidepressant effects of B. adol...

    journal_title:Frontiers in behavioral neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnbeh.2019.00126

    authors: Guo Y,Xie JP,Deng K,Li X,Yuan Y,Xuan Q,Xie J,He XM,Wang Q,Li JJ,Luo HR

    更新日期:2019-06-18 00:00:00

  • Urethane anesthesia depresses activities of thalamocortical neurons and alters its response to nociception in terms of dual firing modes.

    abstract::Anesthetics are often used to characterize the activity of single neurons in vivo for their advantages such as reduction of noise level and convenience in noxious stimulations. Urethane has been a widely used anesthetic in thalamic studies under the assumption that sensory signals are still relayed to the thalamus und...

    journal_title:Frontiers in behavioral neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnbeh.2013.00141

    authors: Huh Y,Cho J

    更新日期:2013-10-10 00:00:00

  • Long-Term Effects of Traumatic Brain Injury on Anxiety-Like Behaviors in Mice: Behavioral and Neural Correlates.

    abstract::Traumatic brain injury (TBI) has been frequently linked to affective disorders such as anxiety and depression. However, much remains to be understood about the underlying molecular and signaling mechanisms that mediate affective dysfunctions following injury. A lack of consensus in animal studies regarding what the af...

    journal_title:Frontiers in behavioral neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnbeh.2019.00006

    authors: Popovitz J,Mysore SP,Adwanikar H

    更新日期:2019-01-23 00:00:00

  • Evidence for a Priori Existence of Attentional Bias Subgroups in Emotional Processing of Aversive Stimuli.

    abstract::Little is known regarding inter-individual differences in attentional biases for pain-related information; more knowledge is crucial, since these biases have been associated with differences in pain processing as well as in predicting the risk of postoperative pain. The present study investigated EEG correlates of att...

    journal_title:Frontiers in behavioral neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnbeh.2017.00087

    authors: van Heck CH,Oosterman JM,de Kleijn KMA,Jongsma MLA,van Rijn CM

    更新日期:2017-05-12 00:00:00

  • Vasopressin Differentially Affects Handgrip Force of Expectant Fathers in Reaction to Own and Unknown Infant Faces.

    abstract::The underlying mechanisms of paternal responses to infant signals are poorly understood. Vasopressin has previously been proposed to affect these responses. Using a double-blind, placebo-controlled, within-subject design (N = 25 expectant fathers), we examined the effect of vasopressin administration on the use of exc...

    journal_title:Frontiers in behavioral neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnbeh.2019.00105

    authors: Alyousefi-van Dijk K,van 't Veer AE,Meijer WM,Lotz AM,Rijlaarsdam J,Witteman J,Bakermans-Kranenburg MJ

    更新日期:2019-05-21 00:00:00

  • Genetically-Driven Enhancement of Dopaminergic Transmission Affects Moral Acceptability in Females but Not in Males: A Pilot Study.

    abstract::Moral behavior has been a key topic of debate for philosophy and psychology for a long time. In recent years, thanks to the development of novel methodologies in cognitive sciences, the question of how we make moral choices has expanded to the study of neurobiological correlates that subtend the mental processes invol...

    journal_title:Frontiers in behavioral neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnbeh.2017.00156

    authors: Pellegrini S,Palumbo S,Iofrida C,Melissari E,Rota G,Mariotti V,Anastasio T,Manfrinati A,Rumiati R,Lotto L,Sarlo M,Pietrini P

    更新日期:2017-08-29 00:00:00

  • Distinct patterns of outcome valuation and amygdala-prefrontal cortex synaptic remodeling in adolescence and adulthood.

    abstract::Adolescent behavior is typified by increased risk-taking, reward- and novelty-seeking, as well as an augmented need for social and environmental stimulation. This behavioral phenotype may result from alterations in outcome valuation or reward learning. In the present set of experiments, we directly compared adult and ...

    journal_title:Frontiers in behavioral neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnbeh.2015.00115

    authors: Stolyarova A,Izquierdo A

    更新日期:2015-05-07 00:00:00

  • Memory accessibility and medical decision-making for significant others: the role of socially shared retrieval-induced forgetting.

    abstract::Medical decisions will often entail a broad search for relevant information. No sources alone may offer a complete picture, and many may be selective in their presentation. This selectivity may induce forgetting for previously learned material, thereby adversely affecting medical decision-making. In the study phase of...

    journal_title:Frontiers in behavioral neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnbeh.2013.00072

    authors: Coman D,Coman A,Hirst W

    更新日期:2013-06-14 00:00:00

  • Neural sensitivity to social reward and punishment anticipation in social anxiety disorder.

    abstract::An imbalance in the neural motivational system may underlie Social Anxiety Disorder (SAD). This study examines social reward and punishment anticipation in SAD, predicting a valence-specific effect: increased striatal activity for punishment avoidance compared to obtaining a reward. Individuals with SAD (n = 20) and a...

    journal_title:Frontiers in behavioral neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnbeh.2014.00439

    authors: Cremers HR,Veer IM,Spinhoven P,Rombouts SA,Roelofs K

    更新日期:2015-01-05 00:00:00

  • Bumblebees Learn a Relational Rule but Switch to a Win-Stay/Lose-Switch Heuristic After Extensive Training.

    abstract::Mapping animal performance in a behavioral task to underlying cognitive mechanisms and strategies is rarely straightforward, since a task may be solvable in more than one manner. Here, we show that bumblebees perform well on a concept-based visual discrimination task but spontaneously switch from a concept-based solut...

    journal_title:Frontiers in behavioral neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnbeh.2020.00137

    authors: MaBouDi H,Solvi C,Chittka L

    更新日期:2020-08-12 00:00:00

  • A Central Component of the N1 Event-Related Brain Potential Could Index the Early and Automatic Inhibition of the Actions Systematically Activated by Objects.

    abstract::Stimuli of the environment, like objects, systematically activate the actions they are associated to. These activations occur extremely fast. Nevertheless, behavioral data reveal that, in most cases, these activations are then automatically inhibited, around 100 ms after the occurrence of the stimulus. We thus tested ...

    journal_title:Frontiers in behavioral neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnbeh.2019.00095

    authors: Debruille JB,Touzel M,Segal J,Snidal C,Renoult L

    更新日期:2019-05-08 00:00:00

  • Pacemaker neuron and network oscillations depend on a neuromodulator-regulated linear current.

    abstract::Linear leak currents have been implicated in the regulation of neuronal excitability, generation of neuronal and network oscillations, and network state transitions. Yet, few studies have directly tested the dependence of network oscillations on leak currents or explored the role of leak currents on network activity. ...

    journal_title:Frontiers in behavioral neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnbeh.2010.00021

    authors: Zhao S,Golowasch J,Nadim F

    更新日期:2010-05-18 00:00:00

  • Early life environmental and pharmacological stressors result in persistent dysregulations of the serotonergic system.

    abstract::Dysregulations in the brain serotonergic system and exposure to environmental stressors have been implicated in the development of major depressive disorder. Here, we investigate the interactions between the stress and serotonergic systems by characterizing the behavioral and biochemical effects of chronic stress appl...

    journal_title:Frontiers in behavioral neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnbeh.2015.00094

    authors: Wong P,Sze Y,Gray LJ,Chang CC,Cai S,Zhang X

    更新日期:2015-04-27 00:00:00

  • Sleep Deprivation Aggravates Cognitive Impairment by the Alteration of Hippocampal Neuronal Activity and the Density of Dendritic Spine in Isoflurane-Exposed Mice.

    abstract::Isoflurane contributes to cognitive deficits when used as a general anesthetic, and so does sleep deprivation (SD). Patients usually suffer from insomnia before an operation due to anxiety, fear, and other factors. It remains unclear whether preoperative SD exacerbates cognitive impairment induced by isoflurane. In th...

    journal_title:Frontiers in behavioral neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnbeh.2020.589176

    authors: Zhang K,Lian N,Ding R,Guo C,Dong X,Li Y,Wei S,Jiao Q,Yu Y,Shen H

    更新日期:2020-11-23 00:00:00

  • Stronger pharmacological cortisol suppression and anticipatory cortisol stress response in transient global amnesia.

    abstract::Transient global amnesia (TGA) is a disorder characterized by a sudden attack of severe anterograde memory disturbance that is frequently preceded by emotional or physical stress and resolves within 24 h. By using MRI following the acute episode in TGA patients, small lesions in the hippocampus have been observed. Hen...

    journal_title:Frontiers in behavioral neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnbeh.2015.00063

    authors: Griebe M,Nees F,Gerber B,Ebert A,Flor H,Wolf OT,Gass A,Hennerici MG,Szabo K

    更新日期:2015-03-09 00:00:00

  • Born to Cry: A Genetic Dissection of Infant Vocalization.

    abstract::Infant vocalizations are one of the most fundamental and innate forms of behavior throughout avian and mammalian orders. They have a critical role in motivating parental care and contribute significantly to fitness and reproductive success. Dysregulation of these vocalizations has been reported to predict risk of cent...

    journal_title:Frontiers in behavioral neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnbeh.2018.00250

    authors: Ashbrook DG,Roy S,Clifford BG,Riede T,Scattoni ML,Heck DH,Lu L,Williams RW

    更新日期:2018-10-29 00:00:00

  • Is there a pilot in the brain? Contribution of the self-positioning system to spatial navigation.

    abstract::Since the discovery of place cells, the hippocampus is thought to be the neural substrate of a cognitive map. The later discovery of head direction cells, grid cells and border cells, as well as of cells with more complex spatial signals, has led to the idea that there is a brain system devoted to providing the animal...

    journal_title:Frontiers in behavioral neuroscience

    pub_type: 杂志文章,评审

    doi:10.3389/fnbeh.2015.00292

    authors: Poucet B,Chaillan F,Truchet B,Save E,Sargolini F,Hok V

    更新日期:2015-10-30 00:00:00