Reinforcement learning in depression: A review of computational research.

Abstract:

:Despite being considered primarily a mood disorder, major depressive disorder (MDD) is characterized by cognitive and decision making deficits. Recent research has employed computational models of reinforcement learning (RL) to address these deficits. The computational approach has the advantage in making explicit predictions about learning and behavior, specifying the process parameters of RL, differentiating between model-free and model-based RL, and the computational model-based functional magnetic resonance imaging and electroencephalography. With these merits there has been an emerging field of computational psychiatry and here we review specific studies that focused on MDD. Considerable evidence suggests that MDD is associated with impaired brain signals of reward prediction error and expected value ('wanting'), decreased reward sensitivity ('liking') and/or learning (be it model-free or model-based), etc., although the causality remains unclear. These parameters may serve as valuable intermediate phenotypes of MDD, linking general clinical symptoms to underlying molecular dysfunctions. We believe future computational research at clinical, systems, and cellular/molecular/genetic levels will propel us toward a better understanding of the disease.

journal_name

Neurosci Biobehav Rev

authors

Chen C,Takahashi T,Nakagawa S,Inoue T,Kusumi I

doi

10.1016/j.neubiorev.2015.05.005

subject

Has Abstract

pub_date

2015-08-01 00:00:00

pages

247-67

eissn

0149-7634

issn

1873-7528

pii

S0149-7634(15)00131-1

journal_volume

55

pub_type

杂志文章,评审
  • Social visual engagement in infants and toddlers with autism: early developmental transitions and a model of pathogenesis.

    abstract::Efforts to determine and understand the causes of autism are currently hampered by a large disconnect between recent molecular genetics findings that are associated with the condition and the core behavioral symptoms that define the condition. In this perspective piece, we propose a systems biology framework to bridge...

    journal_title:Neuroscience and biobehavioral reviews

    pub_type: 杂志文章,评审

    doi:10.1016/j.neubiorev.2014.10.006

    authors: Klin A,Shultz S,Jones W

    更新日期:2015-03-01 00:00:00

  • Overlapping mechanisms linking insulin resistance with cognition and neuroprogression in bipolar disorder.

    abstract::Cognitive impairment is highly prevalent in the progression of both diabetes mellitus and bipolar disorder. The relationship between insulin resistance in diabetes and the risk of developing major neurocognitive disorders such as Alzheimer's disease has been well described. Insulin resistance and the associated metabo...

    journal_title:Neuroscience and biobehavioral reviews

    pub_type: 杂志文章,评审

    doi:10.1016/j.neubiorev.2020.01.022

    authors: Cuperfain AB,Kennedy JL,Gonçalves VF

    更新日期:2020-04-01 00:00:00

  • Importance of gender for the display of social impairment in pairbond disrupted gerbils.

    abstract::Gerbils form stable male/female pairbonds. Disruption of these has been shown to have consequences for subsequent social behaviour. The response in males is typically a decrease in the initiation of social contacts, whilst females typically freeze when approached. The current studies examined the influence on these ph...

    journal_title:Neuroscience and biobehavioral reviews

    pub_type: 杂志文章

    doi:10.1016/s0149-7634(98)00028-1

    authors: Starkey NJ,Hendrie CA

    更新日期:1998-01-01 00:00:00

  • The pharmacological treatment of aggression in children and adolescents with conduct disorder. Do callous-unemotional traits modulate the efficacy of medication?

    abstract:BACKGROUND:Children and adolescents with conduct disorder (CD) show repetitive and persistent patterns of aggressive behaviour and the more severe forms are often associated with callous-unemotional (CU) traits. OBJECTIVES:To systematically review and, where data are adequate, conduct meta-analyses on the efficacy of ...

    journal_title:Neuroscience and biobehavioral reviews

    pub_type: 杂志文章,meta分析

    doi:10.1016/j.neubiorev.2017.01.024

    authors: Balia C,Carucci S,Coghill D,Zuddas A

    更新日期:2018-08-01 00:00:00

  • Strategies for integrated analysis in imaging genetics studies.

    abstract::Imaging Genetics (IG) integrates neuroimaging and genomic data from the same individual, deepening our knowledge of the biological mechanisms behind neurodevelopmental domains and neurological disorders. Although the literature on IG has exponentially grown over the past years, the majority of studies have mainly anal...

    journal_title:Neuroscience and biobehavioral reviews

    pub_type: 杂志文章

    doi:10.1016/j.neubiorev.2018.06.013

    authors: Vilor-Tejedor N,Alemany S,Cáceres A,Bustamante M,Pujol J,Sunyer J,González JR

    更新日期:2018-10-01 00:00:00

  • The hierarchical basis of neurovisceral integration.

    abstract::The neurovisceral integration (NVI) model was originally proposed to account for observed relationships between peripheral physiology, cognitive performance, and emotional/physical health. This model has also garnered a considerable amount of empirical support, largely from studies examining cardiac vagal control. How...

    journal_title:Neuroscience and biobehavioral reviews

    pub_type: 杂志文章,评审

    doi:10.1016/j.neubiorev.2017.02.003

    authors: Smith R,Thayer JF,Khalsa SS,Lane RD

    更新日期:2017-04-01 00:00:00

  • Altered midbrain dopaminergic neurotransmission during development in an animal model of ADHD.

    abstract::To understand the onset and the molecular mechanisms triggering dopaminergic (DA) dysregulation in Attention-Deficit Hyperactivity Disorder (ADHD), we have used the Spontaneously Hypertensive Rats (SHR), the most widely studied animal model for this disease. We have studied the pattern of expression of specific genes ...

    journal_title:Neuroscience and biobehavioral reviews

    pub_type: 杂志文章,评审

    doi:10.1016/j.neubiorev.2003.08.009

    authors: Leo D,Sorrentino E,Volpicelli F,Eyman M,Greco D,Viggiano D,di Porzio U,Perrone-Capano C

    更新日期:2003-11-01 00:00:00

  • Stress-induced prefrontal reorganization and executive dysfunction in rodents.

    abstract::The prefrontal cortex (PFC) mediates a range of higher order 'executive functions' that subserve the selection and processing of information in such a way that behavior can be planned, controlled and directed according to shifting environmental demands. Impairment of executive functions typifies many forms of psychopa...

    journal_title:Neuroscience and biobehavioral reviews

    pub_type: 杂志文章,评审

    doi:10.1016/j.neubiorev.2008.11.005

    authors: Holmes A,Wellman CL

    更新日期:2009-06-01 00:00:00

  • Dopamine, GABA, cholecystokinin and opioids in neuroleptic-induced tardive dyskinesia.

    abstract::The long-term administration of neuroleptics causes tardive dyskinesia, which closely resembles levodopa-induced dyskinesias, and is brought about through complex mechanisms which are ill-defined. It is generally believed that the pathogenesis of tardive dyskinesia relates closely to the chronic blockade of dopamine r...

    journal_title:Neuroscience and biobehavioral reviews

    pub_type: 杂志文章,评审

    doi:10.1016/s0149-7634(88)80039-3

    authors: Ebadi M,Hama Y

    更新日期:1988-10-01 00:00:00

  • Differential nicotinic regulation of the nigrostriatal and mesolimbic dopaminergic pathways: implications for drug development.

    abstract::Neuronal nicotinic acetylcholine receptors (nAChRs) modulate dopaminergic function. Discovery of their multiplicity has lead to the search for subtype-selective nAChR agonists that might be therapeutically beneficial in diseases linked to brain dopaminergic pathways. The regulation and responses of the nigrostriatal a...

    journal_title:Neuroscience and biobehavioral reviews

    pub_type: 杂志文章,评审

    doi:10.1016/j.neubiorev.2006.09.008

    authors: Janhunen S,Ahtee L

    更新日期:2007-01-01 00:00:00

  • Psychopharmacological effects in the radial-arm maze.

    abstract::The radial-arm maze (RAM) has become a very widely used method for assessing spatial memory in rodents. It has proven to be quite useful in the investigation of the effects of a variety of pharmacological manipulations on spatial memory. The cholinergic system has been found to be crucial for accurate RAM performance....

    journal_title:Neuroscience and biobehavioral reviews

    pub_type: 杂志文章,评审

    doi:10.1016/s0149-7634(88)80008-3

    authors: Levin ED

    更新日期:1988-07-01 00:00:00

  • Intranasal administration of oxytocin: behavioral and clinical effects, a review.

    abstract::The intranasal (IN-) administration of substances is attracting attention from scientists as well as pharmaceutical companies. The effects are surprisingly fast and specific. The present review explores our current knowledge about the routes of access to the cranial cavity. 'Direct-access-pathways' from the nasal cavi...

    journal_title:Neuroscience and biobehavioral reviews

    pub_type: 杂志文章

    doi:10.1016/j.neubiorev.2013.04.012

    authors: Veening JG,Olivier B

    更新日期:2013-09-01 00:00:00

  • Introduction to the special issue from the 2014 meeting of the International Behavioral Neuroscience Society.

    abstract::In 2013, President Obama launched what has been optimistically described as the "decade of the brain". The launch of this effort comes on the back of widespread acknowledgement that more is required to aid those suffering from mental health disorders. Specifically, a greater understanding of the neural circuitry relat...

    journal_title:Neuroscience and biobehavioral reviews

    pub_type: 社论

    doi:10.1016/j.neubiorev.2015.10.007

    authors: Young JW,Hall FS,Pletnikov M,Kent S

    更新日期:2015-11-01 00:00:00

  • Cognitive deterioration in adult epilepsy: Does accelerated cognitive ageing exist?

    abstract::A long-standing concern has been whether epilepsy contributes to cognitive decline or so-called 'epileptic dementia'. Although global cognitive decline is generally reported in the context of chronic refractory epilepsy, it is largely unknown what percentage of patients is at risk for decline. This review is focused o...

    journal_title:Neuroscience and biobehavioral reviews

    pub_type: 杂志文章,评审

    doi:10.1016/j.neubiorev.2016.02.004

    authors: Breuer LE,Boon P,Bergmans JW,Mess WH,Besseling RM,de Louw A,Tijhuis AG,Zinger S,Bernas A,Klooster DC,Aldenkamp AP

    更新日期:2016-05-01 00:00:00

  • Circadian clock genes: non-circadian roles in sleep, addiction, and psychiatric disorders?

    abstract::Elucidation of the cellular and molecular mechanisms of the circadian clock, along with the realization that these mechanisms are operative in both central and peripheral tissues, has revolutionized circadian biology. Further, these observations have resulted in an explosion of interest in the health implications of c...

    journal_title:Neuroscience and biobehavioral reviews

    pub_type: 杂志文章,评审

    doi:10.1016/j.neubiorev.2010.03.004

    authors: Rosenwasser AM

    更新日期:2010-07-01 00:00:00

  • Modeling panic attacks.

    abstract::The isomorphism of dorsal periaqueductal gray-evoked defensive behaviors and panic attacks was appraised in the present study. Thresholds of electrically induced immobility, trotting, galloping, jumping, exophthalmus, micturition and defecation were recorded before and after acute injections of anxiolytic, anxiogenic ...

    journal_title:Neuroscience and biobehavioral reviews

    pub_type: 杂志文章,评审

    doi:10.1016/s0149-7634(01)00060-4

    authors: Schenberg LC,Bittencourt AS,Sudré EC,Vargas LC

    更新日期:2001-12-01 00:00:00

  • Contributions of the prefrontal cortex to the neural basis of human decision making.

    abstract::The neural basis of decision making has been an elusive concept largely due to the many subprocesses associated with it. Recent efforts involving neuroimaging, neuropsychological studies, and animal work indicate that the prefrontal cortex plays a central role in several of these subprocesses. The frontal lobes are in...

    journal_title:Neuroscience and biobehavioral reviews

    pub_type: 杂志文章,评审

    doi:10.1016/s0149-7634(02)00021-0

    authors: Krawczyk DC

    更新日期:2002-10-01 00:00:00

  • Behavioral patterns under cholinergic control during development: lessons learned from the selective immunotoxin 192 IgG saporin.

    abstract::The immunotoxin 192 IgG saporin (192 IgG-sap) offers a valuable tool to investigate the role of the developing basal forebrain cholinergic system in modulating behavioral functions in developing, as well as adult rats. After neonatal 192 IgG-sap lesions, rats display reduced ultrasonic vocalizations as neonates, defic...

    journal_title:Neuroscience and biobehavioral reviews

    pub_type: 杂志文章,评审

    doi:10.1016/s0149-7634(03)00068-x

    authors: Ricceri L

    更新日期:2003-09-01 00:00:00

  • Effects of MDMA on complex brain function in laboratory animals.

    abstract::This review surveys experiments that have examined the effects of acute and chronic MDMA exposure on schedule-controlled operant behaviors thought to engender responses that reflect the expression of complex brain functions. Such functions include time estimation, short-term memory, learning, motivation, and color and...

    journal_title:Neuroscience and biobehavioral reviews

    pub_type: 杂志文章,评审

    doi:10.1016/0149-7634(95)00064-x

    authors: Frederick DL,Paule MG

    更新日期:1997-01-01 00:00:00

  • Habituation is altered in neuropsychiatric disorders-A comprehensive review with recommendations for experimental design and analysis.

    abstract::Abnormalities in the simplest form of learning, habituation, have been reported in a variety of neuropsychiatric disorders as etiologically diverse as Autism Spectrum Disorder, Fragile X syndrome, Schizophrenia, Parkinson's Disease, Huntington's Disease, Attention Deficit Hyperactivity Disorder, Tourette's Syndrome, a...

    journal_title:Neuroscience and biobehavioral reviews

    pub_type: 杂志文章,评审

    doi:10.1016/j.neubiorev.2017.05.028

    authors: McDiarmid TA,Bernardos AC,Rankin CH

    更新日期:2017-09-01 00:00:00

  • Operational dynamics in the hippocampal-entorhinal axis.

    abstract::How do ensembles of neurons distributed across the hippocampal and entorhinal cortices effectively interact? In the awake-behaving rat, specific subpopulations of hippocampal and entorhinal neurons become entrained into two prominent fast-frequency rhythms (gamma [40-100 Hz], and 200 Hz). These fast rhythms are couple...

    journal_title:Neuroscience and biobehavioral reviews

    pub_type: 杂志文章,评审

    doi:10.1016/s0149-7634(97)00016-x

    authors: Chrobak JJ,Buzsáki G

    更新日期:1998-03-01 00:00:00

  • Functional magnetic resonance imaging of mild traumatic brain injury.

    abstract::Functional magnetic resonance imaging (fMRI) offers great promise for elucidating the neuropathology associated with a single or repetitive mild traumatic brain injury (mTBI). The current review discusses the physiological underpinnings of the blood-oxygen level dependent response and how trauma affects the signal. Me...

    journal_title:Neuroscience and biobehavioral reviews

    pub_type: 杂志文章,评审

    doi:10.1016/j.neubiorev.2014.11.016

    authors: Mayer AR,Bellgowan PS,Hanlon FM

    更新日期:2015-02-01 00:00:00

  • A large outdoor radial maze for comparative studies in birds and mammals.

    abstract::For a comparative neurobiological analysis of spatial learning and memory, a large outdoor eight-arm radial maze was constructed which permits behavioral assessment of many avian and mammalian species both from the laboratory or the wild, using the same metric space and session schedules. It consists of a central part...

    journal_title:Neuroscience and biobehavioral reviews

    pub_type: 杂志文章,评审

    doi:10.1016/s0149-7634(00)00050-6

    authors: Lipp HP,Pleskacheva MG,Gossweiler H,Ricceri L,Smirnova AA,Garin NN,Perepiolkina OP,Voronkov DN,Kuptsov PA,Dell'Omo G

    更新日期:2001-01-01 00:00:00

  • The effect of omega-3 fatty acids on aggression: A meta-analysis.

    abstract::Evidence suggests that omega-3 fatty acids are important for a variety of mental health outcomes and have been shown to improve both mood and behaviors. However, there is little consensus on whether omega-3 fatty acids are beneficial for reducing aggressive behaviors. The current study assesses the relationship betwee...

    journal_title:Neuroscience and biobehavioral reviews

    pub_type: 杂志文章,meta分析,评审

    doi:10.1016/j.neubiorev.2016.07.017

    authors: Gajos JM,Beaver KM

    更新日期:2016-10-01 00:00:00

  • Transcranial magnetic stimulation as a tool for understanding neurophysiology in Huntington's disease: a review.

    abstract::Structural and functional magnetic resonance imaging modalities have been critical in advancing our understanding of the neuroanatomical and pathophysiological changes that emerge during the premanifest and symptomatic stages of Huntington's disease (HD). However, the relationship between underlying neuropathology and...

    journal_title:Neuroscience and biobehavioral reviews

    pub_type: 杂志文章,评审

    doi:10.1016/j.neubiorev.2013.05.009

    authors: Philpott AL,Fitzgerald PB,Cummins TD,Georgiou-Karistianis N

    更新日期:2013-09-01 00:00:00

  • Selection, evolution of behavior and animal models in behavioral neuroscience.

    abstract::We investigated whether genetic differences in various forms of intraspecific aggression and anxiety in four different genetic lines of mice (i.e. wild, outbred Swiss-CD1, inbred DBA/2 and inbred C57/BL6N) may reflect modifications in behavioral strategy. Experiments 1 and 2 used ethologically based paradigms to analy...

    journal_title:Neuroscience and biobehavioral reviews

    pub_type: 杂志文章,评审

    doi:10.1016/s0149-7634(99)00029-9

    authors: Parmigiani S,Palanza P,Rogers J,Ferrari PF

    更新日期:1999-11-01 00:00:00

  • Seizure-triggering mechanisms in the kindling model of epilepsy: collapse of GABA-mediated inhibition and activation of NMDA receptors.

    abstract::Our recent studies on seizure-triggering mechanisms in the kindling model of epilepsy are reviewed. Electroencephalographic (EEG) events during kindling-inducing tetanic stimulation from the site of stimulation were recorded, with an emphasis on EEG suppression and rhythmic synchronous discharge. From electrophysiolog...

    journal_title:Neuroscience and biobehavioral reviews

    pub_type: 杂志文章,评审

    doi:

    authors: Morimoto K

    更新日期:1989-01-01 00:00:00

  • Prenatal malnutrition and development of the brain.

    abstract::In this review, we have summarized various aspects as to how prenatal protein malnutrition affects development of the brain and have attempted to integrate several broad principles, concepts, and trends in this field in relation to our findings and other studies of malnutrition insults. Nutrition is probably the singl...

    journal_title:Neuroscience and biobehavioral reviews

    pub_type: 杂志文章,评审

    doi:10.1016/s0149-7634(05)80234-9

    authors: Morgane PJ,Austin-LaFrance R,Bronzino J,Tonkiss J,Díaz-Cintra S,Cintra L,Kemper T,Galler JR

    更新日期:1993-04-01 00:00:00

  • Understanding smell--the olfactory stimulus problem.

    abstract::The main problem with sensory processing is the difficulty in relating sensory input to physiological responses and perception. This is especially problematic at higher levels of processing, where complex cues elicit highly specific responses. In olfaction, this relationship is particularly obfuscated by the difficult...

    journal_title:Neuroscience and biobehavioral reviews

    pub_type: 杂志文章,评审

    doi:10.1016/j.neubiorev.2013.06.009

    authors: Auffarth B

    更新日期:2013-09-01 00:00:00

  • Melatonin signal transduction in the goldfish, Carassius auratus.

    abstract::Generation and reception of melatonin signals in the goldfish, Carassius auratus, are reviewed. The photoreceptive pineal gland of the goldfish generates circulating melatonin rhythms according to a given photoperiod under light-dark cycles and in a circadian manner under continuous dark conditions. Melatonin is also ...

    journal_title:Neuroscience and biobehavioral reviews

    pub_type: 杂志文章,评审

    doi:10.1016/0149-7634(94)90012-4

    authors: Iigo M,Kezuka H,Suzuki T,Tabata M,Aida K

    更新日期:1994-01-01 00:00:00