当前位置： SCI文献检索 > HIPPOCAMPUS期刊下所有文献 > Correlates of reward-predictive value in learning-related hippocampal neural activity.

Correlates of reward-predictive value in learning-related hippocampal neural activity.

Abstract：

:Temporal difference learning (TD) is a popular algorithm in machine learning. Two learning signals that are derived from this algorithm, the predictive value and the prediction error, have been shown to explain changes in neural activity and behavior during learning across species. Here, the predictive value signal is used to explain the time course of learning-related changes in the activity of hippocampal neurons in monkeys performing an associative learning task. The TD algorithm serves as the centerpiece of a joint probability model for the learning-related neural activity and the behavioral responses recorded during the task. The neural component of the model consists of spiking neurons that compete and learn the reward-predictive value of task-relevant input signals. The predictive-value signaled by these neurons influences the behavioral response generated by a stochastic decision stage, which constitutes the behavioral component of the model. It is shown that the time course of the changes in neural activity and behavioral performance generated by the model exhibits key features of the experimental data. The results suggest that information about correct associations may be expressed in the hippocampus before it is detected in the behavior of a subject. In this way, the hippocampus may be among the earliest brain areas to express learning and drive the behavioral changes associated with learning. Correlates of reward-predictive value may be expressed in the hippocampus through rate remapping within spatial memory representations, they may represent reward-related aspects of a declarative or explicit relational memory representation of task contingencies, or they may correspond to reward-related components of episodic memory representations. These potential functions are discussed in connection with hippocampal cell assembly sequences and their reverse reactivation during the awake state. The results provide further support for the proposal that neural processes underlying learning may be implementing a temporal difference-like algorithm.

journal_name

Hippocampus

journal_title

Hippocampus

authors

Okatan M

doi

10.1002/hipo.20535

subject

Has Abstract

pub_date

2009-05-01 00:00:00

pages

487-506

issue

eissn

1050-9631

issn

1098-1063

journal_volume

pub_type

杂志文章

在线工具

Correlates of reward-predictive value in learning-related hippocampal neural activity.