Abstract：
:Decision making in an uncertain environment poses a conflict between the opposing demands of gathering and exploiting information. In a classic illustration of this 'exploration-exploitation' dilemma, a gambler choosing between multiple slot machines balances the desire to select what seems, on the basis of accumulated experience, the richest option, against the desire to choose a less familiar option that might turn out more advantageous (and thereby provide information for improving future decisions). Far from representing idle curiosity, such exploration is often critical for organisms to discover how best to harvest resources such as food and water. In appetitive choice, substantial experimental evidence, underpinned by computational reinforcement learning (RL) theory, indicates that a dopaminergic, striatal and medial prefrontal network mediates learning to exploit. In contrast, although exploration has been well studied from both theoretical and ethological perspectives, its neural substrates are much less clear. Here we show, in a gambling task, that human subjects' choices can be characterized by a computationally well-regarded strategy for addressing the explore/exploit dilemma. Furthermore, using this characterization to classify decisions as exploratory or exploitative, we employ functional magnetic resonance imaging to show that the frontopolar cortex and intraparietal sulcus are preferentially active during exploratory decisions. In contrast, regions of striatum and ventromedial prefrontal cortex exhibit activity characteristic of an involvement in value-based exploitative decision making. The results suggest a model of action selection under uncertainty that involves switching between exploratory and exploitative behavioural modes, and provide a computationally precise characterization of the contribution of key decision-related brain systems to each of these functions.
journal_name
Naturejournal_title
Natureauthors
Daw ND,O'Doherty JP,Dayan P,Seymour B,Dolan RJdoi
10.1038/nature04766subject
Has Abstractpub_date
2006-06-15 00:00:00pages
876-9issue
7095eissn
0028-0836issn
1476-4687pii
nature04766journal_volume
441pub_type
杂志文章相关文献
NATURE文献大全abstract：:Visible-light absorption and transport of the resultant electronic excitations to a reaction centre through Förster resonance energy transfer1-3 (FRET) are critical to the operation of biological light-harvesting systems4, and are used in various artificial systems made of synthetic dyes5, polymers6 or nanodots7,8. Th...
journal_title：Nature
pub_type： 杂志文章
doi：10.1038/s41586-020-03081-y
更新日期：2021-01-01 00:00:00
abstract：:The 5'-->3' exoribonucleases (XRNs) comprise a large family of conserved enzymes in eukaryotes with crucial functions in RNA metabolism and RNA interference. XRN2, or Rat1 in yeast, functions primarily in the nucleus and also has an important role in transcription termination by RNA polymerase II (refs 7-14). Rat1 exo...
journal_title：Nature
pub_type： 杂志文章
doi：10.1038/nature07731
更新日期：2009-04-09 00:00:00
abstract：:A major problem in the elucidation of the molecular mechanisms governing development is the distinction between direct and indirect regulatory interactions among developmental control genes. In vivo studies have indicated that the Drosophila segmentation gene fushi tarazu (ftz) directly or indirectly autoregulates its...
journal_title：Nature
pub_type： 杂志文章
doi：10.1038/356804a0
更新日期：1992-04-30 00:00:00
abstract：:Toxoplasma gondii, an obligate intracellular parasite of the phylum Apicomplexa, can cause severe disease in humans with an immature or suppressed immune system. The outcome of Toxoplasma infection is highly dependent on the strain type, as are many of its in vitro growth properties. Here we use genetic crosses betwee...
journal_title：Nature
pub_type： 杂志文章
doi：10.1038/nature05395
更新日期：2007-01-18 00:00:00
abstract：: ...
journal_title：Nature
pub_type： 新闻
doi：10.1038/d41586-019-00012-4
更新日期：2019-01-01 00:00:00
abstract：:Recognition of a functional 3' splice site in pre-mRNA splicing requires a heterodimer of the proteins U2AF65/U2AF35. U2AF65 binds to RNA at the polypyrimidine tract, whereas U2AF35 is thought to interact through its arginine/serine-rich (RS) domain with other RS-domain-containing factors bound at the 5' splice site, ...
journal_title：Nature
pub_type： 杂志文章
doi：10.1038/41137
更新日期：1997-07-24 00:00:00
abstract：:Humans are able to classify novel items correctly by category; some other animals have also been shown to do this. During category learning, humans group perceptual stimuli by abstracting qualities from similarity relationships of their physical properties. Forming categories is fundamental to cognition and can be ind...
journal_title：Nature
pub_type： 杂志文章
doi：10.1038/35089076
更新日期：2001-08-16 00:00:00
abstract：:The mineral olivine dominates the composition of the Earth's upper mantle and hence controls its mechanical behaviour and seismic anisotropy. Experiments at high temperature and moderate pressure, and extensive data on naturally deformed mantle rocks, have led to the conclusion that olivine at upper-mantle conditions ...
journal_title：Nature
pub_type： 杂志文章
doi：10.1038/nature03266
更新日期：2005-02-17 00:00:00
abstract：:gamma-Aminobutyric acid (GABA), a major inhibitory neurotransmitter in the mammalian nervous system, is known to operate bicuculline-sensitive Cl- channels through GABAA receptors and bicuculline-insensitive cation channels through GABAB receptors. Recent observations indicate that the retina may contain GABA receptor...
journal_title：Nature
pub_type： 杂志文章
doi：10.1038/361159a0
更新日期：1993-01-14 00:00:00
abstract：:There is considerable interest in the existence and significance of alternative conformations of DNA to the right-handed B-form described originally by Watson and Crick. The indirect immunofluorescence observations of Nordheim et al., Arndt-Jovin et al. and Lemeunier et al. that antibodies against left-handed Z-DNA bi...
journal_title：Nature
pub_type： 杂志文章
doi：10.1038/305338a0
更新日期：1983-09-22 00:00:00
abstract：:An inhomogeneous superconducting state, not yet conclusively identified, was predicted by Fulde and Ferrell and Larkin and Ovchinnikov (FFLO) to arise in superconductors with strong Pauli limiting, a consequence of the electrons' Zeeman (spin) energy in a magnetic field. Radovan et al. propose that the observed cascad...
journal_title：Nature
pub_type： 评论,杂志文章
doi：10.1038/427802a
更新日期：2004-02-26 00:00:00
abstract：:During development, cells become progressively restricted, until they reach their final phenotype. Differentiation was originally thought to be irreversible, but phenotypic plasticity has been observed in a variety of cell types, for example sympathetic neurones, the limb blastema and some glial cell types. A detailed...
journal_title：Nature
pub_type： 杂志文章
doi：10.1038/324569a0
更新日期：1986-12-11 00:00:00
abstract：:Quantum degenerate Fermi gases provide a remarkable opportunity to study strongly interacting fermions. In contrast to other Fermi systems, such as superconductors, neutron stars or the quark-gluon plasma of the early Universe, these gases have low densities and their interactions can be precisely controlled over an e...
journal_title：Nature
pub_type： 杂志文章
doi：10.1038/nature03858
更新日期：2005-06-23 00:00:00
abstract：:Sodium channels in plasma membranes can be blocked by a large variety of toxins and local anaesthetics. This property, however, is not confined to relatively large molecules. For instance, extracellularly applied small ions like hydrogen may also prevent the passive transport of permeant cations across open Na+ channe...
journal_title：Nature
pub_type： 杂志文章
doi：10.1038/287062a0
更新日期：1980-09-04 00:00:00
abstract：:Mechanical stimuli can modify the energy landscape of chemical reactions and enable reaction pathways, offering a synthetic strategy that complements conventional chemistry. These mechanochemical mechanisms have been studied extensively in one-dimensional polymers under tensile stress using ring-opening and reorganiza...
journal_title：Nature
pub_type： 杂志文章
doi：10.1038/nature25765
更新日期：2018-02-21 00:00:00
abstract：:Data from a rocket experiment show details which were not known from ground-based observations. ...
journal_title：Nature
pub_type： 杂志文章
doi：10.1038/226526a0
更新日期：1970-05-09 00:00:00
abstract：:Carbon chemistry exhibits a rich variety in bonding patterns, with homo- or heteronuclear multiple bonds involving sp-hybridized carbon atoms as found in molecules such as acetylenes, nitriles, allenes and carbon dioxide. Carbon's heavier homologues in group 14 of the periodic table--including silicon, germanium and t...
journal_title：Nature
pub_type： 杂志文章
doi：10.1038/nature01380
更新日期：2003-02-13 00:00:00
abstract：:Change history: In Fig. 1c of this Letter, the two graphs were duplicates. The right panel of Fig. 1c has been corrected online. ...
journal_title：Nature
pub_type： 杂志文章,已发布勘误
doi：10.1038/s41586-018-0690-1
更新日期：2018-12-01 00:00:00
abstract：:Intracellular signalling following mitogenic stimulation of quiescent cells involves the initiation of a phosphorylation cascade that leads to the rapid and reversible activation of the mitogen-activated protein (MAP) kinases ERK1 and ERK2. MAP kinase activation is mediated by dual phosphorylation within the motif Thr...
journal_title：Nature
pub_type： 杂志文章
doi：10.1038/367651a0
更新日期：1994-02-17 00:00:00
abstract：:During the past ten years, coupled quantum wells have emerged as a promising system for experiments on Bose condensation of excitons, with numerous theoretical and experimental studies aimed at the demonstration of this effect. One of the issues driving these studies is the possibility of long-range coherent transport...
journal_title：Nature
pub_type： 杂志文章
doi：10.1038/nature00940
更新日期：2002-08-15 00:00:00
abstract：:Metamaterials are artificial optical media composed of sub-wavelength metallic and dielectric building blocks that feature optical phenomena not present in naturally occurring materials. Although they can serve as the basis for unique optical devices that mould the flow of light in unconventional ways, three-dimension...
journal_title：Nature
pub_type： 杂志文章
doi：10.1038/nature14477
更新日期：2015-06-11 00:00:00
abstract：:The loose material--regolith--on the surfaces of asteroids is thought to represent ballistically emplaced ejecta from impacts but the identification of source craters and the detailed study of the regolith modification have been hampered by the limited spatial resolution and area coverage of the few asteroids imaged b...
journal_title：Nature
pub_type： 杂志文章
doi：10.1038/35096513
更新日期：2001-09-27 00:00:00
abstract：:Understanding the fluctuations in marine fish stocks is important for the management of fisheries, and attempts have been made to demonstrate links with oceanographic and climatic variability, including the North Atlantic Oscillation (NAO). The NAO has been correlated with a range of long-term ecological measures, inc...
journal_title：Nature
pub_type： 杂志文章
doi：10.1038/417275a
更新日期：2002-05-16 00:00:00
abstract：:This corrects the article DOI: 10.1038/nature24295. ...
journal_title：Nature
pub_type： 杂志文章,已发布勘误
doi：10.1038/nature25017
更新日期：2018-01-25 00:00:00
abstract：:Tracing the transient atomic motions that lie at the heart of chemical reactions requires high-resolution multidimensional structural information on the timescale of molecular vibrations, which commonly range from 10 fs to 1 ps. For simple chemical systems, it has been possible to map out in considerable detail the re...
journal_title：Nature
pub_type： 杂志文章
doi：10.1038/nature08527
更新日期：2009-11-12 00:00:00
abstract：:Oscillations in cyclin-dependent kinase (CDK) activity drive the somatic cell cycle. After entry into mitosis, CDKs activate the anaphase-promoting complex (APC), which then promotes cyclin degradation and mitotic exit. The re-accumulation of cyclin A causes the inactivation of APC and entry into S phase, but how cycl...
journal_title：Nature
pub_type： 杂志文章
doi：10.1038/nature03023
更新日期：2004-12-02 00:00:00
abstract：:Following the introduction of hydrochlorofluorocarbon (HCFCs) and hydrofluorocarbon (HFCs) gases as replacements for the ozone-destroying chlorofluorocarbons (CFCs), it has been discovered that HCFCs/HFCs can degrade in the atmosphere to produce trifluoroacetic acid, a compound with no known loss mechanisms in the env...
journal_title：Nature
pub_type： 杂志文章
doi：10.1038/35085548
更新日期：2001-07-19 00:00:00
abstract：:It is commonly assumed that certain features are so elementary to the visual system that they require no attentional resources to be perceived. Such 'preattentive' features are traditionally identified by visual search performance, in which the reaction time for detecting a feature difference against a set of distract...
journal_title：Nature
pub_type： 杂志文章
doi：10.1038/42940
更新日期：1997-06-19 00:00:00
abstract：:The glutamate dehydrogenase gene of Escherichia coli has been cloned into broad host-range plasmids and can complement glutamate synthase mutants of Methylophilus methylotrophus. Assimilation of ammonia via glutamate dehydrogenase is more energy-efficient than via glutamate synthase, thus the recombinant organism conv...
journal_title：Nature
pub_type： 杂志文章
doi：10.1038/287396a0
更新日期：1980-10-02 00:00:00
abstract：: ...
journal_title：Nature
pub_type： 评论,新闻
doi：10.1038/d41586-018-07008-6
更新日期：2018-11-01 00:00:00
