Efficient collective swimming by harnessing vortices through deep reinforcement learning.

Abstract:

:Fish in schooling formations navigate complex flow fields replete with mechanical energy in the vortex wakes of their companions. Their schooling behavior has been associated with evolutionary advantages including energy savings, yet the underlying physical mechanisms remain unknown. We show that fish can improve their sustained propulsive efficiency by placing themselves in appropriate locations in the wake of other swimmers and intercepting judiciously their shed vortices. This swimming strategy leads to collective energy savings and is revealed through a combination of high-fidelity flow simulations with a deep reinforcement learning (RL) algorithm. The RL algorithm relies on a policy defined by deep, recurrent neural nets, with long-short-term memory cells, that are essential for capturing the unsteadiness of the two-way interactions between the fish and the vortical flow field. Surprisingly, we find that swimming in-line with a leader is not associated with energetic benefits for the follower. Instead, "smart swimmer(s)" place themselves at off-center positions, with respect to the axis of the leader(s) and deform their body to synchronize with the momentum of the oncoming vortices, thus enhancing their swimming efficiency at no cost to the leader(s). The results confirm that fish may harvest energy deposited in vortices and support the conjecture that swimming in formation is energetically advantageous. Moreover, this study demonstrates that deep RL can produce navigation algorithms for complex unsteady and vortical flow fields, with promising implications for energy savings in autonomous robotic swarms.

authors

Verma S,Novati G,Koumoutsakos P

doi

10.1073/pnas.1800923115

subject

Has Abstract

pub_date

2018-06-05 00:00:00

pages

5849-5854

issue

23

eissn

0027-8424

issn

1091-6490

pii

1800923115

journal_volume

115

pub_type

杂志文章
  • Selection of unique antigenic variants of Newcastle disease virus with neutralizing monoclonal antibodies and anti-immunoglobulin.

    abstract::Monoclonal antibodies were used to isolate nonneutralizable antigenic variants in the hemagglutinin-neuraminidase glycoprotein of Newcastle disease virus. It had been found that a large percentage of virus retains infectivity despite binding neutralizing antibody. This high persistent fraction of nonneutralized virus ...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.82.20.7106

    authors: Iorio RM,Bratt MA

    更新日期:1985-10-01 00:00:00

  • Interplay of positive and negative effectors in function of the C-terminal repeat domain of RNA polymerase II.

    abstract::RNA polymerase II lacking a C-terminal domain (CTD) was active in transcription with purified proteins from yeast but failed to support transcription in a yeast extract. CTD dependence could be reconstituted in the purified system by addition of two fractions from the extract. An inhibitory fraction abolished transcri...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.91.6.2362

    authors: Li Y,Kornberg RD

    更新日期:1994-03-15 00:00:00

  • Cross-polarization/magic-angle sample-spinning C NMR spectroscopic study of chlorophyll a in the solid state.

    abstract::Solid-state cross-polarization/magic-angle sample-spinning (13)C NMR spectra have been recorded on chlorophyll a-water aggregates, methyl pyrochlorophyllide a, and methyl pyropheophorbide a (derivatives that lack a phytyl chain). Spectra have also been collected under a decoupling regime in which resonances of certain...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.81.2.641

    authors: Brown CE,Spencer RB,Burger VT,Katz JJ

    更新日期:1984-01-01 00:00:00

  • Physical limits to spatial resolution of optical recording: clarifying the spatial structure of cortical hypercolumns.

    abstract::Neurons in macaque primary visual cortex are spatially arranged by their global topographic position and in at least three overlapping local modular systems: ocular dominance columns, orientation pinwheels, and cytochrome oxidase (CO) blobs. Individual neurons in the blobs are not tuned to orientation, and populations...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.0500291102

    authors: Polimeni JR,Granquist-Fraser D,Wood RJ,Schwartz EL

    更新日期:2005-03-15 00:00:00

  • From likely to likable: The role of statistical typicality in human social assessment of faces.

    abstract::Humans readily form social impressions, such as attractiveness and trustworthiness, from a stranger's facial features. Understanding the provenance of these impressions has clear scientific importance and societal implications. Motivated by the efficient coding hypothesis of brain representation, as well as Claude Sha...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.1912343117

    authors: Ryali CK,Goffin S,Winkielman P,Yu AJ

    更新日期:2020-11-24 00:00:00

  • The active site structure of Na+/K+-transporting ATPase: location of the 5'-(p-fluorosulfonyl)benzoyladenosine binding site and soluble peptides released by trypsin.

    abstract::When the dog kidney Na+/K+-transporting ATPase (EC 3.6.1.37, formerly EC 3.6.1.3) was labeled with an ATP analogue, 5'-(p-fluorosulfonyl)benzoyladenosine (FSBA), there was a concomitant loss of ATPase activity. The presence of ATP protected the enzyme from both labeling and inactivation. The ATP-sensitive incorporatio...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.83.7.2071

    authors: Ohta T,Nagano K,Yoshida M

    更新日期:1986-04-01 00:00:00

  • New HST data and modeling reveal a massive planetesimal collision around Fomalhaut.

    abstract::The apparent detection of an exoplanet orbiting Fomalhaut was announced in 2008. However, subsequent observations of Fomalhaut b raised questions about its status: Unlike other exoplanets, it is bright in the optical and nondetected in the infrared, and its orbit appears to cross the debris ring around the star withou...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.1912506117

    authors: Gáspár A,Rieke GH

    更新日期:2020-05-05 00:00:00

  • From residue matching patterns to protein folding topographies: general model and bovine pancreatic trypsin inhibitor.

    abstract::A coarse-grained model for protein-folding dynamics is introduced based on a discretized representation of torsional modes. The model, based on the Ramachandran map of the local torsional potential surface and the class (hydrophobic/polar/neutral) of each residue, recognizes patterns of both torsional conformations an...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.96.23.12991

    authors: Fernández A,Kostov K,Berry RS

    更新日期:1999-11-09 00:00:00

  • Localization of phytochrome in etioplasts and its regulation in vitro of gibberellin levels.

    abstract::Etioplasts isolated from barley leaves and purified on a Sephadex G-50 (coarse) column were characterized by electron microscopy and nucleic acid analysis. The majority of etioplasts retained an intact outer envelope, and contamination by other fragments was extremely low. The level of gibberellin-like substances extr...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.73.1.138

    authors: Evans A,Smith H

    更新日期:1976-01-01 00:00:00

  • Transient retinoic acid signaling confers anterior-posterior polarity to the inner ear.

    abstract::Vertebrate hearing and balance are based in complex asymmetries of inner ear structure. Here, we identify retinoic acid (RA) as an extrinsic signal that acts directly on the ear rudiment to affect its compartmentalization along the anterior-posterior axis. A rostrocaudal wave of RA activity, generated by tissues surro...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.1010547108

    authors: Bok J,Raft S,Kong KA,Koo SK,Dräger UC,Wu DK

    更新日期:2011-01-04 00:00:00

  • Reconstitution of paired T cell receptor alpha- and beta-chains from microdissected single cells of human inflammatory tissues.

    abstract::We describe a strategy to "revive" putatively pathogenic T cells from frozen specimens of human inflammatory target organs. To distinguish pathogenic from irrelevant bystander T cells, we focused on cells that were (i) clonally expanded and (ii) in direct morphological contact with a target cell. Using CDR3 spectratyp...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.0604247103

    authors: Seitz S,Schneider CK,Malotka J,Nong X,Engel AG,Wekerle H,Hohlfeld R,Dornmair K

    更新日期:2006-08-08 00:00:00

  • Association of the circadian rhythmic expression of GmCRY1a with a latitudinal cline in photoperiodic flowering of soybean.

    abstract::Photoperiodic control of flowering time is believed to affect latitudinal distribution of plants. The blue light receptor CRY2 regulates photoperiodic flowering in the experimental model plant Arabidopsis thaliana. However, it is unclear whether genetic variations affecting cryptochrome activity or expression is broad...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.0810585105

    authors: Zhang Q,Li H,Li R,Hu R,Fan C,Chen F,Wang Z,Liu X,Fu Y,Lin C

    更新日期:2008-12-30 00:00:00

  • A molecular phylogeny of the marine red algae (Rhodophyta) based on the nuclear small-subunit rRNA gene.

    abstract::A phylogeny of marine Rhodophyta has been inferred by a number of methods from nucleotide sequences of nuclear genes encoding small subunit rRNA from 39 species in 15 orders. Sequence divergences are relatively large, especially among bangiophytes and even among congeners in this group. Subclass Bangiophycidae appears...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.91.15.7276

    authors: Ragan MA,Bird CJ,Rice EL,Gutell RR,Murphy CA,Singh RK

    更新日期:1994-07-19 00:00:00

  • Covalent linkage of ribonuclease S-peptide to microinjected proteins causes their intracellular degradation to be enhanced during serum withdrawal.

    abstract::The amino-terminal 20 amino acids are required for microinjected ribonuclease A (RNase A) to be taken up by lysosomes and degraded at an enhanced rate during serum withdrawal. We used water-soluble carbodiimides to covalently attach the RNase S-peptide (residues 1-20) to [3H]RNase S-protein (residues 21-124) at unspec...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.83.16.5830

    authors: Backer JM,Dice JF

    更新日期:1986-08-01 00:00:00

  • Brain-to-brain coupling during handholding is associated with pain reduction.

    abstract::The mechanisms underlying analgesia related to social touch are not clear. While recent research highlights the role of the empathy of the observer to pain relief in the target, the contribution of social interaction to analgesia is unknown. The current study examines brain-to-brain coupling during pain with interpers...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.1703643115

    authors: Goldstein P,Weissman-Fogel I,Dumas G,Shamay-Tsoory SG

    更新日期:2018-03-13 00:00:00

  • One SUMO is sufficient to silence the dimeric potassium channel K2P1.

    abstract::Small ubiquitin modifier 1 (SUMO1) is shown to regulate K2P1 background channels in the plasma membrane (PM) of live mammalian cells. Confocal microscopy reveals native SUMO1, SAE1, and Ubc9 (the enzymes that activate and conjugate SUMO1) at PM where SUMO1 and expressed human K2P1 are demonstrated to colocalize. Silen...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.1004712107

    authors: Plant LD,Dementieva IS,Kollewe A,Olikara S,Marks JD,Goldstein SA

    更新日期:2010-06-08 00:00:00

  • Iroquois homeobox gene 3 establishes fast conduction in the cardiac His-Purkinje network.

    abstract::Rapid electrical conduction in the His-Purkinje system tightly controls spatiotemporal activation of the ventricles. Although recent work has shed much light on the regulation of early specification and morphogenesis of the His-Purkinje system, less is known about how transcriptional regulation establishes impulse con...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.1106911108

    authors: Zhang SS,Kim KH,Rosen A,Smyth JW,Sakuma R,Delgado-Olguín P,Davis M,Chi NC,Puviindran V,Gaborit N,Sukonnik T,Wylie JN,Brand-Arzamendi K,Farman GP,Kim J,Rose RA,Marsden PA,Zhu Y,Zhou YQ,Miquerol L,Henkelman RM,Sta

    更新日期:2011-08-16 00:00:00

  • Male mate choice selects for female coloration in a fish.

    abstract::Although sexual selection theory has proved successful in explaining a wide array of male ornaments, the function of ornaments occurring in females is largely unknown. Traditionally, female ornaments have been considered nonfunctional, being merely a genetically correlated response to selection for male ornamentation....

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.211439298

    authors: Amundsen T,Forsgren E

    更新日期:2001-11-06 00:00:00

  • Periodic and chaotic host-parasite interactions in human malaria.

    abstract::It has been recognized since ancient times that malaria fever is highly periodic but the mechanism has been poorly understood. Malaria fever is related to the parasite growth cycle in erythrocytes. After a fixed period of replication, a mature parasite (schizont) causes the infected erythrocyte to rupture, releasing p...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.88.12.5111

    authors: Kwiatkowski D,Nowak M

    更新日期:1991-06-15 00:00:00

  • The human visual cortex response to melanopsin-directed stimulation is accompanied by a distinct perceptual experience.

    abstract::The photopigment melanopsin supports reflexive visual functions in people, such as pupil constriction and circadian photoentrainment. What contribution melanopsin makes to conscious visual perception is less studied. We devised a stimulus that targeted melanopsin separately from the cones using pulsed (3-s) spectral m...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.1711522114

    authors: Spitschan M,Bock AS,Ryan J,Frazzetta G,Brainard DH,Aguirre GK

    更新日期:2017-11-14 00:00:00

  • G9a drives hypoxia-mediated gene repression for breast cancer cell survival and tumorigenesis.

    abstract::G9a is an epigenetic regulator that methylates H3K9, generally causing repression of gene expression, and participates in diverse cellular functions. G9a is genetically deregulated in a variety of tumor types and can silence tumor suppressor genes and, therefore, is important for carcinogenesis. Although hypoxia is re...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.1618706114

    authors: Casciello F,Al-Ejeh F,Kelly G,Brennan DJ,Ngiow SF,Young A,Stoll T,Windloch K,Hill MM,Smyth MJ,Gannon F,Lee JS

    更新日期:2017-07-03 00:00:00

  • Mechanism of epidermal growth factor receptor autophosphorylation and high-affinity binding.

    abstract::Epidermal growth factor (EGF) receptor monomers and noncovalently associated dimers were isolated by sucrose density gradient centrifugation, and their respective binding and autophosphorylation activities were determined. We find that monomers are low-affinity receptors and dimers are high-affinity receptors. In the ...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.84.22.7832

    authors: Böni-Schnetzler M,Pilch PF

    更新日期:1987-11-01 00:00:00

  • Structure and function of yeast Atg20, a sorting nexin that facilitates autophagy induction.

    abstract::The Atg20 and Snx4/Atg24 proteins have been identified in a screen for mutants defective in a type of selective macroautophagy/autophagy. Both proteins are connected to the Atg1 kinase complex, which is involved in autophagy initiation, and bind phosphatidylinositol-3-phosphate. Atg20 and Snx4 contain putative BAR dom...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.1708367114

    authors: Popelka H,Damasio A,Hinshaw JE,Klionsky DJ,Ragusa MJ

    更新日期:2017-11-21 00:00:00

  • Contraction of neuronal branching volume: an anatomic correlate of Pavlovian conditioning.

    abstract::Associative memory of the mollusc Hermissenda crassicornis, previously correlated with changes of specific K+ currents, protein phosphorylation, and increased synthesis of mRNA and specific proteins, is here shown to be accompanied by macroscopic alteration in the structure of a single identified neuron, the medial ty...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.87.4.1611

    authors: Alkon DL,Ikeno H,Dworkin J,McPhie DL,Olds JL,Lederhendler I,Matzel L,Schreurs BG,Kuzirian A,Collin C

    更新日期:1990-02-01 00:00:00

  • From the Cover: Neutralization of terminal differentiation in gliomagenesis.

    abstract::An immature state of cellular differentiation--characterized by stem cell-like tendencies and impaired differentiation--is a hallmark of cancer. Using glioblastoma multiforme (GBM) as a model system, we sought to determine whether molecular determinants that drive cells toward terminal differentiation are also genetic...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.1308610110

    authors: Hu J,Ho AL,Yuan L,Hu B,Hua S,Hwang SS,Zhang J,Hu T,Zheng H,Gan B,Wu G,Wang YA,Chin L,DePinho RA

    更新日期:2013-09-03 00:00:00

  • Computational identification of gene-social environment interaction at the human IL6 locus.

    abstract::To identify genetic factors that interact with social environments to impact human health, we used a bioinformatic strategy that couples expression array-based detection of environmentally responsive transcription factors with in silico discovery of regulatory polymorphisms to predict genetic loci that modulate transc...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.0911515107

    authors: Cole SW,Arevalo JM,Takahashi R,Sloan EK,Lutgendorf SK,Sood AK,Sheridan JF,Seeman TE

    更新日期:2010-03-23 00:00:00

  • Chronic inflammation that facilitates tumor progression creates local immune suppression by inducing indoleamine 2,3 dioxygenase.

    abstract::Topical application of phorbol myristate acetate (PMA) elicits intense local inflammation that facilitates outgrowth of premalignant lesions in skin after carcinogen exposure. The inflammatory response to PMA treatment activates immune stimulatory mechanisms. However, we show here that PMA exposure also induces plasma...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.0806173105

    authors: Muller AJ,Sharma MD,Chandler PR,Duhadaway JB,Everhart ME,Johnson BA 3rd,Kahler DJ,Pihkala J,Soler AP,Munn DH,Prendergast GC,Mellor AL

    更新日期:2008-11-04 00:00:00

  • Induction of wild-type p53 activity in human cancer cells by ribozymes that repair mutant p53 transcripts.

    abstract::Several groups have attempted to develop gene therapy strategies to treat cancer via introduction of the wild-type (wt) p53 cDNA into cancer cells. Unfortunately, these approaches do not result in regulated expression of the p53 gene and do not reduce expression of the mutant p53 that is overexpressed in cancerous cel...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.150104097

    authors: Watanabe T,Sullenger BA

    更新日期:2000-07-18 00:00:00

  • Anomalous high-pressure behavior of amorphous selenium from synchrotron x-ray diffraction and microtomography.

    abstract::The high-pressure behavior of amorphous selenium has been investigated with time-resolved diamond anvil cell synchrotron x-ray diffraction and computed microtomography techniques. A two-step dynamic crystallization process is observed in which the monoclinic phase crystallized from the amorphous selenium and gradually...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.0806857105

    authors: Liu H,Wang L,Xiao X,De Carlo F,Feng J,Mao HK,Hemley RJ

    更新日期:2008-09-09 00:00:00

  • Distinct basal ganglia territories are engaged in early and advanced motor sequence learning.

    abstract::In this study, we used functional MRI (fMRI) at high field (3T) to track the time course of activation in the entire basal ganglia circuitry, as well as other motor-related structures, during the explicit learning of a sequence of finger movements over a month of training. Fourteen right-handed healthy volunteers had ...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.0502762102

    authors: Lehéricy S,Benali H,Van de Moortele PF,Pélégrini-Issac M,Waechter T,Ugurbil K,Doyon J

    更新日期:2005-08-30 00:00:00