Evolutionary online behaviour learning and adaptation in real robots.

Abstract:

:Online evolution of behavioural control on real robots is an open-ended approach to autonomous learning and adaptation: robots have the potential to automatically learn new tasks and to adapt to changes in environmental conditions, or to failures in sensors and/or actuators. However, studies have so far almost exclusively been carried out in simulation because evolution in real hardware has required several days or weeks to produce capable robots. In this article, we successfully evolve neural network-based controllers in real robotic hardware to solve two single-robot tasks and one collective robotics task. Controllers are evolved either from random solutions or from solutions pre-evolved in simulation. In all cases, capable solutions are found in a timely manner (1 h or less). Results show that more accurate simulations may lead to higher-performing controllers, and that completing the optimization process in real robots is meaningful, even if solutions found in simulation differ from solutions in reality. We furthermore demonstrate for the first time the adaptive capabilities of online evolution in real robotic hardware, including robots able to overcome faults injected in the motors of multiple units simultaneously, and to modify their behaviour in response to changes in the task requirements. We conclude by assessing the contribution of each algorithmic component on the performance of the underlying evolutionary algorithm.

journal_name

R Soc Open Sci

authors

Silva F,Correia L,Christensen AL

doi

10.1098/rsos.160938

subject

Has Abstract

pub_date

2017-07-26 00:00:00

pages

160938

issue

7

issn

2054-5703

pii

rsos160938

journal_volume

4

pub_type

杂志文章
  • A new insight into the evolution and functional divergence of FRK genes in Pyrus bretschneideri.

    abstract::In plants, plant fructokinases (FRKs) are considered to be the main gateway of fructose metabolism as they can phosphorylate fructose to fructose-6-phosphate. Chinese white pears (Pyrus bretschneideri) are one of the popular fruits in the world market; sugar content is an important factor affecting the quality of the ...

    journal_title:Royal Society open science

    pub_type: 杂志文章

    doi:10.1098/rsos.171463

    authors: Cao Y,Li S,Han Y,Meng D,Jiao C,Abdullah M,Li D,Jin Q,Lin Y,Cai Y

    更新日期:2018-07-18 00:00:00

  • European and Asian contribution to the genetic diversity of mainland South American chickens.

    abstract::Chickens (Gallus gallus domesticus) from the Americas have long been recognized as descendants of European chickens, transported by early Europeans since the fifteenth century. However, in recent years, a possible pre-Columbian introduction of chickens to South America by Polynesian seafarers has also been suggested. ...

    journal_title:Royal Society open science

    pub_type: 杂志文章

    doi:10.1098/rsos.191558

    authors: Herrera MB,Kraitsek S,Alcalde JA,Quiroz D,Revelo H,Alvarez LA,Rosario MF,Thomson V,Jianlin H,Austin JJ,Gongora J

    更新日期:2020-02-05 00:00:00

  • Roads to pentazolate anion: a theoretical insight.

    abstract::The formation mechanism of pentazolate anion (PZA) is not yet clear. In order to present the possible formation pathways of PZA, the potential energy surfaces of phenylpentazole (PPZ), phenylpentazole radical (PPZ-R), phenylpentazole radical anion (PPZ-RA), PPZ and m-chloroperbenzoic acid (m-CPBA), p-pentazolylphenola...

    journal_title:Royal Society open science

    pub_type: 杂志文章

    doi:10.1098/rsos.172269

    authors: Yu T,Ma YD,Lai WP,Liu YZ,Ge ZX,Ren G

    更新日期:2018-05-23 00:00:00

  • Structural characterization of alkali-soluble polysaccharides from Panax ginseng C. A. Meyer.

    abstract::Panax ginseng C. A. Meyer (ginseng) has been widely used as a herb and functional food in the world. Polysaccharides are the main active components of ginseng. In this paper, the polysaccharides were sequentially extracted by 50 mM Na2CO3, 1 M KOH and 4 M KOH from ginseng roots treated sequentially with hot water, α-a...

    journal_title:Royal Society open science

    pub_type: 杂志文章

    doi:10.1098/rsos.171644

    authors: Ji L,Jie Z,Ying X,Yue Q,Zhou Y,Sun L

    更新日期:2018-03-14 00:00:00

  • An arc fault diagnosis algorithm using multiinformation fusion and support vector machines.

    abstract::Arc faults in low-voltage electrical circuits are the main hidden cause of electric fires. Accurate identification of arc faults is essential for safe power consumption. In this paper, a detection algorithm for arc faults is tested in a low-voltage circuit. With capacitance coupling and a logarithmic detector, the hig...

    journal_title:Royal Society open science

    pub_type: 杂志文章

    doi:10.1098/rsos.180160

    authors: Yang JH,Fang HY,Zhang RC,Yang K

    更新日期:2018-09-19 00:00:00

  • The dynamics of trait variance in multi-species communities.

    abstract::In this paper, we establish the explicit connection between deterministic trait-based population-level models (in the form of partial differential equations) and species-level models (in the form of ordinary differential equations), in the context of eco-evolutionary systems. In particular, by starting from a populati...

    journal_title:Royal Society open science

    pub_type: 杂志文章

    doi:10.1098/rsos.200321

    authors: Nordbotten JM,Bokma F,Hermansen JS,Stenseth NC

    更新日期:2020-08-19 00:00:00

  • How successful are mutants in multiplayer games with fluctuating environments? Sojourn times, fixation and optimal switching.

    abstract::Using a stochastic model, we investigate the probability of fixation, and the average time taken to achieve fixation, of a mutant in a population of wild-types. We do this in a context where the environment in which the competition takes place is subject to stochastic change. Our model takes into account interactions ...

    journal_title:Royal Society open science

    pub_type: 杂志文章

    doi:10.1098/rsos.172176

    authors: Baron JW,Galla T

    更新日期:2018-03-21 00:00:00

  • The roles of contact conformity, temperature and displacement amplitude on the lubricated fretting wear of a steel-on-steel contact.

    abstract::This paper investigates the effect of contact geometry, temperature and displacement amplitude on the fretting behaviour of an aero-turbo oil lubricated cylinder-on-flat contact. To be effective, the lubricant needed both to penetrate the contact and then offer protection. Lubricant penetration into the fretting conta...

    journal_title:Royal Society open science

    pub_type: 杂志文章

    doi:10.1098/rsos.150637

    authors: Warmuth AR,Sun W,Shipway PH

    更新日期:2016-10-19 00:00:00

  • Divalent cations bind to phosphoinositides to induce ion and isomer specific propensities for nano-cluster initiation in bilayer membranes.

    abstract::We report all-atom molecular dynamics simulations of asymmetric bilayers containing phosphoinositides in the presence of monovalent and divalent cations. We have characterized the molecular mechanism by which these divalent cations interact with phosphoinositides. Ca2+ desolvates more readily, consistent with single-m...

    journal_title:Royal Society open science

    pub_type: 杂志文章

    doi:10.1098/rsos.192208

    authors: Bradley RP,Slochower DR,Janmey PA,Radhakrishnan R

    更新日期:2020-05-20 00:00:00

  • Camp stability predicts patterns of hunter-gatherer cooperation.

    abstract::Humans regularly cooperate with non-kin, which has been theorized to require reciprocity between repeatedly interacting and trusting individuals. However, the role of repeated interactions has not previously been demonstrated in explaining real-world patterns of hunter-gatherer cooperation. Here we explore cooperation...

    journal_title:Royal Society open science

    pub_type: 杂志文章

    doi:10.1098/rsos.160131

    authors: Smith D,Dyble M,Thompson J,Major K,Page AE,Chaudhary N,Salali GD,Vinicius L,Migliano AB,Mace R

    更新日期:2016-07-13 00:00:00

  • Learned valuation during forage decision-making in cuttlefish.

    abstract::Decision-making, when humans and other animals choose between two options, is not always based on the absolute values of the options but can also depend on their relative values. The present study examines whether decision-making by cuttlefish is dependent on relative values learned from previous experience. Cuttlefis...

    journal_title:Royal Society open science

    pub_type: 杂志文章

    doi:10.1098/rsos.201602

    authors: Kuo TH,Chiao CC

    更新日期:2020-12-16 00:00:00

  • Magnonic band spectrum of spin waves in an elliptical helix.

    abstract::We show that the spin-wave spectrum in an elliptical helix has a band character. The size of the first band gap calculated using the perturbation theory is shown to scale as square root of the eccentricity. Curved magnonic waveguides of the kind considered here could be used as structural elements of future three-dime...

    journal_title:Royal Society open science

    pub_type: 杂志文章

    doi:10.1098/rsos.172285

    authors: Golovchan AV,Kruglyak VV,Tkachenko VS,Kuchko AN

    更新日期:2018-01-31 00:00:00

  • Fire ants perpetually rebuild sinking towers.

    abstract::In the aftermath of a flood, fire ants, Solenopsis invicta, cluster into temporary encampments. The encampments can contain hundreds of thousands of ants and reach over 30 ants high. How do ants build such tall structures without being crushed? In this combined experimental and theoretical study, we investigate the sh...

    journal_title:Royal Society open science

    pub_type: 杂志文章

    doi:10.1098/rsos.170475

    authors: Phonekeo S,Mlot N,Monaenkova D,Hu DL,Tovey C

    更新日期:2017-07-12 00:00:00

  • Limiting stochastic processes of shift-periodic dynamical systems.

    abstract::A shift-periodic map is a one-dimensional map from the real line to itself which is periodic up to a linear translation and allowed to have singularities. It is shown that iterative sequences xn+1 = F(x n ) generated by such maps display rich dynamical behaviour. The intege...

    journal_title:Royal Society open science

    pub_type: 杂志文章

    doi:10.1098/rsos.191423

    authors: Stadlmann J,Erban R

    更新日期:2019-11-27 00:00:00

  • On complex systems of adaptive frugal products.

    abstract::Frugal products possess a proper mix of features including minimal consumption of resources, good functionality under nominal conditions and low cost. Therefore, increasing use of frugal products, that are designed and also fabricated systematically, is crucial to all-round sustainable development. However, their low ...

    journal_title:Royal Society open science

    pub_type: 杂志文章

    doi:10.1098/rsos.192057

    authors: Rao BC

    更新日期:2020-07-08 00:00:00

  • Social flocculation in plant-animal worms.

    abstract::Individual animals can often move more safely or more efficiently as members of a group. This can be as simple as safety in numbers or as sophisticated as aerodynamic or hydrodynamic cooperation. Here, we show that individual plant-animal worms (Symsagittifera roscoffensis) can move to safety more quickly through floc...

    journal_title:Royal Society open science

    pub_type: 杂志文章

    doi:10.1098/rsos.181626

    authors: Worley A,Sendova-Franks AB,Franks NR

    更新日期:2019-03-20 00:00:00

  • Energy scaling and reduction in controlling complex networks.

    abstract::Recent works revealed that the energy required to control a complex network depends on the number of driving signals and the energy distribution follows an algebraic scaling law. If one implements control using a small number of drivers, e.g. as determined by the structural controllability theory, there is a high prob...

    journal_title:Royal Society open science

    pub_type: 杂志文章

    doi:10.1098/rsos.160064

    authors: Chen YZ,Wang LZ,Wang WX,Lai YC

    更新日期:2016-04-20 00:00:00

  • Modification of wheat gluten for improvement of binding capacity with keratin in hair.

    abstract::In this study, enzymatic hydrolysis and cationization with epoxypropyldodecyldimethylammonium chloride of wheat protein, an economic protein complex containing great amount of disulfide bonds, were conducted to improve properties such as solubility and disassociation behaviour for recovery of damaged hair when used in...

    journal_title:Royal Society open science

    pub_type: 杂志文章

    doi:10.1098/rsos.171216

    authors: Wang S,Meng D,Wang S,Zhang Z,Yang R,Zhao W

    更新日期:2018-02-07 00:00:00

  • Aggressive behaviours, food deprivation and the foraging gene.

    abstract::A pleiotropic gene governs multiple traits, which might constrain the evolution of complexity due to conflicting selection on these traits. However, if the pleiotropic effect is modular, then this can facilitate synergistic responses to selection on functionally related traits, thereby leveraging the evolution of comp...

    journal_title:Royal Society open science

    pub_type: 杂志文章

    doi:10.1098/rsos.170042

    authors: Wang S,Sokolowski MB

    更新日期:2017-04-26 00:00:00

  • The wing pattern of Moerarchis Durrant, 1914 (Lepidoptera: Tineidae) clarifies transitions between predictive models.

    abstract::The evolution of wing pattern in Lepidoptera is a popular area of inquiry but few studies have examined microlepidoptera, with fewer still focusing on intraspecific variation. The tineid genus Moerarchis Durrant, 1914 includes two species with high intraspecific variation of wing pattern. A subset of the specimens exa...

    journal_title:Royal Society open science

    pub_type: 杂志文章

    doi:10.1098/rsos.161002

    authors: Schachat SR

    更新日期:2017-03-01 00:00:00

  • A brittle star-like robot capable of immediately adapting to unexpected physical damage.

    abstract::A major challenge in robotic design is enabling robots to immediately adapt to unexpected physical damage. However, conventional robots require considerable time (more than several tens of seconds) for adaptation because the process entails high computational costs. To overcome this problem, we focus on a brittle star...

    journal_title:Royal Society open science

    pub_type: 杂志文章

    doi:10.1098/rsos.171200

    authors: Kano T,Sato E,Ono T,Aonuma H,Matsuzaka Y,Ishiguro A

    更新日期:2017-12-13 00:00:00

  • Performance improvement of miniaturized ZnO nanowire accelerometer fabricated by refresh hydrothermal synthesis.

    abstract::Miniaturized accelerometers are necessary for evaluating the performance of small devices, such as haptics, robotics and simulators. In this study, we fabricated miniaturized accelerometers using well-aligned ZnO nanowires. The layer of ZnO nanowires is used for active piezoelectric layer of the accelerometer, and cop...

    journal_title:Royal Society open science

    pub_type: 杂志文章

    doi:10.1098/rsos.170557

    authors: Song S,Kim HC,Kim JW,Kim D,Kim J

    更新日期:2017-09-13 00:00:00

  • Modelling social care provision in an agent-based framework with kinship networks.

    abstract::Current demographic trends in the UK include a fast-growing elderly population and dropping birth rates, and demand for social care among the aged is rising. The UK depends on informal social care-family members or friends providing care-for some 50% of care provision. However, lower birth rates and a greying populati...

    journal_title:Royal Society open science

    pub_type: 杂志文章

    doi:10.1098/rsos.190029

    authors: Gostoli U,Silverman E

    更新日期:2019-07-17 00:00:00

  • Influence of head morphology and natural postures on sound localization cues in crocodilians.

    abstract::As top predators, crocodilians have an acute sense of hearing that is useful for their social life and for probing their environment in hunting situations. Although previous studies suggest that crocodilians are able to localize the position of a sound source, how they do this remains largely unknown. In this study, w...

    journal_title:Royal Society open science

    pub_type: 杂志文章

    doi:10.1098/rsos.190423

    authors: Papet L,Grimault N,Boyer N,Mathevon N

    更新日期:2019-07-10 00:00:00

  • Using Fisher information to track stability in multivariate systems.

    abstract::With the current proliferation of data, the proficient use of statistical and mining techniques offer substantial benefits to capture useful information from any dataset. As numerous approaches make use of information theory concepts, here, we discuss how Fisher information (FI) can be applied to sustainability scienc...

    journal_title:Royal Society open science

    pub_type: 杂志文章

    doi:10.1098/rsos.160582

    authors: Ahmad N,Derrible S,Eason T,Cabezas H

    更新日期:2016-11-09 00:00:00

  • Graphic kinematics, visual virtual work and elastographics.

    abstract::In this paper, recent progress in graphic statics is combined with Williot displacement diagrams to create a graphical description of both statics and kinematics for two- and three-dimensional pin-jointed trusses. We begin with reciprocal form and force diagrams. The force diagram is dissected into its component cells...

    journal_title:Royal Society open science

    pub_type: 杂志文章

    doi:10.1098/rsos.170202

    authors: McRobie A,Konstantatou M,Athanasopoulos G,Hannigan L

    更新日期:2017-05-24 00:00:00

  • Collembola interact with mycorrhizal fungi in modifying oak morphology, C and N incorporation and transcriptomics.

    abstract::Soil detritivores such as Collembola impact plant growth, tissue nutrient concentration and gene expression. Using a model system with pedunculate oak (Quercus robur) microcuttings that display a typical endogenous rhythmic growth with alternating shoot (SF) and root flushes (RF), we investigated the transcriptomic re...

    journal_title:Royal Society open science

    pub_type: 杂志文章

    doi:10.1098/rsos.181869

    authors: Graf M,Bönn M,Feldhahn L,Kurth F,Grams TEE,Herrmann S,Tarkka M,Buscot F,Scheu S

    更新日期:2019-03-06 00:00:00

  • Native and invasive squirrels show different behavioural responses to scent of a shared native predator.

    abstract::Invasive species pose a serious threat to native species. In Europe, invasive grey squirrels (Sciurus carolinensis) have replaced native red squirrels (Sciurus vulgaris) in locations across Britain, Ireland and Italy. The European pine marten (Martes martes) can reverse the replacement of red squirrels by grey squirre...

    journal_title:Royal Society open science

    pub_type: 杂志文章

    doi:10.1098/rsos.191841

    authors: Twining JP,Ian Montgomery W,Price L,Kunc HP,Tosh DG

    更新日期:2020-02-26 00:00:00

  • Diffuse retro-reflective imaging for improved video tracking of mosquitoes at human baited bednets.

    abstract::Robust imaging techniques for tracking insects have been essential tools in numerous laboratory and field studies on pests, beneficial insects and model systems. Recent innovations in optical imaging systems and associated signal processing have enabled detailed characterization of nocturnal mosquito behaviour around ...

    journal_title:Royal Society open science

    pub_type: 杂志文章

    doi:10.1098/rsos.191951

    authors: Voloshin V,Kröner C,Seniya C,Murray GPD,Guy A,Towers CE,McCall PJ,Towers DP

    更新日期:2020-05-13 00:00:00

  • Correction to: 'Anastasis: recovery from the brink of cell death'.

    abstract::[This corrects the article DOI: 10.1098/rsos.180442.]. ...

    journal_title:Royal Society open science

    pub_type: 杂志文章,已发布勘误

    doi:10.1098/rsos.181629

    authors: Tang HM,Tang HL

    更新日期:2018-10-10 00:00:00