Double attention recurrent convolution neural network for answer selection.

Abstract:

:Answer selection is one of the key steps in many question answering (QA) applications. In this paper, a new deep model with two kinds of attention is proposed for answer selection: the double attention recurrent convolution neural network (DARCNN). Double attention means self-attention and cross-attention. The design inspiration of this model came from the transformer in the domain of machine translation. Self-attention can directly calculate dependencies between words regardless of the distance. However, self-attention ignores the distinction between its surrounding words and other words. Thus, we design a decay self-attention that prioritizes local words in a sentence. In addition, cross-attention is established to achieve interaction between question and candidate answer. With the outputs of self-attention and decay self-attention, we can get two kinds of interactive information via cross-attention. Finally, using the feature vectors of the question and answer, elementwise multiplication is used to combine with them and multilayer perceptron is used to predict the matching score. Experimental results on four QA datasets containing Chinese and English show that DARCNN performs better than other answer selection models, thereby demonstrating the effectiveness of self-attention, decay self-attention and cross-attention in answer selection tasks.

journal_name

R Soc Open Sci

authors

Bao G,Wei Y,Sun X,Zhang H

doi

10.1098/rsos.191517

subject

Has Abstract

pub_date

2020-05-20 00:00:00

pages

191517

issue

5

issn

2054-5703

pii

rsos191517

journal_volume

7

pub_type

杂志文章
  • Differential loss of components of traditional ecological knowledge following a primate extinction event.

    abstract::Traditional ecological knowledge (TEK), an important component of the modern conservation toolkit, is being eroded in indigenous communities around the world. However, the dynamics of TEK loss in response to ecosystem change and disruption to social-ecological systems, and patterns of variation in vulnerability and re...

    journal_title:Royal Society open science

    pub_type: 杂志文章

    doi:10.1098/rsos.172352

    authors: Turvey ST,Bryant JV,McClune KA

    更新日期:2018-06-13 00:00:00

  • Photothermal raster image correlation spectroscopy of gold nanoparticles in solution and on live cells.

    abstract::Raster image correlation spectroscopy (RICS) measures the diffusion of fluorescently labelled molecules from stacks of confocal microscopy images by analysing correlations within the image. RICS enables the observation of a greater and, thus, more representative area of a biological system as compared to other single ...

    journal_title:Royal Society open science

    pub_type: 杂志文章

    doi:10.1098/rsos.140454

    authors: Nieves DJ,Li Y,Fernig DG,Lévy R

    更新日期:2015-06-17 00:00:00

  • Frozen verses: Antarctic minke whales (Balaenoptera bonaerensis) call predominantly during austral winter.

    abstract::The recent identification of the bio-duck call as Antarctic minke whale (AMW) vocalization allows the use of passive acoustic monitoring to retrospectively investigate year-round spatial-temporal patterns in minke whale occurrence in ice-covered areas. Here, we present an analysis of AMW occurrence patterns based on a...

    journal_title:Royal Society open science

    pub_type: 杂志文章

    doi:10.1098/rsos.192112

    authors: Filun D,Thomisch K,Boebel O,Brey T,Širović A,Spiesecke S,Van Opzeeland I

    更新日期:2020-10-07 00:00:00

  • Janus microdimer swimming in an oscillating magnetic field.

    abstract::Artificial microswimmers powered by magnetic fields have numerous applications, such as drug delivery, biosensing for minimally invasive medicine and environmental remediation. Recently, a Janus microdimer surface walker that can be propelled by an oscillating magnetic field near a surface was reported by Li et al. (A...

    journal_title:Royal Society open science

    pub_type: 杂志文章

    doi:10.1098/rsos.200378

    authors: Yang J

    更新日期:2020-12-09 00:00:00

  • The history of introduction of the African baobab (Adansonia digitata, Malvaceae: Bombacoideae) in the Indian subcontinent.

    abstract::To investigate the pathways of introduction of the African baobab, Adansonia digitata, to the Indian subcontinent, we examined 10 microsatellite loci in individuals from Africa, India, the Mascarenes and Malaysia, and matched this with historical evidence of human interactions between source and destination regions. G...

    journal_title:Royal Society open science

    pub_type: 杂志文章

    doi:10.1098/rsos.150370

    authors: Bell KL,Rangan H,Kull CA,Murphy DJ

    更新日期:2015-09-09 00:00:00

  • A polycarboxylic/ether composite polymer electrolyte via in situ UV-curing for all-solid-state lithium battery.

    abstract::A polycarboxylic/ether composite polymer electrolyte derived from two-arm monomer and polyethylene oxide (PEO) was in situ synthesized on the cathode. The composite electrolyte exhibits a high ionic conductivity of 3.6 × 10-5 S cm-1, high oxidation stability, excellent stability towards Li metal and makes Li/LiFePO4 p...

    journal_title:Royal Society open science

    pub_type: 杂志文章

    doi:10.1098/rsos.200598

    authors: Wang W,Qiu Z,Wang Q,Zhou X,Liu Y,Zhou J,Guo B

    更新日期:2020-07-15 00:00:00

  • Dichlorobenzene: an effective solvent for epoxy/graphene nanocomposites preparation.

    abstract::It is generally recognized that dimethylformamide (DMF) and ethanol are good media to uniformly disperse graphene, and therefore have been used widely in the preparation of epoxy/graphene nanocomposites. However, as a solvent to disperse graphene, dichlorobenzene (DCB) has not been fully realized by the polymer commun...

    journal_title:Royal Society open science

    pub_type: 杂志文章

    doi:10.1098/rsos.170778

    authors: Wei J,Saharudin MS,Vo T,Inam F

    更新日期:2017-10-11 00:00:00

  • Effect of alumina shapes on dielectric properties of UV-cured epoxy acrylic composite with alumina.

    abstract::Polymer-based composites with the advantages of ceramics and polymers exhibit high dielectric constant, good processing properties and low dielectric loss. The composites with a varied content of irregular alumina (i-Al2O3) filler were prepared by UV-cured epoxy acrylic (EA). Spherical alumina (s-Al2O3) was used as a ...

    journal_title:Royal Society open science

    pub_type: 杂志文章

    doi:10.1098/rsos.181509

    authors: Bian J,Zhao Q,Hou Z,Dong J,Yang Q,Zhang G

    更新日期:2019-01-16 00:00:00

  • Synthesis and structure/properties characterizations of four polyurethane model hard segments.

    abstract::Four model polyurethane (PU) hard segments were synthesized by reaction of butanol with four typical diisocyanates. The four diisocyanates were aromatic 4,4'-diphenylmethane diisocyanate (4,4'-MDI) and MDI-50 (50% mixture of 2,4'-MDI and 4,4'-MDI), cycloaliphatic 4,4'-dicyclohexylmethane diisocyanate (HMDI) and linear...

    journal_title:Royal Society open science

    pub_type: 杂志文章

    doi:10.1098/rsos.180536

    authors: Jiang L,Ren Z,Zhao W,Liu W,Liu H,Zhu C

    更新日期:2018-07-25 00:00:00

  • Persistent homology in graph power filtrations.

    abstract::The persistence of homological features in simplicial complex representations of big datasets in R n resulting from Vietoris-Rips or Čech filtrations is commonly used to probe the topological structure of such datasets. In this paper, the notion of homological pers...

    journal_title:Royal Society open science

    pub_type: 杂志文章

    doi:10.1098/rsos.160228

    authors: Parks AD,Marchette DJ

    更新日期:2016-10-26 00:00:00

  • Forward modelling the rubber hand: illusion of ownership modifies motor-sensory predictions by the brain.

    abstract::The question of how we attribute observed body parts as our own, and the consequences of this attribution on our sensory-motor processes, is fundamental to understand how our brain distinguishes between self and other. Previous studies have identified interactions between the illusion of ownership, and multi-sensory i...

    journal_title:Royal Society open science

    pub_type: 杂志文章

    doi:10.1098/rsos.160407

    authors: Aymerich-Franch L,Petit D,Kheddar A,Ganesh G

    更新日期:2016-08-24 00:00:00

  • A pheromone outweighs temperature in influencing migration of sea lamprey.

    abstract::Organisms continuously acquire and process information from surrounding cues. While some cues complement one another in delivering more reliable information, others may provide conflicting information. How organisms extract and use reliable information from a multitude of cues is largely unknown. We examined movement ...

    journal_title:Royal Society open science

    pub_type: 杂志文章

    doi:10.1098/rsos.150009

    authors: Brant CO,Li K,Johnson NS,Li W

    更新日期:2015-05-06 00:00:00

  • Kinetic study of catalytic CO2 hydration by metal-substituted biomimetic carbonic anhydrase model complexes.

    abstract::The rapid rise of the CO2 level in the atmosphere has spurred the development of CO2 capture methods such as the use of biomimetic complexes that mimic carbonic anhydrase. In this study, model complexes with tris(2-pyridylmethyl)amine (TPA) were synthesized using various transition metals (Zn2+, Cu2+ and Ni2+) to cont...

    journal_title:Royal Society open science

    pub_type: 杂志文章

    doi:10.1098/rsos.190407

    authors: Park D,Lee MS

    更新日期:2019-08-07 00:00:00

  • Variation in thermal stress response in two populations of the brown seaweed, Fucus distichus, from the Arctic and subarctic intertidal.

    abstract::It is unclear whether intertidal organisms are 'preadapted' to cope with the increase of temperature and temperature variability or if they are currently at their thermal tolerance limits. To address the dichotomy, we focused on an important ecosystem engineer of the Arctic intertidal rocky shores, the seaweed Fucus d...

    journal_title:Royal Society open science

    pub_type: 杂志文章

    doi:10.1098/rsos.150429

    authors: Smolina I,Kollias S,Jueterbock A,Coyer JA,Hoarau G

    更新日期:2016-01-13 00:00:00

  • Emergence of cascading dynamics in interacting tipping elements of ecology and climate.

    abstract::In ecology, climate and other fields, (sub)systems have been identified that can transition into a qualitatively different state when a critical threshold or tipping point in a driving process is crossed. An understanding of those tipping elements is of great interest given the increasing influence of humans on the bi...

    journal_title:Royal Society open science

    pub_type: 杂志文章

    doi:10.1098/rsos.200599

    authors: Klose AK,Karle V,Winkelmann R,Donges JF

    更新日期:2020-06-24 00:00:00

  • Deletion/loss of bone morphogenetic protein 7 changes tooth morphology and function in Mus musculus: implications for dental evolution in mammals.

    abstract::Quantifying regulatory gene effects on dental morphology and function has implications for the underlying mechanisms that generated dental diversity in mammals. We tested the hypothesis that regulatory gene expression changes lead to differences in molars using a neural crest knockout of bone morphogenetic protein 7 (...

    journal_title:Royal Society open science

    pub_type: 杂志文章

    doi:10.1098/rsos.170761

    authors: Zurowski C,Jamniczky H,Graf D,Theodor J

    更新日期:2018-01-03 00:00:00

  • Effect on electrospun fibres by synthesis of high branching polylactic acid.

    abstract::Polylactic electrospun porous fibres have been widely used in tissue engineering scaffolds. However, the application of linear polylactic is limited due to its poor hydrophilicity, which leads to phase separation and has been seldom used in porous fibre preparation. Instead, branching polylactic acts as a new effectiv...

    journal_title:Royal Society open science

    pub_type: 杂志文章

    doi:10.1098/rsos.180134

    authors: Shen W,Zhang G,Ge X,Li Y,Fan G

    更新日期:2018-09-12 00:00:00

  • Native and invasive squirrels show different behavioural responses to scent of a shared native predator.

    abstract::Invasive species pose a serious threat to native species. In Europe, invasive grey squirrels (Sciurus carolinensis) have replaced native red squirrels (Sciurus vulgaris) in locations across Britain, Ireland and Italy. The European pine marten (Martes martes) can reverse the replacement of red squirrels by grey squirre...

    journal_title:Royal Society open science

    pub_type: 杂志文章

    doi:10.1098/rsos.191841

    authors: Twining JP,Ian Montgomery W,Price L,Kunc HP,Tosh DG

    更新日期:2020-02-26 00:00:00

  • Assessing the use of mobile phone data to describe recurrent mobility patterns in spatial epidemic models.

    abstract::The recent availability of large-scale call detail record data has substantially improved our ability of quantifying human travel patterns with broad applications in epidemiology. Notwithstanding a number of successful case studies, previous works have shown that using different mobility data sources, such as mobile p...

    journal_title:Royal Society open science

    pub_type: 杂志文章

    doi:10.1098/rsos.160950

    authors: Panigutti C,Tizzoni M,Bajardi P,Smoreda Z,Colizza V

    更新日期:2017-05-17 00:00:00

  • A rapid microwave synthesis of green-emissive carbon dots with solid-state fluorescence and pH-sensitive properties.

    abstract::The emerging carbon quantum dots (CQDs) have been attracting significant attention for their prominent fluorescence, excellent stability and outstanding biocompatibility. Here, we report a facile one-step synthesis of highly fluorescent CQDs by using phthalic acid and triethylenediamine hexahydrate as precursors throu...

    journal_title:Royal Society open science

    pub_type: 杂志文章

    doi:10.1098/rsos.180245

    authors: Yu T,Wang H,Guo C,Zhai Y,Yang J,Yuan J

    更新日期:2018-07-11 00:00:00

  • Biophysical basis for convergent evolution of two veil-forming microbes.

    abstract::Microbes living in stagnant water typically rely on chemical diffusion to draw nutrients from their environment. The sulfur-oxidizing bacterium Thiovulum majus and the ciliate Uronemella have independently evolved the ability to form a 'veil', a centimetre-scale mucous sheet on which cells organize to produce a macros...

    journal_title:Royal Society open science

    pub_type: 杂志文章

    doi:10.1098/rsos.150437

    authors: Petroff AP,Pasulka AL,Soplop N,Wu XL,Libchaber A

    更新日期:2015-11-11 00:00:00

  • Energy scaling and reduction in controlling complex networks.

    abstract::Recent works revealed that the energy required to control a complex network depends on the number of driving signals and the energy distribution follows an algebraic scaling law. If one implements control using a small number of drivers, e.g. as determined by the structural controllability theory, there is a high prob...

    journal_title:Royal Society open science

    pub_type: 杂志文章

    doi:10.1098/rsos.160064

    authors: Chen YZ,Wang LZ,Wang WX,Lai YC

    更新日期:2016-04-20 00:00:00

  • Determining addition pathways and stable isomers for CF3 functionalization of endohedral Gd@C60.

    abstract::Using density functional theory approaches, we follow the sequential addition of CF3 functional groups to the surface of the metallic endofullerene species Gd@C60. The presence of gadolinium in the interior of the cage strongly influences the addition sequence. The calculations are able to successfully identify end po...

    journal_title:Royal Society open science

    pub_type: 杂志文章

    doi:10.1098/rsos.180588

    authors: Ewels C,Rio J,Niwa H,Omachi H,Shinohara H,Rayson M,Briddon P

    更新日期:2018-09-05 00:00:00

  • Microwave-assisted synthesis, computational studies and antibacterial/ anti-inflammatory activities of compounds based on coumarin-pyrazole hybrid.

    abstract::An efficient, high-yield and rapid synthesis of (E)-1,5-dimethyl-4-((2-((substituted-2-oxo-2H-chromen-4-yl)methoxy)naphthalen-1-yl)methyleneamino)-2-phenyl-1,2-dihydropyrazol-3-one derivatives (3a-3i) containing Schiff base structures under microwave-irradiation has been described. Schiff base is a potential target to...

    journal_title:Royal Society open science

    pub_type: 杂志文章

    doi:10.1098/rsos.172435

    authors: Chavan RR,Hosamani KM

    更新日期:2018-05-02 00:00:00

  • MultispeQ Beta: a tool for large-scale plant phenotyping connected to the open PhotosynQ network.

    abstract::Large-scale high-throughput plant phenotyping (sometimes called phenomics) is becoming increasingly important in plant biology and agriculture and is essential to cutting-edge plant breeding and management approaches needed to meet the food and fuel needs for the next century. Currently, the application of these appro...

    journal_title:Royal Society open science

    pub_type: 杂志文章

    doi:10.1098/rsos.160592

    authors: Kuhlgert S,Austic G,Zegarac R,Osei-Bonsu I,Hoh D,Chilvers MI,Roth MG,Bi K,TerAvest D,Weebadde P,Kramer DM

    更新日期:2016-10-26 00:00:00

  • An electronic device based on gold nanoparticles and tetraruthenated porphyrin as an electrochemical sensor for catechol.

    abstract::The aim of this study was to obtain an electrochemical device between the electrostatic interaction of the electropolymerized porphyrin {CoTPyP[RuCl3(dppb)]4}, where TPyP = 5,10,15, 20-tetrapyridilphorphyrin and dppb = 1,4-bis(diphenylphosphino)butane, and gold nanoparticles (AuNPsn-), to be used as a voltammetric sen...

    journal_title:Royal Society open science

    pub_type: 杂志文章

    doi:10.1098/rsos.170675

    authors: Sousa LM,Vilarinho LM,Ribeiro GH,Bogado AL,Dinelli LR

    更新日期:2017-12-20 00:00:00

  • An investigation into the unusual linkage isomerization and nitrite reduction activity of a novel tris(2-pyridyl) copper complex.

    abstract::The copper-containing nitrite reductases (CuNIRs) are a class of enzymes that mediate the reduction of nitrite to nitric oxide in biological systems. Metal-ligand complexes that reproduce the salient features of the active site of CuNIRs are therefore of fundamental interest, both for elucidating the possible mode of ...

    journal_title:Royal Society open science

    pub_type: 杂志文章

    doi:10.1098/rsos.170593

    authors: Roger I,Wilson C,Senn HM,Sproules S,Symes MD

    更新日期:2017-08-16 00:00:00

  • Characterizing the shape patterns of dimorphic yeast pseudohyphae.

    abstract::Pseudohyphal growth of the dimorphic yeast Saccharomyces cerevisiae is analysed using two-dimensional top-down binary images. The colony morphology is characterized using clustered shape primitives (CSPs), which are learned automatically from the data and thus do not require a list of predefined features or a priori k...

    journal_title:Royal Society open science

    pub_type: 杂志文章

    doi:10.1098/rsos.180820

    authors: Gontar A,Bottema MJ,Binder BJ,Tronnolone H

    更新日期:2018-10-17 00:00:00

  • Environmental offsets, resilience and cost-effective conservation.

    abstract::Conservation management agencies are faced with acute trade-offs when dealing with disturbance from human activities. We show how agencies can respond to permanent ecosystem disruption by managing for Pimm resilience within a conservation budget using a model calibrated to a metapopulation of a coral reef fish species...

    journal_title:Royal Society open science

    pub_type: 杂志文章

    doi:10.1098/rsos.140521

    authors: Little LR,Grafton RQ

    更新日期:2015-07-08 00:00:00

  • Digested sludge-derived three-dimensional hierarchical porous carbon for high-performance supercapacitor electrode.

    abstract::Digested sludge, as the main by-product of the sewage sludge anaerobic digestion process, still contains considerable organic compounds. In this protocol, we report a facile method for preparing digested sludge-derived self-doped porous carbon material for high-performance supercapacitor electrodes via a sustainable p...

    journal_title:Royal Society open science

    pub_type: 杂志文章

    doi:10.1098/rsos.172456

    authors: Zhang JJ,Fan HX,Dai XH,Yuan SJ

    更新日期:2018-04-11 00:00:00