BEHRT: Transformer for Electronic Health Records.

Abstract:

:Today, despite decades of developments in medicine and the growing interest in precision healthcare, vast majority of diagnoses happen once patients begin to show noticeable signs of illness. Early indication and detection of diseases, however, can provide patients and carers with the chance of early intervention, better disease management, and efficient allocation of healthcare resources. The latest developments in machine learning (including deep learning) provides a great opportunity to address this unmet need. In this study, we introduce BEHRT: A deep neural sequence transduction model for electronic health records (EHR), capable of simultaneously predicting the likelihood of 301 conditions in one's future visits. When trained and evaluated on the data from nearly 1.6 million individuals, BEHRT shows a striking improvement of 8.0-13.2% (in terms of average precision scores for different tasks), over the existing state-of-the-art deep EHR models. In addition to its scalability and superior accuracy, BEHRT enables personalised interpretation of its predictions; its flexible architecture enables it to incorporate multiple heterogeneous concepts (e.g., diagnosis, medication, measurements, and more) to further improve the accuracy of its predictions; its (pre-)training results in disease and patient representations can be useful for future studies (i.e., transfer learning).

journal_name

Sci Rep

journal_title

Scientific reports

authors

Li Y,Rao S,Solares JRA,Hassaine A,Ramakrishnan R,Canoy D,Zhu Y,Rahimi K,Salimi-Khorshidi G

doi

10.1038/s41598-020-62922-y

subject

Has Abstract

pub_date

2020-04-28 00:00:00

pages

7155

issue

1

issn

2045-2322

pii

10.1038/s41598-020-62922-y

journal_volume

10

pub_type

杂志文章
  • Inhibition of PDE2 reverses beta amyloid induced memory impairment through regulation of PKA/PKG-dependent neuro-inflammatory and apoptotic pathways.

    abstract::Beta amyloid peptides (Aβ) are known risk factors involved in cognitive impairment, neuroinflammatory and apoptotic processes in Alzheimer's disease (AD). Phosphodiesterase 2 (PDE2) inhibitors increase the intracellular cAMP and/or cGMP activities, which may ameliorate cognitive deficits associated with AD. However, i...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/s41598-017-08070-2

    authors: Wang L,Xiaokaiti Y,Wang G,Xu X,Chen L,Huang X,Liu L,Pan J,Hu S,Chen Z,Xu Y

    更新日期:2017-09-21 00:00:00

  • Translational control of enzyme scavenger expression with toxin-induced micro RNA switches.

    abstract::Biological computation requires in vivo control of molecular behavior to progress development of autonomous devices. miRNA switches represent excellent, easily engineerable synthetic biology tools to achieve user-defined gene regulation. Here we present the construction of a synthetic network to implement detoxificati...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/s41598-021-81679-6

    authors: Pollak NM,Cooper-White JJ,Macdonald J

    更新日期:2021-01-28 00:00:00

  • Gastric cancer depends on aldehyde dehydrogenase 3A1 for fatty acid oxidation.

    abstract::The major source of ATP in cancer cells remains unclear. Here, we examined energy metabolism in gastric cancer cells and found increased fatty acid oxidation and increased expression of ALDH3A1. Metabolic analysis showed that lipid peroxidation by reactive oxygen species led to spontaneous production of 4-hydroxynonen...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/s41598-019-52814-1

    authors: Lee JS,Kim SH,Lee S,Kang JH,Lee SH,Cheong JH,Kim SY

    更新日期:2019-11-08 00:00:00

  • Impact of microscopic In fluctuations on the optical properties of InxGa1-xN blue light-emitting diodes assessed by low-energy X-ray fluorescence mapping using synchrotron radiation.

    abstract::Among the III-nitride semiconductors, InxGa1-xN is a key material for visible optical devices such as light-emitting diodes (LEDs), laser diodes, and solar cells. Light emission is achieved via electron-hole recombination within the InxGa1-xN layer. When InxGa1-xN-based blue LEDs were first commercialized, the high pr...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/s41598-019-39086-5

    authors: Sakaki A,Funato M,Miyano M,Okazaki T,Kawakami Y

    更新日期:2019-03-06 00:00:00

  • Dynamic impact of temporal context of Ca²⁺ signals on inhibitory synaptic plasticity.

    abstract::Neuronal activity-dependent synaptic plasticity, a basis for learning and memory, is tightly correlated with the pattern of increase in intracellular Ca(2+) concentration ([Ca(2+)](i)). Here, using combined application of electrophysiological experiments and systems biological simulation, we show that such a correlati...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/srep00143

    authors: Kawaguchi SY,Nagasaki N,Hirano T

    更新日期:2011-01-01 00:00:00

  • GABA (γ-aminobutyric acid), as a thermo-protectant, to improve the reproductive function of heat-stressed mungbean plants.

    abstract::Rising global temperatures are proving to be detrimental for the agriculture. Hence, strategies are needed to induce thermotolerance in food crops to sustain the food production. GABA (γ-aminobutyric acid), a non-protein amino acid, can partially protect plants from high-temperature stress. This study hypothesises tha...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/s41598-019-44163-w

    authors: Priya M,Sharma L,Kaur R,Bindumadhava H,Nair RM,Siddique KHM,Nayyar H

    更新日期:2019-05-24 00:00:00

  • Grain boundary oxidation of proton-irradiated nuclear grade stainless steel in simulated primary water of pressurized water reactor.

    abstract::Grain boundary (GB) oxidation of proton-irradiated 304 nuclear grade stainless steel in primary water of pressurized water reactor was investigated. The investigation was conducted by studying microstructure of the oxide and oxide precursor formed at GB on an "atom-by-atom" basis by a combination of atom-probe tomogra...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/s41598-020-80600-x

    authors: Deng P,Peng Q,Han EH

    更新日期:2021-01-14 00:00:00

  • A rightward saccade to an unexpected stimulus as a marker for lateralised visuospatial attention.

    abstract::The human brain is lateralised to the right for visuospatial attention, particularly when reorienting attention to unexpected stimuli. However, the developmental characteristics of lateralisation remain unclear. To address this question, we devised a saccade task applicable for both adults and children. To assess the ...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/s41598-018-25890-y

    authors: Sanefuji M,Yamashita H,Torio M,Katsuki D,Akamine S,Ishizaki Y,Kishimoto J,Sakai Y,Takada H,Yoshida K,Ohga S

    更新日期:2018-05-15 00:00:00

  • Effect of Quercetin on Hepatitis C Virus Life Cycle: From Viral to Host Targets.

    abstract::Quercetin is a natural flavonoid, which has been shown to have anti hepatitis C virus (HCV) properties. However, the exact mechanisms whereby quercetin impacts the HCV life cycle are not fully understood. We assessed the effect of quercetin on different steps of the HCV life cycle in Huh-7.5 cells and primary human he...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/srep31777

    authors: Rojas Á,Del Campo JA,Clement S,Lemasson M,García-Valdecasas M,Gil-Gómez A,Ranchal I,Bartosch B,Bautista JD,Rosenberg AR,Negro F,Romero-Gómez M

    更新日期:2016-08-22 00:00:00

  • Polarization tunable all-dielectric color filters based on cross-shaped Si nanoantennas.

    abstract::Polarization sensitive and insensitive color filters have important applications in the area of nano-spectroscopy and CCD imaging applications. Metallic nanostructures provide an efficient way to design and engineer ultrathin color filters. These nanostructures have capability to split the white light into fundamental...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/s41598-017-07986-z

    authors: Vashistha V,Vaidya G,Gruszecki P,Serebryannikov AE,Krawczyk M

    更新日期:2017-08-14 00:00:00

  • Age and sex subgroups vulnerable to copycat suicide: evaluation of nationwide data in South Korea.

    abstract::Media reports of a celebrity's suicide may be followed by copycat suicides, and the impact may vary in different age and sex subgroups. We proposed a quantitative framework to assess the vulnerability of age and sex subgroups to copycat suicide and used this method to investigate copycat suicides in relation to the su...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/s41598-019-53833-8

    authors: Yi H,Hwang J,Bae HJ,Kim N

    更新日期:2019-11-21 00:00:00

  • Indirect genetic effects: a key component of the genetic architecture of behaviour.

    abstract::Behavioural ecology research increasingly focuses on why genetic behavioural variation can persist despite selection. Evolutionary theory predicts that directional selection leads to evolutionary change while depleting standing genetic variation. Nevertheless, evolutionary stasis may occur for traits involved in socia...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/s41598-017-08258-6

    authors: Santostefano F,Wilson AJ,Niemelä PT,Dingemanse NJ

    更新日期:2017-08-31 00:00:00

  • Quantum ratchet in two-dimensional semiconductors with Rashba spin-orbit interaction.

    abstract::Ratchet is a device that produces direct current of particles when driven by an unbiased force. We demonstrate a simple scattering quantum ratchet based on an asymmetrical quantum tunneling effect in two-dimensional electron gas with Rashba spin-orbit interaction (R2DEG). We consider the tunneling of electrons across ...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/srep07872

    authors: Ang YS,Ma Z,Zhang C

    更新日期:2015-01-19 00:00:00

  • Corrigendum: The neuroprotective action of dexmedetomidine on apoptosis, calcium entry and oxidative stress in cerebral ischemia-induced rats: Contribution of TRPM2 and TRPV1 channels.

    abstract::This corrects the article DOI: 10.1038/srep37196. ...

    journal_title:Scientific reports

    pub_type: 已发布勘误

    doi:10.1038/srep47002

    authors: Akpınar H,Nazıroğlu M,Övey IS,Çiğ B,Akpınar O

    更新日期:2018-07-04 00:00:00

  • Orbit-induced spin squeezing in a spin-orbit coupled Bose-Einstein condensate.

    abstract::In recent pioneer experiment, a strong spin-orbit coupling, with equal Rashba and Dresselhaus strengths, has been created in a trapped Bose-Einstein condensate. Moreover, many exotic superfluid phenomena induced by this strong spin-orbit coupling have been predicted. In this report, we show that this novel spin-orbit ...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/srep03166

    authors: Lian J,Yu L,Liang JQ,Chen G,Jia S

    更新日期:2013-11-07 00:00:00

  • Risk factors of immune checkpoint inhibitor-related interstitial lung disease in patients with lung cancer: a single-institution retrospective study.

    abstract::Immune checkpoint inhibitors (ICIs) elicit antitumour effects by activating the host immunity and cause immune-related adverse events (irAEs). ICI-related interstitial lung disease (ICI-ILD) is a fatal irAE that is difficult to treat; moreover, its incidence is relatively higher in patients with lung cancer. Therefore...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/s41598-020-70743-2

    authors: Okada N,Matsuoka R,Sakurada T,Goda M,Chuma M,Yagi K,Zamami Y,Nishioka Y,Ishizawa K

    更新日期:2020-08-13 00:00:00

  • mTORC1 activity is essential for erythropoiesis and B cell lineage commitment.

    abstract::Mechanistic target of rapamycin (mTOR) is a serine/threonine protein kinase that mediates phosphoinositide-3-kinase (PI3K)/AKT signalling. This pathway is involved in a plethora of cellular functions including protein and lipid synthesis, cell migration, cell proliferation and apoptosis. In this study, we proposed to ...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/s41598-019-53141-1

    authors: Malik N,Dunn KM,Cassels J,Hay J,Estell C,Sansom OJ,Michie AM

    更新日期:2019-11-15 00:00:00

  • Evidence of s-wave superconductivity in the noncentrosymmetric La7Ir3.

    abstract::Superconductivity in noncentrosymmetric compounds has attracted sustained interest in the last decades. Here we present a detailed study on the transport, thermodynamic properties and the band structure of the noncentrosymmetric superconductor La 7 Ir 3 (T c  ~ 2.3 K) that was recently proposed to break the time-rever...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/s41598-017-19042-x

    authors: Li B,Xu CQ,Zhou W,Jiao WH,Sankar R,Zhang FM,Hou HH,Jiang XF,Qian B,Chen B,Bangura AF,Xu X

    更新日期:2018-01-12 00:00:00

  • Paradoxical puborectalis syndrome on diffusion-weighted imaging: a retrospective study of 72 cases.

    abstract::This study aimed to evaluate the application value of diffusion-weighted imaging (DWI) for assessing paradoxical puborectalis syndrome (PPS) in patients with obstructive defecation syndrome (ODS). The medical records of 72 ODS patients who underwent magnetic resonance (MR)-DWI and MR-defecography were retrospectively ...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/s41598-017-03127-8

    authors: Liu G,Cui Z,Dai Y,Yao Q,Xu J,Wu G

    更新日期:2017-06-07 00:00:00

  • Phosphodiesterase 4B negatively regulates endotoxin-activated interleukin-1 receptor antagonist responses in macrophages.

    abstract::Activation of TLR4 by lipopolysaccharide (LPS) induces both pro-inflammatory and anti-inflammatory cytokine production in macrophages. Type 4 phosphodiesterases (PDE4) are key cAMP-hydrolyzing enzymes, and PDE4 inhibitors are considered as immunosuppressors to various inflammatory responses. We demonstrate here that P...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/srep46165

    authors: Yang JX,Hsieh KC,Chen YL,Lee CK,Conti M,Chuang TH,Wu CP,Jin SC

    更新日期:2017-04-06 00:00:00

  • Dopamine neuron induction and the neuroprotective effects of thyroid hormone derivatives.

    abstract::Parkinson's disease (PD) is a neurodegenerative disease characterized by progressive movement disturbances caused by the selective loss of dopamine (DA) neurons in the substantia nigra. Despite the identification of the causal mechanisms underlying the pathogenesis of PD, effective treatments remain elusive. In this s...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/s41598-019-49876-6

    authors: Lee EH,Kim SM,Kim CH,Pagire SH,Pagire HS,Chung HY,Ahn JH,Park CH

    更新日期:2019-09-20 00:00:00

  • Establishment of induced pluripotent stem cells from normal B cells and inducing AID expression in their differentiation into hematopoietic progenitor cells.

    abstract::B cell derived induced pluripotent stem cells (BiPSCs) were recently established from peripheral blood B cells by the simultaneous transfection of Yamanaka factors (Oct3/4, Sox2, Klf4, c-Myc) and C/EBPα using a Sendai virus vector. Here, using a different method, we established BiPSCs with immunoglobulin heavy chain (...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/s41598-017-01627-1

    authors: Kawamura F,Inaki M,Katafuchi A,Abe Y,Tsuyama N,Kurosu Y,Yanagi A,Higuchi M,Muto S,Yamaura T,Suzuki H,Noji H,Suzuki S,Yoshida MA,Sasatani M,Kamiya K,Onodera M,Sakai A

    更新日期:2017-05-10 00:00:00

  • Two-dimensional hyper-branched gold nanoparticles synthesized on a two-dimensional oil/water interface.

    abstract::Two-dimensional (2D) gold nanoparticles can possess novel physical and chemical properties, which will greatly expand the utility of gold nanoparticles in a wide variety of applications ranging from catalysis to biomedicine. However, colloidal synthesis of such particles generally requires sophisticated synthetic tech...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/srep06119

    authors: Shin Y,Lee C,Yang MS,Jeong S,Kim D,Kang T

    更新日期:2014-08-26 00:00:00

  • Development and physiological effects of an artificial diet for Wolbachia-infected Aedes aegypti.

    abstract::The endosymbiotic bacterium Wolbachia spreads rapidly through populations of Aedes aegypti mosquitoes, and strongly inhibits infection with key human pathogens including the dengue and Zika viruses. Mosquito control programs aimed at limiting transmission of these viruses are ongoing in multiple countries, yet there i...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/s41598-017-16045-6

    authors: Dutra HLC,Rodrigues SL,Mansur SB,de Oliveira SP,Caragata EP,Moreira LA

    更新日期:2017-11-16 00:00:00

  • Dating the period when intensive anthropogenic activity began to influence the Sanjiang Plain, Northeast China.

    abstract::Dating the start of intensive anthropogenic influence on ecosystems is important for identifying the conditions necessary for ecosystem recovery. However, few studies have focused on determining when anthropogenic influences on wetland began through sedimentary archives. To fill this critical gap in our knowledge, com...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/srep22153

    authors: Cong J,Gao C,Zhang Y,Zhang S,He J,Wang G

    更新日期:2016-02-24 00:00:00

  • Cystoid edema, neovascularization and inflammatory processes in the murine Norrin-deficient retina.

    abstract::Mutations in the Norrin (NDP) gene cause severe developmental blood vessel defects in the retina leading to congenital blindness. In the retina of Ndph-knockout mice only the superficial capillary network develops. Here, a detailed characterization of this mouse model at late stages of the disease using in vivo retina...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/s41598-018-24476-y

    authors: Beck SC,Karlstetter M,Garcia Garrido M,Feng Y,Dannhausen K,Mühlfriedel R,Sothilingam V,Seebauer B,Berger W,Hammes HP,Seeliger MW,Langmann T

    更新日期:2018-04-13 00:00:00

  • Designing novel bulk metallic glass composites with a high aluminum content.

    abstract::The long-standing challenge for forming Al-based BMGs and their matrix composites with a critical size larger than 1 mm have not been answered over the past three decades. In this paper, we reported formation of a series of BMG matrix composites which contain a high Al content up to 55 at.%. These composites can be ca...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/srep03353

    authors: Chen ZP,Gao JE,Wu Y,Wang H,Liu XJ,Lu ZP

    更新日期:2013-11-27 00:00:00

  • Repetitive Biomimetic Self-healing of Ca(2+)-Induced Nanocomposite Protein Hydrogels.

    abstract::Self-healing is a capacity observed in most biological systems in which the healing processes are autonomously triggered after the damage. Inspired by this natural behavior, researchers believed that a synthetic material possessing similar self-recovery capability could also be developed. Albeit various intrinsic self...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/srep30804

    authors: Chen J,Dong Q,Ma X,Fan TH,Lei Y

    更新日期:2016-08-22 00:00:00

  • Molecular characterization of colorectal adenomas with and without malignancy reveals distinguishing genome, transcriptome and methylome alterations.

    abstract::The majority of colorectal cancer (CRC) arises from precursor lesions known as polyps. The molecular determinants that distinguish benign from malignant polyps remain unclear. To molecularly characterize polyps, we utilized Cancer Adjacent Polyp (CAP) and Cancer Free Polyp (CFP) patients. CAPs had tissues from the res...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/s41598-018-21525-4

    authors: Druliner BR,Wang P,Bae T,Baheti S,Slettedahl S,Mahoney D,Vasmatzis N,Xu H,Kim M,Bockol M,O'Brien D,Grill D,Warner N,Munoz-Gomez M,Kossick K,Johnson R,Mouchli M,Felmlee-Devine D,Washechek-Aletto J,Smyrk T,Oberg A,

    更新日期:2018-02-16 00:00:00

  • High percentages and activity of synovial fluid NK cells present in patients with advanced stage active Rheumatoid Arthritis.

    abstract::Rheumatoid Arthritis (RA) causes chronic inflammation of joints. The cytokines TNFα and IFNγ are central players in RA, however their source has not been fully elucidated. Natural Killer (NK) cells are best known for their role in elimination of viral-infected and transformed cells, and they secrete pro-inflammatory c...

    journal_title:Scientific reports

    pub_type: 杂志文章

    doi:10.1038/s41598-018-37448-z

    authors: Yamin R,Berhani O,Peleg H,Aamar S,Stein N,Gamliel M,Hindi I,Scheiman-Elazary A,Gur C

    更新日期:2019-02-04 00:00:00