Near real-time intraoperative brain tumor diagnosis using stimulated Raman histology and deep neural networks.

Abstract:

:Intraoperative diagnosis is essential for providing safe and effective care during cancer surgery1. The existing workflow for intraoperative diagnosis based on hematoxylin and eosin staining of processed tissue is time, resource and labor intensive2,3. Moreover, interpretation of intraoperative histologic images is dependent on a contracting, unevenly distributed, pathology workforce4. In the present study, we report a parallel workflow that combines stimulated Raman histology (SRH)5-7, a label-free optical imaging method and deep convolutional neural networks (CNNs) to predict diagnosis at the bedside in near real-time in an automated fashion. Specifically, our CNNs, trained on over 2.5 million SRH images, predict brain tumor diagnosis in the operating room in under 150 s, an order of magnitude faster than conventional techniques (for example, 20-30 min)2. In a multicenter, prospective clinical trial (n = 278), we demonstrated that CNN-based diagnosis of SRH images was noninferior to pathologist-based interpretation of conventional histologic images (overall accuracy, 94.6% versus 93.9%). Our CNNs learned a hierarchy of recognizable histologic feature representations to classify the major histopathologic classes of brain tumors. In addition, we implemented a semantic segmentation method to identify tumor-infiltrated diagnostic regions within SRH images. These results demonstrate how intraoperative cancer diagnosis can be streamlined, creating a complementary pathway for tissue diagnosis that is independent of a traditional pathology laboratory.

journal_name

Nat Med

journal_title

Nature medicine

authors

Hollon TC,Pandian B,Adapa AR,Urias E,Save AV,Khalsa SSS,Eichberg DG,D'Amico RS,Farooq ZU,Lewis S,Petridis PD,Marie T,Shah AH,Garton HJL,Maher CO,Heth JA,McKean EL,Sullivan SE,Hervey-Jumper SL,Patil PG,Thompson BG

doi

10.1038/s41591-019-0715-9

subject

Has Abstract

pub_date

2020-01-01 00:00:00

pages

52-58

issue

1

eissn

1078-8956

issn

1546-170X

pii

10.1038/s41591-019-0715-9

journal_volume

26

pub_type

杂志文章
  • ORP150 protects against hypoxia/ischemia-induced neuronal death.

    abstract::Oxygen-regulated protein 150 kD (ORP150) is a novel endoplasmic-reticulum-associated chaperone induced by hypoxia/ischemia. Although ORP150 was sparingly upregulated in neurons from human brain undergoing ischemic stress, there was robust induction in astrocytes. Cultured neurons overexpressing ORP150 were resistant t...

    journal_title:Nature medicine

    pub_type: 杂志文章

    doi:10.1038/85463

    authors: Tamatani M,Matsuyama T,Yamaguchi A,Mitsuda N,Tsukamoto Y,Taniguchi M,Che YH,Ozawa K,Hori O,Nishimura H,Yamashita A,Okabe M,Yanagi H,Stern DM,Ogawa S,Tohyama M

    更新日期:2001-03-01 00:00:00

  • Activation of the caspase-3 apoptotic cascade in traumatic spinal cord injury.

    abstract::Traumatic spinal cord injury often results in complete loss of voluntary motor and sensory function below the site of injury. The long-term neurological deficits after spinal cord trauma may be due in part to widespread apoptosis of neurons and oligodendroglia in regions distant from and relatively unaffected by the i...

    journal_title:Nature medicine

    pub_type: 杂志文章

    doi:10.1038/11387

    authors: Springer JE,Azbill RD,Knapp PE

    更新日期:1999-08-01 00:00:00

  • Cleavage of tau by asparagine endopeptidase mediates the neurofibrillary pathology in Alzheimer's disease.

    abstract::Neurofibrillary tangles (NFTs), composed of truncated and hyperphosphorylated tau, are a common feature of numerous aging-related neurodegenerative diseases, including Alzheimer's disease (AD). However, the molecular mechanisms mediating tau truncation and aggregation during aging remain elusive. Here we show that asp...

    journal_title:Nature medicine

    pub_type: 杂志文章

    doi:10.1038/nm.3700

    authors: Zhang Z,Song M,Liu X,Kang SS,Kwon IS,Duong DM,Seyfried NT,Hu WT,Liu Z,Wang JZ,Cheng L,Sun YE,Yu SP,Levey AI,Ye K

    更新日期:2014-11-01 00:00:00

  • Placental growth factor reconstitutes hematopoiesis by recruiting VEGFR1(+) stem cells from bone-marrow microenvironment.

    abstract::The mechanism by which angiogenic factors recruit bone marrow (BM)-derived quiescent endothelial and hematopoietic stem cells (HSCs) is not known. Here, we report that functional vascular endothelial growth factor receptor-1 (VEGFR1) is expressed on human CD34(+) and mouse Lin(-)Sca-1(+)c-Kit(+) BM-repopulating stem c...

    journal_title:Nature medicine

    pub_type: 杂志文章

    doi:10.1038/nm740

    authors: Hattori K,Heissig B,Wu Y,Dias S,Tejada R,Ferris B,Hicklin DJ,Zhu Z,Bohlen P,Witte L,Hendrikx J,Hackett NR,Crystal RG,Moore MA,Werb Z,Lyden D,Rafii S

    更新日期:2002-08-01 00:00:00

  • Human and porcine early kidney precursors as a new source for transplantation.

    abstract::Kidney transplantation has been one of the major medical advances of the past 30 years. However, tissue availability remains a major obstacle. This can potentially be overcome by the use of undifferentiated or partially developed kidney precursor cells derived from early embryos and fetal tissue. Here, transplantation...

    journal_title:Nature medicine

    pub_type: 杂志文章

    doi:10.1038/nm812

    authors: Dekel B,Burakova T,Arditti FD,Reich-Zeliger S,Milstein O,Aviel-Ronen S,Rechavi G,Friedman N,Kaminski N,Passwell JH,Reisner Y

    更新日期:2003-01-01 00:00:00

  • In vivo site-directed mutagenesis of the factor IX gene by chimeric RNA/DNA oligonucleotides.

    abstract::A chimeric RNA/DNA oligonucleotide was constructed to induce a sequence mutation in the rat factor IX gene, resulting in prolonged coagulation. Oligonucleotides were targeted to hepatocytes in cell culture or in vivo by intravenous injection. Nucleotide conversion was both site-specific and dose-dependent. The mutated...

    journal_title:Nature medicine

    pub_type: 杂志文章

    doi:10.1038/nm0398-285

    authors: Kren BT,Bandyopadhyay P,Steer CJ

    更新日期:1998-03-01 00:00:00

  • Gamma secretase-mediated Notch signaling worsens brain damage and functional outcome in ischemic stroke.

    abstract::Mice transgenic for antisense Notch and normal mice treated with inhibitors of the Notch-activating enzyme gamma-secretase showed reduced damage to brain cells and improved functional outcome in a model of focal ischemic stroke. Notch endangers neurons by modulating pathways that increase their vulnerability to apopto...

    journal_title:Nature medicine

    pub_type: 杂志文章

    doi:10.1038/nm1403

    authors: Arumugam TV,Chan SL,Jo DG,Yilmaz G,Tang SC,Cheng A,Gleichmann M,Okun E,Dixit VD,Chigurupati S,Mughal MR,Ouyang X,Miele L,Magnus T,Poosala S,Granger DN,Mattson MP

    更新日期:2006-06-01 00:00:00

  • Targeting the NF-kappaB signaling pathway in Notch1-induced T-cell leukemia.

    abstract::T-cell acute lymphoblastic leukemia (T-ALL), unlike other ALL types, is only infrequently associated with chromosomal aberrations, but it was recently shown that most individuals with T-ALL carry activating mutations in the NOTCH1 gene. However, the signaling pathways and target genes responsible for Notch1-induced ne...

    journal_title:Nature medicine

    pub_type: 杂志文章

    doi:10.1038/nm1524

    authors: Vilimas T,Mascarenhas J,Palomero T,Mandal M,Buonamici S,Meng F,Thompson B,Spaulding C,Macaroun S,Alegre ML,Kee BL,Ferrando A,Miele L,Aifantis I

    更新日期:2007-01-01 00:00:00

  • Identification of a hormonal basis for gallbladder filling.

    abstract::The cycle of gallbladder filling and emptying controls the flow of bile into the intestine for digestion. Here we show that fibroblast growth factor-15, a hormone made by the distal small intestine in response to bile acids, is required for gallbladder filling. These studies demonstrate that gallbladder filling is act...

    journal_title:Nature medicine

    pub_type: 杂志文章

    doi:10.1038/nm1501

    authors: Choi M,Moschetta A,Bookout AL,Peng L,Umetani M,Holmstrom SR,Suino-Powell K,Xu HE,Richardson JA,Gerard RD,Mangelsdorf DJ,Kliewer SA

    更新日期:2006-11-01 00:00:00

  • A single-cell and single-nucleus RNA-Seq toolbox for fresh and frozen human tumors.

    abstract::Single-cell genomics is essential to chart tumor ecosystems. Although single-cell RNA-Seq (scRNA-Seq) profiles RNA from cells dissociated from fresh tumors, single-nucleus RNA-Seq (snRNA-Seq) is needed to profile frozen or hard-to-dissociate tumors. Each requires customization to different tissue and tumor types, posi...

    journal_title:Nature medicine

    pub_type: 杂志文章

    doi:10.1038/s41591-020-0844-1

    authors: Slyper M,Porter CBM,Ashenberg O,Waldman J,Drokhlyansky E,Wakiro I,Smillie C,Smith-Rosario G,Wu J,Dionne D,Vigneau S,Jané-Valbuena J,Tickle TL,Napolitano S,Su MJ,Patel AG,Karlstrom A,Gritsch S,Nomura M,Waghray A,Go

    更新日期:2020-05-01 00:00:00

  • Selective modulation of the androgen receptor AF2 domain rescues degeneration in spinal bulbar muscular atrophy.

    abstract::Spinal bulbar muscular atrophy (SBMA) is a motor neuron disease caused by toxic gain of function of the androgen receptor (AR). Previously, we found that co-regulator binding through the activation function-2 (AF2) domain of AR is essential for pathogenesis, suggesting that AF2 may be a potential drug target for selec...

    journal_title:Nature medicine

    pub_type: 杂志文章

    doi:10.1038/nm.4500

    authors: Badders NM,Korff A,Miranda HC,Vuppala PK,Smith RB,Winborn BJ,Quemin ER,Sopher BL,Dearman J,Messing J,Kim NC,Moore J,Freibaum BD,Kanagaraj AP,Fan B,Tillman H,Chen PC,Wang Y,Freeman BB III,Li Y,Kim HJ,La Spada AR

    更新日期:2018-05-01 00:00:00

  • Rescue of hearing and vestibular function by antisense oligonucleotides in a mouse model of human deafness.

    abstract::Hearing impairment is the most common sensory disorder, with congenital hearing impairment present in approximately 1 in 1,000 newborns. Hereditary deafness is often mediated by the improper development or degeneration of cochlear hair cells. Until now, it was not known whether such congenital failures could be mitiga...

    journal_title:Nature medicine

    pub_type: 杂志文章

    doi:10.1038/nm.3106

    authors: Lentz JJ,Jodelka FM,Hinrich AJ,McCaffrey KE,Farris HE,Spalitta MJ,Bazan NG,Duelli DM,Rigo F,Hastings ML

    更新日期:2013-03-01 00:00:00

  • CCL27-CCR10 interactions regulate T cell-mediated skin inflammation.

    abstract::The skin-associated chemokine CCL27 (also called CTACK, ALP and ESkine) and its receptor CCR10 (GPR-2) mediate chemotactic responses of skin-homing T cells in vitro. Here we report that most skin-infiltrating lymphocytes in patients suffering from psoriasis, atopic or allergic-contact dermatitis express CCR10. Epiderm...

    journal_title:Nature medicine

    pub_type: 杂志文章

    doi:10.1038/nm0202-157

    authors: Homey B,Alenius H,Müller A,Soto H,Bowman EP,Yuan W,McEvoy L,Lauerma AI,Assmann T,Bünemann E,Lehto M,Wolff H,Yen D,Marxhausen H,To W,Sedgwick J,Ruzicka T,Lehmann P,Zlotnik A

    更新日期:2002-02-01 00:00:00

  • Deciphering the genomic, epigenomic, and transcriptomic landscapes of pre-invasive lung cancer lesions.

    abstract::The molecular alterations that occur in cells before cancer is manifest are largely uncharted. Lung carcinoma in situ (CIS) lesions are the pre-invasive precursor to squamous cell carcinoma. Although microscopically identical, their future is in equipoise, with half progressing to invasive cancer and half regressing o...

    journal_title:Nature medicine

    pub_type: 杂志文章

    doi:10.1038/s41591-018-0323-0

    authors: Teixeira VH,Pipinikas CP,Pennycuick A,Lee-Six H,Chandrasekharan D,Beane J,Morris TJ,Karpathakis A,Feber A,Breeze CE,Ntolios P,Hynds RE,Falzon M,Capitanio A,Carroll B,Durrenberger PF,Hardavella G,Brown JM,Lynch AG,Fa

    更新日期:2019-03-01 00:00:00

  • DNA repair processes are critical mediators of p53-dependent tumor suppression.

    abstract::It has long been assumed that p53 suppresses tumor development through induction of apoptosis, possibly with contributions by cell cycle arrest and cell senescence1,2. However, combined deficiency in these three processes does not result in spontaneous tumor formation as observed upon loss of p53, suggesting the exist...

    journal_title:Nature medicine

    pub_type: 杂志文章

    doi:10.1038/s41591-018-0043-5

    authors: Janic A,Valente LJ,Wakefield MJ,Di Stefano L,Milla L,Wilcox S,Yang H,Tai L,Vandenberg CJ,Kueh AJ,Mizutani S,Brennan MS,Schenk RL,Lindqvist LM,Papenfuss AT,O'Connor L,Strasser A,Herold MJ

    更新日期:2018-07-01 00:00:00

  • Restoration of the tumor suppressor function to mutant p53 by a low-molecular-weight compound.

    abstract::The tumor suppressor p53 inhibits tumor growth primarily through its ability to induce apoptosis. Mutations in p53 occur in at least 50% of human tumors. We hypothesized that reactivation of mutant p53 in such tumors should trigger massive apoptosis and eliminate the tumor cells. To test this, we screened a library of...

    journal_title:Nature medicine

    pub_type: 杂志文章

    doi:10.1038/nm0302-282

    authors: Bykov VJ,Issaeva N,Shilov A,Hultcrantz M,Pugacheva E,Chumakov P,Bergman J,Wiman KG,Selivanova G

    更新日期:2002-03-01 00:00:00

  • gammadelta T cells provide a breath of fresh air for asthma research.

    abstract::gammadelta T cells downregulate airways responsiveness to allergen challenge, possibly by controlling the 'repair' response of the airway epithelium to alphabeta T cell-mediated damage (pages 1150-1156). ...

    journal_title:Nature medicine

    pub_type: 评论,新闻

    doi:10.1038/13447

    authors: Holt PG,Sly PD

    更新日期:1999-10-01 00:00:00

  • Targeting sphingosine-1-phosphate lyase as an anabolic therapy for bone loss.

    abstract::Sphingosine-1-phosphate (S1P) signaling influences bone metabolism, but its therapeutic potential in bone disorders has remained unexplored. We show that raising S1P levels in adult mice through conditionally deleting or pharmacologically inhibiting S1P lyase, the sole enzyme responsible for irreversibly degrading S1P...

    journal_title:Nature medicine

    pub_type: 杂志文章

    doi:10.1038/s41591-018-0005-y

    authors: Weske S,Vaidya M,Reese A,von Wnuck Lipinski K,Keul P,Bayer JK,Fischer JW,Flögel U,Nelsen J,Epple M,Scatena M,Schwedhelm E,Dörr M,Völzke H,Moritz E,Hannemann A,Rauch BH,Gräler MH,Heusch G,Levkau B

    更新日期:2018-05-01 00:00:00

  • Immunosuppression in acutely decompensated cirrhosis is mediated by prostaglandin E2.

    abstract::Liver disease is one of the leading causes of death worldwide. Patients with cirrhosis display an increased predisposition to and mortality from infection due to multimodal defects in the innate immune system; however, the causative mechanism has remained elusive. We present evidence that the cyclooxygenase (COX)-deri...

    journal_title:Nature medicine

    pub_type: 杂志文章

    doi:10.1038/nm.3516

    authors: O'Brien AJ,Fullerton JN,Massey KA,Auld G,Sewell G,James S,Newson J,Karra E,Winstanley A,Alazawi W,Garcia-Martinez R,Cordoba J,Nicolaou A,Gilroy DW

    更新日期:2014-05-01 00:00:00

  • Detecting opioid overdoses with smartphones.

    abstract:: ...

    journal_title:Nature medicine

    pub_type: 评论,杂志文章

    doi:10.1038/s41591-019-0362-1

    authors: Stower H

    更新日期:2019-02-01 00:00:00

  • Long noncoding RNA EGFR-AS1 mediates epidermal growth factor receptor addiction and modulates treatment response in squamous cell carcinoma.

    abstract::Targeting EGFR is a validated approach in the treatment of squamous-cell cancers (SCCs), although there are no established biomarkers for predicting response. We have identified a synonymous mutation in EGFR, c.2361G>A (encoding p.Gln787Gln), in two patients with head and neck SCC (HNSCC) who were exceptional responde...

    journal_title:Nature medicine

    pub_type: 杂志文章

    doi:10.1038/nm.4401

    authors: Tan DSW,Chong FT,Leong HS,Toh SY,Lau DP,Kwang XL,Zhang X,Sundaram GM,Tan GS,Chang MM,Chua BT,Lim WT,Tan EH,Ang MK,Lim TKH,Sampath P,Chowbay B,Skanderup AJ,DasGupta R,Iyer NG

    更新日期:2017-10-01 00:00:00

  • Imaging of angiogenesis: from microscope to clinic.

    abstract::Advances in imaging are transforming our understanding of angiogenesis and the evaluation of drugs that stimulate or inhibit angiogenesis in preclinical models and human disease. Vascular imaging makes it possible to quantify the number and spacing of blood vessels, measure blood flow and vascular permeability, and an...

    journal_title:Nature medicine

    pub_type: 杂志文章,评审

    doi:10.1038/nm0603-713

    authors: McDonald DM,Choyke PL

    更新日期:2003-06-01 00:00:00

  • Vaccines: past, present and future.

    abstract::The vaccines developed over the first two hundred years since Jenner's lifetime have accomplished striking reductions of infection and disease wherever applied. Pasteur's early approaches to vaccine development, attenuation and inactivation, are even now the two poles of vaccine technology. Today, purification of micr...

    journal_title:Nature medicine

    pub_type: 历史文章,杂志文章

    doi:10.1038/nm1209

    authors: Plotkin SA

    更新日期:2005-04-01 00:00:00

  • Emerging cytopathic and antigenic simian immunodeficiency virus variants influence AIDS progression.

    abstract::Genetic variants of human and simian immunodeficiency virus (HIV and SIV) that evolve during the course of infection and progression to AIDS are phenotypically and antigenically distinct from their progenitor viruses present at early stages of infection. However, it has been unclear how these late variants, which are ...

    journal_title:Nature medicine

    pub_type: 杂志文章

    doi:10.1038/8414

    authors: Kimata JT,Kuller L,Anderson DB,Dailey P,Overbaugh J

    更新日期:1999-05-01 00:00:00

  • Real-time quantitative RT-PCR after laser-assisted cell picking.

    abstract::The present study describes a technique for quantitation of mRNA in a few isotypic cells obtained from an intact organ structure by combining laser-assisted cell picking and real-time PCR. The microscopically controlled lasering of selected cells in stained tissue sections was applied to lung alveolar macrophages, whi...

    journal_title:Nature medicine

    pub_type: 杂志文章

    doi:10.1038/3327

    authors: Fink L,Seeger W,Ermert L,Hänze J,Stahl U,Grimminger F,Kummer W,Bohle RM

    更新日期:1998-11-01 00:00:00

  • Functional genomics of Neisseria meningitidis pathogenesis.

    abstract::The pathogenic bacterium Neisseria meningitidis is an important cause of septicemia and meningitis, especially in childhood. The establishment and maintenance of bacteremic infection is a pre-requisite for all the pathological sequelae of meningococcal infection. To further understand the genetic basis of this essenti...

    journal_title:Nature medicine

    pub_type: 杂志文章

    doi:10.1038/81380

    authors: Sun YH,Bakshi S,Chalmers R,Tang CM

    更新日期:2000-11-01 00:00:00

  • 27-Hydroxycholesterol is an endogenous SERM that inhibits the cardiovascular effects of estrogen.

    abstract::The cardioprotective effects of estrogen are mediated by receptors expressed in vascular cells. Here we show that 27-hydroxycholesterol (27HC), an abundant cholesterol metabolite that is elevated with hypercholesterolemia and found in atherosclerotic lesions, is a competitive antagonist of estrogen receptor action in ...

    journal_title:Nature medicine

    pub_type: 杂志文章

    doi:10.1038/nm1641

    authors: Umetani M,Domoto H,Gormley AK,Yuhanna IS,Cummins CL,Javitt NB,Korach KS,Shaul PW,Mangelsdorf DJ

    更新日期:2007-10-01 00:00:00

  • Thymosin α1 represents a potential potent single-molecule-based therapy for cystic fibrosis.

    abstract::Cystic fibrosis (CF) is caused by mutations in the gene encoding the cystic fibrosis transmembrane conductance regulator (CFTR) that compromise its chloride channel activity. The most common mutation, p.Phe508del, results in the production of a misfolded CFTR protein, which has residual channel activity but is prematu...

    journal_title:Nature medicine

    pub_type: 杂志文章

    doi:10.1038/nm.4305

    authors: Romani L,Oikonomou V,Moretti S,Iannitti RG,D'Adamo MC,Villella VR,Pariano M,Sforna L,Borghi M,Bellet MM,Fallarino F,Pallotta MT,Servillo G,Ferrari E,Puccetti P,Kroemer G,Pessia M,Maiuri L,Goldstein AL,Garaci E

    更新日期:2017-05-01 00:00:00

  • Role of the MEOX2 homeobox gene in neurovascular dysfunction in Alzheimer disease.

    abstract::Neurovascular dysfunction substantially contributes to Alzheimer disease. Here, we show that transcriptional profiling of human brain endothelial cells (BECs) defines a subset of genes whose expression is age-independent but is considerably altered in Alzheimer disease, including the homeobox gene MEOX2 (also known as...

    journal_title:Nature medicine

    pub_type: 杂志文章

    doi:10.1038/nm1287

    authors: Wu Z,Guo H,Chow N,Sallstrom J,Bell RD,Deane R,Brooks AI,Kanagala S,Rubio A,Sagare A,Liu D,Li F,Armstrong D,Gasiewicz T,Zidovetzki R,Song X,Hofman F,Zlokovic BV

    更新日期:2005-09-01 00:00:00

  • Rapid genomic evolution of a non-virulent coxsackievirus B3 in selenium-deficient mice results in selection of identical virulent isolates.

    abstract::Previous work from our laboratory demonstrated that selenium deficiency in the mouse allows a normally benign (amyocarditic) cloned and sequenced Coxackievirus to cause significant heart damage. Furthermore, Coxsackievirus recovered from the hearts of selenium-deficient mice inoculated into selenium-adequate mice stil...

    journal_title:Nature medicine

    pub_type: 杂志文章

    doi:10.1038/nm0595-433

    authors: Beck MA,Shi Q,Morris VC,Levander OA

    更新日期:1995-05-01 00:00:00