Augmented reality powers a cognitive assistant for the blind.

Abstract:

:To restore vision for the blind, several prosthetic approaches have been explored that convey raw images to the brain. So far, these schemes all suffer from a lack of bandwidth. An alternate approach would restore vision at the cognitive level, bypassing the need to convey sensory data. A wearable computer captures video and other data, extracts important scene knowledge, and conveys that to the user in compact form. Here, we implement an intuitive user interface for such a device using augmented reality: each object in the environment has a voice and communicates with the user on command. With minimal training, this system supports many aspects of visual cognition: obstacle avoidance, scene understanding, formation and recall of spatial memories, navigation. Blind subjects can traverse an unfamiliar multi-story building on their first attempt. To spur further development in this domain, we developed an open-source environment for standardized benchmarking of visual assistive devices.

journal_name

Elife

journal_title

eLife

authors

Liu Y,Stiles NR,Meister M

doi

10.7554/eLife.37841

subject

Has Abstract

pub_date

2018-11-27 00:00:00

issn

2050-084X

pii

37841

journal_volume

7

pub_type

杂志文章

相关文献

eLife文献大全
  • Searching for epilepsy's crystal ball.

    abstract::Multi-modal MRI techniques have identified biomarkers that could help to predict whether someone will develop epilepsy. ...

    journal_title:eLife

    pub_type: 评论,杂志文章

    doi:10.7554/eLife.29853

    authors: Gröhn O,Sierra A

    更新日期:2017-07-26 00:00:00

  • Launching eLife, Part 1.

    abstract::The new open-access journal eLife has launched, making its first content available in PubMed Central. In addition to publishing science of the highest quality, the journal aims to improve both the peer-review process and the presentation of new research results. ...

    journal_title:eLife

    pub_type: 杂志文章

    doi:10.7554/eLife.00270

    authors: Schekman R,Patterson M,Watt F,Weigel D

    更新日期:2012-10-15 00:00:00

  • Clearance of beta-amyloid is facilitated by apolipoprotein E and circulating high-density lipoproteins in bioengineered human vessels.

    abstract::Amyloid plaques, consisting of deposited beta-amyloid (Aβ), are a neuropathological hallmark of Alzheimer's Disease (AD). Cerebral vessels play a major role in AD, as Aβ is cleared from the brain by pathways involving the cerebrovasculature, most AD patients have cerebrovascular amyloid (cerebral amyloid angiopathy (C...

    journal_title:eLife

    pub_type: 杂志文章

    doi:10.7554/eLife.29595

    authors: Robert J,Button EB,Yuen B,Gilmour M,Kang K,Bahrabadi A,Stukas S,Zhao W,Kulic I,Wellington CL

    更新日期:2017-10-10 00:00:00

  • Mitochondrial support of persistent presynaptic vesicle mobilization with age-dependent synaptic growth after LTP.

    abstract::Mitochondria support synaptic transmission through production of ATP, sequestration of calcium, synthesis of glutamate, and other vital functions. Surprisingly, less than 50% of hippocampal CA1 presynaptic boutons contain mitochondria, raising the question of whether synapses without mitochondria can sustain changes i...

    journal_title:eLife

    pub_type: 杂志文章

    doi:10.7554/eLife.15275

    authors: Smith HL,Bourne JN,Cao G,Chirillo MA,Ostroff LE,Watson DJ,Harris KM

    更新日期:2016-12-19 00:00:00

  • Spatial sequestration and detoxification of Huntingtin by the ribosome quality control complex.

    abstract::Huntington disease (HD) is a neurological disorder caused by polyglutamine expansions in mutated Huntingtin (mHtt) proteins, rendering them prone to form inclusion bodies (IB). We report that in yeast, such IB formation is a factor-dependent process subjected to age-related decline. A genome-wide, high-content imaging...

    journal_title:eLife

    pub_type: 杂志文章

    doi:10.7554/eLife.11792

    authors: Yang J,Hao X,Cao X,Liu B,Nyström T

    更新日期:2016-04-01 00:00:00

  • Microsecond sub-domain motions and the folding and misfolding of the mouse prion protein.

    abstract::Protein aggregation appears to originate from partially unfolded conformations that are sampled through stochastic fluctuations of the native protein. It has been a challenge to characterize these fluctuations, under native like conditions. Here, the conformational dynamics of the full-length (23-231) mouse prion prot...

    journal_title:eLife

    pub_type: 杂志文章

    doi:10.7554/eLife.44766

    authors: Goluguri RR,Sen S,Udgaonkar J

    更新日期:2019-04-26 00:00:00

  • Replication Study: Transcriptional amplification in tumor cells with elevated c-Myc.

    abstract::As part of the Reproducibility Project: Cancer Biology, we published a Registered Report (Blum et al., 2015), that described how we intended to replicate selected experiments from the paper 'Transcriptional amplification in tumor cells with elevated c-Myc' (Lin et al., 2012). Here we report the results. We found overe...

    journal_title:eLife

    pub_type: 杂志文章

    doi:10.7554/eLife.30274

    authors: Lewis LM,Edwards MC,Meyers ZR,Talbot CC Jr,Hao H,Blum D,Reproducibility Project: Cancer Biology.

    更新日期:2018-01-09 00:00:00

  • Sensitivity and kinetics of signal transmission at the first visual synapse differentially impact visually-guided behavior.

    abstract::In the retina, synaptic transmission between photoreceptors and downstream ON-bipolar neurons (ON-BCs) is mediated by a GPCR pathway, which plays an essential role in vision. However, the mechanisms that control signal transmission at this synapse and its relevance to behavior remain poorly understood. In this study w...

    journal_title:eLife

    pub_type: 杂志文章

    doi:10.7554/eLife.06358

    authors: Sarria I,Pahlberg J,Cao Y,Kolesnikov AV,Kefalov VJ,Sampath AP,Martemyanov KA

    更新日期:2015-04-16 00:00:00

  • Transient inhibition and long-term facilitation of locomotion by phasic optogenetic activation of serotonin neurons.

    abstract::Serotonin (5-HT) is associated with mood and motivation but the function of endogenous 5-HT remains controversial. Here, we studied the impact of phasic optogenetic activation of 5-HT neurons in mice over time scales from seconds to weeks. We found that activating dorsal raphe nucleus (DRN) 5-HT neurons induced a stro...

    journal_title:eLife

    pub_type: 杂志文章

    doi:10.7554/eLife.20975

    authors: Correia PA,Lottem E,Banerjee D,Machado AS,Carey MR,Mainen ZF

    更新日期:2017-02-14 00:00:00

  • One-shot learning and behavioral eligibility traces in sequential decision making.

    abstract::In many daily tasks, we make multiple decisions before reaching a goal. In order to learn such sequences of decisions, a mechanism to link earlier actions to later reward is necessary. Reinforcement learning (RL) theory suggests two classes of algorithms solving this credit assignment problem: In classic temporal-diff...

    journal_title:eLife

    pub_type: 杂志文章

    doi:10.7554/eLife.47463

    authors: Lehmann MP,Xu HA,Liakoni V,Herzog MH,Gerstner W,Preuschoff K

    更新日期:2019-11-11 00:00:00

  • Pregnancy success in mice requires appropriate cannabinoid receptor signaling for primary decidua formation.

    abstract::With implantation, mouse stromal cells begin to transform into epithelial-like cells surrounding the implantation chamber forming an avascular zone called the primary decidual zone (PDZ). In the mouse, the PDZ forms a transient, size-dependent permeable barrier to protect the embryo from maternal circulating harmful a...

    journal_title:eLife

    pub_type: 杂志文章

    doi:10.7554/eLife.61762

    authors: Li Y,Dewar A,Kim YS,Dey SK,Sun X

    更新日期:2020-09-29 00:00:00

  • Freshwater monitoring by nanopore sequencing.

    abstract::While traditional microbiological freshwater tests focus on the detection of specific bacterial indicator species, including pathogens, direct tracing of all aquatic DNA through metagenomics poses a profound alternative. Yet, in situ metagenomic water surveys face substantial challenges in cost and logistics. Here, we...

    journal_title:eLife

    pub_type: 杂志文章

    doi:10.7554/eLife.61504

    authors: Urban L,Holzer A,Baronas JJ,Hall MB,Braeuninger-Weimer P,Scherm MJ,Kunz DJ,Perera SN,Martin-Herranz DE,Tipper ET,Salter SJ,Stammnitz MR

    更新日期:2021-01-19 00:00:00

  • The age of Homo naledi and associated sediments in the Rising Star Cave, South Africa.

    abstract::New ages for flowstone, sediments and fossil bones from the Dinaledi Chamber are presented. We combined optically stimulated luminescence dating of sediments with U-Th and palaeomagnetic analyses of flowstones to establish that all sediments containing Homo naledi fossils can be allocated to a single stratigraphic ent...

    journal_title:eLife

    pub_type: 杂志文章

    doi:10.7554/eLife.24231

    authors: Dirks PH,Roberts EM,Hilbert-Wolf H,Kramers JD,Hawks J,Dosseto A,Duval M,Elliott M,Evans M,Grün R,Hellstrom J,Herries AI,Joannes-Boyau R,Makhubela TV,Placzek CJ,Robbins J,Spandler C,Wiersma J,Woodhead J,Berger LR

    更新日期:2017-05-09 00:00:00

  • How flies turn food into progeny.

    abstract::Sex-optimal diets have different effects on gene expression in female and male flies. ...

    journal_title:eLife

    pub_type: 评论,杂志文章

    doi:10.7554/eLife.51289

    authors: Flatt T

    更新日期:2019-10-01 00:00:00

  • Performing photosynthesis without β-carotene.

    abstract::Research on mutant tobacco plants shows that a pigment called β-carotene is not necessary for photosynthesis. ...

    journal_title:eLife

    pub_type: 杂志文章

    doi:10.7554/eLife.63584

    authors: Telfer A

    更新日期:2020-11-03 00:00:00

  • Targeting the link between late pregnancy and breast cancer.

    abstract::Why does a first pregnancy after age 35 increase the risk of breast cancer, and what can be done to combat this? ...

    journal_title:eLife

    pub_type: 评论,杂志文章

    doi:10.7554/eLife.01926

    authors: Chakravarthi BV,Varambally S

    更新日期:2013-12-31 00:00:00

  • Structural basis of tubulin recruitment and assembly by microtubule polymerases with tumor overexpressed gene (TOG) domain arrays.

    abstract::XMAP215/Stu2/Alp14 proteins accelerate microtubule plus-end polymerization by recruiting tubulins via arrays of tumor overexpressed gene (TOG) domains, yet their mechanism remains unknown. Here, we describe the biochemical and structural basis for TOG arrays in recruiting and polymerizing tubulins. Alp14 binds four tu...

    journal_title:eLife

    pub_type: 杂志文章

    doi:10.7554/eLife.38922

    authors: Nithianantham S,Cook BD,Beans M,Guo F,Chang F,Al-Bassam J

    更新日期:2018-11-13 00:00:00

  • Large-scale network integration in the human brain tracks temporal fluctuations in memory encoding performance.

    abstract::Although activation/deactivation of specific brain regions has been shown to be predictive of successful memory encoding, the relationship between time-varying large-scale brain networks and fluctuations of memory encoding performance remains unclear. Here, we investigated time-varying functional connectivity patterns...

    journal_title:eLife

    pub_type: 杂志文章

    doi:10.7554/eLife.32696

    authors: Keerativittayayut R,Aoki R,Sarabi MT,Jimura K,Nakahara K

    更新日期:2018-06-18 00:00:00

  • Role of SAGA in the asymmetric segregation of DNA circles during yeast ageing.

    abstract::In eukaryotes, intra-chromosomal recombination generates DNA circles, but little is known about how cells react to them. In yeast, partitioning of such circles to the mother cell at mitosis ensures their loss from the population but promotes replicative ageing. Nevertheless, the mechanisms of partitioning are debated....

    journal_title:eLife

    pub_type: 杂志文章

    doi:10.7554/eLife.03790

    authors: Denoth-Lippuner A,Krzyzanowski MK,Stober C,Barral Y

    更新日期:2014-11-17 00:00:00

  • The DEG/ENaC cation channel protein UNC-8 drives activity-dependent synapse removal in remodeling GABAergic neurons.

    abstract::Genetic programming and neural activity drive synaptic remodeling in developing neural circuits, but the molecular components that link these pathways are poorly understood. Here we show that the C. elegans Degenerin/Epithelial Sodium Channel (DEG/ENaC) protein, UNC-8, is transcriptionally controlled to function as a ...

    journal_title:eLife

    pub_type: 杂志文章

    doi:10.7554/eLife.14599

    authors: Miller-Fleming TW,Petersen SC,Manning L,Matthewman C,Gornet M,Beers A,Hori S,Mitani S,Bianchi L,Richmond J,Miller DM

    更新日期:2016-07-12 00:00:00

  • Inhibition by small-molecule ligands of formation of amyloid fibrils of an immunoglobulin light chain variable domain.

    abstract::Overproduction of immunoglobulin light chains leads to systemic amyloidosis, a lethal disease characterized by the formation of amyloid fibrils in patients' tissues. Excess light chains are in equilibrium between dimers and less stable monomers which can undergo irreversible aggregation to the amyloid state. The dimer...

    journal_title:eLife

    pub_type: 杂志文章

    doi:10.7554/eLife.10935

    authors: Brumshtein B,Esswein SR,Salwinski L,Phillips ML,Ly AT,Cascio D,Sawaya MR,Eisenberg DS

    更新日期:2015-11-18 00:00:00

  • MicroRNAs down-regulate homologous recombination in the G1 phase of cycling cells to maintain genomic stability.

    abstract::Homologous recombination (HR)-mediated repair of DNA double-strand break (DSB)s is restricted to the post-replicative phases of the cell cycle. Initiation of HR in the G1 phase blocks non-homologous end joining (NHEJ) impairing DSB repair. Completion of HR in G1 cells can lead to the loss-of-heterozygosity (LOH), whic...

    journal_title:eLife

    pub_type: 杂志文章

    doi:10.7554/eLife.02445

    authors: Choi YE,Pan Y,Park E,Konstantinopoulos P,De S,D'Andrea A,Chowdhury D

    更新日期:2014-04-30 00:00:00

  • Yeast rises to the occasion.

    abstract::Genetic analyses of 15 species of yeast have shed new light on the divergence of gene regulation during evolution, with significant changes occurring after an event in which a whole genome was duplicated. ...

    journal_title:eLife

    pub_type: 评论,杂志文章

    doi:10.7554/eLife.00933

    authors: Ragan MA

    更新日期:2013-06-18 00:00:00

  • v-SNARE transmembrane domains function as catalysts for vesicle fusion.

    abstract::Vesicle fusion is mediated by an assembly of SNARE proteins between opposing membranes, but it is unknown whether transmembrane domains (TMDs) of SNARE proteins serve mechanistic functions that go beyond passive anchoring of the force-generating SNAREpin to the fusing membranes. Here, we show that conformational flexi...

    journal_title:eLife

    pub_type: 杂志文章

    doi:10.7554/eLife.17571

    authors: Dhara M,Yarzagaray A,Makke M,Schindeldecker B,Schwarz Y,Shaaban A,Sharma S,Böckmann RA,Lindau M,Mohrmann R,Bruns D

    更新日期:2016-06-25 00:00:00

  • Stop that nonsense!

    abstract::Cells can avoid the effects of so-called 'nonsense' mutations by several methods, including a newly discovered mechanism driven by microRNA molecules. ...

    journal_title:eLife

    pub_type: 评论,杂志文章

    doi:10.7554/eLife.04300

    authors: Jopling CL

    更新日期:2014-09-09 00:00:00

  • The laminar organization of the Drosophila ellipsoid body is semaphorin-dependent and prevents the formation of ectopic synaptic connections.

    abstract::The ellipsoid body (EB) in the Drosophila brain is a central complex (CX) substructure that harbors circumferentially laminated ring (R) neuron axons and mediates multifaceted sensory integration and motor coordination functions. However, what regulates R axon lamination and how lamination affects R neuron function re...

    journal_title:eLife

    pub_type: 杂志文章

    doi:10.7554/eLife.25328

    authors: Xie X,Tabuchi M,Brown MP,Mitchell SP,Wu MN,Kolodkin AL

    更新日期:2017-06-20 00:00:00

  • Discovery of novel determinants of endothelial lineage using chimeric heterokaryons.

    abstract::We wish to identify determinants of endothelial lineage. Murine embryonic stem cells (mESC) were fused with human endothelial cells in stable, non-dividing, heterokaryons. Using RNA-seq, it is possible to discriminate between human and mouse transcripts in these chimeric heterokaryons. We observed a temporal pattern o...

    journal_title:eLife

    pub_type: 杂志文章

    doi:10.7554/eLife.23588

    authors: Wong WT,Matrone G,Tian X,Tomoiaga SA,Au KF,Meng S,Yamazoe S,Sieveking D,Chen K,Burns DM,Chen JK,Blau HM,Cooke JP

    更新日期:2017-03-21 00:00:00

  • Retinal stem cells modulate proliferative parameters to coordinate post-embryonic morphogenesis in the eye of fish.

    abstract::Combining clonal analysis with a computational agent based model, we investigate how tissue-specific stem cells for neural retina (NR) and retinal pigmented epithelium (RPE) of the teleost medaka (Oryzias latipes) coordinate their growth rates. NR cell division timing is less variable, consistent with an upstream role...

    journal_title:eLife

    pub_type: 杂志文章

    doi:10.7554/eLife.42646

    authors: Tsingos E,Höckendorf B,Sütterlin T,Kirchmaier S,Grabe N,Centanin L,Wittbrodt J

    更新日期:2019-03-26 00:00:00

  • Illuminating traffic control for cell-division planes.

    abstract::When a plant cell divides, four related proteins control the trafficking of vesicles and ensure that cargo that is normally recycled to the plasma membrane is instead re-routed to the plane of cell division. ...

    journal_title:eLife

    pub_type: 评论,杂志文章

    doi:10.7554/eLife.02747

    authors: Robatzek S

    更新日期:2014-04-08 00:00:00

  • Ready, set, differentiate!

    abstract::The expression of E-Cadherin, a protein best known for its role in cell adhesion, regulates the onset of embryonic differentiation. ...

    journal_title:eLife

    pub_type: 评论,杂志文章

    doi:10.7554/eLife.01839

    authors: Sancho M,Rodríguez TA

    更新日期:2013-12-17 00:00:00