Atoms of recognition in human and computer vision.

Abstract:

:Discovering the visual features and representations used by the brain to recognize objects is a central problem in the study of vision. Recently, neural network models of visual object recognition, including biological and deep network models, have shown remarkable progress and have begun to rival human performance in some challenging tasks. These models are trained on image examples and learn to extract features and representations and to use them for categorization. It remains unclear, however, whether the representations and learning processes discovered by current models are similar to those used by the human visual system. Here we show, by introducing and using minimal recognizable images, that the human visual system uses features and processes that are not used by current models and that are critical for recognition. We found by psychophysical studies that at the level of minimal recognizable images a minute change in the image can have a drastic effect on recognition, thus identifying features that are critical for the task. Simulations then showed that current models cannot explain this sensitivity to precise feature configurations and, more generally, do not learn to recognize minimal images at a human level. The role of the features shown here is revealed uniquely at the minimal level, where the contribution of each feature is essential. A full understanding of the learning and use of such features will extend our understanding of visual recognition and its cortical mechanisms and will enhance the capacity of computational models to learn from visual experience and to deal with recognition and detailed image interpretation.

authors

Ullman S,Assif L,Fetaya E,Harari D

doi

10.1073/pnas.1513198113

subject

Has Abstract

pub_date

2016-03-08 00:00:00

pages

2744-9

issue

10

eissn

0027-8424

issn

1091-6490

pii

1513198113

journal_volume

113

pub_type

杂志文章
  • Counting human somatic cell replications: methylation mirrors endometrial stem cell divisions.

    abstract::Cell proliferation may be altered in many diseases, but it is uncertain exactly how to measure total numbers of divisions. Although it is impossible to count every division directly, potentially total numbers of stem cell divisions since birth may be inferred from numbers of somatic errors. The idea is that divisions ...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.0503976102

    authors: Kim JY,Tavaré S,Shibata D

    更新日期:2005-12-06 00:00:00

  • A general quantitative theory of forest structure and dynamics.

    abstract::We present the first part of a quantitative theory for the structure and dynamics of forests at demographic and resource steady state. The theory uses allometric scaling relations, based on metabolism and biomechanics, to quantify how trees use resources, fill space, and grow. These individual-level traits and propert...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.0812294106

    authors: West GB,Enquist BJ,Brown JH

    更新日期:2009-04-28 00:00:00

  • Mutation, specialization, and hypersensitivity in highly optimized tolerance.

    abstract::We introduce a model of evolution in which competing organisms are represented by percolation lattice models. Fitness is based on the number of occupied sites remaining after removing a cluster connected to a randomly selected site. High-fitness individuals arising through mutation and selection must trade off density...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.261714399

    authors: Zhou T,Carlson JM,Doyle J

    更新日期:2002-02-19 00:00:00

  • Human population dynamics in Europe over the Last Glacial Maximum.

    abstract::The severe cooling and the expansion of the ice sheets during the Last Glacial Maximum (LGM), 27,000-19,000 y ago (27-19 ky ago) had a major impact on plant and animal populations, including humans. Changes in human population size and range have affected our genetic evolution, and recent modeling efforts have reaffir...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.1503784112

    authors: Tallavaara M,Luoto M,Korhonen N,Järvinen H,Seppä H

    更新日期:2015-07-07 00:00:00

  • Evolution of consciousness: phylogeny, ontogeny, and emergence from general anesthesia.

    abstract::Are animals conscious? If so, when did consciousness evolve? We address these long-standing and essential questions using a modern neuroscientific approach that draws on diverse fields such as consciousness studies, evolutionary neurobiology, animal psychology, and anesthesiology. We propose that the stepwise emergenc...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.1301188110

    authors: Mashour GA,Alkire MT

    更新日期:2013-06-18 00:00:00

  • Apparent homology of expressed genes from wood-forming tissues of loblolly pine (Pinus taeda L.) with Arabidopsis thaliana.

    abstract::Pinus taeda L. (loblolly pine) and Arabidopsis thaliana differ greatly in form, ecological niche, evolutionary history, and genome size. Arabidopsis is a small, herbaceous, annual dicotyledon, whereas pines are large, long-lived, coniferous forest trees. Such diverse plants might be expected to differ in a large numbe...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.1132171100

    authors: Kirst M,Johnson AF,Baucom C,Ulrich E,Hubbard K,Staggs R,Paule C,Retzel E,Whetten R,Sederoff R

    更新日期:2003-06-10 00:00:00

  • Energy coupling in the lactose transport system of Escherichia coli.

    abstract::A mutant (ML 308-22) was isolated from Escherichia coli ML 308, which had lost the normal capacity to accumulate lactose analogs despite an increase in the membrane carrier activity. The exit of thiomethylgalactoside was much faster than normal, accounting for the inability of the cell to maintain high intracellular c...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.65.1.63

    authors: Wong PT,Kashket ER,Wilson TH

    更新日期:1970-01-01 00:00:00

  • Acidity across the interface from the ocean surface to sea spray aerosol.

    abstract::Aerosols impact climate, human health, and the chemistry of the atmosphere, and aerosol pH plays a major role in the physicochemical properties of the aerosol. However, there remains uncertainty as to whether aerosols are acidic, neutral, or basic. In this research, we show that the pH of freshly emitted (nascent) sea...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.2018397118

    authors: Angle KJ,Crocker DR,Simpson RMC,Mayer KJ,Garofalo LA,Moore AN,Mora Garcia SL,Or VW,Srinivasan S,Farhan M,Sauer JS,Lee C,Pothier MA,Farmer DK,Martz TR,Bertram TH,Cappa CD,Prather KA,Grassian VH

    更新日期:2021-01-12 00:00:00

  • Conserved glycolipid termini in capsular polysaccharides synthesized by ATP-binding cassette transporter-dependent pathways in Gram-negative pathogens.

    abstract::Bacterial capsules are surface layers made of long-chain polysaccharides. They are anchored to the outer membrane of many Gram-negative bacteria, including pathogens such as Escherichia coli, Neisseria meningitidis, Haemophilus influenzae, and Pasteurella multocida. Capsules protect pathogens from host defenses includ...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.1222317110

    authors: Willis LM,Stupak J,Richards MR,Lowary TL,Li J,Whitfield C

    更新日期:2013-05-07 00:00:00

  • Functional organization of the cat's visual cortex after prenatal interruption of binocular interactions.

    abstract::The functional consequences of interrupting in utero binocular interactions were studied by recording from single cells in area 17 of adult cats that had one eye removed at least 2 wk before birth. In these animals all cortical neurons could be driven by the remaining eye, and in tangential microelectrode penetrations...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.82.11.3901

    authors: Shook BL,Maffei L,Chalupa LM

    更新日期:1985-06-01 00:00:00

  • Modeling early retinal development with human embryonic and induced pluripotent stem cells.

    abstract::Human pluripotent stem cells have the potential to provide comprehensive model systems for the earliest stages of human ontogenesis. To serve in this capacity, these cells must undergo a targeted, stepwise differentiation process that follows a normal developmental timeline. Here we demonstrate the ability of both hum...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.0905245106

    authors: Meyer JS,Shearer RL,Capowski EE,Wright LS,Wallace KA,McMillan EL,Zhang SC,Gamm DM

    更新日期:2009-09-29 00:00:00

  • Restricted Arp3 expression in the testis prevents blood-testis barrier disruption during junction restructuring at spermatogenesis.

    abstract::In epithelia, a primary damage of tight junctions (TJ) always leads to a secondary disruption of adherens junction (AJ), and vice versa. This response, if occurring in the testis, would disrupt spermatogenesis because the blood-testis barrier (BTB) must remain intact during the transit of spermatids in the seminiferou...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.1001823107

    authors: Lie PP,Chan AY,Mruk DD,Lee WM,Cheng CY

    更新日期:2010-06-22 00:00:00

  • Leptin promotes K(ATP) channel trafficking by AMPK signaling in pancreatic β-cells.

    abstract::Leptin is a pivotal regulator of energy and glucose homeostasis, and defects in leptin signaling result in obesity and diabetes. The ATP-sensitive potassium (K(ATP)) channels couple glucose metabolism to insulin secretion in pancreatic β-cells. In this study, we provide evidence that leptin modulates pancreatic β-cell...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.1216351110

    authors: Park SH,Ryu SY,Yu WJ,Han YE,Ji YS,Oh K,Sohn JW,Lim A,Jeon JP,Lee H,Lee KH,Lee SH,Berggren PO,Jeon JH,Ho WK

    更新日期:2013-07-30 00:00:00

  • Low-calorie diet prevents the development of mammary tumors in C3H mice and reduces circulating prolactin level, murine mammary tumor virus expression, and proliferation of mammary alveolar cells.

    abstract::The effect of carlorie intake on the development of spontaneous mammary tumors in virgin C3H mice was studied. Only about 10% of the mice fed a low-calorie diet [10 kcal/day (1 kcal = 4.184 kJ)] since weaning developed mammary tumors, compared to about 60% of those mice that were reared on high-calorie diets (16 kcal/...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.79.24.7758

    authors: Sarkar NH,Fernandes G,Telang NT,Kourides IA,Good RA

    更新日期:1982-12-01 00:00:00

  • Extranuclear estrogen receptor-alpha stimulates NeuroD1 binding to the insulin promoter and favors insulin synthesis.

    abstract::Estrogen receptors (ERs) protect pancreatic islet survival in mice through rapid extranuclear actions. ERalpha also enhances insulin synthesis in cultured islets. Whether ERalpha stimulates insulin synthesis in vivo and, if so, through which mechanism(s) remain largely unknown. To address these issues, we generated a ...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.0914501107

    authors: Wong WP,Tiano JP,Liu S,Hewitt SC,Le May C,Dalle S,Katzenellenbogen JA,Katzenellenbogen BS,Korach KS,Mauvais-Jarvis F

    更新日期:2010-07-20 00:00:00

  • Bovine protein C: amino acid sequence of the light chain.

    abstract::The amino acid sequence of the light chain of bovine protein C was determined by sequenator analysis of the carboxymethylated light chain and fragments obtained by cyanogen bromide treatment, tryptic digestion after blocking of lysine residues, and cleavage with 2-(2-nitrophenylsulfenyl)-3-methyl-3-bromoindolenine (BN...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.75.12.5889

    authors: Fernlund P,Stenflo J,Tufvesson A

    更新日期:1978-12-01 00:00:00

  • Induction of erythroid differentiation and modulation of gene expression by tiazofurin in K-562 leukemia cells.

    abstract::Tiazofurin (2-beta-D-ribofuranosyl-4-thiazole-carboxamide; NSC 286193), an antitumor carbon-linked nucleoside that inhibits IMP dehydrogenase (IMP:NAD+ oxidoreductase; EC 1.1.1.205) and depletes guanylate levels, can activate the erythroid differentiation program of K-562 human leukemia cells. Tiazofurin-mediated cell...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.85.17.6533

    authors: Olah E,Natsumeda Y,Ikegami T,Kote Z,Horanyi M,Szelenyi J,Paulik E,Kremmer T,Hollan SR,Sugar J

    更新日期:1988-09-01 00:00:00

  • Sinuous flow in metals.

    abstract::Annealed metals are surprisingly difficult to cut, involving high forces and an unusually thick "chip." This anomaly has long been explained, based on ex situ observations, using a model of smooth plastic flow with uniform shear to describe material removal by chip formation. Here we show that this phenomenon is actua...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.1509165112

    authors: Yeung H,Viswanathan K,Compton WD,Chandrasekar S

    更新日期:2015-08-11 00:00:00

  • Lipocalin-type prostaglandin D synthase/beta-trace is a major amyloid beta-chaperone in human cerebrospinal fluid.

    abstract::The conformational change in amyloid beta (Abeta) peptide from its monomeric form to aggregates is crucial in the pathogenesis of Alzheimer's disease (AD). In the healthy brain, some unidentified chaperones appear to prevent the aggregation of Abeta. Here we reported that lipocalin-type prostaglandin D synthase (L-PGD...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.0701585104

    authors: Kanekiyo T,Ban T,Aritake K,Huang ZL,Qu WM,Okazaki I,Mohri I,Murayama S,Ozono K,Taniike M,Goto Y,Urade Y

    更新日期:2007-04-10 00:00:00

  • The Vibrio cholerae O139 O-antigen polysaccharide is essential for Ca2+-dependent biofilm development in sea water.

    abstract::Vibrio cholerae is both an inhabitant of estuarine environments and the etiologic agent of the diarrheal disease cholera. Previous work has demonstrated that V. cholerae forms both an exopolysaccharide-dependent biofilm and a Ca2+-dependent biofilm. In this work, we demonstrate a role for the O-antigen polysaccharide ...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.2334614100

    authors: Kierek K,Watnick PI

    更新日期:2003-11-25 00:00:00

  • Cell density and mobility protect swarming bacteria against antibiotics.

    abstract::Swarming bacteria move in multicellular groups and exhibit adaptive resistance to multiple antibiotics. Analysis of this phenomenon has revealed the protective power of high cell densities to withstand exposure to otherwise lethal antibiotic concentrations. We find that high densities promote bacterial survival, even ...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.0910934107

    authors: Butler MT,Wang Q,Harshey RM

    更新日期:2010-02-23 00:00:00

  • Kinetic isotope effects in Ras-catalyzed GTP hydrolysis: evidence for a loose transition state.

    abstract::A remote labeling method has been developed to determine (18)O kinetic isotope effects (KIEs) in Ras-catalyzed GTP hydrolysis. Substrate mixtures consist of (13)C-depleted GTP and [(18)O,(13)C]GTP that contains (18)O at phosphoryl positions of mechanistic interest and (13)C at all carbon positions of the guanosine moi...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.0401675101

    authors: Du X,Black GE,Lecchi P,Abramson FP,Sprang SR

    更新日期:2004-06-15 00:00:00

  • Harm to others outweighs harm to self in moral decision making.

    abstract::Concern for the suffering of others is central to moral decision making. How humans evaluate others' suffering, relative to their own suffering, is unknown. We investigated this question by inviting subjects to trade off profits for themselves against pain experienced either by themselves or an anonymous other person....

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章,随机对照试验

    doi:10.1073/pnas.1408988111

    authors: Crockett MJ,Kurth-Nelson Z,Siegel JZ,Dayan P,Dolan RJ

    更新日期:2014-12-02 00:00:00

  • Linker histones H1 and H5 prevent the mobility of positioned nucleosomes.

    abstract::We have previously identified a generally occurring short-range mobility of nucleosome cores on DNA in relatively low ionic strength conditions. Here we report that this mobility of histone octamers positioned on constructs of 5S rDNA is suppressed by the binding of histone H1 or H5 to the nucleosome. Histone H5 is th...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.91.22.10275

    authors: Pennings S,Meersseman G,Bradbury EM

    更新日期:1994-10-25 00:00:00

  • In vivo evidence that erythropoietin protects neurons from ischemic damage.

    abstract::Erythropoietin (EPO) produced by the kidney and the liver (in fetuses) stimulates erythropoiesis. In the central nervous system, neurons express EPO receptor (EPOR) and astrocytes produce EPO. EPO has been shown to protect primary cultured neurons from N-methyl-D-aspartate (NMDA) receptor-mediated glutamate toxicity. ...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.95.8.4635

    authors: Sakanaka M,Wen TC,Matsuda S,Masuda S,Morishita E,Nagao M,Sasaki R

    更新日期:1998-04-14 00:00:00

  • Isolation of the tumor-inducing RNA from oncogenic and nononcogenic Agrobacterium tumefaciens.

    abstract::Two RNA fractions have been isolated and purified from both oncogenic and nononcogenic strains of Agrobacterium tumefaciens. Both RNAs are capable of inducing the formation of transplantable tumors when introduced at wound sites in stems of Datura stramonium plants. One of these RNA fractions was found to be bound to ...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.71.5.1585

    authors: Beljanski M,Aaron-da Cunha MI,Beljanski MS,Manigault P,Bourgarel P

    更新日期:1974-05-01 00:00:00

  • From the Cover: Directed, efficient, and versatile modifications of the Drosophila genome by genomic engineering.

    abstract::With the completion of genome sequences of major model organisms, increasingly sophisticated genetic tools are necessary for investigating the complex and coordinated functions of genes. Here we describe a genetic manipulation system termed "genomic engineering" in Drosophila. Genomic engineering is a 2-step process t...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.0900641106

    authors: Huang J,Zhou W,Dong W,Watson AM,Hong Y

    更新日期:2009-05-19 00:00:00

  • Transient inositol 1,4,5-trisphosphate-induced Ca2+ release: a model based on regulatory Ca(2+)-binding sites along the permeation pathway.

    abstract::A remarkable property of Ca2+ fluxes through the inositol 1,4,5-trisphosphate (InsP3)-gated Ca2+ channel is that successive increments of InsP3 induce repeated transient release of accumulated Ca2+. The initial aim of this study was to propose a model, based on hypotheses compatible with the current description of thi...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.91.21.10074

    authors: Swillens S,Combettes L,Champeil P

    更新日期:1994-10-11 00:00:00

  • Global regulatory logic for specification of an embryonic cell lineage.

    abstract::Explanation of a process of development must ultimately be couched in the terms of the genomic regulatory code. Specification of an embryonic cell lineage is driven by a network of interactions among genes encoding transcription factors. Here, we present the gene regulatory network (GRN) that directs the specification...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.0711220105

    authors: Oliveri P,Tu Q,Davidson EH

    更新日期:2008-04-22 00:00:00

  • GDF11 promotes osteogenesis as opposed to MSTN, and follistatin, a MSTN/GDF11 inhibitor, increases muscle mass but weakens bone.

    abstract::Growth and differentiation factor 11 (GDF11) and myostatin (MSTN) are closely related transforming growth factor β (TGF-β) family members, but their biological functions are quite distinct. While MSTN has been widely shown to inhibit muscle growth, GDF11 regulates skeletal patterning and organ development during embry...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.1916034117

    authors: Suh J,Kim NK,Lee SH,Eom JH,Lee Y,Park JC,Woo KM,Baek JH,Kim JE,Ryoo HM,Lee SJ,Lee YS

    更新日期:2020-03-03 00:00:00