Characterization of deep neural network features by decodability from human brain activity.

Abstract:

:Achievements of near human-level performance in object recognition by deep neural networks (DNNs) have triggered a flood of comparative studies between the brain and DNNs. Using a DNN as a proxy for hierarchical visual representations, our recent study found that human brain activity patterns measured by functional magnetic resonance imaging (fMRI) can be decoded (translated) into DNN feature values given the same inputs. However, not all DNN features are equally decoded, indicating a gap between the DNN and human vision. Here, we present a dataset derived from DNN feature decoding analyses, which includes fMRI signals of five human subjects during image viewing, decoded feature values of DNNs (AlexNet and VGG19), and decoding accuracies of individual DNN features with their rankings. The decoding accuracies of individual features were highly correlated between subjects, suggesting the systematic differences between the brain and DNNs. We hope the present dataset will contribute to revealing the gap between the brain and DNNs and provide an opportunity to make use of the decoded features for further applications.

journal_name

Sci Data

journal_title

Scientific data

authors

Horikawa T,Aoki SC,Tsukamoto M,Kamitani Y

doi

10.1038/sdata.2019.12

subject

Has Abstract

pub_date

2019-02-12 00:00:00

pages

190012

issn

2052-4463

pii

sdata201912

journal_volume

6

pub_type

  • A lake data set for the Tibetan Plateau from the 1960s, 2005, and 2014.

    abstract::Long-term datasets of number and size of lakes over the Tibetan Plateau (TP) are among the most critical components for better understanding the interactions among the cryosphere, hydrosphere, and atmosphere at regional and global scales. Due to the harsh environment and the scarcity of data over the TP, data accumula...

    journal_title:Scientific data

    pub_type: 杂志文章

    doi:10.1038/sdata.2016.39

    authors: Wan W,Long D,Hong Y,Ma Y,Yuan Y,Xiao P,Duan H,Han Z,Gu X

    更新日期:2016-06-21 00:00:00

  • Large-scale modeled contemporary and future water temperature estimates for 10774 Midwestern U.S. Lakes.

    abstract::Climate change has already influenced lake temperatures globally, but understanding future change is challenging. The response of lakes to changing climate drivers is complex due to the nature of lake-atmosphere coupling, ice cover, and stratification. To better understand the diversity of lake responses to climate ch...

    journal_title:Scientific data

    pub_type: 杂志文章

    doi:10.1038/sdata.2017.53

    authors: Winslow LA,Hansen GJA,Read JS,Notaro M

    更新日期:2017-04-25 00:00:00

  • The systematic identification of cytoskeletal genes required for Drosophila melanogaster muscle maintenance.

    abstract::Animal muscles must maintain their function and structure while bearing substantial mechanical loads. How muscles withstand persistent mechanical strain is presently not well understood. Understanding the mechanisms by which tissues maintain their complex architecture is a key goal of cell biology. This dataset repres...

    journal_title:Scientific data

    pub_type: 杂志文章

    doi:10.1038/sdata.2014.2

    authors: Perkins AD,Lee MJ,Tanentzapf G

    更新日期:2014-03-11 00:00:00

  • Facial model collection for medical augmented reality in oncologic cranio-maxillofacial surgery.

    abstract::Medical augmented reality (AR) is an increasingly important topic in many medical fields. AR enables x-ray vision to see through real world objects. In medicine, this offers pre-, intra- or post-interventional visualization of "hidden" structures. In contrast to a classical monitor view, AR applications provide visual...

    journal_title:Scientific data

    pub_type: 杂志文章

    doi:10.1038/s41597-019-0327-8

    authors: Gsaxner C,Wallner J,Chen X,Zemann W,Egger J

    更新日期:2019-12-09 00:00:00

  • Quantitative mapping of RNA-mediated nuclear estrogen receptor β interactome in human breast cancer cells.

    abstract::The nuclear receptor estrogen receptor 2 (ESR2, ERβ) modulates cancer cell proliferation and tumor growth, exerting an oncosuppressive role in breast cancer (BC). Interaction proteomics by tandem affinity purification coupled to mass spectrometry was previously applied in BC cells to identify proteins acting in concer...

    journal_title:Scientific data

    pub_type: 杂志文章

    doi:10.1038/sdata.2018.31

    authors: Giurato G,Nassa G,Salvati A,Alexandrova E,Rizzo F,Nyman TA,Weisz A,Tarallo R

    更新日期:2018-03-06 00:00:00

  • flEECe, an energy use and occupant behavior dataset for net-zero energy affordable senior residential buildings.

    abstract::The behaviors of building occupants have continued to perplex scholars for years in our attempts to develop models for energy efficient housing. Building simulations, project delivery approaches, policies, and more have fell short of their optimistic goals due to the complexity of human behavior. As a part of a multip...

    journal_title:Scientific data

    pub_type: 杂志文章

    doi:10.1038/s41597-019-0275-3

    authors: Paige F,Agee P,Jazizadeh F

    更新日期:2019-11-26 00:00:00

  • The odonate phenotypic database, a new open data resource for comparative studies of an old insect order.

    abstract::We present The Odonate Phenotypic Database (OPD): an online data resource of dragonfly and damselfly phenotypes (Insecta: Odonata). Odonata is a relatively small insect order that currently consists of about 6400 species belonging to 32 families. The database consists of multiple morphological, life-history and behavi...

    journal_title:Scientific data

    pub_type: 杂志文章

    doi:10.1038/s41597-019-0318-9

    authors: Waller JT,Willink B,Tschol M,Svensson EI

    更新日期:2019-12-12 00:00:00

  • A dataset of distribution and diversity of ticks in China.

    abstract::While tick-borne zoonoses, such as Lyme disease and tick-borne encephalitis, present an increasing global concern, knowledge of their vectors' distribution remains limited, especially for China. In this paper, we present the first comprehensive dataset of known tick species and their distributions in China, derived fr...

    journal_title:Scientific data

    pub_type: 杂志文章

    doi:10.1038/s41597-019-0115-5

    authors: Zhang G,Zheng D,Tian Y,Li S

    更新日期:2019-07-01 00:00:00

  • Arbovirus emergence in the temperate city of Córdoba, Argentina, 2009-2018.

    abstract::The distribution of arbovirus disease transmission is expanding from the tropics and subtropics into temperate regions worldwide. The temperate city of Córdoba, Argentina has been experiencing the emergence of dengue virus, transmitted by the mosquito Aedes aegypti, since 2009, when autochthonous transmission of the v...

    journal_title:Scientific data

    pub_type: 杂志文章

    doi:10.1038/s41597-019-0295-z

    authors: Robert MA,Tinunin DT,Benitez EM,Ludueña-Almeida FF,Romero M,Stewart-Ibarra AM,Estallo EL

    更新日期:2019-11-21 00:00:00

  • Very high resolution, altitude-corrected, TMPA-based monthly satellite precipitation product over the CONUS.

    abstract::The Tropical Rainfall Measuring Mission (TRMM) Multisatellite Precipitation Analysis (TMPA) product provided over 17 years of gridded precipitation datasets. However, the accuracy and spatial resolution of TMPA limits the applicability in hydrometeorological applications. We present a dataset that enhances the accurac...

    journal_title:Scientific data

    pub_type: 杂志文章

    doi:10.1038/s41597-020-0411-0

    authors: Hashemi H,Fayne J,Lakshmi V,Huffman GJ

    更新日期:2020-03-03 00:00:00

  • A high-content image-based drug screen of clinical compounds against cell transmission of adenovirus.

    abstract::Human adenoviruses (HAdVs) are fatal to immuno-suppressed individuals, but no effective anti-HAdV therapy is available. Here, we present a novel image-based high-throughput screening (HTS) platform, which scores the full viral replication cycle from virus entry to dissemination of progeny and second-round infections. ...

    journal_title:Scientific data

    pub_type: 杂志文章

    doi:10.1038/s41597-020-00604-0

    authors: Georgi F,Kuttler F,Murer L,Andriasyan V,Witte R,Yakimovich A,Turcatti G,Greber UF

    更新日期:2020-08-12 00:00:00

  • An annotated fluorescence image dataset for training nuclear segmentation methods.

    abstract::Fully-automated nuclear image segmentation is the prerequisite to ensure statistically significant, quantitative analyses of tissue preparations,applied in digital pathology or quantitative microscopy. The design of segmentation methods that work independently of the tissue type or preparation is complex, due to varia...

    journal_title:Scientific data

    pub_type: 杂志文章

    doi:10.1038/s41597-020-00608-w

    authors: Kromp F,Bozsaky E,Rifatbegovic F,Fischer L,Ambros M,Berneder M,Weiss T,Lazic D,Dörr W,Hanbury A,Beiske K,Ambros PF,Ambros IM,Taschner-Mandl S

    更新日期:2020-08-11 00:00:00

  • Whole genome characterization of sequence diversity of 15,220 Icelanders.

    abstract::Understanding of sequence diversity is the cornerstone of analysis of genetic disorders, population genetics, and evolutionary biology. Here, we present an update of our sequencing set to 15,220 Icelanders who we sequenced to an average genome-wide coverage of 34X. We identified 39,020,168 autosomal variants passing G...

    journal_title:Scientific data

    pub_type: 杂志文章

    doi:10.1038/sdata.2017.115

    authors: Jónsson H,Sulem P,Kehr B,Kristmundsdottir S,Zink F,Hjartarson E,Hardarson MT,Hjorleifsson KE,Eggertsson HP,Gudjonsson SA,Ward LD,Arnadottir GA,Helgason EA,Helgason H,Gylfason A,Jonasdottir A,Jonasdottir A,Rafnar T,Bes

    更新日期:2017-09-21 00:00:00

  • A structured open dataset of government interventions in response to COVID-19.

    abstract::In response to the COVID-19 pandemic, governments have implemented a wide range of non-pharmaceutical interventions (NPIs). Monitoring and documenting government strategies during the COVID-19 crisis is crucial to understand the progression of the epidemic. Following a content analysis strategy of existing public info...

    journal_title:Scientific data

    pub_type: 杂志文章

    doi:10.1038/s41597-020-00609-9

    authors: Desvars-Larrive A,Dervic E,Haug N,Niederkrotenthaler T,Chen J,Di Natale A,Lasser J,Gliga DS,Roux A,Sorger J,Chakraborty A,Ten A,Dervic A,Pacheco A,Jurczak A,Cserjan D,Lederhilger D,Bulska D,Berishaj D,Tames EF,Álv

    更新日期:2020-08-27 00:00:00

  • Genotoype-by-sequencing of three geographically distinct populations of Olympia oysters, Ostrea lurida.

    abstract::Olympia oysters are found along the west coast of North America and as the only native oyster species in the region, receive considerable attention with regard to restoration and conservation. Knowledge of genetic structure of this species is essential for resource managers. Here we provide genetic data for three dist...

    journal_title:Scientific data

    pub_type: 杂志文章

    doi:10.1038/sdata.2017.130

    authors: White SJ,Vadopalas B,Silliman K,Roberts SB

    更新日期:2017-09-12 00:00:00

  • A microarray whole-genome gene expression dataset in a rat model of inflammatory corneal angiogenesis.

    abstract::In angiogenesis with concurrent inflammation, many pathways are activated, some linked to VEGF and others largely VEGF-independent. Pathways involving inflammatory mediators, chemokines, and micro-RNAs may play important roles in maintaining a pro-angiogenic environment or mediating angiogenic regression. Here, we des...

    journal_title:Scientific data

    pub_type: 杂志文章

    doi:10.1038/sdata.2016.103

    authors: Mukwaya A,Lindvall JM,Xeroudaki M,Peebo B,Ali Z,Lennikov A,Jensen LD,Lagali N

    更新日期:2016-11-22 00:00:00

  • A functional trait database for Mediterranean Basin plants.

    abstract::Functional trait databases are emerging as crucial tools for a wide range of ecological studies across the world. Here, we provide a database of functional traits for vascular plant species of the Mediterranean Basin. The database includes 25,764 individual records of 44 traits from 2,457 plant taxa distributed in 119...

    journal_title:Scientific data

    pub_type: 杂志文章

    doi:10.1038/sdata.2018.135

    authors: Tavşanoğlu Ç,Pausas JG

    更新日期:2018-07-10 00:00:00

  • CU-BEMS, smart building electricity consumption and indoor environmental sensor datasets.

    abstract::This paper describes the release of the detailed building operation data, including electricity consumption and indoor environmental measurements, of the seven-story 11,700-m2 office building located in Bangkok, Thailand. The electricity consumption data (kW) are that of individual air conditioning units, lighting, an...

    journal_title:Scientific data

    pub_type: 杂志文章

    doi:10.1038/s41597-020-00582-3

    authors: Pipattanasomporn M,Chitalia G,Songsiri J,Aswakul C,Pora W,Suwankawin S,Audomvongseree K,Hoonchareon N

    更新日期:2020-07-20 00:00:00

  • Imaging and clinical data archive for head and neck squamous cell carcinoma patients treated with radiotherapy.

    abstract::Cross sectional imaging is essential for the patient-specific planning and delivery of radiotherapy, a primary determinant of head and neck cancer outcomes. Due to challenges ensuring data quality and patient de-identification, publicly available datasets including diagnostic and radiation treatment planning imaging a...

    journal_title:Scientific data

    pub_type: 杂志文章

    doi:10.1038/sdata.2018.173

    authors: Grossberg AJ,Mohamed ASR,Elhalawani H,Bennett WC,Smith KE,Nolan TS,Williams B,Chamchod S,Heukelom J,Kantor ME,Browne T,Hutcheson KA,Gunn GB,Garden AS,Morrison WH,Frank SJ,Rosenthal DI,Freymann JB,Fuller CD

    更新日期:2018-09-04 00:00:00

  • MIMIC-CXR, a de-identified publicly available database of chest radiographs with free-text reports.

    abstract::Chest radiography is an extremely powerful imaging modality, allowing for a detailed inspection of a patient's chest, but requires specialized training for proper interpretation. With the advent of high performance general purpose computer vision algorithms, the accurate automated analysis of chest radiographs is beco...

    journal_title:Scientific data

    pub_type: 杂志文章

    doi:10.1038/s41597-019-0322-0

    authors: Johnson AEW,Pollard TJ,Berkowitz SJ,Greenbaum NR,Lungren MP,Deng CY,Mark RG,Horng S

    更新日期:2019-12-12 00:00:00

  • Genome-wide siRNA screen of genes regulating the LPS-induced TNF-α response in human macrophages.

    abstract::The mammalian innate immune system senses many bacterial stimuli through the toll-like receptor (TLR) family. Activation of the TLR4 receptor by bacterial lipopolysaccharide (LPS) is the most widely studied TLR pathway due to its central role in host responses to gram-negative bacterial infection and its contribution ...

    journal_title:Scientific data

    pub_type: 杂志文章

    doi:10.1038/sdata.2017.7

    authors: Sun J,Katz S,Dutta B,Wang Z,Fraser ID

    更新日期:2017-03-01 00:00:00

  • High resolution multi-facies realizations of sedimentary reservoir and aquifer analogs.

    abstract::Geological structures are by nature inaccessible to direct observation. This can cause difficulties in applications where a spatially explicit representation of such structures is required, in particular when modelling fluid migration in geological formations. An increasing trend in recent years has been to use analog...

    journal_title:Scientific data

    pub_type: 杂志文章

    doi:10.1038/sdata.2015.33

    authors: Bayer P,Comunian A,Höyng D,Mariethoz G

    更新日期:2015-07-07 00:00:00

  • A catalogue of 863 Rett-syndrome-causing MECP2 mutations and lessons learned from data integration.

    abstract::Rett syndrome (RTT) is a rare neurological disorder mostly caused by a genetic variation in MECP2. Making new MECP2 variants and the related phenotypes available provides data for better understanding of disease mechanisms and faster identification of variants for diagnosis. This is, however, currently hampered by the...

    journal_title:Scientific data

    pub_type: 杂志文章

    doi:10.1038/s41597-020-00794-7

    authors: Ehrhart F,Jacobsen A,Rigau M,Bosio M,Kaliyaperumal R,Laros JFJ,Willighagen EL,Valencia A,Roos M,Capella-Gutierrez S,Curfs LMG,Evelo CT

    更新日期:2021-01-15 00:00:00

  • Flow cytometry analysis of adrenoceptors expression in human adipose-derived mesenchymal stem/stromal cells.

    abstract::Mesenchymal stem/stromal cells (MSCs) were identified in most tissues of an adult organism. MSCs mediate physiological renewal, as well as regulation of tissue homeostasis, reparation and regeneration. Functions of MSCs are regulated by endocrine and neuronal signals, and noradrenaline is one of the most important MSC...

    journal_title:Scientific data

    pub_type: 杂志文章

    doi:10.1038/sdata.2018.196

    authors: Tyurin-Kuzmin PA,Dyikanov DT,Fadeeva JI,Sysoeva VY,Kalinina NI

    更新日期:2018-10-02 00:00:00

  • High-throughput RNAi screen for essential genes and drug synergistic combinations in colorectal cancer.

    abstract::Metastatic colorectal cancer is a leading cause of cancer death. However, current therapy options are limited to chemotherapy, with the addition of anti-EGFR antibodies for patients with RAS wild-type tumours. Novel drug targets, or drug combinations that induce a synergistic response, would be of great benefit to pat...

    journal_title:Scientific data

    pub_type: 杂志文章

    doi:10.1038/sdata.2017.139

    authors: Williams SP,Barthorpe AS,Lightfoot H,Garnett MJ,McDermott U

    更新日期:2017-10-03 00:00:00

  • Fractionation of parietal function in bistable perception probed with concurrent TMS-EEG.

    abstract::When visual input has conflicting interpretations, conscious perception can alternate spontaneously between these possible interpretations. This is called bistable perception. Previous neuroimaging studies have indicated the involvement of two right parietal areas in resolving perceptual ambiguity (ant-SPLr and post-S...

    journal_title:Scientific data

    pub_type: 杂志文章

    doi:10.1038/sdata.2016.65

    authors: Schauer G,Chang A,Schwartzman D,Rae CL,Iriye H,Seth AK,Kanai R

    更新日期:2016-08-16 00:00:00

  • Spatial data of Ixodes ricinus instar abundance and nymph pathogen prevalence, Scandinavia, 2016-2017.

    abstract::Ticks carry pathogens that can cause disease in both animals and humans, and there is a need to monitor the distribution and abundance of ticks and the pathogens they carry to pinpoint potential high risk areas for tick-borne disease transmission. In a joint Scandinavian study, we measured Ixodes ricinus instar abunda...

    journal_title:Scientific data

    pub_type: 杂志文章

    doi:10.1038/s41597-020-00579-y

    authors: Kjær LJ,Klitgaard K,Soleng A,Edgar KS,Lindstedt HEH,Paulsen KM,Andreassen ÅK,Korslund L,Kjelland V,Slettan A,Stuen S,Kjellander P,Christensson M,Teräväinen M,Baum A,Jensen LM,Bødker R

    更新日期:2020-07-16 00:00:00

  • Two-colour serial femtosecond crystallography dataset from gadoteridol-derivatized lysozyme for MAD phasing.

    abstract::We provide a detailed description of a gadoteridol-derivatized lysozyme (gadolinium lysozyme) two-colour serial femtosecond crystallography (SFX) dataset for multiple wavelength anomalous dispersion (MAD) structure determination. The data was collected at the Spring-8 Angstrom Compact free-electron LAser (SACLA) facil...

    journal_title:Scientific data

    pub_type: 杂志文章

    doi:10.1038/sdata.2017.188

    authors: Gorel A,Motomura K,Fukuzawa H,Doak RB,Grünbein ML,Hilpert M,Inoue I,Kloos M,Nass Kovács G,Nango E,Nass K,Roome CM,Shoeman RL,Tanaka R,Tono K,Foucar L,Joti Y,Yabashi M,Iwata S,Ueda K,Barends TRM,Schlichting I

    更新日期:2017-12-12 00:00:00

  • Paired rRNA-depleted and polyA-selected RNA sequencing data and supporting multi-omics data from human T cells.

    abstract::Both poly(A) enrichment and ribosomal RNA depletion are commonly used for RNA sequencing. Either has its advantages and disadvantages that may lead to biases in the downstream analyses. To better access these effects, we carried out both ribosomal RNA-depleted and poly(A)-selected RNA-seq for CD4+ T naive cells isolat...

    journal_title:Scientific data

    pub_type: 杂志文章

    doi:10.1038/s41597-020-00719-4

    authors: Chen L,Yang R,Kwan T,Tang C,Watt S,Zhang Y,Bourque G,Ge B,Downes K,Frontini M,Ouwehand WH,Lin JW,Soranzo N,Pastinen T,Chen L

    更新日期:2020-11-09 00:00:00

  • Genome-wide identification of accessible chromatin regions in bumblebee by ATAC-seq.

    abstract::Bumblebees (Hymenoptera: Apidae) are important pollinating insects that play pivotal roles in crop production and natural ecosystem services. Although protein-coding genes in bumblebees have been extensively annotated, regulatory sequences of the genome, such as promoters and enhancers, have been poorly annotated. To ...

    journal_title:Scientific data

    pub_type: 杂志文章

    doi:10.1038/s41597-020-00713-w

    authors: Zhao X,Su L,Xu W,Schaack S,Sun C

    更新日期:2020-10-26 00:00:00