An empirical analysis of journal policy effectiveness for computational reproducibility.

Abstract:

:A key component of scientific communication is sufficient information for other researchers in the field to reproduce published findings. For computational and data-enabled research, this has often been interpreted to mean making available the raw data from which results were generated, the computer code that generated the findings, and any additional information needed such as workflows and input parameters. Many journals are revising author guidelines to include data and code availability. This work evaluates the effectiveness of journal policy that requires the data and code necessary for reproducibility be made available postpublication by the authors upon request. We assess the effectiveness of such a policy by (i) requesting data and code from authors and (ii) attempting replication of the published findings. We chose a random sample of 204 scientific papers published in the journal Science after the implementation of their policy in February 2011. We found that we were able to obtain artifacts from 44% of our sample and were able to reproduce the findings for 26%. We find this policy-author remission of data and code postpublication upon request-an improvement over no policy, but currently insufficient for reproducibility.

authors

Stodden V,Seiler J,Ma Z

doi

10.1073/pnas.1708290115

subject

Has Abstract

pub_date

2018-03-13 00:00:00

pages

2584-2589

issue

11

eissn

0027-8424

issn

1091-6490

pii

1708290115

journal_volume

115

pub_type

杂志文章
  • Adeno-associated virus Rep proteins antagonize phosphatase PP1 to counteract KAP1 repression of the latent viral genome.

    abstract::Adeno-associated virus (AAV) is a small human Dependovirus whose low immunogenicity and capacity for long-term persistence have led to its widespread use as vector for gene therapy. Despite great recent successes in AAV-based gene therapy, further improvements in vector technology may be hindered by an inadequate unde...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.1721883115

    authors: Smith-Moore S,Neil SJD,Fraefel C,Linden RM,Bollen M,Rowe HM,Henckaerts E

    更新日期:2018-04-10 00:00:00

  • Stability of plant immune-receptor resistance proteins is controlled by SKP1-CULLIN1-F-box (SCF)-mediated protein degradation.

    abstract::The nucleotide-binding domain and leucine-rich repeats containing proteins (NLRs) serve as immune receptors in both plants and animals. Overaccumulation of NLRs often leads to autoimmune responses, suggesting that the levels of these immune receptors must be tightly controlled. However, the mechanism by which NLR prot...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.1105685108

    authors: Cheng YT,Li Y,Huang S,Huang Y,Dong X,Zhang Y,Li X

    更新日期:2011-08-30 00:00:00

  • Impaired apoptosis, extended duration of immune responses, and a lupus-like autoimmune disease in IEX-1-transgenic mice.

    abstract::Susceptibility of activated T cells to apoptosis must be tightly regulated to ensure sufficient T cell progeny for an effective response, while allowing a rapid depletion of them at the end of the immune response. We show here that a previously isolated, NF-kappa B/rel target gene IEX-1 (Immediate Early response gene ...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.022326699

    authors: Zhang Y,Schlossman SF,Edwards RA,Ou CN,Gu J,Wu MX

    更新日期:2002-01-22 00:00:00

  • Fixation and fate of C and N in the cyanobacterium Trichodesmium using nanometer-scale secondary ion mass spectrometry.

    abstract::The marine cyanobacterium Trichodesmium is ubiquitous in tropical and subtropical seas and is an important contributor to global N and C cycling. We sought to characterize metabolic uptake patterns in individual Trichodesmium IMS-101 cells by quantitatively imaging (13)C and (15)N uptake with high-resolution secondary...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.0810547106

    authors: Finzi-Hart JA,Pett-Ridge J,Weber PK,Popa R,Fallon SJ,Gunderson T,Hutcheon ID,Nealson KH,Capone DG

    更新日期:2009-04-14 00:00:00

  • Deficiency of carbohydrate response element-binding protein (ChREBP) reduces lipogenesis as well as glycolysis.

    abstract::The liver provides for long-term energy needs of the body by converting excess carbohydrate into fat for storage. Insulin is one factor that promotes hepatic lipogenesis, but there is increasing evidence that glucose also contributes to the coordinated regulation of carbohydrate and fat metabolism in liver by mechanis...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.0401516101

    authors: Iizuka K,Bruick RK,Liang G,Horton JD,Uyeda K

    更新日期:2004-05-11 00:00:00

  • Insulin receptors in human circulating cells and fibroblasts.

    abstract::Human lymphocytes obtained from fasted adult subjects and cultured human tumor lymphocytes were investigated for specific insulin receptors. By use of monoiodoinsulin, specific insulin binding sites were demonstrated in peripheral human lymphocytes, cultured human lymphocytes, and in other types of human circulating c...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.69.3.747

    authors: Gavin JR 3rd,Roth J,Jen P,Freychet P

    更新日期:1972-03-01 00:00:00

  • Asymmetric phosphorylation through catalytic P(III) phosphoramidite transfer: enantioselective synthesis of D-myo-inositol-6-phosphate.

    abstract::Despite the ubiquitous use of phosphoramidite chemistry in the synthesis of biophosphates, catalytic asymmetric phosphoramidite transfer remains largely unexplored for phosphate ester synthesis. We have discovered that a tetrazole-functionalized peptide, in the presence of 10-Å molecular sieves, functions as an enanti...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.1001111107

    authors: Jordan PA,Kayser-Bricker KJ,Miller SJ

    更新日期:2010-11-30 00:00:00

  • Unanticipated regulatory roles for Arabidopsis phytochromes revealed by null mutant analysis.

    abstract::In view of the extensive literature on phytochrome mutants in the Ler accession of Arabidopsis, we sought to secure a phytochrome-null line in the same genetic background for comparative studies. Here we report the isolation and phenotypic characterization of phyABCDE quintuple and phyABDE quadruple mutants in the Ler...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.1221738110

    authors: Hu W,Franklin KA,Sharrock RA,Jones MA,Harmer SL,Lagarias JC

    更新日期:2013-01-22 00:00:00

  • Two contemporaneous mitogenomes from terminal Pleistocene burials in eastern Beringia.

    abstract::Pleistocene residential sites with multiple contemporaneous human burials are extremely rare in the Americas. We report mitochondrial genomic variation in the first multiple mitochondrial genomes from a single prehistoric population: two infant burials (USR1 and USR2) from a common interment at the Upward Sun River Si...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 历史文章,杂志文章

    doi:10.1073/pnas.1511903112

    authors: Tackney JC,Potter BA,Raff J,Powers M,Watkins WS,Warner D,Reuther JD,Irish JD,O'Rourke DH

    更新日期:2015-11-10 00:00:00

  • Genetic dissection of histone deacetylase requirement in tumor cells.

    abstract::Histone deacetylase inhibitors (HDACi) represent a new group of drugs currently being tested in a wide variety of clinical applications. They are especially effective in preclinical models of cancer where they show antiproliferative action in many different types of cancer cells. Recently, the first HDACi was approved...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.0903139106

    authors: Haberland M,Johnson A,Mokalled MH,Montgomery RL,Olson EN

    更新日期:2009-05-12 00:00:00

  • Regulation of inflammatory responses by dynamic subcellular localization of RNA-binding protein Arid5a.

    abstract::Adenine-thymine (AT)-rich interactive domain 5a (Arid5a) is an RNA-binding protein found in the cytoplasm and nucleus of normally growing cells. Although Arid5a is known to play an important role in immune regulation, whether and how Arid5a subcellular localization impacts immune regulation has remained unclear. In th...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.1719921115

    authors: Higa M,Oka M,Fujihara Y,Masuda K,Yoneda Y,Kishimoto T

    更新日期:2018-02-06 00:00:00

  • Thy-1: a differentiation marker of potential mammary myoepithelial cells in vitro.

    abstract::The rat mammary cell line Rama 25 [Bennett, D.C., Peachey, L.A., Durbin, H. & Rudland, P.S. (1978) Cell 15, 283--298] differentiates morphologically in vitro from a cuboidal form to a fusiform cell resembling myoepithelial cells. This differentiation occurs in all clonal isolates of the line. By using three different ...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.75.12.6093

    authors: Lennon VA,Unger M,Dulbecco R

    更新日期:1978-12-01 00:00:00

  • rRNA complementarity within mRNAs: a possible basis for mRNA-ribosome interactions and translational control.

    abstract::Our recent demonstration that many eukaryotic mRNAs contain sequences complementary to rRNA led to the hypothesis that these sequences might mediate specific interactions between mRNAs and ribosomes and thereby affect translation. In the present experiments, the ability of complementary sequences to bind to rRNA was i...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.95.21.12238

    authors: Tranque P,Hu MC,Edelman GM,Mauro VP

    更新日期:1998-10-13 00:00:00

  • Membrane lipid heterogeneity associated with acetylcholine receptor particle aggregates in Xenopus embryonic muscle cells.

    abstract::Filipin, digitonin, and saponin react with membrane cholesterol to produce unique membrane alterations (sterol-specific complexes) that are easily discernible in freeze-fracture replicas. We have treated both noninnervated and innervated Xenopus embryonic muscle cells in culture with these agents. Freeze-fracture of t...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.78.2.1278

    authors: Bridgman PC,Nakajima Y

    更新日期:1981-02-01 00:00:00

  • Tertiary structure of apolipoprotein A-I in nascent high-density lipoproteins.

    abstract::Understanding the function of high-density lipoprotein (HDL) requires detailed knowledge of the structure of its primary protein, apolipoprotein A-I (APOA1). However, APOA1 flexibility and HDL heterogeneity have confounded decades of efforts to determine high-resolution structures and consistent models. Here, molecula...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.1721181115

    authors: Pourmousa M,Song HD,He Y,Heinecke JW,Segrest JP,Pastor RW

    更新日期:2018-05-15 00:00:00

  • Promoter sequence of fibroin gene assigned by in vitro transcription system.

    abstract::We have shown that the silk fibroin gene from Bombyx mori is faithfully transcribed in an in vitro transcription system of the HeLa cell extract prepared by the method of Manley et al. [Manley, J. L., Fire, A., Cano, A., Sharp, P. A. & Gefter, M. L. (1980) Proc. Natl. Acad. Sci. USA 77, 3855-3859]. Using this system a...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.78.8.4838

    authors: Tsujimoto Y,Hirose S,Tsuda M,Suzuki Y

    更新日期:1981-08-01 00:00:00

  • Seminoma-derived Nagao isozyme is encoded by a germ-cell alkaline phosphatase gene.

    abstract::A full-length placental alkaline phosphatase (PLAP) cDNA was used to identify and clone the PLAP-like Nagao isozyme gene from human genomic libraries. The entire nucleotide sequence of the gene reveals the existence of 11 exons interrupted by 10 small introns (76-427 base pairs). Putative regulatory sequences have bee...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.85.9.3024

    authors: Millán JL,Manes T

    更新日期:1988-05-01 00:00:00

  • Expression and nuclear envelope localization of biologically active fusion glycoprotein gB of herpes simplex virus in mammalian cells using cloned DNA.

    abstract::Herpes simplex virus (HSV) is known to bud from the inner membrane of the nuclear envelope. The structural gene for the glycoprotein gB, which is essential for virus entry and cell fusion induced by HSV type 1, has been cloned in a transient expression vector containing the adenovirus major late promoter, tripartite l...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.84.16.5675

    authors: Ali MA,Butcher M,Ghosh HP

    更新日期:1987-08-01 00:00:00

  • Myofibrillogenesis visualized in living embryonic cardiomyocytes.

    abstract::Myofibril formation was visualized in cultured live cardiomyocytes that were transfected with plasmids expressing green fluorescent protein (GFP) linked to the Z-band protein, alpha-actinin. The expression of this fluorescent protein provided an in vivo label for structures containing alpha-actinin. The GFP-alpha-acti...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.94.17.9493

    authors: Dabiri GA,Turnacioglu KK,Sanger JM,Sanger JW

    更新日期:1997-08-19 00:00:00

  • Monkeypox virus evades antiviral CD4+ and CD8+ T cell responses by suppressing cognate T cell activation.

    abstract::Monkeypox virus (MPV) is a virulent human pathogen that has gained increased attention because of its potential use as a bioterrorism agent and inadvertent introduction into North America in 2003. The US outbreak also provided an important opportunity to study MPV-specific T cell immunity. Although MPV-specific CD4(+)...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.0800589105

    authors: Hammarlund E,Dasgupta A,Pinilla C,Norori P,Früh K,Slifka MK

    更新日期:2008-09-23 00:00:00

  • Local sources of retinoic acid coincide with retinoid-mediated transgene activity during embryonic development.

    abstract::We have assessed whether retinoic acid (RA) comes from local sources or is available widely to activate gene expression in embryos. We used an RA-responsive indicator cell line, L-C2A5, to localize RA sources. In these cells, an RA-sensitive promoter/lacZ reporter construct used previously by us to produce indicator t...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.90.14.6572

    authors: Colbert MC,Linney E,LaMantia AS

    更新日期:1993-07-15 00:00:00

  • Targeted overexpression of protein kinase C beta2 isoform in myocardium causes cardiomyopathy.

    abstract::Increased cardiovascular mortality occurs in diabetic patients with or without coronary artery disease and is attributed to the presence of diabetic cardiomyopathy. One potential mechanism is hyperglycemia that has been reported to activate protein kinase C (PKC), preferentially the beta isoform, which has been associ...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.94.17.9320

    authors: Wakasaki H,Koya D,Schoen FJ,Jirousek MR,Ways DK,Hoit BD,Walsh RA,King GL

    更新日期:1997-08-19 00:00:00

  • Sequences of the joining region genes for immunoglobulin heavy chains and their role in generation of antibody diversity.

    abstract::To assess the contribution to immunoglobulin heavy chain diversity made by recombination between variable region (VH) genes and joining region (JH) genes, we have determined the sequence of about 2000 nucleotides spanning the rearranged JH gene cluster associated with the VH gene expressed in plasmacytoma HPC76. The a...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.78.1.509

    authors: Gough NM,Bernard O

    更新日期:1981-01-01 00:00:00

  • A combinatorial model for the Macdonald polynomials.

    abstract::We introduce a polynomial C(mu)[Z; q, t], depending on a set of variables Z = z(1), z(2),..., a partition mu, and two extra parameters q, t. The definition of C(mu) involves a pair of statistics (maj(sigma, mu), inv(sigma, mu)) on words sigma of positive integers, and the coefficients of the z(i) are manifestly in N[q...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.0405567101

    authors: Haglund J

    更新日期:2004-11-16 00:00:00

  • Mouse model recapitulating human Fcγ receptor structural and functional diversity.

    abstract::The in vivo biological activities of IgG antibodies result from their bifunctional nature, in which antigen recognition by the Fab is coupled to the effector and immunomodulatory diversity found in the Fc domain. This diversity, resulting from both amino acid and glycan heterogeneity, is translated into cellular respo...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.1203954109

    authors: Smith P,DiLillo DJ,Bournazos S,Li F,Ravetch JV

    更新日期:2012-04-17 00:00:00

  • p53 as a target for cancer vaccines: recombinant canarypox virus vectors expressing p53 protect mice against lethal tumor cell challenge.

    abstract::The p53 protein is an attractive target for immunotherapy, because mutations in the p53 gene are the most common genetic alterations found in human tumors. These mutations result in high levels of p53 protein in the tumor cell, whereas the expression level of wild-type p53 in nonmalignant tissue is usually much lower....

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.93.10.4781

    authors: Roth J,Dittmer D,Rea D,Tartaglia J,Paoletti E,Levine AJ

    更新日期:1996-05-14 00:00:00

  • RNA-protein hybrid ribozymes that efficiently cleave any mRNA independently of the structure of the target RNA.

    abstract::Ribozyme activity in vivo depends on achieving high-level expression, intracellular stability, target colocalization, and cleavage site access. At present, target site selection is problematic because of unforeseeable secondary and tertiary RNA structures that prevent cleavage. To overcome this design obstacle, we wis...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.091411398

    authors: Warashina M,Kuwabara T,Kato Y,Sano M,Taira K

    更新日期:2001-05-08 00:00:00

  • gamma-Aminobutyric acid antagonists decrease junctional communication between L-horizontal cells of the retina.

    abstract::The antagonists of gamma-aminobutyric acid, bicuculline and picrotoxin, were found to narrow the receptive field profile of the large field horizontal cell (L1HC) in the turtle retina when added to the perfusion medium in micromolar concentrations. The coupling resistance between neighboring L1HCs was increased by bic...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.79.11.3671

    authors: Piccolino M,Neyton J,Witkovsky P,Gerschenfeld HM

    更新日期:1982-06-01 00:00:00

  • Biochemical stratagem for obligate parasitism of eukaryotic cells by Coxiella burnetii.

    abstract::Coxiella burnetti, the etiologic agent of Q fever, is an oligate intracellular parasite of eukaryotes. Unlike the majority of successful bacterial parasites, which escape the bactericidal environment of the phagolysosome by various means, C. burnetii multiplies only in the phagolysosome. In view of the relatively hars...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.78.5.3240

    authors: Hackstadt T,Williams JC

    更新日期:1981-05-01 00:00:00

  • Auxin inhibits stomatal development through MONOPTEROS repression of a mobile peptide gene STOMAGEN in mesophyll.

    abstract::Plants, as sessile organisms, must coordinate various physiological processes to adapt to ever-changing surrounding environments. Stomata, the epidermal pores facilitating gas and water exchange, play important roles in optimizing photosynthetic efficiency and adaptability. Stomatal development is under the control of...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.1400542111

    authors: Zhang JY,He SB,Li L,Yang HQ

    更新日期:2014-07-22 00:00:00