Scaling up behavioral science interventions in online education.

Abstract:

:Online education is rapidly expanding in response to rising demand for higher and continuing education, but many online students struggle to achieve their educational goals. Several behavioral science interventions have shown promise in raising student persistence and completion rates in a handful of courses, but evidence of their effectiveness across diverse educational contexts is limited. In this study, we test a set of established interventions over 2.5 y, with one-quarter million students, from nearly every country, across 247 online courses offered by Harvard, the Massachusetts Institute of Technology, and Stanford. We hypothesized that the interventions would produce medium-to-large effects as in prior studies, but this is not supported by our results. Instead, using an iterative scientific process of cyclically preregistering new hypotheses in between waves of data collection, we identified individual, contextual, and temporal conditions under which the interventions benefit students. Self-regulation interventions raised student engagement in the first few weeks but not final completion rates. Value-relevance interventions raised completion rates in developing countries to close the global achievement gap, but only in courses with a global gap. We found minimal evidence that state-of-the-art machine learning methods can forecast the occurrence of a global gap or learn effective individualized intervention policies. Scaling behavioral science interventions across various online learning contexts can reduce their average effectiveness by an order-of-magnitude. However, iterative scientific investigations can uncover what works where for whom.

authors

Kizilcec RF,Reich J,Yeomans M,Dann C,Brunskill E,Lopez G,Turkay S,Williams JJ,Tingley D

doi

10.1073/pnas.1921417117

subject

Has Abstract

pub_date

2020-06-30 00:00:00

pages

14900-14905

issue

26

eissn

0027-8424

issn

1091-6490

pii

1921417117

journal_volume

117

pub_type

杂志文章
  • CTR1 phosphorylates the central regulator EIN2 to control ethylene hormone signaling from the ER membrane to the nucleus in Arabidopsis.

    abstract::The gaseous phytohormone ethylene C(2)H(4) mediates numerous aspects of growth and development. Genetic analysis has identified a number of critical elements in ethylene signaling, but how these elements interact biochemically to transduce the signal from the ethylene receptor complex at the endoplasmic reticulum (ER)...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.1214848109

    authors: Ju C,Yoon GM,Shemansky JM,Lin DY,Ying ZI,Chang J,Garrett WM,Kessenbrock M,Groth G,Tucker ML,Cooper B,Kieber JJ,Chang C

    更新日期:2012-11-20 00:00:00

  • Allosteric regulation of an essential trypanosome polyamine biosynthetic enzyme by a catalytically dead homolog.

    abstract::African sleeping sickness is a fatal disease that is caused by the protozoan parasite Trypanosoma brucei. Polyamine biosynthesis is an essential pathway in the parasite and is a validated drug target for treatment of the disease. S-adenosylmethionine decarboxylase (AdoMetDC) catalyzes a key step in polyamine biosynthe...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.0701111104

    authors: Willert EK,Fitzpatrick R,Phillips MA

    更新日期:2007-05-15 00:00:00

  • Parathyroid hormone regulates 25-hydroxyvitamin D(3)-24-hydroxylase mRNA by altering its stability.

    abstract::The up-regulation of the 25-hydroxyvitamin D(3)-24-hydroxylase by 1,25-dihydroxyvitamin D(3) [1,25(OH)(2)D(3)] is well established and occurs at the transcriptional level through two vitamin D response elements in the promoter of the gene. However, the mechanism of down-regulation of the 24-hydroxylase by parathyroid ...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.241516798

    authors: Zierold C,Mings JA,DeLuca HF

    更新日期:2001-11-20 00:00:00

  • Molecular model of human tropoelastin and implications of associated mutations.

    abstract::Protein folding poses unique challenges for large, disordered proteins due to the low resolution of structural data accessible in experiment and on the basis of short time scales and limited sampling attainable in computation. Such molecules are uniquely suited to accelerated-sampling molecular dynamics algorithms due...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.1801205115

    authors: Tarakanova A,Yeo GC,Baldock C,Weiss AS,Buehler MJ

    更新日期:2018-07-10 00:00:00

  • Anabolic action of parathyroid hormone regulated by the β2-adrenergic receptor.

    abstract::Parathyroid hormone (PTH), the major calcium-regulating hormone, and norepinephrine (NE), the principal neurotransmitter of sympathetic nerves, regulate bone remodeling by activating distinct cell-surface G protein-coupled receptors in osteoblasts: the parathyroid hormone type 1 receptor (PTHR) and the β(2)-adrenergic...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.1109036109

    authors: Hanyu R,Wehbi VL,Hayata T,Moriya S,Feinstein TN,Ezura Y,Nagao M,Saita Y,Hemmi H,Notomi T,Nakamoto T,Schipani E,Takeda S,Kaneko K,Kurosawa H,Karsenty G,Kronenberg HM,Vilardaga JP,Noda M

    更新日期:2012-05-08 00:00:00

  • Action control is mediated by prefrontal BDNF and glucocorticoid receptor binding.

    abstract::Stressor exposure biases decision-making strategies from those based on the relationship between actions and their consequences to others restricted by stimulus-response associations. Chronic stressor exposure also desensitizes glucocorticoid receptors (GR) and diminishes motivation to acquire food reinforcement, alth...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.1208342109

    authors: Gourley SL,Swanson AM,Jacobs AM,Howell JL,Mo M,Dileone RJ,Koleske AJ,Taylor JR

    更新日期:2012-12-11 00:00:00

  • Structure and function of bacterial ribosomes. XI. Dependence of 50S ribosomal assembly on simultaneous assembly of 30S subunits.

    abstract::Some spectinomycin-resistant mutants of Escherichia coli are cold-sensitive. They are unable to assemble both 30S and 50S ribosomal subunits at low temperatures. They accumulate two kinds of incomplete particles, related to 30S and 50S subunits respectively. A single mutation, causing an alteration in a 30S ribosomal ...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.67.3.1440

    authors: Nashimoto H,Nomura M

    更新日期:1970-11-01 00:00:00

  • Evolution of antifreeze glycoprotein gene from a trypsinogen gene in Antarctic notothenioid fish.

    abstract::Freezing avoidance conferred by different types of antifreeze proteins in various polar and subpolar fishes represents a remarkable example of cold adaptation, but how these unique proteins arose is unknown. We have found that the antifreeze glycoproteins (AFGPs) of the predominant Antarctic fish taxon, the notothenio...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.94.8.3811

    authors: Chen L,DeVries AL,Cheng CH

    更新日期:1997-04-15 00:00:00

  • Influence of in vivo growth on human glioma cell line gene expression: convergent profiles under orthotopic conditions.

    abstract::Defining the molecules that regulate tumor cell survival is an essential prerequisite for the development of targeted approaches to cancer treatment. Whereas many studies aimed at identifying such targets use human tumor cells grown in vitro or as s.c. xenografts, it is unclear whether such experimental models replica...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.0502887102

    authors: Camphausen K,Purow B,Sproull M,Scott T,Ozawa T,Deen DF,Tofilon PJ

    更新日期:2005-06-07 00:00:00

  • Genetic contributions to white matter architecture revealed by diffusion tensor imaging in Williams syndrome.

    abstract::Little is known about genetic regulation of the development of white matter. This knowledge is critical in understanding the pathophysiology of neurodevelopmental syndromes associated with altered cognition as well as in elucidating the genetics of normal human cognition. The hemideletion of approximately 25 genes on ...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.0704311104

    authors: Marenco S,Siuta MA,Kippenhan JS,Grodofsky S,Chang WL,Kohn P,Mervis CB,Morris CA,Weinberger DR,Meyer-Lindenberg A,Pierpaoli C,Berman KF

    更新日期:2007-09-18 00:00:00

  • Translocation of synapsin I in response to depolarization of isolated nerve terminals.

    abstract::Depolarization of isolated nerve terminals (synaptosomes) has been shown to stimulate neurotransmitter release and to increase the phosphorylation state of a number of proteins, including synapsin I, in a Ca2+-dependent manner. Synapsin I, a prominent nerve terminal phosphoprotein, interacts with the cytoplasmic surfa...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.86.20.8108

    authors: Sihra TS,Wang JK,Gorelick FS,Greengard P

    更新日期:1989-10-01 00:00:00

  • Bromodomain 4 activation predicts breast cancer survival.

    abstract::Previous work identified the Rap1 GTPase-activating protein Sipa1 as a germ-line-encoded metastasis modifier. The bromodomain protein Brd4 physically interacts with and modulates the enzymatic activity of Sipa1. In vitro analysis of a highly metastatic mouse mammary tumor cell line ectopically expressing Brd4 demonstr...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.0710331105

    authors: Crawford NP,Alsarraj J,Lukes L,Walker RC,Officewala JS,Yang HH,Lee MP,Ozato K,Hunter KW

    更新日期:2008-04-29 00:00:00

  • Formation of junctions involved in excitation-contraction coupling in skeletal and cardiac muscle.

    abstract::During excitation-contraction (e-c) coupling of striated muscle, depolarization of the surface membrane is converted into Ca2+ release from internal stores. This process occurs at intracellular junctions characterized by a specialized composition and structural organization of membrane proteins. The coordinated arrang...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.93.15.8101

    authors: Flucher BE,Franzini-Armstrong C

    更新日期:1996-07-23 00:00:00

  • Functional screening identifies CRLF2 in precursor B-cell acute lymphoblastic leukemia.

    abstract::The prognosis for adults with precursor B-cell acute lymphoblastic leukemia (B-ALL) remains poor, in part from a lack of therapeutic targets. We identified the type I cytokine receptor subunit CRLF2 in a functional screen for B-ALL-derived mRNA transcripts that can substitute for IL3 signaling. We demonstrate that CRL...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.0911726107

    authors: Yoda A,Yoda Y,Chiaretti S,Bar-Natan M,Mani K,Rodig SJ,West N,Xiao Y,Brown JR,Mitsiades C,Sattler M,Kutok JL,DeAngelo DJ,Wadleigh M,Piciocchi A,Dal Cin P,Bradner JE,Griffin JD,Anderson KC,Stone RM,Ritz J,Foà R,

    更新日期:2010-01-05 00:00:00

  • Hormonal regulation of cytodifferentiation and intercellular communication in cultured granulosa cells.

    abstract::Granulosa cells from immature hypophysectomized diethylstilbestrol-treated rats displayed pronounced intracellular and intercellular changes after 48 hr of exposure to follicle-stimulating hormone (FSH) in vitro. As determined by light and electron microscopy, most of the FSH-treated cells became highly aggregated and...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.78.5.3000

    authors: Amsterdam A,Knecht M,Catt KJ

    更新日期:1981-05-01 00:00:00

  • Isolation and characterization of the gene coding for cytosolic phosphoenolpyruvate carboxykinase (GTP) from the rat.

    abstract::The gene for cytosolic phosphoenolpyruvate carboxykinase (GTP) [GTP:oxaloacetate carboxy-lyase (transphosphorylating), EC 4.1.1.32] from the rat was isolated from a recombinant library containing the rat genome in phage lambda Charon 4A. The isolated clone, lambda PCK1, contains the complete gene for phosphoenolpyruva...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.80.12.3656

    authors: Yoo-Warren H,Monahan JE,Short J,Short H,Bruzel A,Wynshaw-Boris A,Meisner HM,Samols D,Hanson RW

    更新日期:1983-06-01 00:00:00

  • A 170-kDa membrane-bound protease is associated with the expression of invasiveness by human malignant melanoma cells.

    abstract::Malignant spreading of cancer cells requires cell surface proteases that cleave the crosslinked collagenous matrix of connective tissues. From correlating the morphologically defined invasiveness of tumor cells with the presence of specific membrane-associated proteases, we have identified a malignant human melanoma c...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.87.21.8296

    authors: Aoyama A,Chen WT

    更新日期:1990-11-01 00:00:00

  • Early patterns of skill acquisition and immigrants' specialization in STEM careers.

    abstract::We provide empirical evidence of immigrants' specialization in skill acquisition well before entering the US labor market. Nationally representative datasets enable studying the academic trajectories of immigrant children, with a focus on high-school course-taking patterns and college major choice. Immigrant children ...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.1812041116

    authors: Rangel MA,Shi Y

    更新日期:2019-01-08 00:00:00

  • Probing the instabilities in the dynamics of helical fragments from mouse PrPC.

    abstract::The first step in the formation of the protease resistant form (PrPSc) of prion proteins involves a conformational transition of the monomeric cellular form of PrPC to a more stable aggregation prone state PrPC*. A search of PDBselect and Escherichia coli and yeast genomes shows that the exact pattern of charges in he...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.0404235101

    authors: Dima RI,Thirumalai D

    更新日期:2004-10-26 00:00:00

  • Temperature-sensitive tumorigenicity of cells transformed by a mutant of Moloney sarcoma virus.

    abstract::Normal rat kidney cells were nonproductively infected either with CP27, a mutant of Moloney sarcoma virus that is temperature-sensitive for maintenance of transformation, or with the parental wild-type virus. The nonproducer cells were inoculated into the tails of athymic nude mice that were subsequently incubated at ...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.77.3.1501

    authors: Klarlund JK,Forchhammer J

    更新日期:1980-03-01 00:00:00

  • Cytoskeletal reorganizations responsible for the phorbol ester-induced formation of cytoplasmic processes: possible involvement of intermediate filaments.

    abstract::The tumor promoter phorbol 12-myristate 13-acetate (PMA) induces characteristic reversible changes of cell shape in certain fibroblastic lines: motile lamellas are transformed into noncontractile narrow processes; simultaneously, the actin microfilament network of lamellas is locally disorganized. This reaction to PMA...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.87.5.1884

    authors: Bershadsky AD,Ivanova OY,Lyass LA,Pletyushkina OY,Vasiliev JM,Gelfand IM

    更新日期:1990-03-01 00:00:00

  • Outer membrane protein G: Engineering a quiet pore for biosensing.

    abstract::Bacterial outer membrane porins have a robust beta-barrel structure and therefore show potential for use as stochastic sensors based on single-molecule detection. The monomeric porin OmpG is especially attractive compared with multisubunit proteins because appropriate modifications of the pore can be easily achieved b...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.0711561105

    authors: Chen M,Khalid S,Sansom MS,Bayley H

    更新日期:2008-04-29 00:00:00

  • Transferrin-polycation conjugates as carriers for DNA uptake into cells.

    abstract::We have developed a high-efficiency nucleic acid delivery system that uses receptor-mediated endocytosis to carry DNA macromolecules into cells. We accomplished this by conjugating the iron-transport protein transferrin to polycations that bind nucleic acids. Human transferrin, as well as the chicken homologue conalbu...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.87.9.3410

    authors: Wagner E,Zenke M,Cotten M,Beug H,Birnstiel ML

    更新日期:1990-05-01 00:00:00

  • Probing the environment along the protein import pathways in yeast mitochondria by site-specific photocrosslinking.

    abstract::Artificially aminoacylated suppressor tRNAs were used to introduce photoreactive amino acids into model mitochondrial precursor proteins to probe the environment along the protein import pathway. Amino acids with benzophenone side chains of various lengths [DL-2-amino-3-(p-benzoylphenyl)propanoic acid (1) and DL-2-ami...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.94.2.485

    authors: Kanamori T,Nishikawa S,Shin I,Schultz PG,Endo T

    更新日期:1997-01-21 00:00:00

  • Maternal transmission, sex ratio distortion, and mitochondria.

    abstract::In virtually all multicellular eukaryotes, mitochondria are transmitted exclusively through one parent, usually the mother. In this short review, we discuss some of the major consequences of uniparental transmission of mitochondria, including deleterious effects in males and selection for increased transmission throug...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章,评审

    doi:10.1073/pnas.1421391112

    authors: Perlman SJ,Hodson CN,Hamilton PT,Opit GP,Gowen BE

    更新日期:2015-08-18 00:00:00

  • The gene for the neuropeptide gonadotropin-releasing hormone is expressed in the mammary gland of lactating rats.

    abstract::The high concentration of gonadotropin-releasing hormone (GnRH) in milk of several species implies that the mammary gland is either a site of synthesis for this neuropeptide or that it is efficiently concentrated from plasma by this organ. By PCR amplification of mammary gland cDNA, we have demonstrated expression of ...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.91.11.4994

    authors: Palmon A,Ben Aroya N,Tel-Or S,Burstein Y,Fridkin M,Koch Y

    更新日期:1994-05-24 00:00:00

  • ATF6alpha-Rheb-mTOR signaling promotes survival of dormant tumor cells in vivo.

    abstract::The pathways that allow quiescent disseminated cancer cells to survive during prolonged dormancy periods are unknown. Here, we identify the transcription factor ATF6alpha as a pivotal survival factor for quiescent but not proliferative squamous carcinoma cells. ATF6alpha is essential for the adaptation of dormant cell...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.0800939105

    authors: Schewe DM,Aguirre-Ghiso JA

    更新日期:2008-07-29 00:00:00

  • Elevated spontaneous mutation rate in Bloom syndrome fibroblasts.

    abstract::The rates of spontaneous mutation to 6-thioguanine resistance were determined in fibroblasts derived from normal and two Bloom syndrome individuals (GM 2548 and GM 1492). Two methods were utilized to determine the rates. Method I obtained the spontaneous mutation rate from the increase in the mutation frequency of a c...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.78.5.3133

    authors: Warren ST,Schultz RA,Chang CC,Wade MH,Trosko JE

    更新日期:1981-05-01 00:00:00

  • Template-directed pausing in in vitro DNA synthesis by DNA polymerase a from Drosophila melanogaster embryos.

    abstract::The activity of Drosophila melanogaster DNA polymerase alpha on DNA-primed single-stranded DNA templates has been examined. The DNA templates contain a 1471-nucleotide sequence from the heavy-strand origin region of mouse mtDNA inserted into the single-stranded bacteriophage vector M13Gori1. Preferred sites for pausin...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.79.4.983

    authors: Kaguni LS,Clayton DA

    更新日期:1982-02-01 00:00:00

  • Expression of two X-linked genes in human hair follicles of double heterozygotes.

    abstract::Expression of the two X-linked loci glucose-6-phosphate dehydrogenase (G6PD; EC 1.1.1.49) and hypoxanthine:guanine phosphoribosyltransferase (HGPRT; EC 2.4.2.8) was studied in single hair follicles of two females who were heterozygous for both of these genes (double heterozygotes). The coupling phase for these two loc...

    journal_title:Proceedings of the National Academy of Sciences of the United States of America

    pub_type: 杂志文章

    doi:10.1073/pnas.68.7.1425

    authors: Goldstein JL,Marks JF,Gartler SM

    更新日期:1971-07-01 00:00:00