DeepLabCut: markerless pose estimation of user-defined body parts with deep learning.

Abstract:

:Quantifying behavior is crucial for many applications in neuroscience. Videography provides easy methods for the observation and recording of animal behavior in diverse settings, yet extracting particular aspects of a behavior for further analysis can be highly time consuming. In motor control studies, humans or other animals are often marked with reflective markers to assist with computer-based tracking, but markers are intrusive, and the number and location of the markers must be determined a priori. Here we present an efficient method for markerless pose estimation based on transfer learning with deep neural networks that achieves excellent results with minimal training data. We demonstrate the versatility of this framework by tracking various body parts in multiple species across a broad collection of behaviors. Remarkably, even when only a small number of frames are labeled (~200), the algorithm achieves excellent tracking performance on test frames that is comparable to human accuracy.

journal_name

Nat Neurosci

journal_title

Nature neuroscience

authors

Mathis A,Mamidanna P,Cury KM,Abe T,Murthy VN,Mathis MW,Bethge M

doi

10.1038/s41593-018-0209-y

subject

Has Abstract

pub_date

2018-09-01 00:00:00

pages

1281-1289

issue

9

eissn

1097-6256

issn

1546-1726

pii

10.1038/s41593-018-0209-y

journal_volume

21

pub_type

杂志文章
  • Temporal structure of motor variability is dynamically regulated and predicts motor learning ability.

    abstract::Individual differences in motor learning ability are widely acknowledged, yet little is known about the factors that underlie them. Here we explore whether movement-to-movement variability in motor output, a ubiquitous if often unwanted characteristic of motor performance, predicts motor learning ability. Surprisingly...

    journal_title:Nature neuroscience

    pub_type: 杂志文章

    doi:10.1038/nn.3616

    authors: Wu HG,Miyamoto YR,Gonzalez Castro LN,Ölveczky BP,Smith MA

    更新日期:2014-02-01 00:00:00

  • Synchrony-dependent propagation of firing rate in iteratively constructed networks in vitro.

    abstract::The precise role of synchronous neuronal firing in signal encoding remains unclear. To examine what kinds of signals can be carried by synchrony, I reproduced a multilayer feedforward network of neurons in an in vitro slice preparation of rat cortex using an iterative procedure. When constant and time-varying frequenc...

    journal_title:Nature neuroscience

    pub_type: 杂志文章

    doi:10.1038/nn1056

    authors: Reyes AD

    更新日期:2003-06-01 00:00:00

  • Astrocytes control synaptic strength by two distinct v-SNARE-dependent release pathways.

    abstract::Communication between glia cells and neurons is crucial for brain functions, but the molecular mechanisms and functional consequences of gliotransmission remain enigmatic. Here we report that astrocytes express synaptobrevin II and cellubrevin as functionally non-overlapping vesicular SNARE proteins on glutamatergic v...

    journal_title:Nature neuroscience

    pub_type: 杂志文章

    doi:10.1038/nn.4647

    authors: Schwarz Y,Zhao N,Kirchhoff F,Bruns D

    更新日期:2017-11-01 00:00:00

  • Molecular basis of NMDA receptor-coupled ion channel modulation by S-nitrosylation.

    abstract::Several ion channels are thought to be directly modulated by nitric oxide (NO), but the molecular basis of this regulation is unclear. Here we show that the NMDA receptor (NMDAR)-associated ion channel was modulated not only by exogenous NO but also by endogenous NO. Site-directed mutagenesis identified a critical cys...

    journal_title:Nature neuroscience

    pub_type: 杂志文章

    doi:10.1038/71090

    authors: Choi YB,Tenneti L,Le DA,Ortiz J,Bai G,Chen HS,Lipton SA

    更新日期:2000-01-01 00:00:00

  • Laminar differences in the orientation selectivity of geniculate afferents in mouse primary visual cortex.

    abstract::It has been debated whether orientation selectivity in mouse primary visual cortex (V1) is derived from tuned lateral geniculate nucleus (LGN) inputs or computed from untuned LGN inputs. However, few studies have measured orientation tuning of LGN axons projecting to V1. We measured the response properties of mouse LG...

    journal_title:Nature neuroscience

    pub_type: 杂志文章

    doi:10.1038/nn.4215

    authors: Kondo S,Ohki K

    更新日期:2016-02-01 00:00:00

  • The representation of economic value in the orbitofrontal cortex is invariant for changes of menu.

    abstract::Economic choice entails assigning values to the available options and is impaired by lesions to the orbitofrontal cortex (OFC). Recent results show that some neurons in the OFC encode the values that monkeys (Macaca mulatta) assign to different goods when they choose between them. A broad and fundamental question is h...

    journal_title:Nature neuroscience

    pub_type: 杂志文章

    doi:10.1038/nn2020

    authors: Padoa-Schioppa C,Assad JA

    更新日期:2008-01-01 00:00:00

  • EP3 prostaglandin receptors in the median preoptic nucleus are critical for fever responses.

    abstract::Fever is a result of the action of prostaglandin E2 (PGE2) on the brain and appears to require EP3 prostaglandin receptors (EP3Rs), but the specific neurons on which PGE2 acts to produce fever have not been definitively established. Here we report that selective genetic deletion of the EP3Rs in the median preoptic nuc...

    journal_title:Nature neuroscience

    pub_type: 杂志文章

    doi:10.1038/nn1949

    authors: Lazarus M,Yoshida K,Coppari R,Bass CE,Mochizuki T,Lowell BB,Saper CB

    更新日期:2007-09-01 00:00:00

  • Feedback of visual object information to foveal retinotopic cortex.

    abstract::The mammalian visual system contains an extensive web of feedback connections projecting from higher cortical areas to lower areas, including primary visual cortex. Although multiple theories have been proposed, the role of these connections in perceptual processing is not understood. We found that the pattern of func...

    journal_title:Nature neuroscience

    pub_type: 杂志文章

    doi:10.1038/nn.2218

    authors: Williams MA,Baker CI,Op de Beeck HP,Shim WM,Dang S,Triantafyllou C,Kanwisher N

    更新日期:2008-12-01 00:00:00

  • Differentiation of human pluripotent stem cells into neurons or cortical organoids requires transcriptional co-regulation by UTX and 53BP1.

    abstract::UTX is a chromatin modifier required for development and neural lineage specification, but how it controls these biological processes is unclear. To determine the molecular mechanisms of UTX, we identified novel UTX protein interaction partners. Here we show that UTX and 53BP1 directly interact and co-occupy promoters...

    journal_title:Nature neuroscience

    pub_type: 杂志文章

    doi:10.1038/s41593-018-0328-5

    authors: Yang X,Xu B,Mulvey B,Evans M,Jordan S,Wang YD,Pagala V,Peng J,Fan Y,Patel A,Peng JC

    更新日期:2019-03-01 00:00:00

  • SOD1 rescues cerebral endothelial dysfunction in mice overexpressing amyloid precursor protein.

    abstract::Peptides derived from proteolytic processing of the beta-amyloid precursor protein (APP), including the amyloid-beta peptide, are important for the pathogenesis of Alzheimer's dementia. We found that transgenic mice overexpressing APP have a profound and selective impairment in endothelium-dependent regulation of the ...

    journal_title:Nature neuroscience

    pub_type: 杂志文章

    doi:10.1038/5715

    authors: Iadecola C,Zhang F,Niwa K,Eckman C,Turner SK,Fischer E,Younkin S,Borchelt DR,Hsiao KK,Carlson GA

    更新日期:1999-02-01 00:00:00

  • Changing objects lead briefly flashed ones.

    abstract::Continuous, predictable events and spontaneous events may coincide in the visual environment. For a continuously moving object, the brain compensates for delays in transmission between a retinal event and neural responses in higher visual areas. Here we show that it similarly compensated for other smoothly changing fe...

    journal_title:Nature neuroscience

    pub_type: 杂志文章

    doi:10.1038/74865

    authors: Sheth BR,Nijhawan R,Shimojo S

    更新日期:2000-05-01 00:00:00

  • A sugar transporter as a candidate for the outer hair cell motor.

    abstract::Forces developed by cochlear outer hair cells (OHCs) are responsible for the sharp tuning that underlies sensitivity and frequency selectivity in the ear. OHCs exhibit a voltage-dependent motility involving a 'motor' protein embedded in the basolateral membrane. The motor has so far resisted molecular identification. ...

    journal_title:Nature neuroscience

    pub_type: 杂志文章

    doi:10.1038/11174

    authors: Géléoc GS,Casalotti SO,Forge A,Ashmore JF

    更新日期:1999-08-01 00:00:00

  • Gaze bias both reflects and influences preference.

    abstract::Emotions operate along the dimension of approach and aversion, and it is reasonable to assume that orienting behavior is intrinsically linked to emotionally involved processes such as preference decisions. Here we describe a gaze 'cascade effect' that was present when human observers were shown pairs of human faces an...

    journal_title:Nature neuroscience

    pub_type: 杂志文章

    doi:10.1038/nn1150

    authors: Shimojo S,Simion C,Shimojo E,Scheier C

    更新日期:2003-12-01 00:00:00

  • The same synaptic vesicles drive active and spontaneous release.

    abstract::Synaptic vesicles release neurotransmitter both actively (on stimulation) and spontaneously (at rest). It has been assumed that identical vesicles use both modes of release; however, recent evidence has challenged this view. Using several assays (FM dye imaging, pHluorin imaging and antibody-labeling of synaptotagmin)...

    journal_title:Nature neuroscience

    pub_type: 杂志文章

    doi:10.1038/nn.2690

    authors: Wilhelm BG,Groemer TW,Rizzoli SO

    更新日期:2010-12-01 00:00:00

  • Activity-dependent AIDA-1 nuclear signaling regulates nucleolar numbers and protein synthesis in neurons.

    abstract::Neuronal development, plasticity and survival require activity-dependent synapse-to-nucleus signaling. Most studies implicate an activity-dependent regulation of gene expression in this phenomenon. However, little is known about other nuclear functions that are regulated by synaptic activity. Here we show that a newly...

    journal_title:Nature neuroscience

    pub_type: 杂志文章

    doi:10.1038/nn1867

    authors: Jordan BA,Fernholz BD,Khatri L,Ziff EB

    更新日期:2007-04-01 00:00:00

  • Neuregulin 1 represses limbic epileptogenesis through ErbB4 in parvalbumin-expressing interneurons.

    abstract::Epilepsy is a common and refractory neurological disorder, but the neuronal regulatory mechanisms of epileptogenesis remain largely unclear. Activity-dependent transcription of genes for neurotrophins such as brain-derived neurotrophic factor (BDNF) has been shown to promote epileptogenesis; however, little is known a...

    journal_title:Nature neuroscience

    pub_type: 杂志文章

    doi:10.1038/nn.3005

    authors: Tan GH,Liu YY,Hu XL,Yin DM,Mei L,Xiong ZQ

    更新日期:2011-12-11 00:00:00

  • Heterogeneity of CNS myeloid cells and their roles in neurodegeneration.

    abstract::The diseased brain hosts a heterogeneous population of myeloid cells, including parenchymal microglia, perivascular cells, meningeal macrophages and blood-borne monocytes. To date, the different types of brain myeloid cells have been discriminated solely on the basis of their localization, morphology and surface epito...

    journal_title:Nature neuroscience

    pub_type: 杂志文章,评审

    doi:10.1038/nn.2923

    authors: Prinz M,Priller J,Sisodia SS,Ransohoff RM

    更新日期:2011-09-27 00:00:00

  • Opportunities and challenges of pluripotent stem cell neurodegenerative disease models.

    abstract::Human neurodegenerative disorders are among the most difficult to study. In particular, the inability to readily obtain the faulty cell types most relevant to these diseases has impeded progress for decades. Recent advances in pluripotent stem cell technology now grant access to substantial quantities of disease-perti...

    journal_title:Nature neuroscience

    pub_type: 杂志文章,评审

    doi:10.1038/nn.3425

    authors: Sandoe J,Eggan K

    更新日期:2013-07-01 00:00:00

  • Retrieval induces adaptive forgetting of competing memories via cortical pattern suppression.

    abstract::Remembering a past experience can, surprisingly, cause forgetting. Forgetting arises when other competing traces interfere with retrieval and inhibitory control mechanisms are engaged to suppress the distraction they cause. This form of forgetting is considered to be adaptive because it reduces future interference. Th...

    journal_title:Nature neuroscience

    pub_type: 杂志文章

    doi:10.1038/nn.3973

    authors: Wimber M,Alink A,Charest I,Kriegeskorte N,Anderson MC

    更新日期:2015-04-01 00:00:00

  • mTOR complexes in neurodevelopmental and neuropsychiatric disorders.

    abstract::The mechanistic target of rapamycin (mTOR) acts as a highly conserved signaling "hub" that integrates neuronal activity and a variety of synaptic inputs. mTOR is found in two functionally distinct complexes, mTORC1 and mTORC2, that crucially control long-term synaptic efficacy and memory storage. Dysregulation of mTOR...

    journal_title:Nature neuroscience

    pub_type: 杂志文章,评审

    doi:10.1038/nn.3546

    authors: Costa-Mattioli M,Monteggia LM

    更新日期:2013-11-01 00:00:00

  • PI3K promotes voltage-dependent calcium channel trafficking to the plasma membrane.

    abstract::Phosphatidylinositol 3-kinase (PI3K) has been shown to enhance native voltage-dependent calcium channel (Ca(v)) currents both in myocytes and in neurons; however, the mechanism(s) responsible for this regulation were not known. Here we show that PI3K promotes the translocation of GFP-tagged Ca(v) channels to the plasm...

    journal_title:Nature neuroscience

    pub_type: 杂志文章

    doi:10.1038/nn1300

    authors: Viard P,Butcher AJ,Halet G,Davies A,Nürnberg B,Heblich F,Dolphin AC

    更新日期:2004-09-01 00:00:00

  • Specialized neuronal adaptation for preserving input sensitivity.

    abstract::Some neurons in auditory cortex respond to recent stimulus history by adapting their response functions to track stimulus statistics directly, as might be expected. In contrast, some neurons respond to loud sounds by adjusting their response functions away from high intensities and consequently remain sensitive to sof...

    journal_title:Nature neuroscience

    pub_type: 杂志文章

    doi:10.1038/nn.2201

    authors: Watkins PV,Barbour DL

    更新日期:2008-11-01 00:00:00

  • ADF/cofilin-mediated actin dynamics regulate AMPA receptor trafficking during synaptic plasticity.

    abstract::Dendritic spines undergo actin-based growth and shrinkage during synaptic plasticity, in which the actin depolymerizing factor (ADF)/cofilin family of actin-associated proteins are important. Elevated ADF/cofilin activities often lead to reduced spine size and immature spine morphology but can also enhance synaptic po...

    journal_title:Nature neuroscience

    pub_type: 杂志文章

    doi:10.1038/nn.2634

    authors: Gu J,Lee CW,Fan Y,Komlos D,Tang X,Sun C,Yu K,Hartzell HC,Chen G,Bamburg JR,Zheng JQ

    更新日期:2010-10-01 00:00:00

  • HCN hyperpolarization-activated cation channels inhibit EPSPs by interactions with M-type K(+) channels.

    abstract::The processing of synaptic potentials by neuronal dendrites depends on both their passive cable properties and active voltage-gated channels, which can generate complex effects as a result of their nonlinear properties. We characterized the actions of HCN (hyperpolarization-activated cyclic nucleotide-gated cation) ch...

    journal_title:Nature neuroscience

    pub_type: 杂志文章

    doi:10.1038/nn.2307

    authors: George MS,Abbott LF,Siegelbaum SA

    更新日期:2009-05-01 00:00:00

  • A distinct entorhinal cortex to hippocampal CA1 direct circuit for olfactory associative learning.

    abstract::Lateral and medial parts of entorhinal cortex (EC) convey nonspatial 'what' and spatial 'where' information, respectively, into hippocampal CA1, via both the indirect EC layer 2→ hippocampal dentate gyrus→CA3→CA1 and the direct EC layer 3→CA1 paths. However, it remains elusive how the direct path transfers distinct in...

    journal_title:Nature neuroscience

    pub_type: 杂志文章

    doi:10.1038/nn.4517

    authors: Li Y,Xu J,Liu Y,Zhu J,Liu N,Zeng W,Huang N,Rasch MJ,Jiang H,Gu X,Li X,Luo M,Li C,Teng J,Chen J,Zeng S,Lin L,Zhang X

    更新日期:2017-04-01 00:00:00

  • Merlin isoform 2 in neurofibromatosis type 2-associated polyneuropathy.

    abstract::The autosomal dominant disorder neurofibromatosis type 2 (NF2) is a hereditary tumor syndrome caused by inactivation of the NF2 tumor suppressor gene, encoding merlin. Apart from tumors affecting the peripheral and central nervous systems, most NF2 patients develop peripheral neuropathies. This peripheral nerve diseas...

    journal_title:Nature neuroscience

    pub_type: 杂志文章

    doi:10.1038/nn.3348

    authors: Schulz A,Baader SL,Niwa-Kawakita M,Jung MJ,Bauer R,Garcia C,Zoch A,Schacke S,Hagel C,Mautner VF,Hanemann CO,Dun XP,Parkinson DB,Weis J,Schröder JM,Gutmann DH,Giovannini M,Morrison H

    更新日期:2013-04-01 00:00:00

  • Contribution of mGluR5 to pathophysiology in a mouse model of human chromosome 16p11.2 microdeletion.

    abstract::Human chromosome 16p11.2 microdeletion is the most common gene copy number variation in autism, but the synaptic pathophysiology caused by this mutation is largely unknown. Using a mouse with the same genetic deficiency, we found that metabotropic glutamate receptor 5 (mGluR5)-dependent synaptic plasticity and protein...

    journal_title:Nature neuroscience

    pub_type: 杂志文章

    doi:10.1038/nn.3911

    authors: Tian D,Stoppel LJ,Heynen AJ,Lindemann L,Jaeschke G,Mills AA,Bear MF

    更新日期:2015-02-01 00:00:00

  • Zebrafish unplugged reveals a role for muscle-specific kinase homologs in axonal pathway choice.

    abstract::En route to their target, pioneering motor growth cones repeatedly encounter choice points at which they make pathway decisions. In the zebrafish mutant unplugged, two of the three segmental motor axons make incorrect decisions at a somitic choice point. Using positional cloning, we show here that unplugged encodes a ...

    journal_title:Nature neuroscience

    pub_type: 杂志文章

    doi:10.1038/nn1350

    authors: Zhang J,Lefebvre JL,Zhao S,Granato M

    更新日期:2004-12-01 00:00:00

  • β-amyloid disrupts human NREM slow waves and related hippocampus-dependent memory consolidation.

    abstract::Independent evidence associates β-amyloid pathology with both non-rapid eye movement (NREM) sleep disruption and memory impairment in older adults. However, whether the influence of β-amyloid pathology on hippocampus-dependent memory is, in part, driven by impairments of NREM slow wave activity (SWA) and associated ov...

    journal_title:Nature neuroscience

    pub_type: 杂志文章

    doi:10.1038/nn.4035

    authors: Mander BA,Marks SM,Vogel JW,Rao V,Lu B,Saletin JM,Ancoli-Israel S,Jagust WJ,Walker MP

    更新日期:2015-07-01 00:00:00

  • CNS-derived glia ensheath peripheral nerves and mediate motor root development.

    abstract::Motor function requires that motor axons extend from the spinal cord at regular intervals and that they are myelinated by Schwann cells. Little attention has been given to another cellular structure, the perineurium, which ensheaths the motor nerve, forming a flexible, protective barrier. Consequently, the origin of p...

    journal_title:Nature neuroscience

    pub_type: 杂志文章

    doi:10.1038/nn2025

    authors: Kucenas S,Takada N,Park HC,Woodruff E,Broadie K,Appel B

    更新日期:2008-02-01 00:00:00