Decoding Dynamic Brain Patterns from Evoked Responses: A Tutorial on Multivariate Pattern Analysis Applied to Time Series Neuroimaging Data.

Abstract:

:Multivariate pattern analysis (MVPA) or brain decoding methods have become standard practice in analyzing fMRI data. Although decoding methods have been extensively applied in brain-computer interfaces, these methods have only recently been applied to time series neuroimaging data such as MEG and EEG to address experimental questions in cognitive neuroscience. In a tutorial style review, we describe a broad set of options to inform future time series decoding studies from a cognitive neuroscience perspective. Using example MEG data, we illustrate the effects that different options in the decoding analysis pipeline can have on experimental results where the aim is to "decode" different perceptual stimuli or cognitive states over time from dynamic brain activation patterns. We show that decisions made at both preprocessing (e.g., dimensionality reduction, subsampling, trial averaging) and decoding (e.g., classifier selection, cross-validation design) stages of the analysis can significantly affect the results. In addition to standard decoding, we describe extensions to MVPA for time-varying neuroimaging data including representational similarity analysis, temporal generalization, and the interpretation of classifier weight maps. Finally, we outline important caveats in the design and interpretation of time series decoding experiments.

journal_name

J Cogn Neurosci

authors

Grootswagers T,Wardle SG,Carlson TA

doi

10.1162/jocn_a_01068

subject

Has Abstract

pub_date

2017-04-01 00:00:00

pages

677-697

issue

4

eissn

0898-929X

issn

1530-8898

journal_volume

29

pub_type

杂志文章,评审
  • Event-related brain potentials elicited by morphological, homographic, orthographic, and semantic priming.

    abstract::The morphological structure of words, in terms of their stem morphemes and affixes, could influence word access and representation in lexical memory. Three experiments were carried out to explore the attributes of event-related potentials evoked by different types of priming. Morphological priming, with pairs of words...

    journal_title:Journal of cognitive neuroscience

    pub_type: 临床试验,杂志文章

    doi:10.1162/089892904323057326

    authors: Domínguez A,de Vega M,Barber H

    更新日期:2004-05-01 00:00:00

  • The first does the work, but the third time's the charm: the effects of massed repetition on episodic encoding of multimodal face-name associations.

    abstract::In social interactions, it is often necessary to rapidly encode the association between visually presented faces and auditorily presented names. The present study used event-related potentials to examine the neural correlates of associative encoding for multimodal face-name pairs. We assessed study-phase processes lea...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/jocn.2009.21201

    authors: Mangels JA,Manzi A,Summerfield C

    更新日期:2010-03-01 00:00:00

  • An FMRI investigation of spontaneous mental state inference for moral judgment.

    abstract::Human moral judgment depends critically on "theory of mind," the capacity to represent the mental states of agents. Recent studies suggest that the right TPJ (RTPJ) and, to lesser extent, the left TPJ (LTPJ), the precuneus (PC), and the medial pFC (MPFC) are robustly recruited when participants read explicit statement...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/jocn.2009.21137

    authors: Young L,Saxe R

    更新日期:2009-07-01 00:00:00

  • How do monkeys look at faces?

    abstract::Facial displays are an important form of social communication in nonhuman primates. Clues to the information conveyed by faces are the temporal and spatial characteristics of ocular viewing patterns to facial images. The present study compares viewing patterns of four rhesus monkeys (Macaca mulatta) to a set of 1- and...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/jocn.1997.9.5.611

    authors: Nahm FK,Perret A,Amaral DG,Albright TD

    更新日期:1997-10-01 00:00:00

  • Verbal labels modulate perceptual object processing in 1-year-old children.

    abstract::Whether verbal labels help infants visually process and categorize objects is a contentious issue. Using electroencephalography, we investigated whether possessing familiar or novel labels for objects directly enhances 1-year-old children's neural processes underlying the perception of those objects. We found enhanced...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/jocn.2010.21427

    authors: Gliga T,Volein A,Csibra G

    更新日期:2010-12-01 00:00:00

  • Using complement coercion to understand the neural basis of semantic composition: evidence from an fMRI study.

    abstract::Previous research regarding the neural basis of semantic composition has relied heavily on violation paradigms, which often compare implausible sentences that violate world knowledge to plausible sentences that do not violate world knowledge. This comparison is problematic as it may involve extralinguistic operations ...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/jocn_a_00040

    authors: Husband EM,Kelly LA,Zhu DC

    更新日期:2011-11-01 00:00:00

  • Rich Club Organization and Cognitive Performance in Healthy Older Participants.

    abstract::The human brain is a complex network that has been noted to contain a group of densely interconnected hub regions. With a putative "rich club" of hubs hypothesized to play a central role in global integrative brain functioning, we assessed whether hub and rich club organizations are associated with cognitive performan...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/jocn_a_00821

    authors: Baggio HC,Segura B,Junque C,de Reus MA,Sala-Llonch R,Van den Heuvel MP

    更新日期:2015-09-01 00:00:00

  • Brain response to unexpected novel noises in children with low and high trait anxiety.

    abstract::The behavioral inhibition system [Gray, J. A. The neuropsychology of anxiety: An enquiry into the functions of the septo-hippocampal system. Oxford: Oxford University Press, 1982] proposes that anxiety is associated with the processing of novel stimuli. We aimed to explore this relationship by recording auditory event...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/jocn.2007.19.1.25

    authors: Hogan AM,Butterfield EL,Phillips L,Hadwin JA

    更新日期:2007-01-01 00:00:00

  • Working memory and the suppression of reflexive saccades.

    abstract::Conscious behavioral intentions can frequently fail under conditions of attentional depletion. In attempting to trace the cognitive origin of this effect, we hypothesized that failures of action control--specifically, oculomotor movement--can result from the imposition of fronto-executive load. To evaluate this predic...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/089892902317205357

    authors: Mitchell JP,Macrae CN,Gilchrist ID

    更新日期:2002-01-01 00:00:00

  • Effects of Dopaminergic Drugs on Cognitive Control Processes Vary by Genotype.

    abstract::Dopamine (DA) has been implicated in modulating multiple cognitive control processes, including the robust maintenance of task sets and memoranda in the face of distractors (cognitive stability) and, conversely, the ability to switch task sets or update the contents of working memory when it is advantageous to do so (...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/jocn_a_01518

    authors: Furman DJ,White RL 3rd,Naskolnakorn J,Ye J,Kayser A,D'Esposito M

    更新日期:2020-05-01 00:00:00

  • Rapid interactions between lexical semantic and word form analysis during word recognition in context: evidence from ERPs.

    abstract::We used ERPs to investigate the time course of interactions between lexical semantic and sublexical visual word form processing during word recognition. Participants read sentence-embedded pseudowords that orthographically resembled a contextually supported real word (e.g., "She measured the flour so she could bake a ...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/jocn_a_00148

    authors: Kim A,Lai V

    更新日期:2012-05-01 00:00:00

  • Interview with alfonso caramazza.

    abstract::Abstract Alfonso Caramazza is the David T. McLaughlin Distinguished Professor at Dartmouth College. He received the B.A. degree in psychology from McGill University in 1970 and the Ph.D. from Johns Hopkins University in 1974. He joined the Hopkins faculty in 1974 and taught there first in the Psychology Department and...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/jocn.1995.7.2.303

    authors:

    更新日期:1995-04-01 00:00:00

  • Neural mechanisms of verb argument structure processing in agrammatic aphasic and healthy age-matched listeners.

    abstract::Processing of lexical verbs involves automatic access to argument structure entries entailed within the verb's representation. Recent neuroimaging studies with young normal listeners suggest that this involves bilateral posterior peri-sylvian tissue, with graded activation in these regions on the basis of argument str...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/jocn.2009.21334

    authors: Thompson CK,Bonakdarpour B,Fix SF

    更新日期:2010-09-01 00:00:00

  • Losing their configural mind. Amnesic patients fail on transverse patterning.

    abstract::A configural theory of human amnesia is proposed. The theory predicts that amnesic patients will exhibit selective deficits on tasks that normal subjects perform by learning new configurations of stimulus elements. This prediction is supported by results for four amnesic patients who learned a nonconfigural control ta...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/089892998562915

    authors: Rickard TC,Grafman J

    更新日期:1998-07-01 00:00:00

  • Quantitative characterization of functional anatomical contributions to cognitive control under uncertainty.

    abstract::Although much evidence indicates that RT increases as a function of computational load in many cognitive tasks, quantification of changes in neural activity related to increasing demand of cognitive control has rarely been attempted. In this fMRI study, we used a majority function task to quantify the effect of comput...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/jocn_a_00554

    authors: Fan J,Van Dam NT,Gu X,Liu X,Wang H,Tang CY,Hof PR

    更新日期:2014-07-01 00:00:00

  • Using neuroimaging to resolve the psi debate.

    abstract::Abstract Parapsychology is the scientific investigation of apparently paranormal mental phenomena (such as telepathy, i.e., "mind reading"), also known as psi. Despite widespread public belief in such phenomena and over 75 years of experimentation, there is no compelling evidence that psi exists. In the present study,...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/jocn.2008.20.1.182

    authors: Moulton ST,Kosslyn SM

    更新日期:2008-01-01 00:00:00

  • The neurophysiology of functionally meaningful categories: macaque ventrolateral prefrontal cortex plays a critical role in spontaneous categorization of species-specific vocalizations.

    abstract::Neurophysiological studies in nonhuman primates have demonstrated that the prefrontal cortex (PFC) plays a critical role in the acquisition of learned categories following training. What is presently unclear is whether this cortical area also plays a role in spontaneous recognition and discrimination of natural catego...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/0898929054985464

    authors: Gifford GW 3rd,MacLean KA,Hauser MD,Cohen YE

    更新日期:2005-09-01 00:00:00

  • Savings in relearning face-name associations as evidence for "covert recognition" in prosopagnosia.

    abstract::Prosopagnosic patients appear to be impaired at recognizing faces. However, recent evidence for "covert recognition" in prosopagnosia has been taken to suggest that the impairment is not in face recognition per se, but rather in conscious access to face recognition. The most widely used test for covert recognition of ...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/jocn.1992.4.2.150

    authors: Wallace MA,Farah MJ

    更新日期:1992-04-01 00:00:00

  • A model of prefrontal cortical mechanisms for goal-directed behavior.

    abstract::Many behavioral tasks require goal-directed actions to obtain delayed reward. The prefrontal cortex appears to mediate many aspects of goal-directed decision making. This article presents a model of prefrontal cortex function emphasizing the influence of goal-related activity on the choice of the next motor output. Th...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/0898929054475190

    authors: Hasselmo ME

    更新日期:2005-07-01 00:00:00

  • The role of Broca's area in sentence comprehension.

    abstract::The role of Broca's area in sentence processing has been debated for the last 30 years. A central and still unresolved issue is whether Broca's area plays a specific role in some aspect of syntactic processing (e.g., syntactic movement, hierarchical structure building) or whether it serves a more general function on w...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章,评审

    doi:10.1162/jocn.2010.21530

    authors: Rogalsky C,Hickok G

    更新日期:2011-07-01 00:00:00

  • Processing graded feedback: electrophysiological correlates of learning from small and large errors.

    abstract::Feedback processing is important for learning and therefore may affect the consolidation of skills. Considerable research demonstrates electrophysiological differences between correct and incorrect feedback, but how we learn from small versus large errors is usually overlooked. This study investigated electrophysiolog...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章,随机对照试验

    doi:10.1162/jocn_a_00543

    authors: Luft CD,Takase E,Bhattacharya J

    更新日期:2014-05-01 00:00:00

  • Behavioral and electrophysiological evidence for early and automatic detection of phonological equivalence in variable speech inputs.

    abstract::Speech sounds are not always perceived in accordance with their acoustic-phonetic content. For example, an early and automatic process of perceptual repair, which ensures conformity of speech inputs to the listener's native language phonology, applies to individual input segments that do not exist in the native invent...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/jocn.2011.21606

    authors: Kharlamov V,Campbell K,Kazanina N

    更新日期:2011-11-01 00:00:00

  • Neocortical correlates of vibrotactile detection in humans.

    abstract::This study examined the cortical representation of vibrotactile detection in humans using event-related fMRI paired with psychophysics. Suprathreshold vibrotactile stimulation activated several areas, including primary (SI) and second somatosensory cortices (SII/PV). For threshold-level stimuli, poststimulus activity ...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/jocn_a_00315

    authors: Moore CI,Crosier E,Greve DN,Savoy R,Merzenich MM,Dale AM

    更新日期:2013-01-01 00:00:00

  • Self-enhancement influences medial frontal cortex alpha power to social rejection feedback.

    abstract::Although previous research has demonstrated that individuals are motivated to self-enhance, the neurocognitive mechanisms and temporal dynamics of self-enhancement are poorly understood. The current research examined whether self-enhancing motivations affect the perceptual processing of social feedback. Participants w...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/jocn_a_00645

    authors: Leitner JB,Hehman E,Jones JM,Forbes CE

    更新日期:2014-10-01 00:00:00

  • Electrophysiological Correlates of Monitoring in Typing with and without Visual Feedback.

    abstract::New theories of monitoring in language production, regardless of their mechanistic differences, all posit monitoring mechanisms that share general computational principles with action monitoring. This perspective, if accurate, would predict that many electrophysiological signatures of performance monitoring should be ...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/jocn_a_01500

    authors: Pinet S,Nozari N

    更新日期:2020-04-01 00:00:00

  • Biased Competition during Long-term Memory Formation.

    abstract::A key task for the brain is to determine which pieces of information are worth storing in memory. To build a more complete representation of the environment, memory systems may prioritize new information that has not already been stored. Here, we propose a mechanism that supports this preferential encoding of new info...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/jocn_a_00889

    authors: Hutchinson JB,Pak SS,Turk-Browne NB

    更新日期:2016-01-01 00:00:00

  • Learning Temporal Statistics for Sensory Predictions in Aging.

    abstract::Predicting future events based on previous knowledge about the environment is critical for successful everyday interactions. Here, we ask which brain regions support our ability to predict the future based on implicit knowledge about the past in young and older age. Combining behavioral and fMRI measurements, we test ...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/jocn_a_00907

    authors: Luft CD,Baker R,Goldstone A,Zhang Y,Kourtzi Z

    更新日期:2016-03-01 00:00:00

  • The bimusical brain is not two monomusical brains in one: evidence from musical affective processing.

    abstract::Complex auditory exposures in ambient environments include systems of not only linguistic but also musical sounds. Because musical exposure is often passive, consisting of listening rather than performing, examining listeners without formal musical training allows for the investigation of the effects of passive exposu...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/jocn_a_00105

    authors: Wong PC,Chan AH,Roy A,Margulis EH

    更新日期:2011-12-01 00:00:00

  • Effects of left inferior prefrontal stimulation on episodic memory formation: a two-stage fMRI-rTMS study.

    abstract::Successful recovery of words from episodic memory relies strongly on semantic processes at the time of encoding. Evidence from several functional magnetic resonance imaging (fMRI) studies has shown that changes in neural activity in the left inferior prefrontal cortex (LIPFC) during semantic encoding predict subsequen...

    journal_title:Journal of cognitive neuroscience

    pub_type: 临床试验,杂志文章

    doi:10.1162/089892904322984490

    authors: Köhler S,Paus T,Buckner RL,Milner B

    更新日期:2004-03-01 00:00:00

  • Cerebellar transcranial direct current stimulation impairs the practice-dependent proficiency increase in working memory.

    abstract::How the cerebellum is involved in the practice and proficiency of non-motor functions is still unclear. We tested whether transcranial direct current stimulation (tDCS) over the cerebellum (cerebellar tDCS) induces after-effects on the practice-dependent increase in the proficiency of a working memory (WM) task (Stern...

    journal_title:Journal of cognitive neuroscience

    pub_type: 杂志文章

    doi:10.1162/jocn.2008.20112

    authors: Ferrucci R,Marceglia S,Vergari M,Cogiamanian F,Mrakic-Sposta S,Mameli F,Zago S,Barbieri S,Priori A

    更新日期:2008-09-01 00:00:00