Neural Activity and Decoding of Action Observation Using Combined EEG and fNIRS Measurement.

Abstract:

:In a social world, observing the actions of others is fundamental to understanding what they are doing, as well as their intentions and feelings. Studies of the neural basis and decoding of action observation are important for understanding action-related processes and have implications for cognitive, social neuroscience, and human-machine interaction (HMI). In the current study, we first investigated temporal-spatial dynamics during action observation using a combined 64-channel electroencephalography (EEG) and 48-channel functional near-infrared spectroscopy (fNIRS) system. We measured brain activation while 16 healthy participants observed three action tasks: (1) grasping a cup with the intention of drinking; (2) grasping a cup with the intention of moving it; and (3) touching a cup with an unclear intention. The EEG and fNIRS source analysis results revealed the dynamic involvement of both the mirror neuron system (MNS) and the theory of mind (ToM)/mentalizing network during action observation. The source analysis results suggested that the extent to which these two systems were engaged was determined by the clarity of the intention of the observed action. Based on the difference in neural activity observed among different action-observation tasks in the first experiment, we conducted a second experiment to classify the neural processes underlying action observation using a feature classification method. We constructed complex brain networks based on the EEG and fNIRS data. Fusing features from both EEG and fNIRS complex brain networks resulted in a classification accuracy of 72.7% for the three action observation tasks. This study provides a theoretical and empirical basis for elucidating the neural mechanisms of action observation and intention understanding, and a feasible method for decoding the underlying neural processes.

journal_name

Front Hum Neurosci

authors

Ge S,Wang P,Liu H,Lin P,Gao J,Wang R,Iramina K,Zhang Q,Zheng W

doi

10.3389/fnhum.2019.00357

subject

Has Abstract

pub_date

2019-10-15 00:00:00

pages

357

issn

1662-5161

journal_volume

13

pub_type

杂志文章
  • Brain Activity During Unilateral Physical and Imagined Isometric Contractions.

    abstract::By convention, it is believed that the ipsilateral side of the body is controlled by the contralateral side of the brain. Past studies measuring brain activity primarily recorded changes before and after an intervention is performed on one side of the body within one hemisphere (usually the contralateral) of the brain...

    journal_title:Frontiers in human neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnhum.2019.00413

    authors: Martinez JA,Wittstein MW,Folger SF,Bailey SP

    更新日期:2019-11-26 00:00:00

  • Dissociation of category-learning systems via brain potentials.

    abstract::Behavioral, neuropsychological, and neuroimaging evidence has suggested that categories can often be learned via either an explicit rule-based (RB) mechanism critically dependent on medial temporal and prefrontal brain regions, or via an implicit information-integration (II) mechanism relying on the basal ganglia. In ...

    journal_title:Frontiers in human neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnhum.2015.00389

    authors: Morrison RG,Reber PJ,Bharani KL,Paller KA

    更新日期:2015-07-07 00:00:00

  • Neurophysiological and behavioral responses to music therapy in vegetative and minimally conscious States.

    abstract::Assessment of awareness for those with disorders of consciousness is a challenging undertaking, due to the complex presentation of the population. Debate surrounds whether behavioral assessments provide greatest accuracy in diagnosis compared to neuro-imaging methods, and despite developments in both, misdiagnosis rat...

    journal_title:Frontiers in human neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnhum.2013.00884

    authors: O'Kelly J,James L,Palaniappan R,Taborin J,Fachner J,Magee WL

    更新日期:2013-12-25 00:00:00

  • The Encephalophone: A Novel Musical Biofeedback Device using Conscious Control of Electroencephalogram (EEG).

    abstract::A novel musical instrument and biofeedback device was created using electroencephalogram (EEG) posterior dominant rhythm (PDR) or mu rhythm to control a synthesized piano, which we call the Encephalophone. Alpha-frequency (8-12 Hz) signal power from PDR in the visual cortex or from mu rhythm in the motor cortex was us...

    journal_title:Frontiers in human neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnhum.2017.00213

    authors: Deuel TA,Pampin J,Sundstrom J,Darvas F

    更新日期:2017-04-26 00:00:00

  • The dopamine agonist bromocriptine differentially affects fronto-striatal functional connectivity during working memory.

    abstract::We investigated the effect of bromocriptine, a dopamine agonist, on individual differences in behavior as well as frontal-striatal connectivity during a working memory task. After dopaminergic augmentation, frontal-striatal connectivity in low working memory capacity individuals increases, corresponding with behaviora...

    journal_title:Frontiers in human neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnhum.2011.00032

    authors: Wallace DL,Vytlacil JJ,Nomura EM,Gibbs SE,D'Esposito M

    更新日期:2011-03-31 00:00:00

  • Strong Functional Connectivity among Homotopic Brain Areas Is Vital for Motor Control in Unilateral Limb Movement.

    abstract::The mechanism underlying brain region organization for motor control in humans remains poorly understood. In this functional magnetic resonance imaging (fMRI) study, right-handed volunteers were tasked to maintain unilateral foot movements on the right and left sides as consistently as possible. We aimed to identify t...

    journal_title:Frontiers in human neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnhum.2017.00366

    authors: Wei P,Zhang Z,Lv Z,Jing B

    更新日期:2017-07-12 00:00:00

  • Global Epileptic Seizure Identification With Affinity Propagation Clustering Partition Mutual Information Using Cross-Layer Fully Connected Neural Network.

    abstract::A longstanding challenge in epilepsy research and practice is the need to classify synchronization patterns hidden in multivariate electroencephalography (EEG) data that is routinely superimposed with intensive noise. It is essential to select a suitable feature extraction method to achieve high recognition performanc...

    journal_title:Frontiers in human neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnhum.2018.00396

    authors: Wang F,Ke H

    更新日期:2018-10-02 00:00:00

  • Age and Race-Related Differences in Sleep Discontinuity Linked to Associative Memory Performance and Its Neural Underpinnings.

    abstract::There is a strong relationship between sleep and memory for the details of past events. In old age, both episodic memory performance and related neural activity decline. These changes occur in parallel to age-related decreases in sleep quality. Thus, poor sleep quality may be an explanatory factor for poor memory in o...

    journal_title:Frontiers in human neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnhum.2019.00176

    authors: Hokett E,Duarte A

    更新日期:2019-06-04 00:00:00

  • Hypnosis as neurophenomenology.

    abstract::Hypnosis research binds phenomenology and neuroscience. Here we show how recent evidence probing the impact of hypnosis and suggestion can inform and advance a neurophenomenological approach. In contrast to meditative practices that involve lengthy and intensive training, hypnosis induces profound alterations in subje...

    journal_title:Frontiers in human neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnhum.2013.00469

    authors: Lifshitz M,Cusumano EP,Raz A

    更新日期:2013-08-15 00:00:00

  • Perceived Intensity and Discrimination Ability for Lingual Electrotactile Stimulation Depends on Location and Orientation of Electrodes.

    abstract::Malfunctioning sensory systems can severely impact quality of life and repair is not always possible. One solution, called sensory substitution, is to use another sensory system to bring lost information to the brain. This approach often involves the use of bioengineered devices that electrically stimulate somatosenso...

    journal_title:Frontiers in human neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnhum.2017.00186

    authors: Moritz J Jr,Turk P,Williams JD,Stone-Roy LM

    更新日期:2017-04-21 00:00:00

  • Mirror Box Training in Hemiplegic Stroke Patients Affects Body Representation.

    abstract::The brain integrates multisensory inputs coming from the body (i.e., proprioception, tactile sensations) and the world that surrounds it (e.g., visual information). In this way, it is possible to build supra-modal and coherent mental representations of our own body, in order to process sensory events and to plan movem...

    journal_title:Frontiers in human neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnhum.2017.00617

    authors: Tosi G,Romano D,Maravita A

    更新日期:2018-01-04 00:00:00

  • The Bay Area Verbal Learning Test (BAVLT): Normative Data and the Effects of Repeated Testing, Simulated Malingering, and Traumatic Brain Injury.

    abstract::Verbal learning tests (VLTs) are widely used to evaluate memory deficits in neuropsychiatric and developmental disorders. However, their validity has been called into question by studies showing significant differences in VLT scores obtained by different examiners. Here we describe the computerized Bay Area Verbal Lea...

    journal_title:Frontiers in human neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnhum.2016.00654

    authors: Woods DL,Wyma JM,Herron TJ,Yund EW

    更新日期:2017-01-12 00:00:00

  • Situating emotional experience.

    abstract::Psychological construction approaches to emotion suggest that emotional experience is situated and dynamic. Fear, for example, is typically studied in a physical danger context (e.g., threatening snake), but in the real world, it often occurs in social contexts, especially those involving social evaluation (e.g., publ...

    journal_title:Frontiers in human neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnhum.2013.00764

    authors: Wilson-Mendenhall CD,Barrett LF,Barsalou LW

    更新日期:2013-11-26 00:00:00

  • EEG-informed fMRI analysis during a hand grip task: estimating the relationship between EEG rhythms and the BOLD signal.

    abstract::In the last decade, an increasing interest has arisen in investigating the relationship between the electrophysiological and hemodynamic measurements of brain activity, such as EEG and (BOLD) fMRI. In particular, changes in BOLD have been shown to be associated with changes in the spectral profile of neural activity, ...

    journal_title:Frontiers in human neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnhum.2014.00186

    authors: Sclocco R,Tana MG,Visani E,Gilioli I,Panzica F,Franceschetti S,Cerutti S,Bianchi AM

    更新日期:2014-04-01 00:00:00

  • The trait anger affects conflict inhibition: a Go/Nogo ERP study.

    abstract::To explore the time course of inhibitory control in high trait anger individuals, we recorded and analyzed ERP data relevant to visual Go/Nogo task in high and low trait anger participants. Compared with low trait anger participants, high trait anger participants revealed faster RTs in the Go/Nogo task. The nogo effec...

    journal_title:Frontiers in human neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnhum.2014.01076

    authors: Liu Y,Zhan X,Li W,Han H,Wang H,Hou J,Yan G,Wang Y

    更新日期:2015-01-21 00:00:00

  • Effector-Specific Characterization of Brain Dynamics in Manual vs. Oculomotor Go/NoGo Tasks.

    abstract::Motor inhibitory control (IC), the ability to suppress unwanted actions, has been previously shown to rely on domain-general IC processes that are involved in a wide range of IC tasks. Nevertheless, the existence of effector-specific regions and activation patterns that would differentiate manual vs. oculomotor respon...

    journal_title:Frontiers in human neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnhum.2020.600667

    authors: Simonet M,Ruggeri P,Barral J

    更新日期:2020-12-03 00:00:00

  • "I didn't want to do it!" The detection of past intentions.

    abstract::In daily life and in courtrooms, people regularly analyze the minds of others to understand intentions. Specifically, the detection of intentions behind prior events is one of the main issues dealt with in courtrooms. To our knowledge, there are no experimental works focused on the use of memory detection techniques t...

    journal_title:Frontiers in human neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnhum.2015.00608

    authors: Zangrossi A,Agosta S,Cervesato G,Tessarotto F,Sartori G

    更新日期:2015-11-05 00:00:00

  • Neuro-Immunity Controls Obesity-Induced Pain.

    abstract::The prevalence of obesity skyrocketed over the past decades to become a significant public health problem. Obesity is recognized as a low-grade inflammatory disease and is linked with several comorbidities such as diabetes, circulatory disease, common neurodegenerative diseases, as well as chronic pain. Adipocytes are...

    journal_title:Frontiers in human neuroscience

    pub_type: 杂志文章,评审

    doi:10.3389/fnhum.2020.00181

    authors: Eichwald T,Talbot S

    更新日期:2020-06-09 00:00:00

  • Evidence for [Coronal] Underspecification in Typical and Atypical Phonological Development.

    abstract::The Featurally Underspecified Lexicon (FUL) theory predicts that [coronal] is the language universal default place of articulation for phonemes. This assumption has been consistently supported with adult behavioral and event-related potential (ERP) data; however, this underspecification claim has not been tested in de...

    journal_title:Frontiers in human neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnhum.2020.580697

    authors: Cummings AE,Ogiela DA,Wu YC

    更新日期:2020-12-22 00:00:00

  • A Double-Coil TMS Method to Assess Corticospinal Excitability Changes at a Near-Simultaneous Time in the Two Hands during Movement Preparation.

    abstract:BACKGROUND:Many previous transcranial magnetic stimulation (TMS) studies have investigated corticospinal excitability changes occurring when choosing which hand to use for an action, one of the most frequent decision people make in daily life. So far, these studies have applied single-pulse TMS eliciting motor-evoked p...

    journal_title:Frontiers in human neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnhum.2016.00088

    authors: Wilhelm E,Quoilin C,Petitjean C,Duque J

    更新日期:2016-03-07 00:00:00

  • Corrigendum: Cognitive Function Impairments Linked to Alcohol and Cannabis Use During Adolescence: A Study of Gender Differences.

    abstract::[This corrects the article DOI: 10.3389/fnhum.2020.00095.]. ...

    journal_title:Frontiers in human neuroscience

    pub_type: 已发布勘误

    doi:10.3389/fnhum.2020.00239

    authors: Noorbakhsh S,Afzali MH,Boers E,Conrod PJ

    更新日期:2020-07-15 00:00:00

  • Semantic Processing in Autism Spectrum Disorders Is Associated With the Timing of Language Acquisition: A Magnetoencephalographic Study.

    abstract::Individuals with autism show difficulties in using sentence context to identify the correct meaning of ambiguous words, such as homonyms. In this study, the brain basis of sentence context effects on word understanding during reading was examined in autism spectrum disorder (ASD) and typical development (TD) using mag...

    journal_title:Frontiers in human neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnhum.2020.00267

    authors: Ahtam B,Braeutigam S,Bailey A

    更新日期:2020-07-10 00:00:00

  • Lexical-perceptual integration influences sensorimotor adaptation in speech.

    abstract::A combination of lexical bias and altered auditory feedback was used to investigate the influence of higher-order linguistic knowledge on the perceptual aspects of speech motor control. Subjects produced monosyllabic real words or pseudo-words containing the vowel [ε] (as in "head") under conditions of altered auditor...

    journal_title:Frontiers in human neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnhum.2014.00208

    authors: Bourguignon NJ,Baum SR,Shiller DM

    更新日期:2014-04-17 00:00:00

  • Differential Brain Activity in Regions Linked to Visuospatial Processing During Landmark-Based Navigation in Young and Healthy Older Adults.

    abstract::Older adults have difficulties in navigating unfamiliar environments and updating their wayfinding behavior when faced with blocked routes. This decline in navigational capabilities has traditionally been ascribed to memory impairments and dysexecutive function, whereas the impact of visual aging has often been overlo...

    journal_title:Frontiers in human neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnhum.2020.552111

    authors: Ramanoël S,Durteste M,Bécu M,Habas C,Arleo A

    更新日期:2020-10-29 00:00:00

  • Multiple tasks and neuroimaging modalities increase the likelihood of detecting covert awareness in patients with disorders of consciousness.

    abstract::Minimal or inconsistent behavioral responses to command make it challenging to accurately diagnose the level of awareness of a patient with a Disorder of consciousness (DOC). By identifying markers of mental imagery being covertly performed to command, functional neuroimaging (fMRI), electroencephalography (EEG) has s...

    journal_title:Frontiers in human neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnhum.2014.00950

    authors: Gibson RM,Fernández-Espejo D,Gonzalez-Lara LE,Kwan BY,Lee DH,Owen AM,Cruse D

    更新日期:2014-11-26 00:00:00

  • No Effect of Anodal Transcranial Direct Current Stimulation Over the Motor Cortex on Response-Related ERPs during a Conflict Task.

    abstract::Anodal transcranial direct current stimulation (tDCS) over the motor cortex is considered a potential treatment for motor rehabilitation following stroke and other neurological pathologies. However, both the context under which this stimulation is effective and the underlying mechanisms remain to be determined. In thi...

    journal_title:Frontiers in human neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnhum.2016.00384

    authors: Conley AC,Fulham WR,Marquez JL,Parsons MW,Karayanidis F

    更新日期:2016-08-05 00:00:00

  • On Response Bias in the Face Congruency Effect for Internal and External Features.

    abstract::Some years ago Cheung et al. (2008) proposed the complete design (CD) for measuring the failure of selective attention in composite objects. Since the CD is a fully balanced design, analysis of response bias may reveal potential effects of the experimental manipulation, the stimulus material, and/or attributes of the ...

    journal_title:Frontiers in human neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnhum.2017.00494

    authors: Meinhardt G,Meinhardt-Injac B,Persike M

    更新日期:2017-10-17 00:00:00

  • Linking neuroscientific research on decision making to the educational context of novice students assigned to a multiple-choice scientific task involving common misconceptions about electrical circuits.

    abstract::Functional magnetic resonance imaging was used to identify the brain-based mechanisms of uncertainty and certainty associated with answers to multiple-choice questions involving common misconceptions about electric circuits. Twenty-two scientifically novice participants (humanities and arts college students) were aske...

    journal_title:Frontiers in human neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnhum.2014.00014

    authors: Potvin P,Turmel E,Masson S

    更新日期:2014-01-27 00:00:00

  • Egocentric Navigation Abilities Predict Episodic Memory Performance.

    abstract::The medial temporal lobe supports both navigation and declarative memory. On this basis, a theory of phylogenetic continuity has been proposed according to which episodic and semantic memories have evolved from egocentric (e.g., path integration) and allocentric (e.g., map-based) navigation in the physical world, resp...

    journal_title:Frontiers in human neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnhum.2020.574224

    authors: Committeri G,Fragueiro A,Campanile MM,Lagatta M,Burles F,Iaria G,Sestieri C,Tosoni A

    更新日期:2020-11-27 00:00:00

  • Self-awareness, self-regulation, and self-transcendence (S-ART): a framework for understanding the neurobiological mechanisms of mindfulness.

    abstract::Mindfulness-as a state, trait, process, type of meditation, and intervention has proven to be beneficial across a diverse group of psychological disorders as well as for general stress reduction. Yet, there remains a lack of clarity in the operationalization of this construct, and underlying mechanisms. Here, we provi...

    journal_title:Frontiers in human neuroscience

    pub_type: 杂志文章

    doi:10.3389/fnhum.2012.00296

    authors: Vago DR,Silbersweig DA

    更新日期:2012-10-25 00:00:00