Identifying and quantifying multisensory integration: a tutorial review.

Abstract:

:We process information from the world through multiple senses, and the brain must decide what information belongs together and what information should be segregated. One challenge in studying such multisensory integration is how to quantify the multisensory interactions, a challenge that is amplified by the host of methods that are now used to measure neural, behavioral, and perceptual responses. Many of the measures that have been developed to quantify multisensory integration (and which have been derived from single unit analyses), have been applied to these different measures without much consideration for the nature of the process being studied. Here, we provide a review focused on the means with which experimenters quantify multisensory processes and integration across a range of commonly used experimental methodologies. We emphasize the most commonly employed measures, including single- and multiunit responses, local field potentials, functional magnetic resonance imaging, and electroencephalography, along with behavioral measures of detection, accuracy, and response times. In each section, we will discuss the different metrics commonly used to quantify multisensory interactions, including the rationale for their use, their advantages, and the drawbacks and caveats associated with them. Also discussed are possible alternatives to the most commonly used metrics.

journal_name

Brain Topogr

journal_title

Brain topography

authors

Stevenson RA,Ghose D,Fister JK,Sarko DK,Altieri NA,Nidiffer AR,Kurela LR,Siemann JK,James TW,Wallace MT

doi

10.1007/s10548-014-0365-7

subject

Has Abstract

pub_date

2014-11-01 00:00:00

pages

707-30

issue

6

eissn

0896-0267

issn

1573-6792

journal_volume

27

pub_type

杂志文章,评审
  • Techniques for detection and localization of weak hippocampal and medial frontal sources using beamformers in MEG.

    abstract::Magnetoencephalography provides precise information about the temporal dynamics of brain activation and is an ideal tool for investigating rapid cognitive processing. However, in many cognitive paradigms visual stimuli are used, which evoke strong brain responses (typically 40-100 nAm in V1) that may impede the detect...

    journal_title:Brain topography

    pub_type: 杂志文章

    doi:10.1007/s10548-012-0217-2

    authors: Mills T,Lalancette M,Moses SN,Taylor MJ,Quraan MA

    更新日期:2012-07-01 00:00:00

  • Functional imaging of the brain using single photon emission computerized tomography (SPECT).

    abstract::The use of tracers is an important technique available for studying cerebral function. Changes in 'signal' are large, but as a result of its photon limited nature, the measurement of this signal is limited: spatially, temporally and in terms of accuracy. The most commonly used single photon (SPECT) system (as apposed ...

    journal_title:Brain topography

    pub_type: 杂志文章,评审

    doi:10.1007/BF01129039

    authors: Todd-Pokropek AE

    更新日期:1992-01-01 00:00:00

  • Electrocortical Dynamics in Children with a Language-Learning Impairment Before and After Audiovisual Training.

    abstract::Detecting and discriminating subtle and rapid sound changes in the speech environment is a fundamental prerequisite of language processing, and deficits in this ability have frequently been observed in individuals with language-learning impairments (LLI). One approach to studying associations between dysfunctional aud...

    journal_title:Brain topography

    pub_type: 杂志文章

    doi:10.1007/s10548-015-0466-y

    authors: Heim S,Choudhury N,Benasich AA

    更新日期:2016-05-01 00:00:00

  • Cognitive Bias by Gender Interaction on N170 Response to Emotional Facial Expressions in Major and Minor Depression.

    abstract::States of depression are considered to relate to a cognitive bias reactivity to emotional events. Moreover, gender effect may influence differences in emotional processing. The current study is to investigate whether there is an interaction of cognitive bias by gender on emotional processing in minor depression (MiD) ...

    journal_title:Brain topography

    pub_type: 杂志文章

    doi:10.1007/s10548-015-0444-4

    authors: Wu X,Chen J,Jia T,Ma W,Zhang Y,Deng Z,Yang L

    更新日期:2016-03-01 00:00:00

  • A-magnetic optic-mechanical device to quantify finger kinematics for fMRI studies of bimanual coordination.

    abstract::Several fMRI studies have been performed to detect the neural correlates of stable bimanual coordination patterns in humans. Only few of those studies were accompanied by the on-line recording of the relative phase of fingers or hands, but none with high space and time resolutions. Conversely, the high-resolution reco...

    journal_title:Brain topography

    pub_type: 临床试验,杂志文章

    doi:10.1007/s10548-007-0022-5

    authors: De Luca C,Comani S,Di Donato L,Caulo M,Bertollo M,Romani GL

    更新日期:2007-04-01 00:00:00

  • The value of EEG-mapping in focal cerebral lesions.

    abstract::In 148 patients with focal cerebral lesions the findings of EEG mapping, routine EEG and CT were compared. Regarding etiology 43 patients suffered from completed stroke (CS), 43 patients from transient ischemic attack (TIA), 33 patients had an intracerebral hemorrhage (ICH) and 29 an hemispheric tumor. In 37 patients ...

    journal_title:Brain topography

    pub_type: 杂志文章

    doi:10.1007/BF01129003

    authors: Logar C,Boswell M

    更新日期:1991-07-01 00:00:00

  • Topology of EEG coherence changes may reflect differential neural network activation in cold and pain perception.

    abstract::Pain perception in the brain can be analyzed by neuroimaging (PET, fMRI) and electrophysiological parameter mapping (EEG, ERP/MEG, MEF). These studies have generally been focused on the localization of cerebral activation. Whether pain can be conceptualized as localized function or best be understood by distributed fu...

    journal_title:Brain topography

    pub_type: 杂志文章

    doi:10.1023/a:1022254505510

    authors: Chen AC,Rappelsberger P,Filz O

    更新日期:1998-01-01 00:00:00

  • Improvement of source localization by dynamical systems based modeling (DSBM).

    abstract::Recently, we have proposed a new concept for analyzing EEG/MEG data (Uhl et al. 1998), which leads to a dynamical systems based modeling (DSBM) of neurophysiological data. We report the application of this approach to four different classes of simulated noisy data sets, to investigate the impact of DSBM-filtering on s...

    journal_title:Brain topography

    pub_type: 杂志文章

    doi:10.1023/a:1007859220001

    authors: Uhl C,Hutt A,Kruggel F

    更新日期:2001-04-01 00:00:00

  • Mismatch negativity with visual-only and audiovisual speech.

    abstract::The functional organization of cortical speech processing is thought to be hierarchical, increasing in complexity and proceeding from primary sensory areas centrifugally. The current study used the mismatch negativity (MMN) obtained with electrophysiology (EEG) to investigate the early latency period of visual speech ...

    journal_title:Brain topography

    pub_type: 杂志文章

    doi:10.1007/s10548-009-0094-5

    authors: Ponton CW,Bernstein LE,Auer ET Jr

    更新日期:2009-05-01 00:00:00

  • The normal scalp topography of the middle latency auditory evoked potential Pa component following monaural click stimulation.

    abstract::The scalp topography of the middle latency auditory evoked potential (MLAEP) Pa component following left and right ear click stimulation was investigated in 15 normal hearing and neurologically intact right-handed subjects. An unbiased reference was employed. The Pa component showed a broad voltage field that was reco...

    journal_title:Brain topography

    pub_type: 杂志文章

    doi:10.1007/BF01129337

    authors: Jacobson GP,Grayson AS

    更新日期:1988-10-01 00:00:00

  • EEG Frequency-Tagging and Input-Output Comparison in Rhythm Perception.

    abstract::The combination of frequency-tagging with electroencephalography (EEG) has recently proved fruitful for understanding the perception of beat and meter in musical rhythm, a common behavior shared by humans of all cultures. EEG frequency-tagging allows the objective measurement of input-output transforms to investigate ...

    journal_title:Brain topography

    pub_type: 杂志文章,评审

    doi:10.1007/s10548-017-0605-8

    authors: Nozaradan S,Keller PE,Rossion B,Mouraux A

    更新日期:2018-03-01 00:00:00

  • Influence of a silastic ECoG grid on EEG/ECoG based source analysis.

    abstract::The simultaneous evaluation of the local electrocorticogram (ECoG) and the more broadly distributed electroencephalogram (EEG) from humans undergoing evaluation for epilepsy surgery has been shown to further the understanding of how pathologies give rise to spontaneous seizures. However, a well-known problem is that t...

    journal_title:Brain topography

    pub_type: 杂志文章

    doi:10.1007/s10548-012-0251-0

    authors: Lanfer B,Röer C,Scherg M,Rampp S,Kellinghaus C,Wolters C

    更新日期:2013-04-01 00:00:00

  • Abnormal Functional Connectivity Density in Post-Stroke Aphasia.

    abstract::Post-stroke aphasia (PSA), which refers to the loss or impairment of language, is typically caused by left hemisphere lesions. Previous neuroimaging studies have indicated that the pathology of PSA may be related to abnormalities in functional integration. In this study, we used resting-state functional magnetic reson...

    journal_title:Brain topography

    pub_type: 杂志文章

    doi:10.1007/s10548-018-0681-4

    authors: Guo J,Yang M,Biswal BB,Yang P,Liao W,Chen H

    更新日期:2019-03-01 00:00:00

  • Scalp EEG is not a blur: it can see high frequency oscillations although their generators are small.

    abstract::High frequency oscillations (HFOs) are emerging as biomarkers of epileptogenicity. They have been shown to originate from small brain regions. Surprisingly, spontaneous HFOs can be recorded from the scalp. To understand how is it possible to observe these small events on the scalp, one avenue is the analysis of the co...

    journal_title:Brain topography

    pub_type: 杂志文章

    doi:10.1007/s10548-013-0321-y

    authors: Zelmann R,Lina JM,Schulze-Bonhage A,Gotman J,Jacobs J

    更新日期:2014-09-01 00:00:00

  • Sound-induced flash illusion is resistant to feedback training.

    abstract::A single flash accompanied by two auditory beeps tends to be perceived as two flashes (Shams et al. Nature 408:788, 2000, Cogn Brain Res 14:147-152, 2002). This phenomenon is known as 'sound-induced flash illusion.' Previous neuroimaging studies have shown that this illusion is correlated with modulation of activity i...

    journal_title:Brain topography

    pub_type: 杂志文章

    doi:10.1007/s10548-009-0090-9

    authors: Rosenthal O,Shimojo S,Shams L

    更新日期:2009-05-01 00:00:00

  • Change in Excitability of Corticospinal Pathway and GABA-Mediated Inhibitory Circuits of Primary Motor Cortex Induced by Contraction of Adjacent Hand Muscle.

    abstract::The present study examined whether the excitability of the corticospinal pathway and the GABA-mediated inhibitory circuits of the primary motor cortex that project onto the corticospinal neurons in the tonically contracting hand muscle are changed by tonic contraction of the adjacent hand muscle. The motor evoked pote...

    journal_title:Brain topography

    pub_type: 杂志文章

    doi:10.1007/s10548-016-0499-x

    authors: Jono Y,Iwata Y,Mizusawa H,Hiraoka K

    更新日期:2016-11-01 00:00:00

  • Comparing electrophysiological correlates of word production in immediate and delayed naming through the analysis of word age of acquisition effects.

    abstract::Most EEG studies analysing speech production with event related brain potential (ERP) have adopted silent metalinguistic tasks or delayed or tacit picture naming in order to avoid possible artefacts during motor preparation. A central issue in the interpretation of these results is whether the processes involved in th...

    journal_title:Brain topography

    pub_type: 杂志文章

    doi:10.1007/s10548-010-0162-x

    authors: Laganaro M,Perret C

    更新日期:2011-03-01 00:00:00

  • The effect of slice orientation on auditory FMRI at the level of the brainstem.

    abstract::Although auditory information is processed in several subcortical nuclei, most fMRI studies focus solely on the auditory cortex and do not take brainstem responses into account. One common difficulty in obtaining clear functional brainstem recordings is due to heartbeat related motion, manifested in the rostro-caudal ...

    journal_title:Brain topography

    pub_type: 杂志文章

    doi:10.1007/s10548-010-0141-2

    authors: Slabu LM

    更新日期:2010-09-01 00:00:00

  • Reliability of Visual and Somatosensory Feedback in Skilled Movement: The Role of the Cerebellum.

    abstract::The integration of vision and somatosensation is required to allow for accurate motor behavior. While both sensory systems contribute to an understanding of the state of the body through continuous updating and estimation, how the brain processes unreliable sensory information remains to be fully understood in the con...

    journal_title:Brain topography

    pub_type: 杂志文章

    doi:10.1007/s10548-015-0446-2

    authors: Mizelle JC,Oparah A,Wheaton LA

    更新日期:2016-01-01 00:00:00

  • A Finite-Difference Solution for the EEG Forward Problem in Inhomogeneous Anisotropic Media.

    abstract::Accurate source localization of electroencephalographic (EEG) signals requires detailed information about the geometry and physical properties of head tissues. Indeed, these strongly influence the propagation of neural activity from the brain to the sensors. Finite difference methods (FDMs) are head modelling approach...

    journal_title:Brain topography

    pub_type: 杂志文章

    doi:10.1007/s10548-018-0683-2

    authors: Cuartas Morales E,Acosta-Medina CD,Castellanos-Dominguez G,Mantini D

    更新日期:2019-03-01 00:00:00

  • Methodology for combined TMS and EEG.

    abstract::The combination of transcranial magnetic stimulation (TMS) with simultaneous electroencephalography (EEG) provides us the possibility to non-invasively probe the brain's excitability, time-resolved connectivity and instantaneous state. Early attempts to combine TMS and EEG suffered from the huge electromagnetic artifa...

    journal_title:Brain topography

    pub_type: 杂志文章

    doi:10.1007/s10548-009-0123-4

    authors: Ilmoniemi RJ,Kicić D

    更新日期:2010-01-01 00:00:00

  • Cortical processing of vowels and tones as measured by event-related desynchronization.

    abstract::Event-Related Desynchronization (ERD) and Synchronization (ERS) were studied in 20 normal subjects during a Sternberg-type auditory memory-scanning paradigm. Half of the subjects performed the experiment with vowels and the other half with tones as stimuli. The stimuli consisted of 100 msec long synthesized vowels and...

    journal_title:Brain topography

    pub_type: 杂志文章

    doi:10.1007/BF01187669

    authors: Krause CM,Lang H,Laine M,Kuusisto M,Pörn B

    更新日期:1995-10-01 00:00:00

  • Brain mapping analysis in patients with hepatic encephalopathy.

    abstract::Topographical analysis of cerebral electrical activity was performed in 44 patients with hepatic encephalopathy. These patients were classified in 5 groups according to clinical criteria. Eight healthy subjects were used as a control group. All were studied in an awake, eyes closed, condition and some [Control Group (...

    journal_title:Brain topography

    pub_type: 杂志文章

    doi:10.1007/BF01140590

    authors: Sagalés T,Gimeno V,de la Calzada MD,Casellas F,Dolors Macià M,Villar Soriano M

    更新日期:1990-04-01 00:00:00

  • EEG Artifact Removal in TMS Studies of Cortical Speech Areas.

    abstract::The combination of transcranial magnetic stimulation (TMS) and electroencephalography (EEG) is commonly applied for studying the effective connectivity of neuronal circuits. The stimulation excites neurons, and the resulting TMS-evoked potentials (TEPs) are recorded with EEG. A serious obstacle in this method is the g...

    journal_title:Brain topography

    pub_type: 杂志文章

    doi:10.1007/s10548-019-00724-w

    authors: Salo KS,Mutanen TP,Vaalto SMI,Ilmoniemi RJ

    更新日期:2020-01-01 00:00:00

  • Saccade related gamma-band activity in intracerebral EEG: dissociating neural from ocular muscle activity.

    abstract::Recent evidence suggests that transient increases in scalp electroencephalography (EEG) gamma band power (above 30 Hz) can be due to miniature eye movements. Although, these findings do not raise doubts about the widely established role of gamma range neural synchrony, it does call for caution when it comes to interpr...

    journal_title:Brain topography

    pub_type: 杂志文章

    doi:10.1007/s10548-009-0078-5

    authors: Jerbi K,Freyermuth S,Dalal S,Kahane P,Bertrand O,Berthoz A,Lachaux JP

    更新日期:2009-06-01 00:00:00

  • Evoked and induced gamma-band activity of the human cortex.

    abstract::The evoked gamma-band activity is an event related rhythmic response which persists within the first 100 ms after the stimulus onset. It shows spectral peaks between 30 and 40 Hz in the auditory, between 45 and 55 Hz in the somatosensory and between 100 and 110 Hz in the visual system. After separation of the wide-ban...

    journal_title:Brain topography

    pub_type: 杂志文章

    doi:10.1007/BF01195258

    authors: Pantev C

    更新日期:1995-07-01 00:00:00

  • Neurons activated during fear memory consolidation and reconsolidation are mapped to a common and new topography in the lateral amygdala.

    abstract::A key question in neuroscience is how memory is selectively allocated to neural networks in the brain. This question remains a significant research challenge, in both rodent models and humans alike, because of the inherent difficulty in tracking and deciphering large, highly dimensional neuronal ensembles that support...

    journal_title:Brain topography

    pub_type: 杂志文章

    doi:10.1007/s10548-012-0266-6

    authors: Bergstrom HC,McDonald CG,Dey S,Fernandez GM,Johnson LR

    更新日期:2013-07-01 00:00:00

  • A four sphere model for calculating the magnetic field associated with spreading cortical depression.

    abstract::In our previous model, we ascertained that the large amplitude waves (LAWs), reported by Barkley and coworkers (1990) in time series magnetoencephalography (MEG) recordings from migraine patients, could be simulated and compared with the recorded signals using a simple plane volume conductor model (Tepley and Wijesing...

    journal_title:Brain topography

    pub_type: 杂志文章

    doi:10.1007/BF01190388

    authors: Wijesinghe RS,Tepley N

    更新日期:1997-04-01 00:00:00

  • Cerebral dynamics of SEPS to non-painful and painful cutaneous electrical stimulation of the thenar and hypothenar.

    abstract::Early, middle and late latency somatosensory evoked potentials (SEPs) elicited by cutaneous electrical stimulation (painful vs. non-painful) of right and left hands were recorded. The aims were to study (1) if lifelong use of dominant right hand would result in different SEP topographies compared to non-dominant left ...

    journal_title:Brain topography

    pub_type: 杂志文章

    doi:10.1023/a:1026655001804

    authors: Niddam DM,Arendt-Nielsen L,Chen AC

    更新日期:2000-01-01 00:00:00

  • Altered directed connectivity in patients with early vascular dementia during a visual oddball task.

    abstract::The altered functional connectivity in the brain of patients with early vascular dementia (VaD) is poorly understood. Here we investigated the directed connectivity differences between VaD and normal elderly while performing a visual oddball task. Multichannel EEG data during a visual oddball task were recorded for 12...

    journal_title:Brain topography

    pub_type: 杂志文章

    doi:10.1007/s10548-014-0385-3

    authors: Xu J,Lou W,Zhao S,Wang C

    更新日期:2015-03-01 00:00:00