Finding Phrases: The Interplay of Word Frequency, Phrasal Prosody and Co-speech Visual Information in Chunking Speech by Monolingual and Bilingual Adults.

Abstract:

:The audiovisual speech signal contains multimodal information to phrase boundaries. In three artificial language learning studies with 12 groups of adult participants we investigated whether English monolinguals and bilingual speakers of English and a language with opposite basic word order (i.e., in which objects precede verbs) can use word frequency, phrasal prosody and co-speech (facial) visual information, namely head nods, to parse unknown languages into phrase-like units. We showed that monolinguals and bilinguals used the auditory and visual sources of information to chunk "phrases" from the input. These results suggest that speech segmentation is a bimodal process, though the influence of co-speech facial gestures is rather limited and linked to the presence of auditory prosody. Importantly, a pragmatic factor, namely the language of the context, seems to determine the bilinguals' segmentation, overriding the auditory and visual cues and revealing a factor that begs further exploration.

journal_name

Lang Speech

journal_title

Language and speech

authors

de la Cruz-Pavía I,Werker JF,Vatikiotis-Bateson E,Gervain J

doi

10.1177/0023830919842353

subject

Has Abstract

pub_date

2020-06-01 00:00:00

pages

264-291

issue

2

eissn

0023-8309

issn

1756-6053

journal_volume

63

pub_type

杂志文章
  • Vowel production and perception: hyperarticulation without a hyperspace effect.

    abstract::The ability of speakers to exaggerate speech sounds ("hyperarticulation") has led to the theory that the targets themselves must be hyperspace hyperarticulated. Johnson, Flemming, and Wright (1993) found that perceptual "best exemplar" choices for vowels were more speech extreme than listeners' own productions. Our fi...

    journal_title:Language and speech

    pub_type: 临床试验,杂志文章,随机对照试验

    doi:10.1177/00238309040470020301

    authors: Whalen DH,Magen HS,Pouplier M,Kang AM,Iskarous K

    更新日期:2004-01-01 00:00:00

  • Toddlers’ Word Recognition in an Unfamiliar Regional Accent: The Role of Local Sentence Context and Prior Accent Exposure.

    abstract::Adults are generally adept at recognizing familiar words in unfamiliar accents. However, studies testing young children’s abilities to cope with accent-related variation in the speech signal have generated mixed results, with some work emphasizing toddlers’ early competence and other work focusing more on their long-l...

    journal_title:Language and speech

    pub_type: 杂志文章

    doi:10.1177/0023830915600471

    authors: van Heugten M,Johnson EK

    更新日期:2016-09-01 00:00:00

  • Linking Variation in Perception and Production in Sound Change: Evidence from Dutch Obstruent Devoicing.

    abstract::This study investigates the link between the perception and production in sound change in progress, both at the regional and the individual level. Two devoicing processes showing regional variation in Dutch are studied: the devoicing of initial labiodental fricatives and of initial bilabial stops. Five regions were se...

    journal_title:Language and speech

    pub_type: 杂志文章

    doi:10.1177/0023830919880206

    authors: Pinget AF,Kager R,Van de Velde H

    更新日期:2020-09-01 00:00:00

  • Word-minimality, epenthesis and coda licensing in the early acquisition of English.

    abstract::Many languages exhibit constraints on prosodic words, where lexical items must be composed of at least two moras of structure, or a binary foot. Demuth and Fee (1995) proposed that children demonstrate early sensitivity to word-minimality effects, exhibiting a period of vowel lengthening or vowel epenthesis if coda co...

    journal_title:Language and speech

    pub_type: 杂志文章

    doi:10.1177/00238309060490020201

    authors: Demuth K,Culbertson J,Alter J

    更新日期:2006-01-01 00:00:00

  • Individual Differences in the Adoption of Sound Change.

    abstract::It is still unclear whether an individual's adoption of on-going sound change starts in production or in perception, and what the time course of the adoption of sound change is in adult speakers. These issues are investigated by means of a large-scale (106 participants) laboratory study of an on-going vowel shift in D...

    journal_title:Language and speech

    pub_type: 杂志文章

    doi:10.1177/0023830920959753

    authors: Voeten CC

    更新日期:2020-10-25 00:00:00

  • Does vowel inventory density affect vowel-to-vowel coarticulation?

    abstract::This study tests the output constraints hypothesis that languages with a crowded phonemic vowel space would allow less vowel-to-vowel coarticulation than languages with a sparser vowel space to avoid perceptual confusion. Mandarin has fewer vowel phonemes than Cantonese, but their allophonic vowel spaces are similarly...

    journal_title:Language and speech

    pub_type: 杂志文章

    doi:10.1177/0023830912443948

    authors: Mok PP

    更新日期:2013-06-01 00:00:00

  • Identification of acoustically modified Mandarin tones by non-native listeners.

    abstract::This study investigated identification of fragmented Mandarin tones by non-native listeners. Monosyllabic Mandarin words were digitally processed to generate intact, silent-center, center-only, and onset-only syllables. The syllables were recorded with two carrier phrases such that the offset of the carrier tone and t...

    journal_title:Language and speech

    pub_type: 杂志文章

    doi:10.1177/0023830909357160

    authors: Lee CY,Tao L,Bond ZS

    更新日期:2010-01-01 00:00:00

  • Interspeaker variability in emphatic accent production in French.

    abstract::This research aims (1) to describe the acoustic manifestations of emphatic accent in French by examining similarities and differences between four speakers; and (2) to identify, amongst the acoustic measures, those which determine the perception of emphasis. In experiment 1, four speakers were asked to read twenty-fou...

    journal_title:Language and speech

    pub_type: 杂志文章

    doi:10.1177/002383099603900402

    authors: Dahan D,Bernard JM

    更新日期:1996-10-01 00:00:00

  • Early Speech Segmentation in French-learning Infants: Monosyllabic Words versus Embedded Syllables.

    abstract::Lexical acquisition relies on many mechanisms, one of which corresponds to segmentation abilities, that is, the ability to extract word forms from fluent speech. This ability is important since words are rarely produced in isolation even when talking to infants. The present study explored whether young French-learning...

    journal_title:Language and speech

    pub_type: 杂志文章

    doi:10.1177/0023830914551375

    authors: Nishibayashi LL,Goyet L,Nazzi T

    更新日期:2015-09-01 00:00:00

  • Sorry, Not Sorry: The independent role of multiple phonetic cues in signaling the difference between two word meanings.

    abstract::We examine the use of multiple subphonemic differences distinguishing homophones in production and perception, through a case study focusing on the distinction between two polysemous senses of the English word "sorry" (apology vs. attention-seeking). An analysis of production data from voice actors revealed significan...

    journal_title:Language and speech

    pub_type: 杂志文章

    doi:10.1177/0023830921988975

    authors: Martinuzzi C,Schertz J

    更新日期:2021-01-28 00:00:00

  • Interaction of native- and second-language vowel system(s) in early and late bilinguals.

    abstract::The objective of this study was to determine how bilinguals' age at the time of language acquisition influenced the organization of their phonetic system(s). The productions of six English and five Korean vowels by English and Korean monolinguals were compared to the productions of the same vowels by early and late Ko...

    journal_title:Language and speech

    pub_type: 杂志文章

    doi:10.1177/00238309050480010101

    authors: Baker W,Trofimovich P

    更新日期:2005-01-01 00:00:00

  • Native and Non-native Perception of Stress in Mapudungun: Assessing Structural Maintenance in the Phonology of an Endangered Language.

    abstract::Today, virtually all speakers of Mapudungun (formerly Araucanian), an endangered language of Chile and Argentina, are bilingual in Spanish. As a result, the firmness of native speaker intuitions-especially regarding perceptually complex issues such as word-stress-has been called into question. Even though native intui...

    journal_title:Language and speech

    pub_type: 杂志文章

    doi:10.1177/0023830916628899

    authors: Molineaux BJ

    更新日期:2017-03-01 00:00:00

  • Are eyebrow movements linked to voice variations and turn-taking in dialogue? An experimental investigation.

    abstract::Following our work on the relationship between eyebrow movements and the fundamental frequency of the voice, this article presents the results of a study on this phenomenon, and also on the temporal location of rapid eyebrow movements with respect to speaking turns during dialogue. We used an automatic movement-acquis...

    journal_title:Language and speech

    pub_type: 杂志文章

    doi:10.1177/0023830909103167

    authors: Guaïtella I,Santi S,Lagrue B,Cavé C

    更新日期:2009-01-01 00:00:00

  • Effects of vowel duration and vowel quality on vowel-to-vowel coarticulation.

    abstract::This work investigates how vowel duration and vowel quality affect degrees of vowel-to-vowel coarticulation. The effects of these two factors on vowel-to-vowel coarticulation have previously received little study. Phonological durational differences due to vowel length distinction were examined in Thai. It was hypothe...

    journal_title:Language and speech

    pub_type: 杂志文章

    doi:10.1177/0023830911404961

    authors: Mok PP

    更新日期:2011-12-01 00:00:00

  • Infants' Processing of Prosodic Cues: Electrophysiological Evidence for Boundary Perception beyond Pause Detection.

    abstract::Infants as young as six months are sensitive to prosodic phrase boundaries marked by three acoustic cues: pitch change, final lengthening, and pause. Behavioral studies suggest that a language-specific weighting of these cues develops during the first year of life; recent work on German revealed that eight-month-olds,...

    journal_title:Language and speech

    pub_type: 杂志文章

    doi:10.1177/0023830917730590

    authors: Holzgrefe-Lang J,Wellmann C,Höhle B,Wartenburger I

    更新日期:2018-03-01 00:00:00

  • Dialect effects in vowel perception: the role of temporal information in French.

    abstract::The importance of vowel duration for specifying vowel contrasts differs across languages. In English, for example, a number of vowel pairs are acoustically differentiated by both temporal and spectral information, whereas in standard French temporal information plays a much more minor role. Gottfried and Beddor (1988)...

    journal_title:Language and speech

    pub_type: 杂志文章

    doi:10.1177/002383099704000304

    authors: Miller JL,Grosjean F

    更新日期:1997-07-01 00:00:00

  • The role of tonal onglides in German nuclear pitch accents.

    abstract::A perception experiment with native German listeners provided evidence for the relevance of the tonal onglide in nuclear accents--the pitch movement leading towards the target on the accented syllable. Listeners were able to distinguish between two pragmatic meanings of a short phrase (given/non-contrastive and new/co...

    journal_title:Language and speech

    pub_type: 杂志文章

    doi:10.1177/0023830914565688

    authors: Ritter S,Grice M

    更新日期:2015-03-01 00:00:00

  • Cognitive Load Reduces Perceived Linguistic Convergence Between Dyads.

    abstract::Speech convergence is the tendency of talkers to become more similar to someone they are listening or talking to, whether that person is a conversational partner or merely a voice heard repeating words. To elucidate the nature of the mechanisms underlying convergence, this study uses different levels of task difficult...

    journal_title:Language and speech

    pub_type: 杂志文章

    doi:10.1177/0023830916665652

    authors: Abel J,Babel M

    更新日期:2017-09-01 00:00:00

  • Comprehension of temporal terms by good and poor readers.

    abstract::Poor beginning readers often have difficulty comprehending spoken sentences with complex syntactic structures. This study attempts to identify the reasons for this difficulty. Second-grade good and poor readers were tested for comprehension of spoken sentences containing the temporal terms before and after. Processing...

    journal_title:Language and speech

    pub_type: 杂志文章

    doi:10.1177/002383098903200103

    authors: Macaruso P,Bar-Shalom E,Crain S,Shankweiler D

    更新日期:1989-01-01 00:00:00

  • Crossmodal and incremental perception of audiovisual cues to emotional speech.

    abstract::In this article we report on two experiments about the perception of audiovisual cues to emotional speech. The article addresses two questions: 1) how do visual cues from a speaker's face to emotion relate to auditory cues, and (2) what is the recognition speed for various facial cues to emotion? Both experiments repo...

    journal_title:Language and speech

    pub_type: 杂志文章

    doi:10.1177/0023830909348993

    authors: Barkhuysen P,Krahmer E,Swerts M

    更新日期:2010-01-01 00:00:00

  • Durational patterning at syntactic and discourse boundaries in Mandarin spontaneous speech.

    abstract::This study focused on durational cues (i.e., syllable duration, pause duration, and syllable onset intervals (SOIs)) at discourse boundaries in two dialects of Mandarin,Taiwan and Mainland varieties. Speech was elicited by having 18 participants describe events in The Pear Story film. Recorded data were transcribed, l...

    journal_title:Language and speech

    pub_type: 杂志文章

    doi:10.1177/0023830910372492

    authors: Fon J,Johnson K,Chen S

    更新日期:2011-03-01 00:00:00

  • Biomechanically preferred consonant-vowel combinations fail to appear in adult spoken corpora.

    abstract::Certain consonant/vowel (CV) combinations are more frequent than would be expected from the individual C and V frequencies alone, both in babbling and, to a lesser extent, in adult language, based on dictionary counts: Labial consonants co-occur with central vowels more often than chance would dictate; coronals co-occ...

    journal_title:Language and speech

    pub_type: 杂志文章

    doi:10.1177/0023830911434123

    authors: Whalen DH,Giulivi S,Nam H,Levitt AG,Hallé P,Goldstein LM

    更新日期:2012-12-01 00:00:00

  • Perception of American-English Vowels by Early and Late Spanish-English Bilinguals.

    abstract::Increasing numbers of Hispanic immigrants are entering the US and learning American-English (AE) as a second language (L2). Previous studies investigating the relationship between AE and Spanish vowels have revealed an advantage for early L2 learners for their accuracy of L2 vowel perception. Replicating and extending...

    journal_title:Language and speech

    pub_type: 杂志文章

    doi:10.1177/0023830918806933

    authors: Baigorri M,Campanelli L,Levy ES

    更新日期:2019-12-01 00:00:00

  • Polynomial modeling of child and adult intonation in German spontaneous speech.

    abstract::In a data set of 291 spontaneous utterances from German 5-year-olds, 7-year-olds and adults, nuclear pitch contours were labeled manually using the GToBI annotation system.Ten different contour types were identified.The fundamental frequency (F0) of these contours was modeled using third-order orthogonal polynomials, ...

    journal_title:Language and speech

    pub_type: 杂志文章

    doi:10.1177/0023830910397495

    authors: de Ruiter LE

    更新日期:2011-06-01 00:00:00

  • Phonological variant recognition: representations and rules.

    abstract::The current research explores the role of lexical representations and processing in the recognition of phonological variants. Two alternative approaches for variant recognition are considered: a representational approach that posits frequency-graded lexical representations for variant forms and inferential processes t...

    journal_title:Language and speech

    pub_type: 杂志文章

    doi:10.1177/0023830913479105

    authors: Pinnow E,Connine CM

    更新日期:2014-03-01 00:00:00

  • Auditory word serial recall benefits from orthographic dissimilarity.

    abstract::The influence of orthographic knowledge has been consistently observed in dissimilarity speech recognition and metaphonological tasks. The present study provides data suggesting that such influence also pervades other cognitive domains phonological related to language abilities, such as verbal working memory. Using se...

    journal_title:Language and speech

    pub_type: 杂志文章

    doi:10.1177/0023830910371450

    authors: Pattamadilok C,Lafontaine H,Morais J,Kolinsky R

    更新日期:2010-01-01 00:00:00

  • Event-related potentials reflecting the processing of phonological constraint violations.

    abstract::How are violations of phonological constraints processed in word comprehension? The present article reports the results of an event-related potentials (ERP) study on a phonological constraint of German that disallows identical segments within a syllable or word (CC(i)VC(i)). We examined three types of monosyllabic lat...

    journal_title:Language and speech

    pub_type: 杂志文章

    doi:10.1177/0023830909336581

    authors: Domahs U,Kehrein W,Knaus J,Wiesel R,Schlesewsky M

    更新日期:2009-01-01 00:00:00

  • Base-language effects on word identification in bilingual speech: evidence from categorical perception experiments.

    abstract::The categorical perception paradigm was used to investigate whether French-English bilinguals categorize a code-switched word as French or English on the basis of its acoustic-phonetic information alone or whether they are influenced by the base-language context in which the word occurs, that is, by the language in wh...

    journal_title:Language and speech

    pub_type: 杂志文章

    doi:10.1177/002383098903200404

    authors: Bürki-Cohen J,Grosjean F,Miller JL

    更新日期:1989-10-01 00:00:00

  • Syntactic structure guides prosody in temporarily ambiguous sentences.

    abstract::A pair of speaking and listening studies investigated the prosody of sentences with temporary Object/Clause and Late/Early Closure ambiguities. Speakers reliably produced prosodic cues that allowed listeners to disambiguate Late/Early Closure sentences, but only infrequently produced prosody that disambiguated Object/...

    journal_title:Language and speech

    pub_type: 杂志文章

    doi:10.1177/0023830910372497

    authors: Anderson C,Carlson K

    更新日期:2010-01-01 00:00:00

  • Early sound patterns in the speech of two Brazilian Portuguese speakers.

    abstract::Sound patterns in the speech of two Brazilian-Portuguese speaking children are compared with early production patterns in English-learning children as well as English and Brazilian-Portuguese (BP) characteristics. The relationship between production system effects and ambient language influences in the acquisition of ...

    journal_title:Language and speech

    pub_type: 杂志文章

    doi:10.1177/00238309020450020401

    authors: Teixeira ER,Davis BL

    更新日期:2002-06-01 00:00:00