Acoustics of persuasion: a systematic review of prosodic features on the communicative attitudes of confidence

Gomes, Dianete Ângela do Valle; Dornelas, Rodrigo; Souza, Lívia Maria Santos de; Strauss, Yonara Caetano de Santana; Silva, Eduardo Magalhães da; Celeste, Letícia Corrêa

doi:10.1590/1678-460X202339345326

Acessibilidade / Reportar erro

Brasil

DELTA: Documentação de Estudos em Lingüística Teórica e Aplicada

Español English

Brasil

Español English

sumário « anterior atual seguinte »

Sumário

Articles • DELTA 39 (3) • 2023 • https://doi.org/10.1590/1678-460X202339345326 copy

Acoustics of persuasion: a systematic review of prosodic features on the communicative attitudes of confidence

Acústica da persuasão: uma revisão sistemática de aspectos prosódicos na atitude comunicativa de confiança

Authorship SCIMAGO INSTITUTIONS RANKINGS

ABSTRACT

Purpose: To review the literature regarding prosodic acoustic features found in communicative attitudes related to confidence, certainty, and persuasion. Method: A systematic review was carried out in the databases VHL, Web of Science, Science Direct, SciELO, and SCOPUS with no temporal restriction. Data Extraction: The data from each article was extracted based on the STROBE Statement checklist. To analyze the prosodic variables, the data were subdivided according to Couper-Kuhlen’s (1986) theoretical assumptions, and the variables were grouped into “temporal organization of speech,” “intensity,” and “pitch”. Conclusion: The data suggested that there are relevant but not consensual variables to characterize a persuasive speech and some variables can be considered as positive, negative, or neutral in different language contexts. The variables that stand out as relevant and are characteristic of the persuasive or confidant speech were faster speech speed and higher intensity. The only negative variable that stood out regarding persuasion was the increase in pitch.

Keywords:
persuasion; prosody; communication; acoustics; speech

Prosodic feature	Specific variables
Speech temporal organization	Higher/faster speech rate
	Lower speech rate
	Pauses
	Short pauses
	Long pauses
	Disfluencies (including filled pauses and stuttering-like disfluencies)
Intensity	Moderate intensity
	Increased mean intensity
	Lower mean amplitude
	Increased variation in intensity
Pitch	Rising pitch/intonation
	High Mean F0
	Increased F0 range/increased variation in pitch
	Decreased F0 range/unmarked intonation
	Lower mean F0
	Wide falling tone (pitch range)
	Falling-rising tone (pitch range)

N	Author	Year	Journal	Title	Country of origin
1	Klofstad & AndersonKlofstad, C. A., & Anderson, R. C. (2018). Voice pitch predicts electability but does not signal leadership ability. Evolution and Human Behavior, 39(3), 349-354. https://doi.org/10.1016/j.evolhumbehav.2018.02.007. https://doi.org/10.1016/j.evolhumbehav.2...	2018	Evolution and Human Behaviour	Voice pitch predicts electability, but does not signal leadership ability	USA
2	Zhao et al.Zhao, L., Dehé, N., & Murphy, V. A. (2018) From pitch to purpose: The prosodic-pragmatic mapping of [I+verb] belief constructions in English and Mandarin. Journal of Pragmatics, 123, 57-77. https://doi.org/10.1016/j.pragma.2017.10.015. https://doi.org/10.1016/j.pragma.2017.10...	2018	Journal of Pragmatics	From pitch to purpose: The prosodic pragmatic mapping of [i+verb] belief constructions in English and Mandarin	UK
3	Jiang & PellJiang, X., & Pell, M. D. (2017). The sound of confidence and doubt. Speech Communication, 88, 106-126. https://doi.org/10.1016/j.specom.2017.01.011. https://doi.org/10.1016/j.specom.2017.01...	2017	Speech Communication	The sound of confidence and doubt	Canada
4	Jiang & PellJiang, X., & Pell, M. D. (2016). Neural responses towards a speaker’s feeling of (un)knowing. Neuropsychologia, 81, 79-93. https://doi.org/10.1016/j.neuropsychologia.2015.12.008. https://doi.org/10.1016/j.neuropsycholog...	2016	Neuropsychology	Neural responses towards a speaker’s feeling of unknowing	Canada
5	Chen et al.Chen, D., Halberstam, Y., & Yu, A. C. (2016). Perceived Masculinity Predicts U.S. Supreme Court Outcomes. PLoS One, 11(10), e0164324. https://doi.org/10.1371/journal.pone.0164324. https://doi.org/10.1371/journal.pone.016...	2016	PLOS ONE	Perceived masculinity predicts U.S. Supreme Court Outcomes	France
6	Jiang & PellJiang, X., & Pell, M. D. (2015). On how the brain decodes vocal cues about speaker confidence. Cortex, 66, 9-34. https://doi.org/10.1016/j.cortex.2015.02.002. https://doi.org/10.1016/j.cortex.2015.02...	2015	Cortex	On how the brain decodes vocal cues about speaker confidence	Canada
7	Elbert & DijkstraElbert, S. P., & Dijkstra, A. (2014). An experimental test of the relationship between voice intonation and persuasion in the domain of health. Psychology & Health, 29(9), 1014-1031. https://doi.org/10.1080/08870446.2014.903482. https://doi.org/10.1080/08870446.2014.90...	2014	Psychology & Health	An experimental test of the relationship between voice intonation and persuasion in the domain of health	Netherlands
8	Azevedo et al.Azevedo, l. L., Souza, I. S., Oliveira, P. M., & Cardoso, F. (2015). Effect of speech therapy and pharmacological treatment in prosody of parkinsonians. Arquivos de Neuro-Psiquiatria, 73(1), 30-35. https://doi.org/10.1590/0004-282X20140193. https://doi.org/10.1590/0004-282X2014019...	2014	Arq. Neuro-Psiquiatria	Effect of Speech Therapy and pharmacological treatment in prosody of parkinsonians	Brazil
9	Celeste & ReisCeleste, L. C., & Reis, C. (2013a). Expressão de atitudes na fala com gagueira: percepção de falantes fluentes. Alfa: Revista de Linguística, 57, 275-29. https://doi.org/10.1590/S1981-57942013000100012. https://doi.org/10.1590/S1981-5794201300...	2013	Alfa	Attitudes expression on stuttering speech: perception of fluent speakers	Brazil
10	Celeste & ReisCeleste, L. C., & Reis, C. (2013b). Expressão de certeza e dúvida na gagueira: estudo dos aspectos temporais da fala. Revista CEFAC, 15, 1609-1620. https://doi.org/10.1590/S1516-18462012005000060. https://doi.org/10.1590/S1516-1846201200...	2013	Ver. CEFAC	Expression of certainty and doubt in stuttering: study of temporal aspects of speech	Brazil
11	Yokoyama & DaiboYokoyama, H., & Daibo, I. (2012). Effects of gaze and speech rate on receivers’ evaluations of persuasive speech. Psychological Reports, 110(2), 663-676. https://doi.org/10.2466/07.11.21.28.PR0.110.2.663-676. https://doi.org/10.2466/07.11.21.28.PR0....	2012	Psychological Reports	Effects of gaze and speech rate on receivers, evaluations of persuasive speech	Japan
12	Tomlinson & TreeTomlinson Jr., J. M., & Fox Tree, J. E. (2011) Listeners’ comprehension of uptalk in spontaneous speech. Cognition, 119(1), 58-69. https://doi.org/10.1016/j.cognition.2010.12.005. https://doi.org/10.1016/j.cognition.2010...	2011	Cognition	Listeners’ comprehension of uptalk in spontaneous speech	USA
13	Jones et al.Jones, C., Berry, L., & Stevens, C. (2007). Synthesized speech intelligibility and persuasion: Speech rate and non-native listeners. Computer Speech & Language, 21(4), 641-651. https://doi.org/10.1016/j.csl.2007.03.001. https://doi.org/10.1016/j.csl.2007.03.00...	2007	Speech and Computer Language	Synthesized speech intelligibility and persuasion: Speech rate and non-native listeners.	Australia
14	Chebat et al.Chebat, J. C., El Hedhli, K., Gelinas-Chebat, C., & Boivin, R. (2007). Voice and persuasion in a banking telemarketing context. Perceptual Motor Skills, 104(2), 419-437. https://doi.org/10.2466/PMS.104.2.419-437. https://doi.org/10.2466/PMS.104.2.419-43...	2007	Perceptual and motor skills	Voice and persuasion in a banking telemarketing context	Canada
15	Pell MD	2006	Brain and Language	Reduced sensitivity to prosodic attitudes in adults with focal right hemisphere brain damage	Canada
16	Verdugo DRRamírez Verdugo, D. (2005). The nature and patterning of native and non-native intonation in the expression of certainty and uncertainty: Pragmatic effects. Journal of Pragmatics, 37(12), 2086-2115. https://doi.org/10.1016/j.pragma.2005.02.012. https://doi.org/10.1016/j.pragma.2005.02...	2005	Journal of Pragmatics	The nature and patterning of native and non-native intonation in the expression of certainty and uncertainty: Pragmatic effects	Spain
17	Krahmer & SwertsKrahmer, E., & Swerts, M. (2005). How children and adults produce and perceive uncertainty in audiovisual speech. Language and Speech, 48(Pt 1), 29-53. https://doi.org/10.1177/00238309050480010201. https://doi.org/10.1177/0023830905048001...	2005	Language and Speech	How children and adults produce and perceive uncertainty in audiovisual speech	Netherlands
18	Barr, DJBarr, D. J. (2003). Paralinguistic correlates of conceptual structure. Psychonomic on Bulletin & Review, 10(2), 462-467. https://doi.org/10.3758/BF03196507. https://doi.org/10.3758/BF03196507...	2003	Psychonomic Bulletin & Review	Paralinguistic correlates of conceptual structure	USA
19	Gélinas-Chebat et al.Gelinas-Chebat, C., & Chebat, J. C. (1996). Voice and advertising: effects of intonation and intensity of voice on source credibility, attitudes toward the advertised service and the intent to buy. Perceptual and Motor Skills, 83(1), 243-262. https://doi.org/10.1080/08870446.2014.903482. https://doi.org/10.1080/08870446.2014.90...	1996	Perceptual and motor skills	Voice and advertising: Effects of intonation and intensity of voice on source credibility, attitudes toward the advertised service and the intent to buy	Canada
20	Erickson et alErickson, B., Lind, E. A., Johnson, B. C., & O’Barr, W. M. (1978). Speech style and impression formation in a court setting: The effects of “powerful” and “powerless” speech. Journal of Experimental Social Psychology, 14(3), 266-279. https://doi.org/10.1016/0022-1031(78)90015-X. https://doi.org/10.1016/0022-1031(78)900... .	1978	Journal of experimental social psychology	Speech style and impression formation in a court setting: The effects of “powerful” and “powerless” speech.	USA

N	Results	Conclusion
1	The observational study shows that Members of Congress with lower voices are not more effective leaders, and the experiment shows that speakers with lower voices are not more persuasive policy advocates. Taken together, the two studies suggest that voice pitch is not a reliable signal of leadership ability.	Voice pitch does not correlate with leadership ability. The data presented here supports the hypothesis that voice pitch contains information about leadership ability. Members of Congress with lower voices are not more effective legislators, and speakers with lower voices are not more persuasive when making statements about governmental policies.
2	The study showed that prosody with contrasting foci seem to be performed universally as a pragmatic tool to present new information. In fact, there is congruent evidence in the use of pitch to signal the contrast of focus strategy that is used both in English and Mandarin. In the intonation (emphasis) the focus is marked by the accentuation of the pitch. However, the prosodic structure within the lexical component, makes lexical access easier and determines the lexical identity, rather than the pragmatical interpretation of the statement.	The findings strengthen the notion that both pitch and pitch range function successfully as a cue of prominence. The [I+verb] perception task discussed in this paper revealed that perceived confidence of [I+verb] constructs correspond to alternative semantic interpretations created by prosodic variation of focus-marking, with direct statements appearing most confident, followed by the main clause, epistemic marker, and finally discourse marker [I+verb] variations.
3	Confident voices tend to display increased intensity, and increased variation in both intensity and pitch, whereas doubtful voices are marked by a higher pitch, more pauses, and decreased rate of speech. Neutral statements were significantly lower in pitch and weakest in intensity, varied the least in pitch and intensity, and were spoken faster than all the other expressions that were seen as communicating some level of confidence. Intonation contour (upward versus downward) can play an important role in how expressed confidence is communicated.	The findings provide new information on how metacognitive states such as confidence and doubt are communicated by vocal and linguistic cues which permit listeners to arrive at graded impressions of a speaker’s feeling of (un)knowing.
4	For the lexical phrase, the mean F0 was highest when a speaker was unconfident, lower in the close-to-confident condition, and lowest in confident expressions. Mean speaker amplitude was highest in confident expressions and lowest in unconfident expressions. Speech rate was notably slower when speakers were unconfident and was slower in close-to-confident than in confident expressions. The analysis of F0 and amplitude range did not yield significant differences across conditions, although unconfident expressions tended to display the largest F0 range.	The results show the mechanisms of cognitive processing and the individual factors that govern how we infer the speaker’s mental state from the speech signal.
5	The study found significant correlation between vocal characteristics and court outcomes and the correlation is specific to perceived masculinity, even when judgement of masculinity is based only on less than three seconds of exposure to a lawyer’s speech sample. Specifically, male advocates are more likely to win when they are perceived as less masculine. No other personality dimension predicts court outcomes.	While the study does not aim to establish any casual connections, the findings suggest that vocal characteristics may be relevant in even as solemn a setting as the Supreme Court of the United States.
6	In general, mean F0 was higher when a speaker was unconfident than in all other conditions. Also, close-to-confident and confident expressions (which did not differ) displayed a higher mean F0 than neutral intending utterances. Regarding amplitude, neutral-intending and confident expressions are highest (which did not differ), and close-to-confident expressions are lowest. The confident expressions showed a larger range of variation than all other expression types. Speech-rate was significantly faster for neutral-intending expressions than all three types of confidence expressions. They were also notably slower when speakers were unconfident than confident or close-to-confident. The analysis of F0 range did not yield significant differences across conditions, although unconfident expressions tended to display the largest F0 range.	The results establish that a listener’s brain is rapidly attuned to vocal cues that signal one’s feeling of knowing and can differentiate subtle vocal variations as a function of the perceived degree of knowing.
7	The studies showed that high intonation led to a significant drop in intention amongst respondents who perceived their own health as good. After self-affirmation, persuasion was increased.	A high level of intonation seems to induce self- regulatory defenses in people who do not see the necessity to change their health behavior, whereas people with poor perceived health might perceive potential to change. The use of a normal level of intonation in auditory health messages is recommended.
8	Speech therapy and its association with drug treatment promoted the improvement of prosodic parameters, namely increases of F0 measures, reduction of measures of duration, and greater intensity.	Levodopa is effective in improving the duration parameter. As such, its association with speech therapy to improve other prosodic parameters (F0 and intensity) and to improve communication performance in patients with Parkinson’s Disease - thus to improve their quality of life - is noteworthy.
9	The results showed a statistically significant difference between the results of CG and EG judges: judges recognize attitudes expressed by non-stutterers better than those expressed by stutterers.	Fluent speakers succeed in expressing certainty and doubt, while stutterers do not.
10	The expression of doubt has the lowest rate of articulation in the CG, followed by neutral and certainty expressions, with statistically significant differences. Pauses were present in the CG, but disfluencies happened only in the expression of doubt. In the EG, the largest difference was found in the vowel duration of the stressed syllable.	CG showed a more varied temporal organization in the expression of attitudes. However, it’s also possible to note a trend in the group of people who stutter. Regarding the speech rate, after removing the pauses and disfluencies, both EG1 and EG2 differentiate certainty, articulating each syllable faster.
11	High incidences of persuasive ability are related to groups with lower speech rates in comparison to groups with faster speech rates.	Analysis of speech rate, gaze, and the listener’s sex revealed that when combined with a small amount of gaze, slow speech rate decreased trustworthiness when compared to a fast speech rate. For women, slow speech rate was thought to be indicative of less expertise, when compared to a fast speech rate combined with low gaze. There were no significant interactions, but there were main effects of gaze and speech rate on persuasiveness. High levels of gaze and slow speech rate each enhanced perceptions of the speaker’s persuasiveness.
12	In Experiment 1A, listeners rated speakers as less accurate when speakers prolonged syllables the end of the first utterance in the pair. Accuracy ratings were unaffected by rising pitch at the end of the first utterance in the pair. In Experiment 1B, listeners rated speakers as less certain when speakers prolonged syllables at the end of the first utterance in the pair. Certainty ratings were unaffected by rising pitch at the end of the first utterance in the pair. In Experiment 2 words were monitored for speed when they followed sentences ending in prolonged rising pitch. Words were slower when there were sentences ending in non-prolonged rising pitch. In Experiment 3 the interaction between rising pitch and prolongations depended on the listeners beliefs about the speaker’s mental state.	Results support the theory that temporal and situational context are important in determining intonational meaning. When listeners believed that speakers were non-experts, they interpreted rising pitch and prolongations similarly to when they were provided with no information about speakers. However, when listeners thought that speakers were experts, their word monitoring was no longer affected by rising pitch or prolongations. This is strong evidence that listeners establish relationships between linguistic form and function by first presupposing a speaker’s mental state.
13	The study indicates that simply raising the speech rate from normal to high does not result in greater persuasiveness. Such manipulation alone brought no gain for an audience of native and non-native listeners, as raising the speech rate above 178 wpm is likely to reduce comprehension even further for all listeners. Increase in speech rate is not worth pursuing to increase persuasiveness.	A faster speech rate lowers comprehension for both native and non-native listeners and does not influence persuasiveness. There was a non-significant tendency, however, for the usefulness of products, where the product description was delivered at a faster speech rate. There was no difference between native and non-native listeners on the effect of speech rate on persuasion.
14	Analysis indicated a moderate intensity, an unmarked intonation, and a fast speech rate associated with a more credible source than other combinations. Sex was not a significant moderator in the relationship between voice characteristics and source credibility.	Voice characteristics significantly affected attitude towards the advertisement and behavioral intention.
15	High confidence was expressed with a lower mean F0 than low confidence, and both high and moderate confidence utterances displayed a reduced F0 range, when compared to low confidence utterances. High confidence was expressed with a faster speech rate than moderate and low confidence for the prosody stimuli.	Although emotional and attitudinal meanings of prosody seem to implicate the right hemisphere in a mandatory way, perhaps at multiple processing levels, the findings are inconclusive regarding the probable input of the left hemisphere in these processes. This bias meant that when prosodic cues were continuously encoded in speech and weighed heavily for assigning speaker attitudes (Experiment 1) or signaled a non-literal interpretation of the verbal message (Experiment 2), right hemisphere damage patients failed to fully appreciate the attitude of the speaker in these situations. “When speakers used a high/rising rather than a falling intonation contour, requests were invariably perceived as more polite by all participants in the study”.
16	Spanish learners avoid the falling-rising tone to express lack of certainty, using a falling contour in all contexts instead. The intonation of the non-native speakers does not contribute to a clear distinction between certainty and uncertainty. Their falling tones are very shallow, which does not help towards discerning any absolute certainty in their responses. Instead, the responses are realized with a narrow falling pitch range and mid-level flat contours. On the gradient from strong certainty, realized with a wide falling tone, to high uncertainty, signaled by a falling-rising tone, the tones produced by non-native speakers range from narrow falling to level, just in the middle of the intonational scale described.	The results demonstrate that non-native English intonation, as to nature and patterning, differs from native intonation when it comes to expressing modality. The results reveal that the Spanish speakers’ choice of the English tone system may lead to pragmatic incompatibility in the expression of modality in their interactions. The intonation of the non-native speakers does not contribute to a clear distinction between certainty and uncertainty. Their falling tones are very shallow, which does not help discerning any absolute certainty in their responses.
17	Results show that when adult speakers were uncertain, they were more likely to produce fillers, delays, high intonation, eyebrow movements, and “funny faces”.	It was found that both children and adults judges rated with more accurate scores answers from adult speakers than from child speakers. Child judges provided less accurate scores than adult judges. No meta-cognitive differences were found between adults and children. It appears that adult speakers use audiovisual prosody to rate their level of uncertainty in a more consistent and clearer way than child speakers.
18	Paralinguistic expressed confidence was consistent with the underlying category structure. When speakers showed such characteristic, learners acquired the categories more rapidly and showed better category differentiation from the earliest moments of learning. 95% of the least confident utterances began with a filled pause, whereas none of the most confident ones did. 92% of the least confident utterances also included rising intonation, whereas none of the most confident utterances did show such intonation.	Listeners’ ability to exploit paralinguistic cues of uncertainty in learning novel concepts has important implications for theories of language use, categorization, and language learning.
19	Analysis by a system of simultaneous equations indicated that the effects of voice are different under low and high involvement. Voice intensity affects credibility of the source significantly more under low than high involvement. Voice intonation affects credibility more under high than low involvement.	Voice characteristics affect attitudes toward the advertised service and the intent to buy.
20	The use of a powerful style resulted in greater attraction to the witness, regardless of his/her sex or the subject, or the mode of the testimony presentation. A powerful style also resulted in greater perceived credibility of the witness than did a powerless style. However, this effect was stronger when the subject and the witness were of the same sex than when they were of the opposite sex. For the male witness-written presentation condition, a powerful style produced more acceptance of the position advocated in the testimony than did a powerless (rise intonation) style.	The results discussed the possible relationships between speech styles and person perception and persuasion processes, regarding the social psychology of legal issues.
21	Confident voice condition may indicate that paralinguistic expression of confidence is achieved, in part, through selective stress of strategic linguistic units. In the confident voice condition, the speaker used pauses less frequently and such pauses were shorter. The means suggest that the speaker used substantially longer pauses to express doubtful voice under confident text conditions, but this interaction approaches significance only for between-sentence pauses. There were no significant differences with respect to number or duration of pauses for the text variable. Findings suggest that pauses of various sorts are indicative of cognitive tension states, relevant to them, and may indicate some of the correlates of the expressed confidence and doubt.	The study suggests that confidence is expressed in a paralinguistic way by increased voice loudness, higher pitch level (under certain conditions), shorter pauses, and a faster speech rate.

Setting/Variables	Effect on persuasion
Setting/Variables	Positive	Negative	Neutral
Speech Temporal Organization
Higher/faster speech rate	4		3
Lower speech rate	1	4	1
Pauses		2
Short pauses	1
Long pauses		1
Disfluencies¹		4
Intensity
Moderate intensity²	1
Lower mean amplitude²		1
Increased mean intensity³	5		1
Increased variation in intensity³	2
Pitch
Rising pitch/intonation⁴		3
High Mean F0⁴	1	6
Increased F0 range/variation in pitch⁴	4	2	1
Decreased F0 range/unmarked intonation⁵	1
Lower mean F0⁵	2	1	1
Wide falling tone (pitch range)⁵	1
Falling-rising tone (pitch range)⁵		1

Pontifícia Universidade Católica de São Paulo - PUC-SP PUC-SP - LAEL, Rua Monte Alegre 984, 4B-02, São Paulo, SP 05014-001, Brasil, Tel.: +55 11 3670-8374 - São Paulo - SP - Brazil
E-mail: delta@pucsp.br

Acompanhe os números deste periódico no seu leitor de RSS

[1] Conflict of interests

The authors declare they have no conflict of interest.

Number 1
Objective: To assess whether voice pitch is a reliable signal of leadership ability, if individuals with lower pitched voices are better leaders, individuals with lower pitched voices should be more persuasive when making policy appeals.
Global design: Production and perception
Corpus (speech production)	Perceptual evaluation (perception)	Participants
Study 1. Observational study. Recordings of each Member of Congress. Voice sources from YouTube and CSPAN online archive videos.	Study1. Leadership ability is measured based on a power ranking of the Members of the 109th US Congress created by Knowlegis (cqrollcall.com/knowlegis) and compared to results of acoustic analysis by PRAAT used to measure the mean F0 of each recording.	Study 1. 536 Members of Congress
Study 2. Policy persuasion experiment. Four male and four female native English speakers were recorded speaking the following six policy advocacy statements:	Study 2. The experiment required subjects to listen to recordings of policy advocacy statements delivered by speakers with differently pitched voices to test whether speakers with lower voices are more persuasive.	Study 2. 777 participants. 344 men and 433 women. Cooperative; Congressional.
“You should support same sex marriage”
Number 2
Objective: Study the “prosodic variation as a cue to pragmatic interpretation in a specific linguistic construction namely [l+verb]”.
Global design: Production and perception
Corpus (speech production)	Perceptual evaluation (perception)	Participants
An online language questionnaire adapted from the questionnaire Zaho’s (2013) was used and online perception tasks created via Qualtrics (Qualtrics Lab, INC, 2015) and validated by pilot test. The tasks combine the studies of Meyer and Mleineks (2006) that use electronic research to present audio recordings for the perception and categorization of tasks involving the prosodic interpretation of issues/utterances in Russian; and the studies of Kurumada et al. (2012) with electronic human intelligence (artificial intelligence) in tasks of weekly interpretations and prosodic variation of the utterance: “It looks like”, and that similarly, analyzed the effect of prosodic variation in the semantic interpretation.	‘‘Think’’ (‘juede’ in Mandarin), the most used belief verb, was used across trials. All target nouns were imaginable, common words and were chosen for their neutrality and contextual plausibility. (...) These were audio recorded with one of the six prosodic variations and presented for the listener to click and hear. Each recording was followed by a question asking the participant to choose whether the speaker in the recording sounds, ‘‘Deliberate,’’ ‘‘Uncertain,’’ or ‘‘Reluctant’’, with a short definition following each term” (...) “This task included 24 target nouns with each of the six prosodic variations appearing four times”.	59 individuals consisting of 30 in the US/English group and 29 in the China/Mandarin Group.
Number 3
Objective: To shed light on how speakers and listeners use systematic variations in verbal and vocal cues to communicate confidence along a continuum of expressed meanings (confident, close-to-confident, unconfident) and in the context of utterances serving different communicative functions (facts, judgments, intentions).
Global design: Production and perception
Corpus (speech production)	Perceptual evaluation (perception)	Participants
Experiment 1. Sentences were produced by native Canadian English speakers. Speakers were encouraged to produce statements with a certain level of confidence by responding to a question from a female examiner in a mini dialogue format (e.g., “What will happen?” - Target: “Maybe, we will run out of gas”).	Listeners were asked to make two consecutive judgments. They were first asked to judge whether the speaker intended to convey some level of confidence by clicking on a YES.	Experiment 1. Six native Canadian English speakers (mean age of 22.8 years, three female and three male). Experiment 2. A total of 72 native speakers of Canadian English were recruited from McGill University and consented to serve as listeners in the study (37 females and 35 males, mean age of 24.8 years - from 18 to 35 YO ; mean education of 16.34 years, from 13 to 21 YO).
Number 4
Objective: To Investigate the time course and neural responses underlying a listener’s ability to evaluate speaker confidence from combined verbal and vocal cues.
Global design: Perception
Corpus (speech production)	Perceptual evaluation (perception)	Participants
Recordings were selected for four different actors (two females and two males, aged from 19-25, 24 triplets/speaker); these speakers produced the most perceptually salient distinctions in the low to high levels of expressed confidence based on ratings from 60 listeners in a validation study.	96 stimulus triplets were selected from a database of vocal confidence recordings (Jiang and Pell, 2014). A stimulus was composed of a lexical phrase communicating one of three distinct levels of confidence (confident, close-to-confident, unconfident), followed by the main utterance that was linguistically identical across confidence conditions, but produced in a tone of voice that was congruent with the lexical phrase.	30 university students consented to participate in the electroencephalogram (EEG) experiment (15 female/15 male, mean age of 22.6 years, range from 18 to 30 YO). All were right-handed, native Canadian English speakers who took part in a companion study focusing on vocal confidence perception.
Number 5
Objective: To test whether people’s subjective voice-based trait judgments are predictive of the Supreme Court of the US outcomes.
Global design: Perception
Corpus (speech production)	Perceptual evaluation (perception)	Participants
1634 oral arguments made by 916 distinct male advocates. The stimuli for this study were drawn from oral arguments made in the Supreme Court of the US between 1998 and 2012. Use of identical two to three seconds of content delivered at the outset of each argument: “Mr. Chief Justice, (and) may it please the Court”.	Participants from Amazon Mechanical Turk (AMT) rated the voice clips of the Supreme Court advocates. About half	916 male advocates; 634 raters (321 female).
	(321) of the 634 distinct participants who completed our survey were female.
	Participants were asked to rate the voice clips of Supreme Court advocates on a scale of 1 to 7 in terms of aggressiveness, attractiveness, confidence, intelligence, masculinity, and trustworthiness. Each participant rated 66 voice recordings.
Number 6
Objective: Examine the temporal neural dynamics underlying a listener’s ability to infer speaker confidence from vocal cues during speech processing and investigate how and when the brain responds to expressed confidence in the vocal channel of speech, to provide new data on how listeners infer key aspects of a speaker’s mental state (i.e., “feeling of knowing”).
Global design: Perception
Corpus (speech production)	Perceptual evaluation (perception)	Participants
The EEG study used recordings from two male and two female speakers who encoded the most salient distinctions in the low to high levels of confidence when judged by native listeners in the validation study. Altogether, 384 recordings (96 statements and four confidence levels) were chosen as the experimental stimuli. Another 480 utterances that contained an initial lexical phrase for inferring confidence (e.g., “I’m positive…”, “Maybe…”) were also presented for the purpose of a companion study investigating the effects of verbal cues on vocal confidence perception (for these items, sentences were identical to the critical stimuli but included an initial lexical phrase that was not removed prior to the EEG experiment).	96 stimulus “quartets” were selected from a database of vocal expressions of confidence. Within each quartet, identical statements expressed either a confident, close-to-confident, unconfident, or neutral intending message based only on changes in tone of voice. The 96 statements varied in communicative function: 32 were descriptions of fact (e.g., “She has access to the building”), 32 were statements of judgment (e.g., “He’s too old to split the wood”), and 32 were statements of intention (e.g., “We’ll help them with it”).	To production - used recordings by two male and two female speakers. To perception - 30 university students (15 female/15 male, mean age 22.6 years, range from 18 to 30 YO), native Canadian English speakers, right-handed. None had suffered from major psychiatric or neurological illness, had speech or hearing problems, or had participated in our previous studies.
Number 7
Objective: To test to what extent different levels of intonation are related to persuasion and whether for some recipients the threat posed by the message information might become too strong to face.
Global design: Perception
Corpus (speech production)	Perceptual evaluation (perception)	Participants
An actress with sufficient control over her voice was selected and directed by the first author to produce three versions of the health message which varied on the dimension of intonation (low, moderate, and low).	Study 1. 130 respondents listened to a health message with either a low, moderate, or high level of intonation.	Study 1. 130 Dutch student participants (76.2% females), ranging from 17 to 32 YO, randomly distributed over the following conditions: low intonation condition; moderate intonation condition; high intonation condition.
	Study 2. 143 respondents. The same manipulations of intonation were applied, but half of the respondents were affirmed before they listened to the persuasive message. Intention to increase fruit and vegetable intake was used as a dependent variable.	Study 2: 143 participants (72.7% females), who varied in age from 17 to 31 YO; self-affirmation conditions: low, moderate, high level of intonation; no self-affirmation conditions: low, moderate, high level of intonation.
Number 8
Objective: To verify the influence of levodopa and of the adapted Lee Silverman Vocal Treatment Method on prosodic parameters employed by parkinsonian patients.
Global design: Production
Corpus (speech production)	Perceptual evaluation (perception)	Participants
Recording of utterances produced in four stages: expressing attitudes of certainty and doubt and declarative and interrogative modalities. The sentences were recorded under the effect of levodopa (on), without the effect of levodopa (off), and before and after speech therapy during the on and off periods.	No perceptual evaluation done.	Ten patients with idiopathic Parkinson’s disease using levodopa, consisting of five men ranging from 59 to 88 YO and five women, ranging from 59 to 75 YO.
Number 9
Objective: To verify how fluent speakers of Brazilian Portuguese perceive the expression of certainty and doubt attitudes on stutterers’ speech.
Global design: Perception
Corpus (speech production)	Perceptual evaluation (perception)	Participants
12 stutterers (EG) and 12 non- stutterers (CG) recorded two utterances in each of the three forms studied (neutral, certainty, and doubt)	60 judges have participated: 30 judged CG’s utterances and 30 judged EG’s utterances.	60 male judges ranging from 20 to 40 YO. 24 participants, 12 with stuttering and 12 without stuttering for speech data.
Number 10
Objective: To examine the role of speech temporal organization on the expression for attitudes of certainty and doubt in a group of adults who stutter, comparing such analysis with a group of speech-fluent adults.
Global design: Production
Corpus (speech production)	Perceptual evaluation (perception)	Participants
10 key phrases that were produced in the neutral form, expressing doubt and certainty, totaling 840 utterances.	No perceptual evaluation done.	24 individuals, 12 who stuttered (EG1 and EG2) and 12 non-stuttering (CG).
Number 11
Objective: This study examined how gaze and speech rate affect the perceptions of a speaker.
Global design: Production and perception
Corpus (speech production)	Perceptual evaluation (perception)	Participants
The speaker was a 23 YO female graduate student. The speaker wore a black suit and glasses, showing her shoulders and head. Two gazes were directed at the camera: 8% of the total visual recording time (low gaze) and 83% of total visual recording time (high gaze). A group of recordings with a slow speech rate (330 syllables/min) and another group with a fast speech rate (510 syllables/min.), based on the average speech rate of 420 words/min. Pitch was set constant during the editing process. This produced four stimulus types: low gaze + fast speech, low gaze + slow speech, high gaze + fast speech, and high gaze + slow speech.	Participants were divided into four groups according to stimulus gaze (high gaze + low gaze groups) and stimulus speech rate (fast speech + slow speech groups). Participants were initially told that the aim of the study was to examine participants’ comprehension of a provided communication. Participants were shown a static image of the speaker for five seconds, so that they could become accustomed to the study environment. Participants were asked to listen to and observe the speaker from the perspective of a person who is attending the conference.	466 students with a mean age of 19.6 years.
Number 12
Objective: To test the hypothesis that the extensions at the end of the declarative utterances, or uptalk, can differentiate the conflicting functions of the increase of the tone. To verify whether the listeners assign different levels of certainty to the increase of tone and the prolongations.
Global design: Perception
Corpus (speech production)	Perceptual evaluation (perception)	Participants
For each utterance with a rising contour, a matched utterance was digitally stylized with a falling contour using the PSOLA function on PRAAT. Likewise, for each utterance with a falling contour, a matched utterance was digitally created with a rising contour. The beginning of the rise or fall was kept the same. The upward and downward of the contour was multiplied or divided by a factor of 1.5 and then further stylized to smooth out the contour. In this way, the same item could be heard with and without uptalk.	Experiment 1. 48 utterance pairs were selected from a specially compiled corpus of spontaneous speech. Speakers created spontaneous sentence frames to convey celebrity facts to an addressee who attempted to select the celebrity out of an array. For example, upon reading place of birth: Brooklyn, the speaker might say to the addressee, “This actor was born in Brooklyn, New York.” The utterance pairs consisted of two sentences spontaneously produced by the same speaker; for example, “I have two children. I was the princess of Wales.” The first utterance of the pair had either rising prolonged pitch (n=12), rising non-prolonged pitch (n=12), falling prolonged pitch (n=12), or falling non- prolonged pitch (n=12).	All 26 participants were native English speakers, students from The University of California Santa Cruz.
	Experiment 2 and 3. The same 48 stimuli were used as in Experiment 1. In addition, 48 filler stimuli were created. The filler stimuli were of two types. The first had the target word in the first utterance. The second did not contain the target word. When the target word was presented in the stimulus, there was a 1000ms pause until the next trial started.	Experiment 2. 21 students participated.
		Experiment 3. 48 students participated.
Number 13
Objective: To assess the effect of variation in speech rate on comprehension and persuasiveness of a message presented in text-to-speech (TTS) synthesis to native and non-native listeners.
Global design: Perception
Corpus (speech production)	Perceptual evaluation (perception)	Participants
Eight banking product descriptions under one of four conditions: normal rate (155 words/minute) with no background noise, normal rate with multi-talker background noise (+6 dB SNR), fast-normal (178 words/minute) with no background noise, and fast-normal with multi-talker background noise.	Participants rated each product on a scale from 1-5 (where 1 = not useful at all, and 5 = extremely useful), and answered two true/false questions about the product description they had just heard.	80 non-native English speakers and 80 native Australian English speakers.
Number 14
Objective: To examine the influence of voice and sex on the credibility of the voice source in a banking telemarketing context as well as with regards to the attitude toward the advertisement and subjects’ behavioral intention.
Global design: Perception
Corpus (speech production)	Perceptual evaluation (perception)	Participants
Two professional actors (a woman and a man) manipulated the intensity and the intonation of the voice and the speech rate for each condition. The professionals, supervised by a phonetician, modified their voices to have a low, moderate, or high intensity, a marked, moderate, or unmarked intonation, and a slow, moderate, or fast speech rate. The message consisted of an advertisement for an ATM (Automatic Teller Machine) card offered by a Canadian bank.	Source credibility was evaluated with a semantic differential scale containing nine items. This scale ranged from -3 to +3 with zero as a midpoint. Participants were asked if the source of the voice who conveyed the message was competent or incompetent in the financial service field (V1), inspired confidence or distrust (V2), inspired honesty or dishonesty (V3), whether the listener believed or did not believe everything that was said (V4), had or did not have the power of persuasion (V5), was or was not prestigious (V6), had or did not have a similar cultural background (V7), was pleasant or unpleasant (V8), and was attractive or repulsive (V9). Participants completed questionnaires for attitude towards the advertisement and behavioral intention.	399 native speakers of Australian English.
Number 15
Objective: Study the relationship of the right hemisphere with the ability to classify the emotional attitudes of confidence and politeness of the speaker, based on prosody, through the comparison between individuals with and without impairment of the right hemisphere.
Global design: Production and perception
Corpus (speech production)	Perceptual evaluation (perception)	Participants
Two experiments were carried out. The first one had prosody as a clue to judge confidence level and the second had prosody as a clue to judge the speaker’s politeness. Sentences from six to 11 syllables, recorded by 4 male actors, were used. Half of the utterances were semantically congruent, and half were pseudo utterances only with acoustic clues, both with high, medium, or low confidence levels. 10 male and 10 female judges rated the recordings performed by actors on a scale from 1 to 5, resulting in 45 selected stimulators.	Experiment 1. Evaluation of statements expressing confidence in two situations: (1) linguistic context provided by an informative semantical content; the sentences began with linguistic phrases indicating high, moderate, or low level of confidence; (2) pseudo utterance of exclusively auditory characteristics, produced with high, moderate, and low degrees of confidence.	Experiment 1. Nine individuals with involvement of the right hemisphere and 11 individuals without such involvement. All English speakers with an average age of 63 and an average formal education time of 12 years.
In the second experiment, eight simple commands were used in sentences of three to five syllables recorded by two female actors, in two tones, and two auditory forms: with ascending prosody and descending prosody, and with four different linguistic beginnings: declaratory, direct, indirect, rather indirect and with the word please. The linguistic and prosodic utterances were judged by eight adults. They resulted in 80 linguistic and 32 prosodic-only utterances, totaling 112 selected statements.	Experiment 2. Evaluation of utterances that express levels of politeness based on linguistic situations expressed by (1) sematic content and prosody and (2) prosody alone.	Experiment 2. Six individuals with an impairment and 11 without and impairment participated. Their mean age was 65 and they had an average of 12 years of formal education. There was an equal number of men and women.
Number 16
Objective: To investigate whether the interlanguage intonation produced by non-native speakers of English might lead to pragmatic differences that could affect their spoken discourse in the expression of certainty and uncertainty.
Global design: Production and perception
Corpus (speech production)	Perceptual evaluation (perception)	Participants
A cross-linguistic computerized corpus has been compiled to study Spanish learners of English and English native speakers’ intonation. The speech of both groups of speakers was digitally recorded while they performed two tasks: reading aloud and interpreting short English conversations. The conversations highlight the contrast between different degrees of certainty and uncertainty.	The data collected in the corpus, totaling over 3 million words, were analyzed acoustically, so that comparable qualitative and quantitative information on the prosodic characteristics produced by the two language user groups could be obtained.	Two homogeneous groups of undergraduate students: a group of 10 Spanish learners of English and a group of 10 native speakers of English.
Number 17
Objective: The objective of this study is twofold: (1) To assess whether children’s feelings of perceived judgment are similar to those of adults and (2) to assess whether children use fewer audiovisual cues for uncertainty in a less systematic way.
Global design: Production and perception
Corpus (speech production)	Perceptual evaluation (perception)	Participants
Experiment 1. First, participants were asked a series of questions by the researcher and their responses were filmed using a digital camera. This part of the experiment was set up in such a way that participants could not see the researcher. Second, the same sequence of questions was asked again, for participants to indicate how sure they were that they would recognize the correct answer if they had to find it in a multiple-choice test. Third, the same sequence of questions was asked once more in a multiple-choice paper-and-pencil test, in which the correct answer was mixed with three plausible alternatives.	Experiment 1. Certain and uncertain speaker utterances from adults and children were collected by asking them a series of factual questions (40 for adults, 30 for children). For adults, the questions came from two sources. First, we selected questions with a single word answer (e.g., “Who wrote Faust?”), and then we added a supplementary list from the Dutch version of the game Trivial Pursuit. For children, we selected questions with a single word answer (e.g., “How much is a dozen?”) only. For both groups questions were selected in a way that different types of responses could be elicited, namely answers, non-answers, certain, and uncertain responses.	Experiment 1. Twenty adults and 21 children participated as speakers. The adults (11 males, 9 females) were colleagues and students from Tilburg University, between 20 and 50 YO.
Experiment 2. Detecting uncertainty. 30 adult utterances and 30 child utterances were selected from the corpus of answers collected in the first study. Stimuli were presented on a screen where the judges first saw the stimulus ID (1 through 30) and then the actual stimulus.	Experiment 2. Judges were instructed to estimate whether speakers were uncertain about their answers or not. Adult judges scored on a seven-point Likert scale, child judges on a five-point Likert scale (using the same facial representation as above)	Experiment 2. 80 native speakers of Dutch participated as judges, 40 adults and 40 children (20 male and 20 females per group), and all different from the speakers that participated in the production experiments.
Number 18
Objective: Because atypical instances of a category are more difficult to classify than typical instances, when speakers refer to these instances their lack of confidence will be demonstrated in a paralinguistic way, that is, in the form of hesitations, filled pauses, or rising prosody. These features can help listeners learn by enabling them to differentiate good from bad examples of a category.
Global design: Perception
Corpus (speech production)	Perceptual evaluation (perception)	Participants
Participants were asked to imagine that they were new employees in the stockroom of an Internet clothing store, where their job was to fill orders. A male “expert teacher” trained the participants on the store color scheme. The voice used for the teacher’s sound recordings was that of a male confederate, who was instructed to speak each color name five times with confidence that varied from very unsure to very sure. 95% of the least confident utterances began with a filled pause (e.g., “uh”, “um”, “mm”), whereas none of the most confident ones did. 92% of the least confident utterances also included rising intonation, whereas none of the most confident utterances did.	Listeners learned a set of novel color categories from an expert teacher. For half of the categories, the paralinguistic characteristics of the teacher’s utterances were consistent with the category structure: difficult-to-classify instances (i.e., atypical) were marked by unconfident-sounding utterances, and easy-to classify instances (i.e., typical), by confident-sounding ones. For the other half, the characteristics were inconsistent with the category structure.	36 undergraduates, 22 females and 14 males.
Number 19
Objective: In an experiment with 2x2x2 factorial design, several hypotheses derived from the Elaboration Likelihood Model and from phonetics literature were tested.
Global design: Perception
Corpus (speech production)	Perceptual evaluation (perception)	Participants
Two linguistically similar advertising messages of financial services of high (student loan) versus low (Automatic Teller Machine cards) involvement were recorded by a professional actor using four types of voice (two levels of intonation of voice x two levels of intensity).	Once exposed to the experimental advertisement, subjects were asked to complete a questionnaire. Credibility was operationalized using two sets of four items each, one measuring “internalization” and the other “identification.” “Internalization” was measured by four 7-point bipolar scales of “trustworthy”, “honest”, “competent”, and “believes in what he says”. Identification was measured by four 7- point bipolar scales of “prestigious”, “same culture as me”, “pleasant”, and “attractive”.	229 university students.
Number 20
Objective: Assess the effects of powerful and powerless speech on the impressions of the speaker and on persuasion.
Global design: Perception
Corpus (speech production)	Perceptual evaluation (perception)	Participants
To develop the verbal stimuli, we examined the tapes of actual court trials and chose a trial in which a female witness had given her testimony in a style characterized by frequent use of powerless forms (i.e., hedges, intensifiers, rising intonations, especially formal grammar, and polite forms). Actors then reproduced this original testimony (changing only names, dates, places, and editing certain legal technicalities). A female witness powerful-style tape was also made (using the same actors), in which most of the powerless features were omitted, but the substance of the testimony remained unchanged. The “powerless” style is characterized by the frequent use of linguistic features such as intensifiers, hedges, hesitation forms, and questioning intonations. The “powerful” style is marked by less frequent use of these features.	Subjects were provided either with earphones through which they could hear the stimulus tape (in the oral-presentation conditions) or with envelopes containing one of the four experimental transcripts (in the written-presentation conditions). Subjects rated the witness on a series of 11-point semantic differential-type rating scales with the endpoints: powerful-powerless, competent-incompetent, masculine-feminine, trustworthy not trustworthy, likely able-unlikely able, strong-weak, intelligent-not intelligent, and active-passive. Subjects also used 11-point scales to rate how much they believed the witness, how convincing the witness was, how sympathetic they felt toward the witness, how similar the witness was to them, and how qualified they felt the witness was to testify. Additional questions inquired how responsible and how negligent the defendants were for the victim’s death and how much the defendants should pay the plaintiffs in damages.	152 undergraduate students (73 male and 79 female). Five additional subjects did not fill in the whole questionnaire and were omitted from the analysis.
Number 21
Objective: Study the paralinguistic cues in the speaker when coding confidence and doubt in speech as well as the attributes observed in the speaker when exposed to these cues.
Global design: Perception
Corpus (speech production)	Perceptual evaluation (perception)	Participants
The study was conducted in two parts, a recording of linguistically confident texts and another of linguistically doubtful texts. This process generated four texts with two disparate channels and two congruent channels.	Evaluation of the audio recordings to classify the speakers as trustworthy, experts, and legally competent. Textual characteristics were rated on a scale from zero to 100 and speech features were rated on a scale from zero to nine simultaneously, to establish the pairs of effectiveness of manipulation and to evaluate about 23 personality characteristics and features of speech. The recording was classified as “text and voice confident”, “confident text and voice doubtful”, “doubtful text and confident voice”, “doubtful text with doubtful voice”. About 23 personality characteristics and seven features of speech on a scale from zero to nine were also evaluated.	To assess trust or doubt: 10 women college students, paid volunteers, were tested one at a time, using peer comparison techniques. They were asked about which pair expressed greater confidence. The order and the peers were randomized. To assess personality and attributes of voice 47 women from a female school, who were paid volunteers, in 4 sessions, were asked to evaluate the ability of law students to practice.