Audiovisual Modalities Research Articles

The Modulation of Exogenous Attention on Emotional Audiovisual Integration.

Although emotional audiovisual integration has been investigated previously, whether emotional audiovisual integration is affected by the spatial allocation of visual attention is currently unknown. To examine this question, a variant of the exogenous spatial cueing paradigm was adopted, in which stimuli varying by facial expressions and nonverbal affective prosody were used to express six basic emotions (happiness, anger, disgust, sadness, fear, surprise) via a visual, an auditory, or an audiovisual modality. The emotional stimuli were preceded by an unpredictive cue that was used to attract participants’ visual attention. The results showed significantly higher accuracy and quicker response times in response to bimodal audiovisual stimuli than to unimodal visual or auditory stimuli for emotional perception under both valid and invalid cue conditions. The auditory facilitation effect was stronger than the visual facilitation effect under exogenous attention for the six emotions tested. Larger auditory enhancement was induced when the target was presented at the expected location than at the unexpected location. For emotional perception, happiness shared the biggest auditory enhancement among all six emotions. However, the influence of exogenous cueing effect on emotional perception seemed to be absent.

La evolución del español a través del doblaje en España.

In this text, we propose an overview of the evolution of the Spanish language through the dubbed versions of foreign films in Spain along the twentieth century.We cover from the early stages of cinema and silent movies and the use of intertitles –as iliteracy was high in large cities and the rate was even higher among women and in rural areas (Gubern, 1993)– so these title cards were something problematic to deal with, for this reason the film lecturer (Sánchez Salas, 2011), the commentator (Fuentes Luque, 2019) or the “explicador” film explainer proved key as a link between the audience and the movies (Fuentes Luque, 2019). After the talkies appeared, different varieties of Spanish could be heard in multilingual movies. Franco’s regime influenced the result of many films exhibited in Spanish movie theatres not only in the images, but also in the political ideologies, the religious aspects, the indecorous language, and sexual or improper activities, portrayed in Hollywood movies (Díaz Cintas, 2019). A “neutral” Spanish was created during the sixties to achieve a greater Hispanic audience. This practice was used on TV series, cartoons, and in Walt Disney’s movies. During the 70s, and with the boom of the 80s’ blockbusters, a greater number of American films were translated and consumed into Spanish. The immense impact of these movies influenced Spanish language and the traditional audiovisual translation mode –dubbing– (Rica Peromingo 2019), adapting and domesticating cultural references, filtering calques and false friends (Rica Peromingo, 2016).

English vowel perception by non-native speakers: impact of audio and visual training modalities

Perception of sounds of a second language (L2) presents difficulties for non-native speakers which can be improved with training (Bradlow, Pisoni, Akahane-Yamada & Tohkura, 1997; Logan, Lively & Pisoni, 1991; Iverson & Evans, 2009). The aim of this study was to compare three different English vowel perceptual training programmes using audio (A), audiovisual (AV) and video (V) modes in non-native speakers with Spanish as native language (L1). 47 learners of English with Spanish as L1 were allocated to three different vowel training groups (AT, AVT, VT) and were given five training sessions to assess their improvement in English vowel perception. Additionally, participants were recorded before and after training to measure their improvement in the production of English vowels. Results showed that participants improved their perception and production of English vowels regardless of their training modality with no evidence of a benefit of visual information. These results also suggest that there is a lot of individual differences in perception and production of L2 vowels which may be related to a complex relation between speech perceptual and production mechanisms.

ОСОБЕННОСТИ ВИЗУАЛЬНОГО РЯДА МУЗЫКАЛЬНОЙ РЕКЛАМЫ И ЕГО ВОЗДЕЙСТВИЕ НА ПОТРЕБИТЕЛЯ

Before 1950s, advertising had a reputation as a not entirely reputable business. A fragment from A. Hitchcock’ film may serve as an approval of it, where a hero states that in the world of advertising, there is no such thing as a lie, but there is only the expedient exaggeration. With the advent of the TV, the musical functions of transferring and evoking the emotions are generated. Since 1990s, music in advertising refers to music integrated in the media advertisement in order to enhance its success. The novelty of the research concerns the visual and music-visual modalities in the advertisement video contributing to the commercial interest from the consumers, which have been analyzed based on the aesthetic appeal to the screen images. Music is a crucial part of advertising. Thus, the Race of Parts musical content of the advertisement for 2008 featuring the Renault Megane, accompanied by the music from Vivaldi’s the Four Seasons, Summer, Part 3, is closely associated with formation of a product itself. It is expressed by the attractive interactions between the car parts and the rising tessitura, while the color gamut is in contradiction to the general associative perception. The musical score expressing a product olfactory perception is more rhythmic and airy. Thus, the advertisement of the Giorgio Armani Acqua Di Gioia perfume uses the audio-visual modality of the water element including rain, sea waves, and waterfall. Constructing the visual perception is supported by the dominant in music with a tendency to the gradually developing variation set. Unreasonable music used in advertising can result in decreasing the interest to the made brand. This fact has caused a strong activity in finding the new ways to attract the interest of the audience to the commercial product. Animation is one of them (for instance, the animated Coca-Cola Polar Bears Commercial, 2012). The music is written in the classical style by Glenn Rueger. Music supplements expand the imagery of the main heroes, attracting the potential consumers. In the clip of political advertising, the music may play a significant role. The music sounding as a patriotic call can help the audience perception of the essence of the challenge images in the clip and the opportunities to overcome them. The clip from the I am Shapovalov film (1973) with the Let’s Raise the Cavalry Swords song (Composer E. N. Ptichkin and Lyricist E. E. Karelov) performed by V. Mulerman contains a sustaining calmer rhythm. With respect to the same song performed by A. Chuprin, the constants of the march precise in rhythm sound against the reference history of creating and developing the Armed Forces of the Soviet Union and modern Russia. The musical content in advertising is shown to increase the psychological impact on the audience and its emotional arousal, enhancing the attractiveness of a commercial product. Therefore, careful selection of the music material and the method of its use may contribute to creating the rhythmically charged imagery of the clip itself, providing insight into imagery and forming an appropriate language content with the use of cinematographic techniques (editing, color grading, etc.). In addition, the ideological dimension of the musical rhythmic pattern in advertising may contribute to determining the genres of the clip itself.

Rhythm pattern discrimination by primary school students

Ascertaining the most effective modes of presenting rhythmic information to students is extremely important in order to facilitate rhythm training. This study examines the effects of different bimodal presentations of rhythmic information on the discrimination of rhythm patterns by primary school students. A 2 × 2 factorial design was conducted with two variables – audiovisual and audio-textual – each using two levels (static and dynamic). Four experimental conditions were designed: (1) static audiovisual, (2) dynamic audiovisual, (3) static audio-textual and (4) dynamic audio-textual. Data were collected by administering a rhythmic discrimination test to intact classes in second grade ( N = 83; 40 boys and 43 girls; 7–8 years old; medium socio-economic level) at two public primary schools from Comunitat Valenciana, Spain. Fourteen rhythmic patterns were presented to each group in each condition. Each pattern was played three consecutive times. The test consisted of comparing the third presentation of each pattern to the first two presentations – thereby exposing the sample pattern – and deciding whether the third was the same or not. The following covariates were measured: age, previous rhythmic skills, musicians in the family environment, out-of-school music studies and grades earned in music school classes during the previous year. The test scores show significant statistical differences between dynamic audiovisual and static audio-textual ( g = 1.25), as well as between dynamic audio-textual and static audio-textual ( g = .90). Furthermore, the audiovisual presentation mode was superior to its audio-textual counterpart ( g = .46) and the findings showed that the dynamic presentations were more effective than the static ones ( g = .69). The implications for teaching and learning rhythm are discussed.

Adapting Online Patient Decision Aids: Effects of Modality and Narration Style on Patients’ Satisfaction, Information Recall and Informed Decision Making

Audiovisual and narrative information are often used in online decision aids. However, few studies have tested whether these strategies are more effective compared to other types of information. We tested the effect of these strategies on satisfaction with the information, recall and informed decision-making in a 2 (Modality: audiovisual vs. textual) x 2 (Narration style: narrative vs. factual) experimental design. Data was collected in an online experiment among 262 analogue cancer patients. Since most cancer patients are older people, we also assessed if the effectiveness of these strategies differs depending on the patient’s age. Data was analyzed using Structural Equation Modeling. Findings showed audiovisual modality had a positive effect on satisfaction. Moreover, audiovisual modality improved recall, both directly and indirectly via satisfaction, which subsequently resulted in better-informed decision-making. Narratives resulted in more satisfaction, but not better recall or informed decision-making. These effects were found in patients of all ages.

Multi-modal cross-linguistic perception of fricatives in clear speech.

Research shows that acoustic modifications in clearly enunciated fricative consonants (relative to the plain, conversational productions) facilitate auditory fricative perception, particularly for auditorily salient sibilant fricatives and for native perception. However, clear-speech effects on visual fricative perception have received less attention. A comparison of auditory and visual (facial) clear-fricative perception is particularly interesting since sibilant fricatives in English are more auditorily salient while non-sibilants are more visually salient. This study thus examines clear-speech effects on multi-modal perception of English sibilant and non-sibilant fricatives. Native English perceivers and non-native (Mandarin, Korean) perceivers with different fricative inventories in their native languages (L1s) identified clear and conversational fricative-vowel syllables in audio-only, visual-only, and audio-visual (AV) modes. The results reveal an overall positive clear-speech effect when visual information is involved. Considering the factor of AV saliency, clear speech benefits sibilants more in the auditory domain and non-sibilants more in the visual domain. With respect to language background, non-native (Mandarin and Korean) perceivers benefit from visual as well as auditory information, even for fricatives non-existent in their respective L1s, but the patterns of clear-speech gains are affected by the relative AV weighting and "nativeness" of the fricatives. These findings are discussed in terms of how saliency-enhancing and category-distinctive cues of speech sounds are adopted in AV perception to improve intelligibility.

Contributions of Voice and Nonverbal Communication to Perceived Masculinity-Femininity for Cisgender and Transgender Communicators.

Purpose The purpose of this study was twofold: (a) to identify a set of communication-based predictors (including both acoustic and gestural variables) of masculinity-femininity ratings and (b) to explore differences in ratings between audio and audiovisual presentation modes for transgender and cisgender communicators. Method The voices and gestures of a group of cisgender men and women (n = 10 of each) and transgender women (n = 20) communicators were recorded while they recounted the story of a cartoon using acoustic and motion capture recording systems. A total of 17 acoustic and gestural variables were measured from these recordings. A group of observers (n = 20) rated each communicator's masculinity-femininity based on 30- to 45-s samples of the cartoon description presented in three modes: audio, visual, and audio visual. Visual and audiovisual stimuli contained point light displays standardized for size. Ratings were made using a direct magnitude estimation scale without modulus. Communication-based predictors of masculinity-femininity ratings were identified using multiple regression, and analysis of variance was used to determine the effect of presentation mode on perceptual ratings. Results Fundamental frequency, average vowel formant, and sound pressure level were identified as significant predictors of masculinity-femininity ratings for these communicators. Communicators were rated significantly more feminine in the audio than the audiovisual mode and unreliably in the visual-only mode. Conclusions Both study purposes were met. Results support continued emphasis on fundamental frequency and vocal tract resonance in voice and communication modification training with transgender individuals and provide evidence for the potential benefit of modifying sound pressure level, especially when a masculine presentation is desired.

Visual analog of the acoustic amplitude envelope benefits speech perception in noise.

The nature of the visual input that integrates with the audio signal to yield speech processing advantages remains controversial. This study tests the hypothesis that the information extracted for audiovisual integration includes co-occurring suprasegmental dynamic changes in the acoustic and visual signal. English sentences embedded in multi-talker babble noise were presented to native English listeners in audio-only and audiovisual modalities. A significant intelligibility enhancement with the visual analogs congruent to the acoustic amplitude envelopes was observed. These results suggest that dynamic visual modulation provides speech rhythmic information that can be integrated online with the audio signal to enhance speech intelligibility.

Exploring Venezuela’s audiovisual translation landscape

ABSTRACT Research on audiovisual translation (AVT) has so far been basically restricted to the European context, almost completely ignoring the Spanish-speaking countries in Latin America. Furthermore, the background and factors that influenced the emergence and development of audiovisual translation modes in Spanish America have not been studied either thus far. The present article shows a review of the historical, social, political, technical and professional aspects that have shaped audiovisual translation in Venezuela, a key country in the evolution of AVT in Spanish America, and the influence of the so-called ‘neutral Spanish’. The research is based, in part, on the nuclear testimonies of some of the main translators, revisers and managers of AVT in Venezuela.

Efficacy of Study for Correlation of TTH vs Age and Gender Factors Using EMG Biofeedback Technique

In this study, the authors have tried their best to check the effect of tension type headache (TTH) over age and gender. TTH is produced by stress, and it may start at any stage of life. Subjects usually suffer from two types of TTHm i.e. for short time and for long time. When subjects suffer for a long time, it affects both mind and body. So, checking at which age it started and how the gender is affected by this problem is useful. For this study, we have used use EMG biofeedback therapy. Biofeedback is the process which examines the body part by sending the wave to ear drum, by electric signal, etc. Here, we took two parameters, age and gender, to analyze the effect of TTH. To check this, we have tested the subjects by using different modes, i.e. audio mode, video mode, and audio-visual mode. Trend models have different types of outcomes by mathematical expression i.e. linear, cubic, exponential, etc. So, the comparisons of outcome are in different modes, it showed that the TTH problem affects females at an early age compared to males.

How Does Mode of Qualitative Data Collection Affect Data and Cost? Findings from a Quasi-experimental Study

Internet-based platforms are increasingly used to collect qualitative data. We conducted a quasi-experimental study to explore whether data collection mode affects data content and data collection costs. Participants ( N = 171) were assigned systematically to one of four modes—(1) in-person (control), (2) online video–based, (3) online chat–based, (4) online e-mail/message board-based—and randomized to individual interview (IDI) or focus group (FG). We conducted 48 IDIs and 24 FGs about medical risk during pregnancy with women in the southeast United States. We found audiovisual (in-person and online video) modes generated significantly greater volumes of data than online text–based modes. However, there were no significant differences in the thematic content among modes, for IDIs or FGs. Online data collection generally cost more per event without travel; in-person IDIs/FGs were more expensive if including travel. Findings offer empirical data for considerations of online versus in-person qualitative data collection.

Lexical access versus lexical decision processes for auditory, visual, and audiovisual items: Insights from behavioral and neural measures

In two experiments, we investigated the relationship between lexical access processes, and processes that are specifically related to making lexical decisions. In Experiment 1, participants performed a standard lexical decision task in which they had to respond as quickly and as accurately as possible to visual (written), auditory (spoken) and audiovisual (written + spoken) items. In Experiment 2, a different group of participants performed the same task but were required to make responses after a delay. Linear mixed effect models on reaction times and single trial Event-Related Potentials (ERPs) revealed that ERP lexicality effects started earlier in the visual than auditory modality, and that effects were driven by the written input in the audiovisual modality. More negative ERP amplitudes predicted slower reaction times in all modalities in both experiments. However, these predictive amplitudes were mainly observed within the window of the lexicality effect in Experiment 1 (the speeded task), and shifted to post-response-probe time windows in Experiment 2 (the delayed task). The lexicality effects lasted longer in Experiment 1 than in Experiment 2, and in the delayed task, we additionally observed a “re-instantiation” of the lexicality effect related to the delayed response. Delaying the response in an otherwise identical lexical decision task thus allowed us to separate lexical access processes from processes specific to lexical decision.

Tailored Web-Based Information for Younger and Older Patients with Cancer: Randomized Controlled Trial of a Preparatory Educational Intervention on Patient Outcomes.

BackgroundMany patients with cancer, including older patients (aged ≥65 years), consult the Web to prepare for their doctor’s visit. In particular, older patients have varying needs regarding the mode in which information is presented (eg, via textual, visual, or audiovisual modes) owing to age-related sensory (eg, impaired vision and hearing) and cognitive decline (eg, reduced processing speed). Therefore, Web-based information targeted at older patient populations is likely to be used and processed more effectively, and evaluated more positively, when tailored to age-related capabilities and preferences. This, in turn, may benefit patient outcomes.ObjectiveThis randomized controlled trial tested the effects of a Web-based tailored educational intervention among newly diagnosed younger (<65 years) and older (≥65 years) patients with cancer. We compared the intervention group who viewed a mode-tailored website (ie, enabling patients to tailor information using textual, visual, and audiovisual modes) with 3 control groups view a nontailored website (ie, text only, text with images, and text with videos). We examined website experience outcomes (ie, website satisfaction, website involvement, knowledge, anxiety, and communication self-efficacy) and consultation experience outcomes (ie, question asking during consultation, anxiety, and information recall).MethodsPatients from a multidisciplinary outpatient clinic (N=232) viewed a mode-tailored or nontailored website as preparation before their hospital consultations to discuss diagnosis and treatment. Data were collected before (T1), during (T2), and after (T3) visitation. Website experience outcomes were assessed with questionnaires (T1). Patients’ question asking was coded from videotaped consultations, and anxiety was assessed through a questionnaire (T2). Telephone interviews were conducted to assess knowledge acquired from the website before (T1) and after consultation (T3), and information recall from the consultation (T3).ResultsThe preparatory website was well used across all conditions (mean 34 min). Younger patients viewing the mode-tailored website were more satisfied before consultation (P=.02) and reported lower anxiety after consultation (P=.046; vs text only). This pattern was not found in older patients. Mode tailoring yielded no other significant differences in patient outcomes. Regression analyses showed that website involvement (beta=.15; P=.03) and, to a lesser extent, website satisfaction (beta=.15; P=.05) positively associated with knowledge before consultation (T1). In turn, higher knowledge before consultation (beta=.39; P<.001), together with time on the website (beta=.21; P=.002; T1), predicted information recall from consultations (T3). Patients with higher knowledge before consultation (T1) also reported higher knowledge from the website afterward (T3; beta=.22; P=.003).ConclusionsOffering preparatory online information before consultations benefits information processing and patient outcomes of both younger and older newly diagnosed patients with cancer. Younger patients benefit even more when information is offered in a mode-tailored manner. We discuss the theoretical, methodological, and practical implications for patient-provider communication research in an electronic health era.Clinical TrialNetherlands Trial Register NTR5904; https://www.trialregister.nl/trial/5750

P1463Cardiology, cardiovascular clinical and economical beneficiary outcomes of tele-cardiology, e-audio-visual cardiology and m-cardiology: TEAM study at multi cardiac centre in India

Abstract Background Telemedicine has beneficiary aspect to manage health and reduce the burden of illness. It represent health promotion with support of many ways like tele (distance mode), e (electronic mode), audio visual mode and m (mobile or smart phones) mode etc. Objectives To evaluate the cardiovascular land economical outcomes of tele-cardiology, e-cardiology, audio-visual cardiology and m-cardiology in large population and to review with increase awareness and application of telemedicine. Methods We enrolled 12872 patients from different cardiac centres in india and registered in TEAM (Tele-cardiology, E-cardiology, Audio-visual cardiology and M-cardiology) registry from 2008 to 2018. We included tele diagnosis, tele assistance, tele monitoring, tele therapy, electronic remot media, audio visual media and mobile apps for management of different category of cardiovascular disease like coronary heart and structural heart disease, hypertension, heart failure and congenital heart disorders. We compared TEAM registry with usual group (n=13229) at the platform of beneficiary outcomes regarding diagnostic, therapeutic significance, economical burden, mortality and rate of hospitalization. Results Our data revealed that 34% more correction of the diagnosis of congenital heart diseases, 29% reduction of unnecessary transport of acute coronary syndrome and non cardiac chest pain from primary to higher cardiac centre. 38% patients of ST elevation of myocardial infarction were benefited by facilliated angioplasty and 50% mortality risk reduction in TEAM registry as compare usual group. In heart failure patients, 12 months clinical outcomes revealed that there was a significant reduction in rehospitalizations in the TEAM group compared with the usual-care group (19.6% versus 33.7%,) and also found 29% stroke reduction in TEAM group. Usual group showed 2.5 fold higher economical burden than TEAM registry. Conclusion Total approach of telemedicine in cardiology service may diagnose correctly at root level, prevent clinical instability, reduce rehospitalization and lower the cost of managing heart patients.

Effects of temporal distortions on consonant perception with and without undistorted visual speech cues.

Effects of temporal distortions on consonant perception were measured using locally time-reversed nonsense syllables. Consonant recognition was measured in both audio and audio-visual modalities for assessing whether the addition of visual speech cues can recover consonant errors caused by time reversing. The degradation in consonant recognition depended highly on the manner of articulation, with sibilant fricatives, affricates, and nasals showing the least degradation. Because consonant errors induced by time reversing were primarily in voicing and place-of-articulation (mostly limited to stop-plosives and non-sibilant fricatives), undistorted visual speech cues could resolve only about half the errors (i.e., only place-of-articulation errors).

Exploring the role of visual aesthetics and presentation modality in luxury fashion brand communication on Instagram

PurposeThe purpose of this paper is to examine the strategic importance of visual aesthetics and presentation modality for consumer responses to fashion luxury brand content posted on Instagram.Design/methodology/approachA content analysis of 40,679 posts on the official Instagram accounts of 15 global luxury brands was conducted.FindingsBrand posts using expressive aesthetic image received more likes and comments on Instagram than those with classical aesthetics. Brand video content received more likes and comments than static content. There was also a significant interaction between visual aesthetics and presentation modality in generating likes and comments. Brand content adopting expressive aesthetic and audio-visual modality generated more responses when using audio-visual modality, while content using classical aesthetics produced more responses in a visual-only format.Practical implicationsAs visual aesthetics and modality resulted in different responses to Instagram ads, luxury marketers should consider using appropriate approaches when creating brand posts on Instagram.Originality/valueThis is one of the few studies examining the effectiveness of visual aesthetics and presentation modality in Instagram advertising, especially in luxury fashion brand context.

Material and Expositional Frames in BBC &lt;i&gt;Arena&lt;/i&gt; ’s Visual Jazz Jukebox

Since 1975, the award-winning BBC documentary series Arena has broadcast programmes on a plethora of cultural subjects. Films focusing explicitly on musical cultures form around 30% of Arena’s programmes; while ‘rockumentaries’ dominate, jazz is a regular topic of Arena’s music documentaries. This paper considers Arena’s first direct engagements with jazz in two 40 minute programmes from 1983. It demonstrates jazz culture’s interrelationship with the audio-visual through an examination of Jazz Juke Box I and Jazz Juke Box II (broadcast on BBC2 on 15/2/1983 at 10:15PM and 23/11/1983 at 10PM respectively). I present the programmes as key sites through which we can better understand Arena’s negotiation of jazz culture through two interdependent layers: firstly, I consider the programme’s aesthetic and formal presentation of jazz and its audio-visual materiality; secondly, I examine the extent of expository material presented in the programmes and the meaning it generates in relation to Arena’s and the BBC’s wider mediation of jazz.&#x0D; Jazz’s Visual Juke Box might serve a better title for the two programmes. Both programmes re-present a selection of, mostly full-length, promotional jazz shorts and ‘Soundies’. The films are introduced from a smoky bar by George Melly who directs our attention towards a visual jukebox that forms the centre of our engagement with the films. Ellington, Basie, Nat King Cole, Billie Holliday, and Bessie Smith are a few of the musicians featured in the, as the Radio Times called them, ‘witty, moving, surreal and always irresistibly entertaining’ short films. It is argued visual techniques are used in the programmes to blur technological lines between the materiality of different audio-visual modes and also spatio-temporal lines between the social spaces where Panorams were originally found and the bar Melly inhabits. In doing so, Arena draws our attention not just to the films themselves, but also the socio-cultural context that surrounded their consumption. The visual aesthetic is also argued to foreground and fetishize the ‘rareness’ of this ‘forgotten’ footage and its analogue mode of reproduction.&#x0D; Between the films, Melly often delivers a contextual and interpretive script that, although educational, does not rely on didacticism nor fully problematize the film’s stereotyped depiction of black musicians. Nevertheless, the audience is offered some possible interpretations of the film’s complex significance to the understanding, remembrance and history of jazz culture. This and the programmes’ expository materials present a mode of documentary film somewhat at odds with the more meditative style for which Arena became famous. This paper discusses the extent to which Arena’s critical presentation of the short films is conditioned by the creator’s own artistic subjectivities and by wider discourses on race and jazz on small-screens in 1980s Britain. It is argued that Melly’s persona, defined as much by his jazz and blues musicianship as his art criticism and journalism, continues the BBC’s fraught negotiation of jazz as an (un)popular music.

DI GIOVANNI, Elena; GAMBIER, Yves. (Eds.). Reception Studies and Audiovisual Translation. Amsterdam/Philadelphia: John Benjamins, 2018. 353 p.

Reception Studies and Audiovisual Translation fornece um panorama das interseções entre os estudos da recepção e a tradução audiovisual. O livro é dividido em quatro partes que tratam, nesta sequência, de pesquisas em estudos da recepção, metodologias de pesquisa voltada para o público, modalidades de tradução audiovisual, e mídias híbridas e novos tipos de público. Os quinze capítulos que compõem a obra traçam um histórico dos desenvolvimentos destes estudos e estimulam novas pesquisas na área, sugerindo uma abordagem multi e interdisciplinar que utilize metodologias quantitativas e qualitativas de forma integrada.

Audiovisual speech segmentation in post-stroke aphasia: a pilot study

ABSTRACTBackground: Stroke may cause sentence comprehension disorders. Speech segmentation, i.e. the ability to detect word boundaries while listening to continuous speech, is an initial step allowing the successful identification of words and the accurate understanding of meaning within sentences. It has received little attention in people with post-stroke aphasia (PWA).Objectives: Our goal was to study speech segmentation in PWA and examine the potential benefit of seeing the speakers’ articulatory gestures while segmenting sentences.Methods: Fourteen PWA and twelve healthy controls participated in this pilot study. Performance was measured with a word-monitoring task. In the auditory-only modality, participants were presented with auditory-only stimuli while in the audiovisual modality, visual speech cues (i.e. speaker’s articulatory gestures) accompanied the auditory input. The proportion of correct responses was calculated for each participant and each modality. Visual enhancement was then calculated in order to estimate the potential benefit of seeing the speaker’s articulatory gestures.Results: Both in auditory-only and audiovisual modalities, PWA performed significantly less well than controls, who had 100% correct performance in both modalities. The performance of PWA was correlated with their phonological ability. Six PWA used the visual cues. Group level analysis performed on PWA did not show any reliable difference between the auditory-only and audiovisual modalities (median of visual enhancement = 7% [Q1 − Q3: −5 − 39]).Conclusion: Our findings show that speech segmentation disorder may exist in PWA. This points to the importance of assessing and training speech segmentation after stroke. Further studies should investigate the characteristics of PWA who use visual speech cues during sentence processing.