TTS Technology Research Articles

Speech Synthesis and Personalization under Unimodal and Multimodal Conditions

Recently, there have been notable advancements in TTS technology, with researchers optimizing the efficiency, quality, and flexibility of speech generation through various models. This paper systematically explores end-to-end TTS models based on waveform generation, including Parallel WaveGAN, NaturalSpeech, and Multi-Band MelGAN, each of which has unique features in enhancing real-time generation capabilities and sound quality. Additionally, the paper discusses the development of speech separation and synthesis technologies, highlighting the applications of models like CONTENTVEC in pitch adjustment and speaker information disentanglement. In terms of multimodal technology, speech-to-gesture generation has also seen important breakthroughs, utilizing multimodal information to generate natural gestures. The paper provides a detailed summary of the main datasets used in related research, such as LibriTTS, LJSpeech, and VCTK, aiming to offer reference and guidance for future research in speech generation. Although these technologies have achieved significant advancements in efficiency and multifunctionality, the associated models remain complex and require substantial computational resources, limiting their widespread application in practical scenarios.

Improving foreign language reading technique using neural text-to-speech technology

Introduction. The intensification and technical development of the country, the COVID-19 pandemic and the post-crisis phase have led to the active integration of digital resources into the educational process, which has led to a new stage of development of the modern Russian education system – its digitalization. At present, new digital technologies, including artificial intelligence technologies, are being developed and introduced into the teaching of foreign languages. This article considers the use of text-to-speech technology functioning via neural networks to improve the reading technique in English and German of students of linguistic and non-linguistic specialties. Reading skills in a foreign language can be improved with the help of Natural Reader and TTSFree speech synthesizers, which students can use on their own. Due to application of the new FES HVE (Federal Educational Standards of Higher Vocational Education) of 2018 the volume of classroom work with students has decreased and the volume of independent work of students and students number in educational groups have increased, according to this matter the practical use of speech synthesizers in a foreign language classes seems relevant and important. Materials and Methods. Conducting an experiment to determine the effectiveness of the use of Natural Reader and TTSFree speech synthesizers to improve reading skills of linguistic and non-linguistic specialties students, calculating the number of phonetic errors when reading a foreign text before and after using of the voice generator, summarizing and interpreting the results obtained. Results. The list of publications studied in the process of scientific research makes 40 Russian and foreign works. These materials allowed to study the application of TTS technology with the use of neural networks, as well as Natural Reader and TTSFree speech synthesizers in foreign language classes at the university, which allowed to prove in practice the effectiveness of the analyzed services to improve the reading technique in English and German. Discussion and Conclusions. On the basis of theoretical research of scientific sources, as well as studying the experience of practical application of speech synthesizers Natural Reader and TTSFree, the conclusion about the great didactic potential of TTS technology is formulated. Possible applications of speech synthesis include the creation of an authentic language environment, the automation of reading, listening and speaking skills, as well as the self-control of students with their written language, voiced by TTS technology.

Modality Synchronization When People With Aphasia Read With Text-to-Speech Support.

Text-to-speech (TTS) technology potentially benefits people with aphasia by presenting content through two modalities simultaneously; however, for this to help, eye fixations must synchronize with the auditory rendition of words. Researchers have yet to explore how often and to what extent people with aphasia achieve modality synchronization. This retrospective analysis examined the percent of words people with aphasia see and hear concurrently when reading passages presented via TTS technology. Text-to-speech (TTS) technology potentially benefits people with aphasia by presenting content through two modalities simultaneously; however, for this to help, eye fixations must synchronize with the auditory rendition of words. Researchers have yet to explore how often and to what extent people with aphasia achieve modality synchronization. This retrospective analysis examined the percent of words people with aphasia see and hear concurrently when reading passages presented via TTS technology. Nine adults with aphasia had their eye movements tracked while processing TTS passages at a preselected default rate of 150 words per minute. Modality synchronization occurred whenever fixation on a written word occurred during the time span beginning 300 ms before auditory presentation and ending at the next word's initiation. Correlations between standardized test scores, unsupported reading rate, and modality synchronization percentages were informative about the association of aphasia and reading impairment severity with achievement of synchronicity. Three participants demonstrated consistent modality synchronization; average synchronicity ranged from 67% to 76% of passage words. One participant displayed inconsistent synchronization within passages and achieved an average of 58%. The remaining five participants rarely achieved synchronization, with fixations typically lagging substantially behind the auditory presentation. A significant positive correlation occurred between paragraph reading comprehension test scores and modality synchronization percentages. A default TTS presentation rate does not result in dual modality synchronization for most people with aphasia. This lack of synchronization may contribute to inconsistencies in the benefit people with aphasia experience when provided with TTS support.

Comprehension, Processing Time, and Modality Preferences When People With Aphasia and Neurotypical Healthy Adults Read Books: A Pilot Study.

Many people with aphasia (PWA) want to read books. Text-to-speech (TTS) technology sometimes provides comprehension and processing time benefits when PWA read short, multisentence passages. Currently, no research examines the effect of TTS support when PWA read books. This study's primary purpose was to examine comprehension accuracy and total processing time of PWA and neurotypical healthy adults (NHAs) when reading book sections in read-only versus TTS-supported conditions. A secondary aim was to examine condition preference and perceived degree of understanding by people in both participant groups. Ten PWA and 10 NHAs alternated between read-only and TTS-supported conditions to read a book. Participants answered comprehension questions and provided feedback about their reading experience, condition preference, and desire to use TTS technology for future book reading. Outcomes and Result: Overall, PWA exhibited less accurate comprehension and slower processing times compared to NHAs in both conditions. No significant comprehension accuracy difference occurred between conditions for either group. However, four PWA exhibited a 10% or greater increase in comprehension accuracy when receiving TTS support. A significant processing time difference occurred with PWA processing text faster with TTS support, whereas NHAs did not demonstrate processing time differences. Most PWA preferred the TTS condition and expressed a desire to use TTS technology in the future. Most NHAs expressed the opposite preference. TTS support during book reading promotes faster processing without compromising comprehension for PWA. Clinicians should discuss with PWA the relative importance of comprehension accuracy, processing time, and comfort with technology when determining whether using TTS support during book reading is desirable.

Reading Comprehension and Processing Time When People With Aphasia Use Text-to-Speech Technology With Personalized Supports and Features.

Person-centered approaches promote consistent use of supportive technology and feelings of empowerment for people with disabilities. Feature personalization is an aspect of person-centered approaches that can affect the benefit people with aphasia (PWA) derive from using text-to-speech (TTS) technology as a reading support. This study's primary purpose was to compare the comprehension and processing time of PWA when performing TTS-supported reading with preferred settings for voice, speech output rate, highlighting type, and highlighting color versus unsupported reading. A secondary aim was to examine initial support and feature preference selections, preference changes following TTS exposure, and anticipated functional reading activities for utilizing TTS technology. Twenty PWA read passages either via written text or text combined with TTS output using personally selected supports and features. Participants answered comprehension questions, reevaluated their preference selections, and provided feedback both about feature selections and possible future TTS technology uses. Comprehension accuracy did not vary significantly between reading conditions; however, processing time was significantly less in the TTS-supported condition, thus suggesting TTS support promoted greater reading speed without compromising comprehension. Most participants preferred the TTS condition and several anticipated benefits when reading lengthy and difficult materials. Alterations to initial settings were relatively rare. Personalizing TTS systems is relevant to person-centered interventions. Reading with desired TTS system supports and features promotes improved reading efficiency by PWA compared with reading without TTS support. Attending to client preferences is important when customizing and implementing TTS technology as a reading support.

A CASE STUDY ON MANDARIN TEXT-TO-SPEECH

There are three objectives of this study. First, to investigate the effectiveness of TTS in Mandarin language reading, find out the shortage of TTS, and understand the difference between machine-reading and human reading. Second, the study concludes that TTS technology is mature enough now but still needs to solve some problems in specific criteria such as conveying humanity elements, putting in more human nature, and expressing human emotions in the reading process in the future. Third, teaching mandarin reading is still necessary as the TTS system could not, instead of the importance of a teacher in reading and learning thoroughly.

Reading behaviors and text-to-speech technology perceptions of people with aphasia

ABSTRACT People with aphasia often have reading impairments that affect participation in daily activities. Text-to-speech (TTS) devices are technology-based supports that can facilitate processing of written materials. The purpose of this study was to gather information about the reading behaviors and TTS technology perceptions of people with aphasia who had first learned about system features and options. Sixteen people with chronic aphasia participated in single, one-on-one instructional and guided practice sessions using TTS systems. They answered close-ended questions about current reading behaviors and materials and ways they believed these would change given TTS system access. Participants reported reading at home and community locations. Most read calendars, newspapers, magazines, and mail. Participants who did not read lengthy materials – such as newspapers, magazines, and novels – indicated their interest in these materials would likely increase given TTS support. Although participants did not predict substantial comprehension changes given TTS support, most expressed interest in the technology after learning about it. Thus, people with aphasia perceive TTS systems as helpful for comprehending lengthy materials. Given modest predictions about comprehension benefits, presenting TTS as one of several support strategies is an appropriate recommendation.

Perceptions of people with aphasia about supporting reading with text-to-speech technology: A convergent mixed methods study

Text-to-speech (TTS) technology is a possible reading support for people with aphasia; however, adoption for functional reading remains rare, and people with aphasia may have limited knowledge about TTS. Given this situation coupled with inherent communication challenges associated with aphasia, the purpose of this convergent mixed methods study was to explore the perceptions of participants about desired features, benefits, and drawbacks of TTS technology after having engaged in one-on-one education and guided practice activities. Nineteen adults with chronic aphasia completed a single education and guided practice session followed by close-ended questions and participation in a semi-structured interview to explain preferences, concerns, beliefs, and opinions about potential TTS technology benefits and drawbacks. Three participants had previously used TTS technology for functional reading; all others had some prior exposure but did not use a system for functional purposes. Seventeen of 19 participants expressed TTS technology interest after education and guided practice activities. Participants endorsed selection of a preferred voice, control of speech output rate, and highlighting as priority features. Frequently endorsed benefits were improved comprehension and increased reading independence; some participants believed they would succeed in reading a greater variety of materials, communicate more with others, participate in more reading activities, and/or read faster. The greatest concern was mastering device operation; other concerns related to understanding the voice output, needing another person's help for system use, and matching the speech output rate to a preferred reading rate. Overall, most participants had positive perceptions about possible benefits afforded by TTS technology. Practitioners need to provide opportunities for people with aphasia to learn about and explore TTS systems to determine whether adoption is desired.

Sintesis Suara Bernyanyi Dengan Teknologi Text-To-Speech untuk Notasi Musik Angka dan Lirik Lagu Berbahasa Indonesia

Singing is a work of art that can not be separated from human life. It then makes a research about develop the art of singing by technology will brings a useful impact for such a wide aspect of human life. This research is trying to synthesize singing voice with TTS (text-to-speech) technology, as it capability to produce sound with certain pronunciation at certain frequency of sound. Inputs that used in the system are texts of song in TXT format that contain the information of numbered musical notation and lyrics in Indonesian. These inputs will converted to a phonetic transcription, for then synthesize of song voice can done based on the transcription. In general, the system made successfully synthesize song voices with some feature that based on the convention of numbered musical notation. Based on 30 people of respondents, the song voice synthesized has 81.71% of accuracy with 6.24% of deviation standard. The syntax of song text also reputed as a user-friendly convention with only up to 3 times re-compilation done to synthesize 8 bar of song text by each of respondents without any error.

The effects of two assistive technologies on reading comprehension accuracy and rate

ABSTRACTThis study compared the effectiveness of two assistive technologies to accommodate the word reading skills of four middle school students with reading learning disabilities. Kurzweil 3000 is a continuous text-to-speech (TTS) computer software program that allows students to follow along on a computer monitor while passages are read aloud. A reading pen is a discontinuous TTS assistive technology (AT) device that allows students to scan and hear selected words read aloud. An adapted alternating treatments design was implemented to compare the effects of listening-while-reading using continuous TTS AT, discontinuous TTS AT, and silently reading without accommodation on reading comprehension accuracy and rate. Results indicate that in three of the four participants, continuous TTS technology led to the greatest improvements in both comprehension accuracy and rate when compared to silent reading with effect sizes reaching 0.70 and 0.99, respectively. The fourth participant demonstrated the highest comprehension accuracy and rate in the discontinuous TTS condition. The discontinuous TTS condition led to the lowest comprehension rates across all four students. Additionally, participants generally found the continuous TTS AT to be the more acceptable of the two accommodations. Discussion focuses on possible theoretical explanations for the results and implications for future research.

The pedagogical use of mobile speech synthesis (TTS): focus on French liaison

ABSTRACTWe examine the impact of the pedagogical use of mobile TTS on the L2 acquisition of French liaison, a process by which a word-final consonant is pronounced at the beginning of the following word if the latter is vowel-initial (e.g. peti/t.a/mi = > peti[ta]mi ‘boyfriend’). The study compares three groups of L2 French students learning how to produce liaison over a two-month period, following a pretest-posttests design within a mixed-methods approach to data collection and analysis. Participants were divided into three groups: (1) the TTS Group used a TTS application on their mobile devices to complete weekly pronunciation tasks consisting of noticing, listen-and-categorize, and listen-and-repeat; (2) the Non-TTS Group completed the same weekly pronunciation tasks in weekly sessions with a teacher; finally, (3) the Control Group participated in weekly meetings ‘to practice their conversation skills’ with a teacher, who provided no pronunciation feedback. The results indicate that, although all three groups improved in liaison production, if considered separately (within groups), only the two experimental groups improved over time. The discussion of our findings highlights the pedagogical use of mobile TTS technology to complement and enhance the teaching of L2 pronunciation.

READER: DEVICE TO CONVERT WRITTEN/PRINTED TEXT TO SPEECH

A device which is developed with the purpose of helping the blind and the old aged to be able to read books ,articles ,magazines or news papers . Using the ICR and TTS technology the written format is to be converted into speech which the user listens to with the help of earphone connected to 3.5 mm jack.

Design and Realization of Mine Hydrological Alarm System Based on TTS and File Compression Technology

Design and Realization of Mine Hydrological Alarm System Based on TTS and File Compression Technology

TTS Tape Script Construction and Apply to SCADA System

In order to apply TTS technology in SCADA, the demand of tape script is discussed firstly. A method and operating steps to construct tape script is described, that is collecting raw text file through static and dynamical steps, counting the position frequency of every individual Chinese character and phrase in a sentence, and calculating the sentence weight value. A program can realize the method and get tape scripts. In addition, it studied the feature of technical and industrial SCADA system, and discusses the necessity and feasibility using TTS to realizing sound out function in SCADA.

Design and Implementation of Speech Navigation System Based on Android

Using the TTS technology and Svox engine in the Android platform, this paper puts forward the design scheme of the speech navigation system based on Android. The Android platform and structure are introduced firstly, then the system structure and functions are detailed described, lastly the key technology and implement way is given. This system developed methods for the visually impaired application areas have certain guiding significance and the actual practical application value.

The Construction of Colleges and Universities Library Unified Information System Based on Guangxi Regional Features

Through the integrated application of Library information system and campus culture of Guangxi colleges as well as the research of Guangxi colleges serving developments of China-ASEAN, and Guangxi Beibu Gulf economic region, this paper provides solution of integrated construction of college campus culture and library information system on informatization condition. In the system of college campus culture construction based on perspective of Gungxi colleges, college library information resource is used as medium to integrate into cultural connotation serving regional economy on the basis of knowledge architecture, with applications of Internet, computer telecom integration technology as well as IVR and TTS technology, communication tools commonly used by college students and teachers are adopted as informatization approaches, concept identification system, activity identification system, visual identification system, subject and specialty service system, environment and culture planning system and other unified information general culture systems are established, and e-mail, voice message, short message, WAP, real time communication, web, VoIP and other campus culture interactive measures are realized. The reconfigurable analysis of aggregate diagnosis flow proves the integrated construction of campus culture and library unified information is feasible.

Text-to-speech technology effects on reading rate and comprehension by adults with traumatic brain injury

Objective: This study’s purpose was to examine the comprehension, rate and perceptions and reading preferences of adults with severe traumatic brain injury (TBI) when reading passages with and without computerized text-to-speech (TTS) support.Design and methods: Nine adults with severe TBI read 24 passages in two conditions: with and without TTS support. The researchers compared reading rate and comprehension accuracy across conditions. Also, participants rated their perceived performance and reading preferences via a follow-up questionnaire.Results: Comparison to normative data revealed that all nine participants read slower than average neurotypical readers. As a group, participants read significantly faster with TTS support than without such support, even though the TTS reading rate was roughly comparable to the oral rather than silent reading rate of neurotypical adults. No significant differences in comprehension resulted between the two conditions. Over half of the participants preferred the TTS condition over the no-TTS condition. In general, participants were inaccurate in judging their relative reading rates and comprehension accuracy across conditions.Conclusions: TTS may improve reading efficiency without compromising reading comprehension accuracy for adults with TBI. Given this finding, some survivors may find use of TTS technology contributes to increased participation in and efficiency when performing reading activities.

The Application of Multimedia Grid in Barrier-Free for Special Education

A speech navigation teaching assistant system for multimedia grid is designed based on the multimedia grid technology, the TTS technology and Microsoft speech SDK. The multimedia grid technology are introduced firstly, then the system application platform, the structure of resource management and functions are detailed described, lastly the key technology and implement way is given. This system for the application areas of special education for information barrier-free have certain guiding significance and the actual practical application value.

The Service Platform for Barrier-Free Special Education Based on Cloud Computing

Cloud computing is a computing model, computing and storage tasks be assigned to the cloud that be composed of a large number of computers. The cloud computing technology are introduced firstly, then the cloud network platform, the service platform for barrier-free special education and functions are detailed described, lastly the key technology is given, such as TTS technology, Microsoft Speech SDK.

Research and Design of Electronic Speech Reader Based on Text-to-Speech Technology

TTS, namely text-to-speech, is a kind of technology who can convert text information into sound signal according to information Speech processing rules. TTS, as the synthetic technology of the pronunciation, is the key technology in the current development of computer technology, and one of the most forward technical in its voice service, telephone banking, and information home appliances, mobile PDA fields. TTS has its extensive applications. In this paper, TTS is applied to electronic speech reader, which changes traditional way to read e-book, and both listening to and novels and learning English. This article introduces a method about how to make use of TTS technology, and how to achieve an electronic Speech reader of programming based on Visual Studio C# 2008 environment bring API and Microsoft SAPI interface.