Spoken Message Research Articles

IVR to SMS text messenger

Wireless service providers use SMS to notify users of text messages from other wireless users using text-based communications. SMS is used in conjunction with an Interactive Voice Response system and a text-to-speech (TTS) translator to provide enhanced text messaging. Users access the SMS menu on their wireless phone. Instead of typing a text message on the wireless phone keypad, users select an IVR option that connects to the wireless service provider's IVR system. After entering or speaking the telephone number (name or nickname) for the “To:” field, the user speaks the message to be sent via SMS. The IVR reads back the spoken message for user confirmation. Once confirmed, the message is translated to text using a Text-to-Speech translator, or a speech recognition dictation feature, and forwarded to the SMS Messaging Gateway. Alternative embodiments are adapted for use with traditional wireline phones, so that the caller calls the wireless service provider's IVR system, enters the destination number and speaks the message to be sent. Further embodiments provide for the recipient of the message to optionally have the text message spoken via a TTS feature.

Exploring SentenceShaperTM: Treatment and augmentative possibilities

Background: Advances in computer technology have led to the development of innovative approaches to aphasia treatment. One example is SentenceShaperTM, a software program designed to support sentence production for people with nonfluent aphasia. Studies have demonstrated improvement in unaided and/or aided sentence production for some individuals using this program, suggesting therapeutic benefit. In addition, because SentenceShaperTM allows users to record and save spoken messages, it has the potential to augment everyday communication. Aims: The goals of this 4‐month case study were to explore first how using a beta version of SentenceShaperTM could support narrative production for an individual with nonfluent aphasia, and second how she would exploit its therapeutic and augmentative aspects to support her everyday communication. Methods & Procedures: The study, drawing on impairment‐based and social models of intervention, comprised two components. The first used quantitative measures to compare narratives produced before and after 12 weeks of using SentenceShaperTM. The second used qualitative methodologies to explore its impact on communication. Outcomes & Results: Quantitative measures showed an increase in morphosyntactic complexity of the aphasic participant's narratives, while measures of informativeness, efficiency, and narrative structure remained relatively unchanged. Findings from the second component revealed that, although the participant with aphasia used SentenceShaperTM messages for e‐mail and in conversation, neither she nor her mother readily accepted the use of the program to augment communication in everyday life. Conclusions: Reasons for this lack of acceptance are explored. Ways in which the combination of quantitative and qualitative methodologies contributed to a deeper understanding of the findings are discussed

Estimating the Speed of Light from Earth-Moon Communication

During the Moon landing of Apollo 16 on April 21, 1972, a spoken message from Earth is heard returning to Earth roughly 2.7 s later. The signal traveled from Earth to the Moon, from the earphone to the microphone of astronaut John Young's space helmet, and back to Earth. A recording of this “space echo,” available at Ref. 1, enables a simple approximate determination of the speed of light.

Electronic mail method and system using associated audio and visual techniques

A multi-mail system and method is disclosed in which a sender may convey and a recipient can realize emotional aspects associated with substantive content of a multi-mail message by receiving a message that is more than textual in nature. Voice recognition technology and programmatic relation of sound and graphics may be used to produce a talking image. In one embodiment, the image may include the user's own visual and/or audio likeness. In an alternate embodiment, the image may comprise any available visual and/or audio display selected by the user. The multi-mail message may be inputted by a user in a text format and transposed into a format including the selected image and/or voice. In an alternate embodiment, a spoken message may be converted into a format including the selected image and/or voice. The formatted messages are then stored and/or transmitted via an email system or some other electronic network.

A GRAPHEME-TO-PHONEME TRANSLATOR FOR TTS SYNTHESIS IN GREEK

In this paper is presented the algorithm of an automatic grapheme-to-phoneme translator for the Greek language. The proposed algorithm is designed to collaborate with a high quality Text-to-Speech synthesis system in Greek. The algorithm assimilates the full reading process of written text as realized by a Greek speaking person. A detailed study of the Greek language's operation, led us to the implementation of an automatic integrated system which describes its phonetic behaviour in an exact and natural way. The software that implements the algorithm has the capability to receive written text from any input (keyboard, file, screen reader, OCR system e.t.c.) and transform it to phonetic form. Afterwards the output of the algorithm is directed to the input of a concatenation-based speech synthesizer and the right pronunciation of any written text is achieved in real-time. During the reading process the software locates and distinguishes Greek written text from any foreign language words, specially written symbols, abbreviations e. t. c… and afterwards manages them in order that the flow of the reading process permits the right perception of the produced spoken messages. The most important qualification of the algorithm is the possibility to incorporate it in other Text-to-Speech synthesis systems of different technology. Finally experimental measurements indicate the successful operation of the algorithm.

What is the Role of Audition in Literacy?

What is the Role of Audition in Literacy?

Brainstem origins for cortical ‘what’ and ‘where’ pathways in the auditory system

We have developed a data-driven conceptual framework that links two areas of science: the source-filter model of acoustics and cortical sensory processing streams. The source-filter model describes the mechanics behind speech production: the identity of the speaker is carried largely in the vocal cord source and the message is shaped by the ever-changing filters of the vocal tract. Sensory processing streams, popularly called 'what' and 'where' pathways, are well established in the visual system as a neural scheme for separately carrying different facets of visual objects, namely their identity and their position/motion, to the cortex. A similar functional organization has been postulated in the auditory system. Both speaker identity and the spoken message, which are simultaneously conveyed in the acoustic structure of speech, can be disentangled into discrete brainstem response components. We argue that these two response classes are early manifestations of auditory 'what' and 'where' streams in the cortex. This brainstem link forges a new understanding of the relationship between the acoustics of speech and cortical processing streams, unites two hitherto separate areas in science, and provides a model for future investigations of auditory function.

Why the spontaneous images created by the hands during talk can help make TV advertisements more effective

The design of effective communications depends upon an adequate model of the communication process. The traditional model is that speech conveys semantic information and bodily movement conveys information about emotion and interpersonal attitudes. But McNeill (2000) argues that this model is fundamentally wrong and that some bodily movements, namely spontaneous hand movements generated during talk (iconic gestures), are integral to semantic communication. But can we increase the effectiveness of communication using this new theory? Focusing on advertising we found that advertisements in which the message was split between speech and iconic gesture (possible on TV) were significantly more effective than advertisements in which meaning resided purely in speech or language (radio/newspaper). We also found that the significant differences in communicative effectiveness were maintained across five consecutive trials. We compared the communicative power of professionally made TV advertisements in which a spoken message was accompanied either by iconic gestures or by pictorial images, and found the iconic gestures to be more effective. We hypothesized that iconic gestures are so effective because they illustrate and isolate just the core semantic properties of a product. This research suggests that TV advertisements can be made more effective by incorporating iconic gestures with exactly the right temporal and semantic properties.

Marking emergency exits and evacuation routes with sound beacons utilizing the precedence effect

Sound beacons can be extremely useful during emergency evacuations, especially when vision is obscured by smoke. When exits are marked with suitable sound sources, people can find these using only their capacity for directional hearing. Unfortunately, unless very explicit instructions were given, sound beacons currently commercially available (based on modulated noise) led to disappointing results during an evacuation experiment in a traffic tunnel. Only 19% out of 65 subjects were able to find an exit by ear. A signal designed to be more self-explanatory and less hostile-sounding (alternating chime signal and spoken message ‘‘exit here’’) increased the success rate to 86%. In a more complex environment—a mock-up of a ship’s interior—routes to the exit were marked using multiple beacons. By applying carefully designed time delays between successive beacons, the direction of the route was marked, utilizing the precedence effect. Out of 34 subjects, 71% correctly followed the evacuation route by ear (compared to 24% for a noise signal as used in commercially available beacons). Even when subjects were forced to make a worst-case left–right decision at a T-junction, between two beacons differing only in arrival of the first wave front, 77% made the right decision.

Central auditory processing disorder in children with developmental dysphasia

The author analyses the role of auditory perception in children suffering from specific language impairment (SLI) using speech central tests. Disorders of speech comprehension are typical for all of the patients with central auditory processing disorders (CAPDs). In speech perception, temporal processing is one of the functions necessary for the discrimination of phonemes and of similar words. The existence of cognitive functions disorders is much more important than the existence of those that are directly involved in the speech production. Auditory decoding deficits, phonological, lexical, syntactic and associative deficits were diagnosed in children suffering from developmental dysphasia (this term is used in our country for SLI). Many of these children were unable to recognize acoustic contours and to identify the key words from a spoken message [T.J. Bellis, Assessment and Management and Central Auditory Processing Disorders in the Educational Setting, Singular, San Diego, 1996]. Among the characteristics of these central tests' findings are poor performance on mono aural low redundancy speech tests, bilateral deficits on dichotic speech tasks and poor word recognition skills. Competing sentences test and identification test with contralateral competing message represent binaural separation or integration. The dysphasic children (80) were tested by dichotic tasks—repetition of two-syllabic words and short sentences. Our results indicate the relationship between developmental dysphasia and central auditory processing disorder (CAPD): these dysphasic children have auditory processing deficit—not only integration, but also associative deficit.

Comparing disability survey questions in five countries: a study using ICF to guide comparisons

This paper describes an international effort to compare disability survey questions using the ICF framework. The process included backcoding survey questions to ICF. To establish a meaningful basis for comparison, the original 14 functioning areas were scaled to seven: hearing, seeing, speaking, mobility, body movement, gripping and personal care. The names of disability topics changed reflecting ICF definitions, for example, hearing became receiving spoken messages and gripping became fine hand use. A rigorous backcoding process resulted in a comprehensive set of survey questions with unique ICF codes. It was concluded that the question format and focus must be structured to the ICF in the survey development phase in order to achieve the best possible base for international comparability.

Cost‐effective microcontrolled optoelectronic portable color identifier for visual impaired persons

AbstractA hand‐held color‐identifier for blind, color‐blind and vision‐impaired people has been developed. Color data are obtained by balancing the relative intensities of RGB primaries. After a training period, the system is able to identify any arbitrary number of colors. The output is a spoken message, chosen from a preset list. © 2002 Wiley Periodicals, Inc. Microwave Opt Technol Lett 35: 309–310, 2002; Published online in Wiley InterScience (www.interscience.wiley.com). DOI 10.1002/mop.10592

Use of an IC Recorder as a voice output memory aid for patients with prospective memory impairment

This study evaluated the use of an IC Recorder as a voice output memory aid for patients with prospective memory impairment. The IC Recorder can output about 300 previously recorded messages at programmed times. The spoken messages prompted various daily tasks for eight patients with acquired memory impairments. One of these tasks, such as diary writing, or a letter-writing exercise was selected for each patient as a main task, and its completion was logged. These completion data demonstrated that the messages output by the IC Recorder were highly effective in prompting the main tasks for five of the eight patients. This study suggests that the IC Recorder has great potential as a voice output memory aid to assist patients with prospective memory impairment.

Is the phonetic quality of unaccented words unpredictable? An example from spontaneous Finnish

In spontaneous speech, occurrences of the same word form vary phonetically. Words that do not receive sentence accent tend to be less clearly articulated and shorter in duration in comparison to prominent words. If such an unaccented word is isolated from continuous speech, it may not even be identifiable by listeners, but as part of the speech stream, it is usually easily identified and helps the listener to perceive and organize the spoken message as a whole. Thus, the variability of unaccented words is not random but must follow certain patterns determined by context. In this study, we take a closer look at the Finnish unaccented word-like construction niinku in spontaneous conversational speech samples collected from one female Finnish speaker. We provide an analysis of the phonetic variability of the niinku structure found in the data, including such properties as segmental duration, segmental make-up, and phonetic quality. We then show what kind of properties are common to all occurrences of this unaccented construction and discuss the conditions that probably govern its acoustic-phonetic quality.

Can Subjects Perceive Simultaneous Verbal Messages with Correct Localization?

In most aircrafts today, there is no support for simultaneous communication. This study investigated the human perception of three-dimensional auditory information under noise and mental stress conditions. The task was to perceive the location and the verbal contents of spoken messages. The perception of the location of the aural message was not as good as the understanding of the verbal messages themselves. However, noise and mental stress had significant effects on the performance.

Suggestions for Slides at Scientific Meetings

The spoken message in a scientific talk is enhanced by well-prepared slides that are simple, clear, legible, and pleasing to the eye. Good slides can create visual images that endure in the audience's mind long after the speaker has finished. Poorly prepared slides, however, detract from both the speaker and the intended message. Poor slides have features that hinder communication, such as small letters, too much text, dark images on dark backgrounds, outlandish colors, complex figures, or large tables. Poor slides create lasting images, too, but of an undesirable kind. In an effort to encourage scientists to reconsider the effectiveness of their slides, we provide some guidelines for slide preparation. We hope that our opinions will stimulate speakers to prepare slides that enhance, rather than detract from, the spoken words (see Smith 1957, Toft 1998). First, we present our top 10 recommendations, in decreasing order of importance. Then, we offer six additional ideas that also should aid in preparing effective slides and talks.

Chapter 39 EEG changes and epilepsy in developmental dysphasia

This chapter discusses the relationship between developmental dysphasia and electroencephalography (EEG) abnormalities and explains the relationship among the disorders of auditory perception, speech comprehension, and subclinical epileptic disturbances. Typical clinical picture of developmental dysphasia includes retarded speech development with specific disorders in all speech structures: the individual phonological system and the other linguistic levels—lexical, syntactic, grammatical, and semantic. The children have typical speech comprehension problems varying in intensity and have typical auditory decoding deficits, integration deficit, associative deficit, and output organization deficit of speech. Many children are not able to recognize acoustic contours or identify the keywords from a spoken message. The children with developmental dysphasia often behave as if peripheral hearing loss is present, despite normal hearing. Disorders of speech comprehension are typical for all patients with central auditory processing disorders. Developmentally dysphasic children exhibit a higher incidence of abnormal EEG than expected. Spontaneous verbal communication is limited and in the majority of cases, disappears completely. In most cases, epileptic seizures appear, sometimes even as a presenting symptom of the disease.

Managing evacuating people from facilities during a fire emergency

A review of research, interviews and experiments at an IKEA building are presented with results that could affect the planning and real time management. Subjects had to choose between a normal exit and an emergency exit in different conditions. The results show that the majority of subjects choose the normal exit even if the distance is double compared to the emergency exit. The only exception is when the emergency exit is open and it is possible to see the daylight outside. Findings show that a ring signal is often misunderstood but a spoken message is understandable.

The high-power acoustical warning systems

The high-power acoustical warning and informing systems are necessary for various aims. Mostly these systems work in open space, particularly in urban areas (towns, villages, river valleys). The useful coverage depends upon used transducers-emitters and installed electrical power. Almost all such systems have omnidirectional coverage, i.e., equal acoustical energy is radiated in all directions. The environmental conditions (air temperature and humidity, strength and direction of wind, etc.) and miscellaneous barriers (buildings, land configuration, trees) have an influence on the sound propagation for warning and informing systems. The other important point is that these systems are also used for spoken messages, not only for alarm. The computer simulation was done which takes all these parameters into account, and enables calculation of needed acoustical and electrical parameters.

Approaching the locked dialogues of the body: Communicating symptoms through illness diaries

Objective - To describe and analyse communication following the use of an illness diary method in consultations with patients suffering from longstanding illness without clinical findings. Design - Action research in own practice with qualitative formative evaluation of material provided by the use of the diary method. Analysis followed a procedure modified from phenomenologically-based methodology. Setting - The practice of the main author. Subjects - 36 consultations with 16 patients where the illness diary method was applied. Result - Communication following illness diary utilisation could be summarised as: 1) illness diaries as medical documentation, 2) making access to the insight of the patient, 3) exploring internal dialogues and locked voices, and 4) adding meaning to a spoken message through writing (creative distance). By changing the frames of conversation through illness diary utilisation towards one or more of these four levels of communication, the patient may become a more equal consultation partner. Conclusion - Illness diaries can provide clinically relevant information and may emphasise the patient's input and significance in medical dialogues on longstanding symptoms without clinical findings.