Auditory Feedback Research Articles

The Impact of Virtual Reality as a Rehabilitation Method Using TRAVEE System on Functional Outcomes and Disability in Stroke Patients: A Pilot Study

Background: Stroke is the third leading cause of disability. Virtual reality (VR) has shown promising results in post-stroke rehabilitation. The VR TRAVEE system was designed for the neuromotor rehabilitation of the upper limb after a stroke and offers the ability to track limb movements by providing auditory feedback and visual augmentation. The World Health Organization Disability Assessment Schedule 2.0 (WHODAS 2.0), aligned with the International Classification of Functioning, Disability, and Health (ICF) principles, is a valid tool for measuring disability regardless of its cause. This study aimed to investigate the feasibility of the VR TRAVEE system in upper limb rehabilitation for stroke patients. Methods: A total of 14 stroke patients with residual hemiparesis were enrolled in the study. They underwent a 10-day program combining conventional therapy (CnvT) with VR rehabilitation. At baseline (T0), the upper limb was assessed using the Modified Ashworth Scale (MAS), active range of motion (AROM), and the Numeric Rating Scale (NRS) for pain. These assessments were repeated after the 10-day rehabilitation program (T1). Additionally, disability was measured using WHODAS 2.0 at T0 and again 30 days after completing the program. Results: Significant improvements were observed in AROM and MAS scores for the shoulder, elbow, wrist, and metacarpophalangeal joints, as well as in the reduction in shoulder pain (p ˂ 0.001). WHODAS scores decreased across all six domains, with a statistically significant improvement in the Cognition domain (p = 0.011). Conclusions: Combining CnvT with VR as a rehabilitation approach enhances motor function in the upper limb. This method has the potential to reduce disability scores and promote neuroplasticity.

Spatiotemporal mapping of auditory onsets during speech production.

The human auditory cortex is organized according to the timing and spectral characteristics of speech sounds during speech perception. During listening, the posterior superior temporal gyrus is organized according to onset responses, which segment acoustic boundaries in speech, and sustained responses, which further process phonological content. When we speak, the auditory system is actively processing the sound of our own voice to detect and correct speech errors in real time. This manifests in neural recordings as suppression of auditory responses during speech production compared to perception, but whether this differentially affects onset and sustained temporal profiles is not known. Here we investigated this question using intracranial EEG recorded from seventeen pediatric, adolescent, and adult patients with medication-resistant epilepsy while they performed a reading/listening task. We identified onset and sustained responses to speech in bilateral auditory cortex and observed a selective suppression of onset responses during speech production. We conclude that onset responses provide a temporal landmark during speech perception that is redundant with forward prediction during speech production and are therefore suppressed. Phonological feature tuning in these "onset suppression" electrodes remained stable between perception and production. Notably, auditory onset responses and phonological feature tuning were present in the posterior insula during both speech perception and production, suggesting an anatomically and functionally separate auditory processing zone that we believe to be involved in multisensory integration during speech perception and feedback control.Significance Statement Specific neural populations in the auditory cortex preferentially respond to the onset of speech sounds. These "onset responses" aid in perceiving boundaries in continuous speech. We recorded neural responses from patients with intracranial electrodes during a speaking and listening task to investigate the role of onset responses in speech production. Onset responses were present in the auditory cortex during listening, but absent during speaking. On the other hand, onset responses were observed in the insula during both conditions, suggesting a different functional role for the insula in auditory feedback processing. These findings extend our knowledge of how different parts of the brain involved in feedback control operate during speech production by identifying two functionally and anatomically distinct patterns of activity.

Effects of two modalities of practice on the learning of piano pieces under the deprivation of auditory feedback

Sixteen piano students learned four piano pieces under two different conditions that involved the deprivation of auditory and motor feedback. One condition required study away from the piano, thus implying the removal of auditory and kinaesthetic feedback (mental practice, MP). The other condition involved study on a digital piano that was turned off (motor practice, MoP), hence depriving the participant of auditory feedback. Data on the effects of the two different modalities of practice, which also excluded external sound references during the initial study of new piano pieces, were analysed in two different ways. First, video recordings of the participants’ practice sessions were analysed to identify behaviours exhibited during these sessions, quantified by number of incidences. Second, external referees assessed final performances (audio recordings on an acoustic piano) according to four proposed parameters related to piano performance. Data from semi-structured interviews were collected as well. The results showed differences between the two conditions, especially with respect to the utilisation of support activities and pauses during practice. The analysis indicated that procedures related to MP may yield better results when the musical material is approached as small portions one at a time. Finally, the modality of MP described in this article, which bears some relation to other forms of MP, could be a valid alternative for issues of fatigue and complexity related to MP, as has been traditionally described in the literature.

Impaired speaking-induced suppression in schizophrenia predicts auditory verbal hallucinations.

A successful efference copy self-prediction suppresses auditory signals in the primary auditory cortex (A1) is necessary for speakers to successfully compare auditory feedback during speech production with auditory feedback during passive listening, this is called speaker-induced suppression (SIS). The top-rank positive symptom in schizophrenic (SZ) patients, auditory verbal hallucination, for instance, is hypothesized to relate to failure to distinguish the internal voice and external sounds, and this deficit is thought to be associated with impaired self-prediction in comparing external and self-generated contents. In this magnetoencephalographic imaging (MEGI) study, we compared SIS M100 in the primary auditory cortex (A1) between the healthy controls (HC; N = 30) and SZ patients (N = 22). The SZ patients displayed reduced SIS and M100 in the A1, and this impairment is negatively correlated with auditory hallucinations. These outcomes suggest that the SZ patients' hallucinatory symptoms are caused by misattribution between the external and self-generated stimuli. We proposed that the weakened self-agency and neural oscillations may lead to this misattribution.

Bayesian inference of state feedback control parameters for fo perturbation responses in cerebellar ataxia.

Behavioral speech tasks have been widely used to understand the mechanisms of speech motor control in typical speakers as well as in various clinical populations. However, determining which neural functions differ between typical speakers and clinical populations based on behavioral data alone is difficult because multiple mechanisms may lead to the same behavioral differences. For example, individuals with cerebellar ataxia (CA) produce atypically large compensatory responses to pitch perturbations in their auditory feedback, compared to typical speakers, but this pattern could have many explanations. Here, computational modeling techniques were used to address this challenge. Bayesian inference was used to fit a state feedback control (SFC) model of voice fundamental frequency (fo) control to the behavioral pitch perturbation responses of speakers with CA and typical speakers. This fitting process resulted in estimates of posterior likelihood distributions for five model parameters (sensory feedback delays, absolute and relative levels of auditory and somatosensory feedback noise, and controller gain), which were compared between the two groups. Results suggest that the speakers with CA may proportionally weight auditory and somatosensory feedback differently from typical speakers. Specifically, the CA group showed a greater relative sensitivity to auditory feedback than the control group. There were also large group differences in the controller gain parameter, suggesting increased motor output responses to target errors in the CA group. These modeling results generate hypotheses about how CA may affect the speech motor system, which could help guide future empirical investigations in CA. This study also demonstrates the overall proof-of-principle of using this Bayesian inference approach to understand behavioral speech data in terms of interpretable parameters of speech motor control models.

Effects of increasing walking cadence on gait biomechanics in adults with knee osteoarthritis

Gait retraining is a strategy to manage altered loading patterns and pain characteristic of knee osteoarthritis. Lower walking cadence is associated with higher knee joint loading, vertical ground reaction forces, and risk for cartilage worsening. Therefore, we determined the acute effects of increasing walking cadence on measures of lower extremity loading and knee pain in knee osteoarthritis. Twenty-five participants with knee osteoarthritis (age = 62.5 ± 7.2; 76.0 % female) walked at fixed speed on an instrumented treadmill from which baseline cadence was measured. Five, randomized experimental cadence conditions (2 %, 4 %, 6 %, 8 %, or 10 % over baseline cadence) were completed. Real-time auditory and visual feedback on cadence was provided while kinematics and ground reaction forces were sampled. Linear mixed effects models evaluated the effect of cadence on knee adduction and flexion moment peaks and impulses, impact loading metrics (vertical ground reaction force impact peak, vertical average and instantaneous loading rates), and knee pain. Increasing cadence by 2–10 % did not significantly change knee adduction moment peaks or impulse. Peak knee flexion moment increased by 3–32 % and knee flexion moment impulse reduced by 2–9 % with increases in cadence, but these results were not significant (peak knee flexion moment, p = 0.070; knee flexion moment impulse, p = 0.085). Increasing cadence significantly increased the vertical impact peak (p < 0.001), and the vertical average (p = 0.010), and instantaneous (p = 0.007) loading rates. Small increases in cadence at a fixed gait speed does not significantly change surrogate measures of knee joint loading or pain, but does increase measures of impact loading.

Gait Retraining For Reduction Of Vertical Loading Rate Using Real-time Auditory Feedback Provided By Earphones

Gait Retraining For Reduction Of Vertical Loading Rate Using Real-time Auditory Feedback Provided By Earphones

Serial engagement of distinct motor learning mechanisms to alter walking after stroke

This study asked if combining different motor learning mechanisms—adaptation and reinforcement—could produce immediate improvements in over ground walking after stroke. Fifteen adults with stroke engaged in three conditions: (1) reinforcement following adaptation, (2) reinforcement alone, and (3) adaptation alone. Adaptation involved split-belt treadmill walking to produce after-effects that reduce step asymmetry. Reinforcement involved the use of real-time auditory feedback about step length asymmetry. Auditory feedback was binary, signaling whether steps were asymmetric or equal, but not whether to shorten or lengthen either step. Change in step length asymmetry was the outcome assessed during over ground walking. Reinforcement following adaptation led to reductions in step length asymmetry that persisted into an immediate retention period. Importantly, it led to the desired pattern of lengthening the shorter step in a majority of participants. Reinforcement alone led to no significant change in step length asymmetry, and sometimes produced a non-optimal pattern of shortening the longer step. Our control condition of adaptation alone led to more transient reductions in step length asymmetry. These findings reveal the potential for utilizing serial delivery of adaptation and reinforcement to influence a complex movement in the real-world context of over ground walking, in people with stroke.

Neurophysiological evidence of sensory prediction errors driving speech sensorimotor adaptation.

The human sensorimotor system has a remarkable ability to quickly and efficiently learn movements from sensory experience. A prominent example is sensorimotor adaptation, learning that characterizes the sensorimotor system's response to persistent sensory errors by adjusting future movements to compensate for those errors. Despite being essential for maintaining and fine-tuning motor control, mechanisms underlying sensorimotor adaptation remain unclear. A component of sensorimotor adaptation is implicit (i.e., the learner is unaware of the learning process) which has been suggested to result from sensory prediction errors-the discrepancies between predicted sensory consequences of motor commands and actual sensory feedback. However, to date no direct neurophysiological evidence that sensory prediction errors drive adaptation has been demonstrated. Here, we examined prediction errors via magnetoencephalography (MEG) imaging of the auditory cortex (n = 34) during sensorimotor adaptation of speech to altered auditory feedback, an entirely implicit adaptation task. Specifically, we measured how speaking-induced suppression (SIS)--a neural representation of auditory prediction errors--changed over the trials of the adaptation experiment. SIS refers to the suppression of auditory cortical response to speech onset (in particular, the M100 response) to self-produced speech when compared to the response to passive listening to identical playback of that speech. SIS was reduced (reflecting larger prediction errors) during the early learning phase compared to the initial unaltered feedback phase. Furthermore, reduction in SIS positively correlated with behavioral adaptation extents, suggesting that larger prediction errors were associated with more learning. In contrast, such a reduction in SIS was not found in a control experiment in which participants heard unaltered feedback and thus did not adapt. In addition, in some participants who reached a plateau in the late learning phase, SIS increased (reflecting smaller prediction errors), demonstrating that prediction errors were minimal when there was no further adaptation. Together, these findings provide the first neurophysiological evidence for the hypothesis that prediction errors drive human sensorimotor adaptation.

Speech-induced suppression and vocal feedback sensitivity in human cortex

Across the animal kingdom, neural responses in the auditory cortex are suppressed during vocalization, and humans are no exception. A common hypothesis is that suppression increases sensitivity to auditory feedback, enabling the detection of vocalization errors. This hypothesis has been previously confirmed in non-human primates, however a direct link between auditory suppression and sensitivity in human speech monitoring remains elusive. To address this issue, we obtained intracranial electroencephalography (iEEG) recordings from 35 neurosurgical participants during speech production. We first characterized the detailed topography of auditory suppression, which varied across superior temporal gyrus (STG). Next, we performed a delayed auditory feedback (DAF) task to determine whether the suppressed sites were also sensitive to auditory feedback alterations. Indeed, overlapping sites showed enhanced responses to feedback, indicating sensitivity. Importantly, there was a strong correlation between the degree of auditory suppression and feedback sensitivity, suggesting suppression might be a key mechanism that underlies speech monitoring. Further, we found that when participants produced speech with simultaneous auditory feedback, posterior STG was selectively activated if participants were engaged in a DAF paradigm, suggesting that increased attentional load can modulate auditory feedback sensitivity.

Speech-induced suppression and vocal feedback sensitivity in human cortex.

Across the animal kingdom, neural responses in the auditory cortex are suppressed during vocalization, and humans are no exception. A common hypothesis is that suppression increases sensitivity to auditory feedback, enabling the detection of vocalization errors. This hypothesis has been previously confirmed in non-human primates, however a direct link between auditory suppression and sensitivity in human speech monitoring remains elusive. To address this issue, we obtained intracranial electroencephalography (iEEG) recordings from 35 neurosurgical participants during speech production. We first characterized the detailed topography of auditory suppression, which varied across superior temporal gyrus (STG). Next, we performed a delayed auditory feedback (DAF) task to determine whether the suppressed sites were also sensitive to auditory feedback alterations. Indeed, overlapping sites showed enhanced responses to feedback, indicating sensitivity. Importantly, there was a strong correlation between the degree of auditory suppression and feedback sensitivity, suggesting suppression might be a key mechanism that underlies speech monitoring. Further, we found that when participants produced speech with simultaneous auditory feedback, posterior STG was selectively activated if participants were engaged in a DAF paradigm, suggesting that increased attentional load can modulate auditory feedback sensitivity.

Immediate auditory feedback regulates inter-articulator speech coordination in service to phonetic structure.

Research has shown that talkers reliably coordinate the timing of articulator movements across variation in production rate and syllable stress, and that this precision of inter-articulator timing instantiates phonetic structure in the resulting acoustic signal. We here tested the hypothesis that immediate auditory feedback helps regulate that consistent articulatory timing control. Talkers with normal hearing recorded 480 /tV#Cat/ utterances using electromagnetic articulography, with alternative V (/ɑ/-/ɛ/) and C (/t/-/d/), across variation in production rate (fast-normal) and stress (first syllable stressed-unstressed). Utterances were split between two listening conditions: unmasked and masked. To quantify the effect of immediate auditory feedback on the coordination between the jaw and tongue-tip, the timing of tongue-tip raising onset for C, relative to the jaw opening-closing cycle for V, was obtained in each listening condition. Across both listening conditions, any manipulation that shortened the jaw opening-closing cycle reduced the latency of tongue-tip movement onset, relative to the onset of jaw opening. Moreover, tongue-tip latencies were strongly affiliated with utterance type. During auditory masking, however, tongue-tip latencies were less strongly affiliated with utterance type, demonstrating that talkers use afferent auditory signals in real-time to regulate the precision of inter-articulator timing in service to phonetic structure.

Managing lower extremity loading in distance running by altering sagittal plane trunk leaning

BackgroundTrunk lean angle is an underrepresented biomechanical variable for modulating and redistributing lower extremity joint loading and potentially reducing the risk of running-related overuse injuries. The purpose of this study was to systematically alter the trunk lean angle in distance running using an auditory real-time feedback approach and to derive dose–response relationships between sagittal plane trunk lean angle and lower extremity (cumulative) joint loading to guide overuse load management in clinical practice. MethodsThirty recreational runners (15 males and 15 females) ran at a constant speed of 2.5 m/s at 5 systematically varied trunk lean conditions on a force-instrumented treadmill while kinematic and kinetic data were captured. ResultsA change in trunk lean angle from –2° (extension) to 28° (flexion) resulted in a systematic increase in stance phase angular impulse, cumulative impulse, and peak moment at the hip joint in the sagittal and transversal plane. In contrast, a systematic decrease in these parameters at the knee joint in the sagittal plane and the hip joint in the frontal plane was found (p < 0.001). Linear fitting revealed that with every degree of anterior trunk leaning, the cumulative hip joint extension loading increases by 3.26 Nm·s/kg/1000 m, while simultaneously decreasing knee joint extension loading by 1.08 Nm·s/kg/1000 m. ConclusionTrunk leaning can reduce knee joint loading and hip joint abduction loading, at the cost of hip joint loading in the sagittal and transversal planes during distance running. Modulating lower extremity joint loading by altering trunk lean angle is an effective strategy to redistribute joint load between/within the knee and hip joints. When implementing anterior trunk leaning in clinical practice, the increased demands on the hip musculature, dynamic stability, and the potential trade-off with running economy should be considered.

Real-time auditory feedback for improving gait and walking in people with Parkinson’s disease: a pilot and feasibility trial

BackgroundTechnology is poised to bridge the gap between demand for therapies to improve gait in people with Parkinson’s and available resources. A wearable sensor, Heel2Toe™, a small device that attaches to the side of the shoe and gives a sound each time the person starts their step with a strong heel strike, has been developed and pre-tested by a team at McGill University. The objective of this study was to estimate feasibility and efficacy potential of the Heel2Toe™ sensor in changing walking capacity and gait pattern in people with Parkinson’s.MethodsA pilot study was carried out involving 27 people with Parkinson’s randomized 2:1 to train with the Heel2Toe[TM] sensor and or to train with recommendations from a gait-related workbook.ResultsA total of 21 completed the 3-month evaluation, 14 trained with the Heel2Toe[TM] sensor, and 7 trained with the workbook. Thirteen of 14 people in the Heel2Toe group improved over measurement error on the primary outcome, the 6-Minute Walk Test, (mean change 66.4 m) and 0 of the 7 in the Workbook group (mean change − 19.4 m): 4 of 14 in the Heel2Toe group made reliable change and 0 of 7 in the Workbook group. Improvements in walking distance were accompanied by improvements in gait quality. Forty percent of participants in the intervention group were strongly satisfied with their technology experience and an additional 37% were satisfied.ConclusionsDespite some technological difficulties, feasibility and efficacy potential of the Heel2Toe sensor in improving gait in people with Parkinson’s was supported.

Real time eye dose reduction in fluoroscopy with auditory and visual feedback dosimeter through swine model experiments

This paper proposes measurement and reduction of eye dose in real time for the physician and the assistant performing fluoroscopy guided arterial puncture. Eye dose rates were measured for 30 fluoroscopy-guided punctures of bilateral femoral arteries in pigs. Fifteen fluoroscopy-guided punctures were performed using real time radiation dosimeter without auditory and visual feedback and other fifteen punctures were done using real time radiation dosimeter with visual and auditory feedback worn on forehead by an interventional cardiologist having experience of more than 10 years. The mean radiation dose rate for eyes of physician during arterial puncturing with real time radiation dosimeter with auditory feedback was 0.07 mSv/h (n = 15) whereas it was 0.18 mSv/h (n = 15) without visual and auditory feedback. The percentage of reduction with the device was 61% for eyes. In case of assistant the reduction was 33% for eyes (n = 15). The real time visual and auditory feedback dosimeter has reduced the eye dose rate of the physician and assistant and also helped him staying away from the X-ray source. Real time radiation dosimeters can be an effective tool to measure and reduce the dose to the eyes. The radiation eye dose rate for physician and assistant was significantly reduced by using real time radiation dosimeter with visual and auditory feedback. The real time radiation dosimeter not only helps in measuring but also help in minimizing the radiation dose rate for the physician and assistant in real time.

Implicit audiomotor adaptation

Sensorimotor adaptation alters mappings between motor commands and their predicted outcomes. Such remapping has been extensively studied in the visual domain, but the degree to which it occurs in modalities other than vision remains less well understood. Here, we manipulated the modality of reach target presentation to compare sensorimotor adaptation in response to perturbations of visual and auditory feedback location. We compared the extent of adaptation to perturbed sensory feedback for visual and auditory sensory modalities, and the magnitude of reach-direction aftereffects when the perturbation was removed. To isolate the contribution of implicit sensorimotor recalibration to adaptation in reach direction, we held sensory prediction errors and task-performance errors constant via a task-irrelevant clamp of sensory feedback. Seventy-two participants performed one of three experiments in which target location information and endpoint reach direction feedback were presented by loudspeakers (n = 24), headphones (n = 24), or a visual display (n = 24). Presentation durations for target stimuli (500 ms) and (non-veridical) endpoint feedback of reach direction (100 ms) were matched for visual and auditory modalities. For all three groups, when endpoint feedback was perturbed, adaptation was evident: reach-directions increased significantly in the direction opposite the clamped feedback, and a significant aftereffect persisted after participants were instructed that the perturbation had been removed. This study provides new evidence that implicit sensorimotor adaptation occurs in response to perturbed auditory feedback of reach direction, suggesting that an implicit neural process to recalibrate sensory to motor maps in response to sensory prediction errors may be ubiquitous across sensory modalities.

A compact solution for vibrotactile proprioceptive feedback of wrist rotation and hand aperture

BackgroundClosing the control loop between users and their prostheses by providing artificial sensory feedback is a fundamental step toward the full restoration of lost sensory-motor functions.MethodsWe propose a novel approach to provide artificial proprioceptive feedback about two degrees of freedom using a single array of 8 vibration motors (compact solution). The performance afforded by the novel method during an online closed-loop control task was compared to that achieved using the conventional approach, in which the same information was conveyed using two arrays of 8 and 4 vibromotors (one array per degree of freedom), respectively. The new method employed Gaussian interpolation to modulate the intensity profile across a single array of vibration motors (compact feedback) to convey wrist rotation and hand aperture by adjusting the mean and standard deviation of the Gaussian, respectively. Ten able-bodied participants and four transradial amputees performed a target achievement control test by utilizing pattern recognition with compact and conventional vibrotactile feedback to control the Hannes prosthetic hand (test conditions). A second group of ten able-bodied participants performed the same experiment in control conditions with visual and auditory feedback as well as no-feedback.ResultsConventional and compact approaches resulted in similar positioning accuracy, time and path efficiency, and total trial time. The comparison with control condition revealed that vibrational feedback was intuitive and useful, but also underlined the power of incidental feedback sources. Notably, amputee participants achieved similar performance to that of able-bodied participants.ConclusionsThe study therefore shows that the novel feedback strategy conveys useful information about prosthesis movements while reducing the number of motors without compromising performance. This is an important step toward the full integration of such an interface into a prosthesis socket for clinical use.

Application of an Auditory-Based Feedback Distortion to Modify Gait Symmetry in Healthy Individuals.

Augmenting auditory feedback through an error-augmentation paradigm could facilitate the perception and correction of gait asymmetry in stroke survivors, but how such a paradigm should be tailored to individual asymmetry profiles remains unclear. Before implementing the paradigm in rehabilitation, we need to investigate the instantaneous effects of distorted footstep sound feedback on gait symmetry in healthy young adults. Participants (n = 12) walked on a self-paced treadmill while listening to their footstep sounds, which were distorted unilaterally according to five conditions presented randomly: small delay; small advance; large delay; large advance; or unmodified (control). The primary outcomes were swing time ratio (SWR) and step length ratio (SLR). Secondary outcomes included walking speed, bilateral swing time, step length, and maximum toe height, as well as hip, knee, and ankle angle excursions. SWR (p < 0.001) but not SLR (p ≥ 0.05) was increased in all distorted feedback conditions compared to the control condition. Increased swing time on the perturbed side ipsilateral to feedback distortion was observed in the advanced conditions (p < 0.001), while swing time increased bilaterally in the delayed conditions (p < 0.001) but to a larger extent on the unperturbed side contralateral to feedback distortion. Increases in swing time were accompanied by larger maximum toe height as well as larger hip and knee joint excursions (p < 0.05 to p < 0.001). No differences in any outcomes were observed between small and large feedback distortion magnitudes. Distorted footstep sound feedback successfully elicits adaptation in temporal gait symmetry (SWR), with distinct modulation patterns for advanced vs. delayed footstep sounds. Spatial symmetry (SLR) remains unaltered, likely because auditory feedback primarily conveys temporal information. This research lays the groundwork to implement personalized augmented auditory feedback in neurorehabilitation.

Personalized Language Model Selection Through Gamified Elicitation of Contrastive Concept Preferences.

Language models are widely used for different Natural Language Processing tasks while suffering from a lack of personalization. Personalization can be achieved by, e.g., fine-tuning the model on training data that is created by the user (e.g., social media posts). Previous work shows that the acquisition of such data can be challenging. Instead of adapting the model's parameters, we thus suggest selecting a model that matches the user's mental model of different thematic concepts in language. In this article, we attempt to capture such individual language understanding of users. In this process, two challenges have to be considered. First, we need to counteract disengagement since the task of communicating one's language understanding typically encompasses repetitive and time-consuming actions. Second, we need to enable users to externalize their mental models in different contexts, considering that language use changes depending on the environment. In this article, we integrate methods of gamification into a visual analytics (VA) workflow to engage users in sharing their knowledge within various contexts. In particular, we contribute the design of a gameful VA playground called Concept Universe. During the four-phased game, the users build personalized concept descriptions by explaining given concept names through representative keywords. Based on their performance, the system reacts with constant visual, verbal, and auditory feedback. We evaluate the system in a user study with six participants, showing that users are engaged and provide more specific input when facing a virtual opponent. We use the generated concepts to make personalized language model suggestions.

A deep learning model to assist visually impaired in pothole detection using computer vision

Visually impaired individuals encounter numerous impediments when traveling, such as navigating unfamiliar routes, accessing information, and transportation, which can limit their mobility and restrict their access to opportunities. However, assistive technologies and infrastructure solutions such as tactile paving, audio cues, voice announcements, and smartphone applications have been developed to mitigate these challenges. Visually impaired individuals also face difficulties when encountering potholes while traveling. Potholes can pose a significant safety hazard, as they can cause individuals to trip and fall, potentially leading to injury. For visually impaired individuals, identifying and avoiding potholes can be particularly challenging. The solutions ensure that all individuals can travel safely and independently, regardless of their visual abilities. An innovative approach that leverages the You Only Look Once (YOLO) algorithm to detect potholes and provide auditory or haptic feedback to visually impaired individuals has been proposed in this paper. The dataset of pothole images was trained and integrated into an application for detecting potholes in real-time image data using a camera. The app provides feedback to the user, allowing them to navigate potholes and increasing their mobility and safety. This approach highlights the potential of YOLO for pothole detection and provides a valuable tool for visually impaired individuals. According to the testing, the model achieved 82.7% image accuracy and 30 Frames Per Second (FPS) accuracy in live video. The model is trained to detect potholes close to the user, but it may be hard to detect potholes far away from the user. The current model is only trained to detect potholes, but visually impaired people face other challenges. The proposed technology is a portable option for visually impaired people.